Select Page

CVPR 2018 Workshop and Challenge: Automated Analysis of Marine Video for Environmental Monitoring


Call for Papers

This workshop will convene experts and researchers interested in learning about the challenges, current work, and opportunities in marine video analytics, including video captured both under and above water. As in other domains, maritime video collection is expanding exponentially, particularly for monitoring of fish, shellfish, marine mammals, coral reefs, bottom habitats, and other wildlife. Biologists, oceanographers, stock assessment officials and others will benefit greatly from increased automated video processing, which is currently manual, labor intensive and very tedious. Indeed, manual annotation of video is the largest bottleneck to studying many marine biological problems such as estimating populations of fish, whales, shellfish and seals. The vision community has a compelling opportunity to significantly impact this important area of environmental science.

The workshop is currently accepting papers involving computer vision applied to maritime environmental monitoring, including:

  • Types of data (e.g. number, size, species classification) resource managers need to extract from video data
  • Animal detection and tracking in video, including stereo video
  • Animal species classification
  • Segmentation of similar individuals in high-density populations (e.g. schooling fish, seals hauled out on beaches)
  • Animal behavior analysis and classification
  • 3D reconstruction and volumetric assessment of animals
  • Normalcy modeling and anomaly detection
  • Aquatic plant and coral classification
  • Habitat and substrate classification
  • Underwater SLAM
  • Other imaging sensing modalities (sonar, lidar, hyperspectral)
  • Physics-based vision as it pertains to marine imaging, e.g. refraction at the surface and fluorescence
  • Methods that operate in far-field, low-contrast conditions
  • Image and video enhancement for underwater conditions including high turbidity
  • Interactive methods including on-the-fly model training

Please see our CMT page for paper submissions. The page limit is 8 pages, not including references, following the standard CVPR format. Each paper will be reviewed by at least two members of the program committee.


Important Dates


Paper submission: March 26th

Decisions announced: April 9th

Camera ready papers due: April 18th

Data challenge initial data release: February 23

Data challenge extra data release: February 28


Data Challenge


This workshop also features a data challenge in this unique domain. Large amounts of underwater image and video data have been collected and annotated by the National Oceanic and Atmospheric Administration (NOAA) from a variety of image and video sensors deployed underwater in a variety of oceanic environments and climates. The data shows many species of fish, shellfish, underwater plants, and other biota. Data and annotations will be available before the workshop, with well-defined problems to address fish detection, species classification, and scallop detection. Submissions will be evaluated against a test sequence withheld until the end of the competition, and the winners invited to the conference.

Related and Previous Workshops


A few prior workshops have involved maritime environmental monitoring. At ICCV 2013, the Underwater Vision Workshop was the first (that we are aware of) to focus on the proposed domain. Three workshops on Automated Analysis of Video Data for Wildlife Surveillance (AVDWS), chaired by this workshop’s organizers, were held in association with IEEE WACV 2015, 2016, and 2017. The 2015 AVDWS included ten oral presentations (3 invited, 7 submitted) covering topics from counting and sizing fish to monitoring giraffe behavior in thermal video. The 2015 AVDWS also included a discussion of the DARPA Visual Media Reasoning Program and the role of citizen science in optical data processing. The 2016 AVDWS included a discussion of a Kaggle challenge for the automated detection of right whales from aerial imagery, bird recognition in mobile phones, and a web-based tool for the analysis of seafloor images from coral reefs. More recently, “The First Workshop on Visual Wildlife Monitoring” was held in conjunction with ICCV 2017. The ICCV workshop covered a wide range of wildlife topics, as did our three WACV workshops, including both terrestrial and marine problem domains.