Joseph K. Geisz | Geology Reports

USGS2024

A transferable approach for quantifying benthic fish sizes and densities in annotated underwater images

1. Benthic fishes are a common target of scientific monitoring but are difficult to quantify because of their close association to bottom habitats that are hard to access. Advances in image-acquisition technologies, machine vision, and deep learning have made capturing and quantifying fishes with cameras increasingly feasible. We present a method and open-source software called ‘FishScale’ to estimate benthic fish lengths, numeric abundance, and biomass density in underwater environments assessed with down-looking monocular images. 2. ‘FishScale’ estimates fish abundances and size frequencies from near-nadir monocular images where fish have already been semantically segmented. The software accounts for lens distortion, underwater magnification effects, and fish body curvature to automatically estimate fish lengths and the areas of images where they were captured. Numeric and biomass density are estimated through a deterministic machine vision algorithm that requires a user-provided length-weight relationship for species of interest and calibration images. 3. Results from validation studies show that lengths and weights can be estimated with high accuracy and precision for round goby ( Neogobius melanostomus ) captured in distorted action camera images, and from large-bodied lake trout ( Salvelinus namaycush ) imaged with a machine vision camera. The real-world utility of the approach is demonstrated in a case study estimating round goby abundances and size frequencies along a 10.7-km transect surveyed with an autonomous underwater vehicle in Lake Michigan, USA. 4. Our validation studies demonstrate that the approach estimates benthic and benthopelagic fish lengths and weights with little bias and good accuracy and precision for species with much different body shapes and sizes. The method is applicable to data collected using a variety of nadir imaging approaches with widespread applications to fisheries monitoring and quantification of any species or object for which nadir images and working distances between the camera and feature of interest are available.

Illinois, Indiana, Michigan, Wisconsin↗

USGS2024

Classification of lakebed geologic substrate in autonomously collected benthic imagery using machine learning

Mapping benthic habitats with bathymetric, acoustic, and spectral data requires georeferenced ground-truth information about habitat types and characteristics. New technologies like autonomous underwater vehicles (AUVs) collect tens of thousands of images per mission making image-based ground truthing particularly attractive. Two types of machine learning (ML) models, random forest (RF) and deep neural network (DNN), were tested to determine whether ML models could serve as an accurate substitute for manual classification of AUV images for substrate type interpretation. RF models were trained to predict substrate class as a function of texture, edge, and intensity metrics (i.e., features) calculated for each image. Models were tested using a manually classified image dataset with 9-, 6-, and 2-class schemes based on the Coastal and Marine Ecological Classification Standard (CMECS). Results suggest that both RF and DNN models achieve comparable accuracies, with the 9-class models being least accurate (~73–78%) and the 2-class models being the most accurate (~95–96%). However, the DNN models were more efficient to train and apply because they did not require feature estimation before training or classification. Integrating ML models into benthic habitat mapping process can improve our ability to efficiently and accurately ground-truth large areas of benthic habitat using AUV or similar images.

Michigan, Wisconsin↗