Study explores the use of robots and artificial intelligence to understand the deep-sea

AI could lead to a major increase in data availability for conservation research and biodiversity management
During the dive, the AUV vehicle is flying 3 meters high over the seabed at 2.2 knots (roughly 4 km per hours) and takes an image every second

During the dive, the AUV vehicle is flying 3 meters high over the seabed at 2.2 knots (roughly 4 km per hours) and takes an image every second

Artificial intelligence (AI) could help scientists shed new light on the variety of species living on the ocean floor, according to new research led by the University of Plymouth.

With increasing threats facing the marine environment, scientists desperately need more information about what inhabits the seabed in order to inform conservation and biodiversity management.

Autonomous underwater vehicles (AUV) mounted with the latest cameras are now able to collect vast amounts of data, but a bottleneck is still created by humans having to process it.

In a new study published in Marine Ecology Progress Series, marine scientists and robotics experts tested the effectiveness of a computer vision (CV) system in potentially fulfilling that role.

They showed on average it is around 80% accurate in identifying various animals in images of the seabed, but can be up to 93% accurate for specific species if enough data is used to train the algorithm.

This, scientists say, demonstrates CV could soon be routinely employed to study marine animals and plants and lead to a major increase in data availability for conservation research and biodiversity management.

PhD student Nils Piechaud, lead author on the study, said:

“Autonomous vehicles are a vital tool for surveying large areas of the seabed deeper than 60m (the depth most divers can reach). But we are currently not able to manually analyse more than a fraction of that data. This research shows AI is a promising tool but our AI classifier would still be wrong one out of five times, if it was used to identify animals in our images.
“This makes it an important step forward in dealing with the huge amounts of data being generated from the ocean floor, and shows it can help speed up analysis when used for detecting some species. But we are not at the point of considering it a suitable complete replacement for humans at this stage.”

Dr Kerry Howell, Associate Professor in Marine Ecology and Principal Investigator for the Deep Links project, added:

“Most of our planet is deep sea, a vast area in which we have equally large knowledge gaps. With increasing pressures on the marine environment including climate change, it is imperative that we understand our oceans and the habitats and species found within them.
"In the age of robotic and autonomous vehicles, big data, and global open research, the development of AI tools with the potential to help speed up our acquisition of knowledge is an exciting and much needed advance.”

The study was conducted as part of Deep Links, a research project funded by the Natural Environment Research Council, and led by the University of Plymouth, in collaboration with Oxford University, British Geological Survey and the Joint Nature Conservation Committee.

One of the UK’s national AUVs – Autosub6000, deployed in May 2016 – collected more than 150,000 images in a single dive from around 1200m beneath the ocean surface on the north-east side of Rockall Bank, in the North East Atlantic. Around 1,200 of these images were manually analysed, containing 40,000 individuals of 110 different kinds of animals (morphospecies), most of them only seen a handful of times.

Researchers then used Google’s Tensorflow, an open access library, to teach a pre-trained Convolutional Neural Network (CNN) to identify individuals of various deep-sea morphospecies found in the AUV images. They then assessed how the CNN performed when trained with different numbers of example images of animals, and different of numbers of morphospecies to choose from.

Robotic and underwater autonomous vehicles

Watch an animation explaining how robots and artificial intelligence help us explore the depths of our ocean

The accuracy of manual annotation by humans can range from 50–95%, but this method is slow and even specialists are very inconsistent across time and research teams. This automated method reached around 80% accuracy, approaching the performance of humans with a clear speed and consistency advantage.

This is particularly true for some morphospecies that the algorithms work very well with. For example, the model correctly identifies one animal (a type of xenophyophore) 93% of the time.

While the study does not advocate the replacement of manual annotation, it does demonstrate that marine biologists could be able to implement AI for specific tasks if carefully assessing the reliability of their predictions. This would greatly enhance the capacity of scientists to analyse their data.

The researchers say the combination of specialist ecological knowledge with the high-tech AUV’s capacity to survey large areas of the seabed, and the fast data processing capacity of AI, could greatly speed up deep-ocean exploration, and with it our wider understanding of marine ecosystems.

Images taken by the AutoSub6000 in the North East Atlantic

A ray swimming away from the vehicle. The grey ball, left of the ray, is a xenophyophore: the largest known single-celled organism on the planet and one of the most abundant organisms in our images
A ray swimming away from the vehicle. The grey ball, left of the ray, is a xenophyophore: the largest known single-celled organism on the planet and one of the most abundant organisms in our images
A community of various sponges and associated mobile animals. The squat-lobsters are relatively abundant in this area and probably play an important role within the ecosystem
A community of various sponges and associated mobile animals. The squat-lobsters are relatively abundant in this area and probably play an important role within the ecosystem
A large starfish (possibly a species of the genus Hymenaster). This animal is rare and only seen a handful of times, which limits the amount of training material for the AI, making manual analysis more suited to measure its abundance
A large starfish (possibly a species of the genus Hymenaster). This animal has only been seen a handful of times, which limits the amount of training material for the AI, making manual analysis more suited to measure its abundance
Some animals attach themselves to rocks. This is also a special case in which the AI cannot disentangle substrate and animals; only a human can interpret these complex features
Some animals attach themselves to rocks. This is also a special case in which the AI cannot disentangle substrate and animals; only a human can interpret these complex features

The full study – Piechaud et al: Automated identification of benthic epifauna with computer vision – is published in Marine Ecology Progress Series, https://doi.org/10.3354/meps12925.

The Deep Links Project

Deep Links is a collaborative project between The University of Plymouth Deep Sea CRU and the University of Oxford, in partnership with the Joint Nature Conservation Committee (JNCC) and the British Geological Survey (BGS), funded by the Natural Environment Research Council (NERC).

The project is investigating how patterns of population connectivity vary with depth in the deep sea around the UK, and how this influences species diversity.

Learn more about the project

Deep Links Project

Marine Institute

Representing 3000 staff, researchers and students, the University of Plymouth's Marine Institute is the first and largest such institute in the UK. 

We provide the external portal to our extensive pool of world-leading experts and state-of-the-art facilities, enabling us to understand the relationship between the way we live, the seas that surround us and the development of sustainable policy solutions.

Discover more about the Marine Institute

Marine Institute