Skip to main content
Unsupported Browser Detected

Internet Explorer lacks support for the features of this website. For the best experience, please use a modern browser such as Chrome, Firefox, or Edge.

Automatic Whale Detector, Version 1.0

February 09, 2015

Scientists have combined infrared cameras with image recognition software to automatically detect and count migrating gray whales.


Every year, gray whales migrate from their summer feeding grounds in the Arctic to their wintering grounds off Baja California in Mexico. And roughly every other year, scientists with binoculars count them as they funnel past a point on the California coast a bit south of Monterey Bay. Scientists conduct this survey to keep track of how well the population is doing, and this year they have a new set of eyes to help with the job.

Three eyes, to be exact. Each one is a thermal imaging camera that captures the blow from a whale as it surfaces to breathe.

“A whale is this great big motor that takes in a breath of air and holds it inside for a long time,” said Wayne Perryman, a NOAA Fisheries scientist who helped develop the new system. “When it exhales, the air is much warmer than the background, and we can detect that difference very easily, both day and night.”

New Tech on the Job

The cameras themselves are nothing new—they’re similar to the infrared cameras that police use when searching for suspects from a helicopter. What is new is software that automatically analyzes the video to detect when a whale blows. To do that, it has to distinguish the blow of a whale from other signals that might confuse it, such as a bird diving into the water or a small boat passing by.

“The biggest challenge was getting the detector to be as accurate as possible without having it get fooled by false alarms,” said Dave Weller, the NOAA Fisheries scientist who leads the survey team.

In addition, every time the computer sees a blow, it predicts where and when that same whale will surface to blow again. That prediction algorithm, which is based on years of research into gray whale diving behavior, allows the computer to track individual whales. “If you don’t have a way of tracking who’s who, you can double-count some whales or miss them altogether,” Weller said.

Previously, two scientists would conduct the survey—one a spotter with high-powered binoculars and the other a record-keeper. For now, human observers are still working the survey to ensure that the automated system produces accurate results. However, human observers can only count whales during daylight, and limited budgets mean that they’re onsite only during the peak weeks of the migration. But the thermal imaging system works 24/7 throughout the entire migration—it was already counting when the earliest migrants made their way south, and it will still be counting when the stragglers take up the rear.

“The biggest advantage of the new system is that it vastly increases our sample size,” Weller said. “That means we can more accurately estimate the size of the population.”

A Conservation Success Story

Gray whales were hunted nearly to extinction during the whaling days. But this population of gray whales has been making a steady recovery since then, and they were taken off the endangered species list in 1994 (though a second population on the Russian side of the Pacific remains endangered). “They’re a real success story as far as the management of large whales goes,” said Perryman. “Today the population is up around 20,000, and that appears to be pretty stable,”

Scientists still need to keep track of gray whale populations, however. Despite their recovery, the animals are still at risk from ship strikes, entanglement in fishing gear, and other human impacts. Also, as the climate changes, scientists want to know if changes in the amount of sea ice are correlated with changes in population size or timing of the migration.

And so the count goes on. But as of this year it’s more high tech, and the numbers will be a bit more accurate.

Last updated by Office of Communications on October 10, 2017

Endangered Species Recovery