Shipping company Bernhard Schulte and research institute Fraunhofer CML have developed a camera-based assistance system designed to improve nautical watchkeeping and situational awareness on ship bridges.
The system, named EyeCaptain, is intended for use in complex traffic situations, narrow fairways, and periods of poor visibility. It works by linking 360-degree panoramic cameras and thermal imaging technology with real-time data from the Automatic Identification System (AIS), Global Positioning System (GPS), radar, and electronic nautical charts.
Modular software components aggregate the data and present it on a touchscreen display. The system is designed to provide the bridge team with an improved visual overview and active decision-making support, continuously performing an analysis of the traffic situation to calculate the Closest Point of Approach (CPA) and the Time to Closest Point of Approach (TCPA).
By monitoring these metrics, EyeCaptain can provide early warnings regarding potential collisions, groundings, or risky encounters. Relevant events are recorded automatically for later evaluation on shore, to support training and safety management processes.
An artificial intelligence model for object detection allows the system to be used with various camera configurations, to enable operators to use existing surveillance cameras and minimise installation costs.
Depending on the quality of the cameras used, the system can incorporate the Pelican technology also developed at Fraunhofer CML, which uses horizon stabilisation and continuously trained object recognition to improve the detection of other objects on the water in difficult visibility conditions.
