Background

Augmented Reality (AR) has been widely adopted across all markets and industries; most commonly paired with our smart mobile phones. Development of a mobile heads-up display (HUD) that exploits AR technology is rapidly improving user interfaces and interactions with consumer products. Recently, large companies such as Google and Apple have been working to embed and/or enhance road navigation using AR technology in pairing with their mobile hardware. AR can significantly improve navigation by eliminating common mis-understandings associated with a two-dimensional (2D) map. For example, creating AR advancing arrows directing you to your destination is a form of providing you real-time information that helps you reduce any missed turns, and ultimately helps reduce the chance of error.

University of Hawaii researchers developed an AR HUD paired with an Automatic Identification System (AIS) to address this reduction for the chance of error. Maritime vessel operations in dense surface-traffic environments such as ports and harbors are challenging. The degree of risk depends upon multiple factors ranging from environmental conditions to operator experience. To assist with close-quarter manoeuvring, the AIS was developed in the 1990s. AIS is a shipboard broadcast system that acts like a transponder operating in the very high frequency (VHF) radio band. It is capable of handling over 4,500 vessel reports per minute and updates as often as every two seconds.

Technology Overview

To improve the ability of submarines to manoeuvre in dense surface-traffic environments, researchers at the Applied Research Laboratory at the University of Hawaii (ARL@UH) have invented a novel affordable, low-latency mobile-based software video overlay display that combines AIS data with a visualization configuration to present three-dimensional (3D) information with AR (). Enhanced AIS data acquisition supports operation in denied, intermittent, and low bandwidth communication environments. Enhanced visual cueing aids in reducing the possibility of errors made while navigating. The researchers developed testing and configuring software to expand existing capabilities for AR and created a prototype using a smartphone for displaying and importing AIS data to the phone. This prototype, standalone system reduces information assurance risks to shipboard systems and can be installed on vessels of opportunity for demonstrations and experimentation. The researchers also configured a dedicated AIS receiver and low-power computer to organize and present AIS data for visualization in an environment with limited network connectivity.

Benefits

Low production cost
Fully wireless capability
Open-source software
Secure
Commercial off the shelf
Real-time information
Non-reliant on existing networks
Night operation

Applications

This solution is a user-friendly application implemented on low-cost, commercial-off-the-shelf hardware that indicates the position and heading of nearby vessels using 3D augmented reality visualization on personnel mobile phones.
Maritime navigation at night and poor weather conditions.
Autonomous maritime manoeuvrability.

Automatic Identification System Heads-Up Display

Patents

IP Status

Seeking