Ships calling at American ports in 2018 carried almost 1601 million tons of international traded goods for a total value of $ 1.762 billion, according to the U.S. International Trade Administration. Because of the quantities involved, ship cargo never has a low value, even if the vessel is small and the unit price of the traded commodity modest.

A 2020 report by the European Maritime Safety Agency (EMSA) about the causes of 1801 ship accidents in Europe within the 2014-2019 timeframe indicates humans were responsible for 54% of accidents. The primary factor was noncompliance with collision prevention rules issued by the International Maritime Organization (IMO).

The U.S. National Transportation Security Board reached similar conclusions. In “Safer Seas Digest 2020,” the board examined the causes of 42 major accidents in recent years within American waters or American vessels and concluded “those who do not attend (or attend to) accident lessons most risk paying a steep price—not necessarily only a financial one.”¹

Paradoxically, the increased flow of information on the bridge provided by improved monitoring technology may increase cognitive stress and lead to delayed decisions by the officers on watch. Technology itself may trigger accidents it is supposed to prevent.

In the future, by ever-increasing vessel dimensions and sea traffic to a global scale, an intelligent, autonomous ship will be able to process information flows quickly enough to react accordingly and guarantee safe delivery of valued cargoes (see Fig. 1).

Efforts to produce a fully autonomous ship of IMO degree four, in which “the operating system of the ship is able to make decisions and determine actions by itself,” are underway in Scandinavia and other neuralgic maritime areas.

The four IMO degrees of autonomy are:

Degree 1: Ship with automated processes and decision support. Seafarers are on board to operate and control shipboard systems and functions. Some operations may be automated and at times be unsupervised, but with seafarers on board ready to take control.

Degree 2: Remotely controlled ship with seafarers on board. The ship is controlled and operated from another location. Seafarers are available on board to take control and operate the shipboard systems and functions.

Degree 3: Remotely controlled ship without seafarers on board. The ship is controlled and operated from another location. There are no seafarers on board.

Degree 4: Fully autonomous ship. The operating system of the ship is able to make decisions and determine actions by itself.

Beyond radar: electro-optical ship sensors

In 2015, Rødesth and Burmeister created a modularization scheme of components for the design of autonomous vessels based on the concept of an unmanned dry bulker of approximately 50,000 tons dwt.² IMO recommended their Formal Safety Analysis (see Fig. 2).

(Image credit: Ø. J. Rødesth and H. C. Burmeister [2])

Several factors limit the identification of potential collision risks by radar and automatic identification systems (AIS). Radars have a blind spot and do not register smaller wood or fiberglass craft unless they carry a reflector. They are further subject to signal clutter in traffic-intensive ports or in access waters to ports. AIS is a passive type of sensor that provides information only on targets also carrying an AIS that must be switched on (not always the case).

Rødesth and Burmeister proposed integrating information from electronics with the input of electro-optical sensors: a visual camera and a FLIR camera in the far-infrared.

The specific advantages to seafaring of each IR waveband are:

MWIR and LWIR. A bit ahead of the times, the German Navy in WWII feared the Allies could track submarines on surface at night by the IR emissions of their diesel engines. Thermal emissions of a ship cause a temperature difference with its surrounding background of sky and sea that can be readily identified in darkness by thermal sensors—no external target illumination is needed. Some masters use thermal cameras to improve night navigation. Castaways, if alive, can be identified in darkness by the temperature difference between the sea and their bodies. Small craft, sail ships, buoys, or lost containers with little or no thermal emission are hardly perceived in the midwave-infrared (MWIR), but by residual temperature difference with the waters, it can occasionally be done in the longwave-infrared (LWIR).

SWIR and NIR. Signals in shortwave-infrared (SWIR) and near-infrared (NIR) are less influenced by scatter and allow more efficient long-distance sensing in adverse weather and visibility conditions (snow, rain, fog, haze, and smoke). Smaller craft and objects with temperatures similar to the sea background are more easily detected. SWIR cameras, like those in the visible, rely on reflected light via the sun, moon, or artificial sources. Data fusion is favored by analogous imaging of the two, and some NIR sensors perform down to 500 nm with a favorable overlap that enriches images in the visible.

Almost half of recent research on algorithms for ship detection focus on IR imaging, according to a 2021 survey by Liquian Wang and colleagues of Shandong University, with 20% dealing with the combination of visible plus IR.³ Because of the reduced atmospheric absorption, the majority of the researchers (68%) use LWIR. SWIR ship detection is primarily done via satellites in space.

Multispectral sensing, with information extraction from visible, SWIR, MWIR, and LWIR images, provides comprehensive target detection and discrimination the shipping community needs for autonomous vessels. An intelligent system capturing and evaluating data in different spectral bands is more error-proof. The increase of contrast leads to more sensitivity—for instance, the advantage of blending visible and IR images (see Fig. 3).

(Courtesy of Groke Technologies, Finland)

The three bands IR sensor

Four distinct cameras onboard a ship are located in strategic positions, which can be a rather cumbersome solution. More input sources complicate the data fusion algorithm and the detection process, but favorable developments of IR sensor technology may help in the near future.

Quantum well photoconductors (QWIPs) and sensors based on mercury cadmium telluride (HgCdTe; MCT) are available and feature dual-band IR detection. But QWIPs have a low response, and the use and production of mercury cadmium photodetectors face regulatory limits and cooling requirements that currently aren’t attractive solutions on merchant vessels.

Competing with MCT, a more ecofriendly antimonide technology, T2SL, may enable more flexible solutions. Research activity based on Type-II InAs/GaSb superlattices is targeting a new generation of IR imaging instruments with multispectral response. There is a further drive to reduce the cost of systems and increase their operation temperature to be more conducive to implementation on ships.

At Northwestern University’s Center of Quantum Devices, Professor Manijeh Razeghi is pursuing development of T2SL materials with “a remarkable tuning capability from SWIR to long infrared.”⁴ In 2020, Razeghi presented bias-selectable, multiband photodetectors based on indium arsenide (InAs)/gallium antimonide (GaSb)/aluminum antimonide (AlSb) and InAs/InAs 1-x Sb x type‐II superlattice that features a wide spectral response in the IR at temperatures of 77 and 150 K (see Fig. 4).

(Image credit: M. Razeghi, A. Dehzangi, and J. Li, Res. Opt. (2021); https://doi.org/10.1016/j.rio.2021.100054)

The system consists of three layers grown on each other for the LWIR, MWIR, and SWIR, respectively. Activation in sequence of each absorber depends on the applied bias voltage.

IR eyes on the seas: an example

Situational awareness systems for ships are designed to support and eventually surrogate humans in the key functions of organizing object detection, identification, classification, and tracking.

Finland is a pioneer in situational awareness systems for autonomous ships. A system designed by Groke Technologies is an example of IR cameras using the sensor pack for ship detection and identification in darkness. Mitsubishi Corp. is one of the main investors in the company, and Groke has a strong presence in Japan. Groke is participating in an R&D initiative led by Kawasaki Kisen Kaisha Ltd., JRC Ltd., and YDK Technologies Co. Ltd. Fujitsu is expected to develop the AI segment.

The goal of this R&D project is to design a system to prevent serious maritime accidents, such as ship collisions and groundings. The project aims to meet degree one of the IMO standard of autonomous ships development.

Groke has tested two awareness systems: the AS Lite is a pilot installation working on a fare in Japan, and the AS Pro, which has been in trials since March 2021 on the Ship Polaris VG on the route from Rauma in Finland to Rostock in Germany.

Data from AIS receivers, global navigation satellite systems (GNSS), and onboard inertial measurement units (IMU) are fused with those of a visible and thermal camera for measuring the position of the vessel and monitoring the sea surface.

“When we started at Groke, we evaluated the different technologies and we decided to go with the combination of daylight and thermal cameras,” says Iiro Lindborg, co-founder and VP of Groke; he is the former general manager of remote and autonomous operations at Rolls-Royce. “The unique part of this solution is the so-called ‘thermal blending,’ where we combine both visible and thermal image. We get the color from the camera in the visible and the thermal signature from thermal camera, and we join them together in our user interface.”

For data fusion, “our system uses data fusion by comparing the data from multiple sources, like AIS and camera detections,” Lindborg adds. “And then, if they are defined to be information on the same target, it is fused and only one object detection is shown. For that object, we can then provide details based on all the available sources.” The sea situation can be checked in real time on a bridge and from any location on the ship via handheld devices.

Groke had to develop its own IR sensor as well. “In the AS Pro, the 180 thermal camera is possibly the first in the world with such a field of view and performance,” says Teemu Helenius, hardware development lead at Groke. The situational awareness system developed by Groke will be installed on all company vessels owned by Tsurumi Sunmarine Co., Ltd, a chemical/clean tankers operator.

In 2018, the car ferry “Falco” of Finferry was the first vessel ever to navigate completely autonomously on a voyage from Parainen to Nauno within the Finnish archipelago. Rolls-Royce designed its situational awareness system, and Konghsbergs Maritime acquired Rolls-Royce Commercial Marine in 2019.

In 2020, the world’s merchant fleet consisted of 119,999 ships.⁵ Sooner or later, this expanding fleet will need some form of autonomy or at least more sophisticated sea-awareness systems. Supplying this promising market with broadband IR sensors based on antimonide technologies is the future task of the photonics industry.

Source: https://www.laserfocusworld.com/detectors-imaging/article/14281772/the-eyes-of-a-ship-part-2-ir-detection-at-sea

Sitronics Group (part of Sistema Public Joint Stock Financial Corporation) says it has acquired over 50% of Russian company Emperium producing ships with electric propulsion in order to develop its business in synergy with maritime and electric propulsion segments.

Ecocruiser is Russia’s first serial project of ships with electric propulsion featuring innovative and environmentally friendly solutions. Among its designs are electric ships of river and lake class: high-speed catamarans Ecocruiser, Ecovolt for voyages, tours and transportation of passengers, Ecobus and Cityvolt ships intended for operation as water buses with electric propulsion. The company’s shipyard is located at the premises of the production complex in Otradnoye, Leningrad Region.

The company takes part in the project on launching river-going electric ships on the Moskva river. As a subcontractor, Emperium is responsible for construction of electric ships able to carry up to 50 passengers on the two city routes. A total of 21 electric ships are planned for operation in the capital. Besides, Emperium has secured contracts for supply of 130-passenger Ecocruiser ships for leisure voyages in Saint-Petersburg, Krasnoyarsk and Nizhny Novgorod.

“Moscow will be the world’s first ship with regular electricity-powered water transport of that level. So, we look at both internal and the international market,” commented Aleksey Katkov, Chairman of Sitronics Group BoD, Executive Partner of Sistema.

Sitronics Group develops intellectual solutions for digitalization of shipping, electro-charging infrastructure for private and public vehicles. Construction of electric ships is a complementary activity of the company. Sitronics Group will develop its new business and in the future electric ships can be fitted with autonomous shipping systems navigation systems developed by one of the Group’s companies.

Source: https://en.portnews.ru/news/334591/

The U.S. Navy has added a third vessel to its fleet of medium-sized uncrewed workboats, which were first developed and unveiled by the Pentagon-run “Operation Overlord” program. The newly-christened Mariner is the first newbuild in this adapted flotilla: all are crewboat designs, and the first two – Nomad and Ranger – began their lives working in the Gulf oil patch.

Mariner is a modern 200-foot crewboat built at Gulf Craft and adapted to the Navy’s needs before delivery. The vessel was built to a commercial series design with a high degree of automation, lending itself well to further upgrades for uncrewed operation. It has eight TEU of container capacity on the back deck and two more forward for modular payloads.

Mariner was christened in a ceremony Tuesday at the U.S. Naval Academy, where she is on display to introduce the concept of uncrewed operations to cadets and more senior personnel alike. She will soon join the Navy’s other USVs in San Diego, under the supervision of Surface Development Squadron One.

A fourth purpose-built Overlord USV is under construction now at the Austal USA yard in Alabama, with oversight from L3Harris. SURFDEVRON One also has two slightly smaller USVs, the trimarans Sea Hunter and Sea Hawk, built by Leidos under a DARPA program.

With its growing uncrewed fleet, the Navy hopes to accelerate up the learning curve with USV operations by operating multiple vessels at once. Rear Adm. Casey Moton told Defense News that Mariner is equipped to allow remote-control testing to proceed without pulling a destroyer off duty to serve as a command platform.

In addition to working out the details of how to make the technology function for months at sea without any service, the testing program is designed to help the Navy figure out how it wants to use medium USVs in the high-end fight – whether as supply boats, scouts, auxiliary magazine ships, and in what size and configuration. Congress has asked for a clearer vision of what these vessels might be used for, and why uncrewed systems are a funding priority (as opposed to simply more crewed hulls). A high-profile uncrewed appearance at the Rim of the Pacific international naval exercise this year was intended to showcase these systems’ capabilities and explore how they could be deployed in a teamed environment, and the Navy says that it will be examining the data and results from those maneuvers carefully.

SOURCE: https://www.maritime-executive.com/article/u-s-navy-christens-its-third-autonomous-crewboat

Stellium and Voyager Portal have announced a partnership to deliver an integrated platform to make Stellium’s SAP Transportation Management (TM) technology available for bulk shipping operations.

“Bulk commodity shipping is a highly complex and fragmented mode of marine transport,” said ,” says Matthew Costello, CEO of Voyager Portal.

“Over 90% of ships crossing the ocean will transport bulk commodities such as crude oil, gas, petrochemicals, agricultural products, heavy equipment, and minerals. Given the complexity and variability of each shipment, the operations teams often work exclusively with email and XLS for tracking, planning and execution activities.”

Voyager Portal offers software to assist bulk shipping teams in digitally managing their operations with their external parties in a shared collaborative environment. Its low-code workflow technology allows users to design and execute their own processes, then surface the data for Exceptions Based Management and reporting.

The platform covers operational workflows such as vessel nominations, survey appointments, terminal clearances, ETA tracking, demurrage and cargo claims.

“Our team has extensive first-hand experience implementing SAP TM for our customers. Through our many business consulting and system integration engagements we have become acutely aware of both the importance of bulk shipping to our customers, and also the inherent risks that exist with this unique mode. With Voyager and SAP TM, our customers’ planning, production and sales teams can have a true end-to-end picture of their transportation operations in one place,” said Randeep Nambiar, CEO of Stellium.

Source: https://smartmaritimenetwork.com/2022/08/25/stellium-and-voyager-portal-to-integrate-systems/

BOSTON – Sea Machines Robotics’ SM300 system aboard the Foss Maritime Company tug Rachael Allen has achieved a key milestone. The American Bureau of Shipping (ABS) verified the design of the Foss harbor tug outfitted with the Sea Machines SM300 autonomy system. This follows the established process of new technology qualification, document evaluation in accordance with ABS Rules and Guides, a successful product review and shows that Sea Machines’ technology conforms with ABS’ requirements addressing use aboard.

Rachael Allen will first leverage the Sea Machines’ autonomy system for routine transit and stand-by operations, and then trial remote piloting from a shore-based command center. The SM300 transit autonomy and station keeping are provided by interfacing with the Kongsberg-MTU propulsion system controls.

Sea Machines has previously earned full approval from ABS for its SM200 commercial wireless helm for installation aboard a class of U.S.-flag tugboats that support articulated tug-barge (ATB) sets.

The SM300 installed on Rachael Allen is the result of close collaboration between three U.S.- based companies: Sea Machines, Foss and ABS. This cooperation by a software company, marine transportation provider and classification society highlights the importance of interdisciplinary collaboration in bringing emerging technology solutions into commercial operations and enhancing productivity and safety by addressing issues like crew fatigue during long transits or idle periods.

“Sea Machines worked closely alongside ABS and FOSS to yield this most recent approval, which moves our entire industry yet another step closer to widespread adoption of autonomous marine technologies,” said Michael G. Johnson, CEO of Sea Machines. “Earning this approval demonstrates our unwavering commitment to ensuring that these technologies are utilized safely, while making our industries more competitive and productive.”

“As part of our ‘Always Safe, Always Ready’ culture, Foss is pleased to be providing the SM300 system for additional crew and vessel safety through the enhanced situational awareness it will bring to our operations,” said FOSS’ Dan Cole, Foss project manager. 

“Autonomous technology continues to advance at pace and ABS is committed to supporting its introduction to the industry. That’s why we are proud to support the FOSS tug equipped with Sea Machines’ SM300 system and work with industry leaders all over the world on the approval of this technology,” said ABS’s Gareth Burton, vice president of technology.

Rachael Allen is deployed to Foss Maritime, in California, where it provides tanker escort and ship assists for Foss’ customers.

The SM300 is the flagship of Sea Machines’ SM Series of products, which provide marine operators an array of autonomous and captain-assistance capabilities. The products are available for sale and installation in new builds or retrofits for a wide variety of applications, including maritime transportation and support, such as fast support vessels and OSV’s, which also spend significant time at sea transiting and loitering.

Sea Machines plans to continue its engineering development and working with ABS for design review of the SM300 in the coming months.

Source: https://www.maritimeeconomy.com/post-details.php?post_id=aGlmag==&post_name=&segment_name=