Marine and offshore jobs are some of the most stressful in the world, with psychological and emotional factors including fatigue not only affecting the safety and health of the concerned seafarer, but also the immediate safety of others onboard, safety of the vessels and the marine environment.
There is a lack of feasible objective means to determine the psychological and emotional status of a seafarer before he or she is assigned to an important task or scheduled watches, which could lead to injury, death or damage to property or the environment, if the seafarer is not psychologically sound.
This Safety Accelerator challenge, set in partnership with one of the world’s largest containership operators, Pacific International Lines (PIL), sought innovative methods to assess the psychological and emotional wellbeing of individual crew members in real-time, whilst they are onboard and before they are about to go on duty, with their consent and protecting their privacy.
The Lloyd's Register Safety Accelerator worked with PIL to define the parameters of the challenge and along with Accelerator partners Plug and Play sourced 15 best-in-class startups with cutting-edge and new approaches, to solve the challenge. Through a competitive selection process, the Austin-based startup Senseye.co was selected to trial their solution with PIL, during a three-month pilot.
Senseye is a computational neuroscience company based in Austin, TX that uses high-resolution video footage of the eye to quantify previously inaccessible cognitive insights. During the pilot, Senseye drew upon their experience working with US military training fighter jet pilots, applying their expertise in cognitive psychology, computer vision and machine learning technology.
In collaboration with PIL, Senseye built and deployed an Operational Risk Management solution on top of its existing Emotional Intelligence Engine and camera, modifying the hardware to allow for the system to run from a ship.
The solution involves a camera and computer vision-based pattern recognition, scanning a crew member's eyes and assessing in real-time if they're 'fit for duty' or not, based on the following criteria:
- Impairment from Alcohol or Drugs
- Psychological Risk Factors such as depression or stress
The system begins with a login screen, where the individual identifies themselves and then moves to a short self-assessment survey, followed by an ocular vigilance task. Upon completion of the task, the individual is presented with a green or red light based on their assessed readiness; green meaning that he is fit for duty and red indicating that he needs to speak to the captain, for him to get some rest with alternative work arrangements made.
The following screens show the User Interface used by crew during their assessment
The Senseye ORM solution was deployed on a PIL container ship that travelled between two US ports, to China, then back to the US, over a six-week period.
During this time, most of the 23 PIL crew members used the system twice daily and provided extensive amounts of detailed feedback to Senseye.
Senseye's ORM solution product added value to the crew and ship master in that they could get a quantified fitness for duty before any given shift.
The trial was instrumental in helping Senseye shape the product and provide more value for users going forward.
"This has been an exciting journey for us in the management office ashore and for our floating colleagues on board, we truly appreciate the amazing technologies Senseye had developed, and in given time, will be perfected to address the pain point of the industry." ChuXing Peng, Asst GM, QSSD, Fleet Division, Pacific International Lines.
"Our collaboration with the Safety Accelerator pilot and with PIL allowed Senseye to realise the opportunity for our technology to thrive in the new SafetyTech market. We're looking forward to continuing this exciting collaboration and making the Marine industry safer." David Zakariaie, CEO, Senseye.
LR, PIL and Senseye continue to explore further development of the solution, beyond the initial pilot period, improving the assessment test time, pass/fail accuracy and auto stabilisation enhancements, to account for the ship's movement at sea.
Across the wider industrial landscape, this solution offers an ability to quantify individual's fitness for duty, to reduce the risk of accidents include injuries caused by staff who were unfit for work. This applies to the workers themselves and their colleagues, especially where machinery is being operated in safety critical industries.
In addition to enhancing safety for workers, there are also financial benefits, such as reducing lost man days and compensation pay-outs.
About the Safety Accelerator
The Lloyd's Register Safety Accelerator is a joint initiative between Lloyd's Register Foundation, a charitable foundation helping to protect life and property by supporting engineering-related education, public engagement and the application of research, and Lloyd's Group, one of the world's leading providers of professional services for engineering and technology.
Our aim is to make the world a safer place, by encouraging the growth of the safetytech industry and accelerating the adoption of digital technology for safety.
The Safety Accelerator is run in partnership with Plug and Play Tech Centre, the largest global innovation platform and most active venture capital fund in Silicon Valley.
The programme selected its first startup cohort in September 2018 and has received an impressive 400 startup applications since then, with 40 advancing through the rigorous selection process getting the opportunity to live-pitch their solution at Safety Accelerator Innovation Days, in front of expert industry judges.