How to maintain the human in the loop? · KONGSBERG PROPRIETARY –See Statement of Proprietary Information •Deeper waters, colder waters, heavier loads, larger forces, tougher

KONGSBERG PROPRIETARY – See Statement of Proprietary Information

How to maintain the human in the loop?

Thor Hukkelås, M.Sc.Principal Engineer Marine Operations

Business Development, Kongsberg Maritime AS

Digital Ship Bergen 2014


Background: • Demanding marine operations & Modern ships bridges

Challenges:• How to reduce complexity and avoid information overload on the bridge?

• How to design for optimal Situational Awareness & Decision Support?

• How to support good human decision making?

• How to provide for proper training?

Meeting the challenges:• K-Master

• The R&D project SITUMAR

Outline


But first, - the loop


Nature / Reality / Environment

Human

Observe

Cause Effect

Observe

Learning by observing



Human

Observe

Cause Effect

Act

Learning by doing / Human in the loop



Human

Measure

Cause Effect

Act

Machines

Human

ObserveAct

Doing by Machines



Human

Observe

Cause Effect

Act

Machines

Human

Act Observe

Human back in the loop??


The First Machine Age


Driving the Tesla Model S is like using an iPad, thanks to leading-edge interior

The Second Machine Age


Are we loosing control of the machines?

Humans should thinkMachines should work.


• Deeper waters, colder waters, heavier loads, larger forces, tougher environment and more demanding weather.

• Control systems, organizations and tasks are becoming increasingly more complex and complicated.

The consequences of making wrong decisions during failure or stress situations can be disastrous and may have catastrophic

implications.

Pushing the limits




Dynamic Positioning (DP) of Diving Support Vessel

«DP is 99% boredom and 1% panic»


What’s wrong with the current situation?

• Human-Machine-Interface (HMI):• “Users are flooded with too much information,

and lose mastery of the situation.”

• Alarms:• “In alarm situations, many buttons and

indicators start flashing. Heartbeats race, without a sense of what can be done.”

• “When the screen is filled up with alarms, the operator just has to pick out some using gut instinct”.

• General

• “We think with our spine.”• “We don’t read manuals”




Has the evolution of man’s cognitive abilities kept pace with the development of technology?


• HOW to:• increase Safety

• increase Efficiency

• lower the Environmental Footprint

• WHILE

• maintaining the «Human in the loop»

• WHEN

• performing marine operations

SITUMAR ®Situation Awareness & Decision Support for demanding Marine OperationsA KM R&D project sponsored by the Research Council of Norway


Phase 1

• Literature Studies• General information

collection and research with special emphases on Human Factors, Decision Making and the importance of Situation Awareness.

01/02/12

• Case studies of selected marine operations

• We go on board and perform Task Analysis (what is actually done during Planning, Execution, Evaluation etc.)

• System Design

Phase 2

01/01/13

• Building prototypes in simulator environment

• User-evaluation of prototype in a realistic, simulated environment

• Reporting and requirement validation

Phase 3

01/01/14 31/12/14

SITUMAR ®From theory to product


“If I had asked people what they wanted, they would have said faster horses.” Henry Ford

“Ask them what they do and observe them doing it”

SITUMAR ®

User centred design

1. Active involvement of users and understanding of user and task requirements.

2. Appropriate allocation of functions between users and technology.

3. Iteration of design solutions.

4. Multidisciplinary design team.


Situation Awareness Human Decision Making


What is Situation Awareness (SA)?

• Basically, SA is being aware of what is happening around you and understanding what that information means to you now and in the future.

• The formal definition of SA breaks down into three separate levels:

• Level 1 – perception of the elements in the environment

• Level 2 – comprehension of the current situation, and

• Level 3 – projection of future status

Source: Designing for Situation Awareness. An Approach to User-Centered Design. Endsley, Bolte, Jones.


SITUMAR ®Situation Awareness & Decision Support for demanding Marine Operations


Planning & Preparation

Normal Situation

Abnormal Situation

Barriers

Recovery

SITUMAR ®

Decision Support systems should be Proactive, not Reactive


Time

Criticality

SITUMAR ®

Thinking slow, thinking fast


Skill

Time

Do you know this??

Can you do this??

SITUMAR ®

“Train as you fight – fight as you train”


• New 360 degrees seamless integrated bridge• Unified HMI across subsystems (e.g. K-Master)• Focus on ship handling, not on “operating systems”• Re-inventing the DP => Giving it back to the mariner

• New information design: • Multi Sensor Fusion => Dramatic reduction of # of displays• Task-oriented design – focus on what to do• Correct Information when you need it, where you need it

• New training design:• Harmonized info development with Training requirements• Increased focus on skill training• ‘Train as you fight – fight as you train’

• New Decision Support design: • Re-thinking Alarm Handling philosophy• Building barriers – going from re-active to pro-active

SITUMAR ®

KM’s Design Thinking – User Centered Design


SITUMAR ®

The 3600 seamless integrated bridgeHarmonized ship handling units & Unified HMI across subsystems


/ 30 / 10-Mar-14

K-Master –The complete OSV Aft Bridge Operator StationK-MasterUnified HMI - A true integration of several systems with a common look & feel.


SITUMAR ®

Simplification – simplification - simplification

KONGSBERG PROPRIETARY – See Statement of Proprietary Information10.03.2014 WORLD CLASS - through people, technology and dedication

Page 33

SITUMAR ®

Harmonized ship handling units – Giving the DP back to the mariner


SITUMAR ®

Multi Sensor Fusion & Maritime Situational Awareness Displays


Tech “think” Human “think”

Task “think”

Machines should workHumans should think

SITUMAR ®

Task-oriented Design:Technology should adapt to humans, not the other way around!


SITUMAR ®

Task-oriented Design – new Anchor Handling Concept


Thank you for your attention

Documents

How to maintain the human in the loop? · KONGSBERG PROPRIETARY –See Statement of Proprietary Information •Deeper waters, colder waters, heavier loads, larger forces, tougher