The Architecture of the AMEBICA Agent Based Adaptive
Process Control Interface
Christopher J. KhalilIMPACT Research Group,
Dept. of Computer Science,
Loughborough University, UKAMEBICA Homepage:
http://enid.lboro.ac.uk/users/cocjk/homepage.htm
Introduction
Presentation Order:
1: What is Amebica?
2:AMEBICA Background.
3: Why AMEBICA is useful for an Operator/Designer.
4: AMEBICA System Details
5: AMEBICA and Multi-Media.
6: Research Issues
7: Conclusion
What Is AMEBICA?
A System to dynamically select the best media and adapt representation for a certain context within a Process Control Environment.
ESPRIT Basic Research Project with partners around Europe.
Alcatel (FRANCE),
Elsag (ITALY),
Iberdrola (SPAIN),
Institutt for Energiteknikk (NORWAY),
LABEIN Technological Research (SPAIN),
Association pour la Recherche et le Dévelopment des Méthodes et Process Indusriels (FRANCE),
IMPACT Research Group - Loughborough University (UNITED KINGDOM),
Softeco (ITALY)
AMEBICA Background
AMEBICA: Auto-Adaptive Multi-Media Environment Based on Intelligent Collaborating Agents.
CONTEXT: PROCESS CONTROL, such as IBERDROLA.
AMEBICA Background
In Process Control there has been a general move away from the Hard-Desk approach to the Soft-Desk. This has led to the operator often experiencing information overload when the process is in a disturbed condition.
Objective: To develop the conceptual and technological foundation for Auto-Adaptive Multimedia Interfaces, using as a basis the Multi-Agent architecture paradigm, with industrial process control as the target domain
Why is AMEBICA useful to the Operator
Complex Systems must be monitored in low bandwidth displays.
Often operator is confronted with Information Overload, hard to disseminate useful information from spurious information.
Use of different Media and ways of presenting information can make Operators job easier.
Bad Interface design can cause major disasters or expensive shutdowns.
Factors Affecting Human Performance
Organisational Context
Working Environment
Human Task Equipment
Input Error
Not Detected
Slow Response
Poor Diagnosis
Incorrect
Maintenance
Examples of Human Error.
Channel Tunnel Fire 1996: Mistakes and Delays occurred configuring power system and dampers. Inquiry reported management system needed to be modified, so that Operator not faced with unmanageable workload in future incidents.
Texas Oil Refinery Explosion: Team failed to diagnose correctly the problems. Inability to appreciate mass flows blamed on control system which provided no clear overview of mass balances. Flood of alarms hampered operation. Recommendation: Improve display of plant data, and alarm handling system
These incidents highlight problems interfaces can provide. Costs millions of dollars.
How AMEBICA Helps the Operator.
Combats Interface Rigidity: A rigid Interface often creates additional and unnecessary tasks for the operators.
Provides Flexibile Mapping System: Adapts the interface to best suit the current task/problem/operator.
Improves Interface Effectivness: AMEBICA will ease the task of the operator, and reinforce effectivenesss during system disturbances.
Manages Informtion Overload: Will filter information according to criteria such as urgency and operator condition. Will ensure that the main presentation parameters of form, location, and modality correspond to the contents and nature of the information.
Why is AMEBICA useful for a Designer?
Interface Designer Information: Will provide future Interface designers with valuable information and guidelines on usefulness of Adaptive Systems.
Domain Independent: The adaptive framework is process/interface independent. It therefore provides a generic architecture which can be plugged into other process domains and other interface rendering engines.
Reduces Design Time: Since system captures a whole range of possible mappings, the interface can be updated very simply by varying the range of possible mappings or adding new ones.
AMEBICA Adaptation Foundation
Operatorresponse
Normal
Delayed (relativeto expectedresponses)
Erratic(occasionallywrong display commands)
Disorganised(constantlywrong display commends)
Process state
Normal
(2) Inattentive.Accentuate
presentation(specific)
(3) Confusedloss of control.
Go to overviewpresentation
Process state
Disturbed, high info rate
Check with Operator
(4) Overloaded.Filter information,simplifypresentation
(5) Overloaded.
Simplify displays,remove information(6) Severe loss
of control.Alert Domain Specialists
Process state
Disturbedlow info rate
Check with Operator
(7) “Frozen”.Repeat recent
representation
(8) Partial loss ofcomprehension.
Switch modality
(9) Complete loss ofcomprehension.
Go one level up,
Alert other Assistance
(1) Inattentive:Accentuatepresentation
OK, no action
AMEBICA System Context
Process
S&C system
HMI
UIMS
Supervision &Control System
Human-MachineInterface
Auto-adaptive
UIMS enhancement
AMEBICAfunctionality
• AMEBICA lies between the UIMS system and the Interface.• AMEBICA operates on information flow between these two systems.• AMEBICA endeavours to make the interface renderings more suitable for the operator.
AMEBICA Process/Interface Independence
AMEBICA acts on streams of information that run from the Process to the Interface.
AMEBICA does not affect the streams, merely the way the streams are represented at the Interface.
The AMEBICA framework is generic and can be applied to other processes/Interfaces.
S & CSystem
RenderingI nterf ace
RenderingResources
AmebicaApplication
AmebicaFramework
CustomizationProcedure
One Phisical stream,many logical streams
Flexible mapping of streams onto rendering resources
AMEBICA Process/Interface Independence
Process data streams
Process Model Agent
AMEBICA Framework
MULTI AGENTSYSTEM
manipulation
PROCESSABSTRACT RENDERING INTERFACE
AMEBICA Process/Interface Independence
The Process Model Agent (PMA) monitors the state of the process, and maintains an updated view of process conditions.
If certain, discrete conditions are met (say an alarm condition), the PMA recognise adaptation is required. It then translates these conditions to process independent terms that the AMEBICA framework can understand.
Upon the required adaptation being completed the framework passes the appropriate information to the Abstract Rendering Interface (ARI). The ARI is responsible for translating the requisite adaptation to renderings at the Interface.
AMEBICA Basic Principles
Each software agent represents a particular actor within the System (Operator, Environment).
The total system intelligence will therefore be the result of the collective intelligence and communication capacities of the agents.
All system rules should be simple/straightforward
AMEBICA should attempt to operate as quickly as possible.
Roles of the Media Allocator and Rendering Resolution Agent
Presentation AgentMedia Allocator
Agent
Rendering Resolution Agent
Set of media Agents
Process Model Agent
Human Factors Database
Environment Agent
Operator Agent
Rendering system
PROCESS
Advantages of Multi-Media
Use of Multi-Media can:
Increase the bandwidth of Communication.
Facilitate Multitasking.
Improve Attention-Getting.
Facilitate Representations at Multiple Levels of Abstraction in the Interface.
Provide Vivid and Engaging Presentations
Definitions of Multi-Media
Modality: Output modality refers to the human sensory system through which physical artefacts are perceived. Artefacts include visual, auditory or perhaps haptic.
Channel: Line of information transfer. Table = visual/verbal channel, Picture = visual/spatial channel.
Perceptual Dimension: Within a channel several perceptual dimensions can be used to encode information. A graphic symbol, for example, may have a given shape and colour which represent meaningful attributes.
Medium: Is an artefact which renders information and has structural and functional properties.
Definitions Of Multi-Media
Medium: Has higher level functional characteristics such as syntax and semantics.
Multi-Media: Describes a computing system which employs multiple media. Term is often misused, for example some writers in the popular press claim a system must have live video and audio in synchronisation to qualify as a multi-media system. This is not true, a word processor which allows drawings and text to be integrated into a document is a multi-media system
The Power of Multi-Media
A more natural way to communicate information.
Allows exploitation of the “whole” human mind both perceptually and cognitively.
Representations must be designed to exploit our perceptual capabilities.
Use of metaphors is difficult in a Process Control system, as they event displayed do not lend themselves naturally to everyday items.
Excessive use of multi-media can be dangerous in a Process Control situation, can detract from the main task of not carefully used.
SPATIAL VERBAL
Modality/Code
Abstracted Stylistic Realistic (abstracted)
Static Abstract Graphics Mimics Pictures Alphanumerics
VISUAL
Semi-Dynamic
Animated Graphics
Animated Mimics Slide Show Time-Varying Alphanumerics
Dynamic Data Visualisation Cartoons Video
Static Motif Generated Auditory
AUDITORYSemi-Dynamic
Earcons Auditory Icons Icons Spoken Word
Dynamic Data Audiolisation (3D Binaural)
Continuous Everyday Sounds
Spoken Passage
AMEBICA Flexible Mappings
In traditional systems the designer must pick the best ALL PURPOSE representation and discard the others (The broken-line arrows).
The other representations could possibly be better under a different set of conditions. AMEBICA captures these possible representations within a Media Agent .
At run time AMEBICA will consider the current dynamic run-time conditions, if another representation is more appropriate it will select it
AMEBICA Flexible Mappings
Output class 1
Output class 1
MMI media (UIMS / MMI)
Medium 1
Medium 1
Medium 2
Medium 2
Medium ...
Medium ... Medium nMedium n
Output class 2
Output class 2
Output class ..
.
Output class ..
.Input
class 1Input
class 1Output class n
Output class n
Input class ..
.
Input class ..
.
ProcessProcess
S&C system
Design defined mapping
Output from process Input to process
AMEBICA Flexible Mappings and Affordances
Dynamic Images
5
Dynamic Text
Process EventsProcess Events
Trends
AMEBICA Operations
AMEBICA Adaptive Actions:
A: Switch from different states (Overview, Detail)
B: Select MOST appropriate Representation
C: Select MOST appropriate characteristics (colour, flashing, text size, behaviour)
D: Select MOST appropriate Location and Size.
E: Adapt interface to accommodate important Representations. (Move, Resize, Overlap, Layer Windows)
MEDIA USED:
Auditory: Speech recognition, Speech Output, Alarm Sounds.
Graphic: Mimics, Animations, Pictures, Video,Animated Graphics
Bounding Interface Adaptation
No active moving of windows allowed. The user has a spatial understanding of where unserviced renderings are, if windows are moved around the screen it disrupts user effectivness.
Window re-sizing allowed: Re-sizing a window only partially affects the users spatial map, and they still have a understanding of where that rendering is, even if it is smaller.
Run Time Selection: Any Representation can be selected an run-time as long as it fits interface resources.
Layer Use: Use of layers permitted (foreground, background)
What Does AMEBICA Interface Look Like
Research Issues
Set up Process Simulator using real apparatus.
Simulate certain scenarios and observe user’s responses.
Ascertain effectiveness of AMEBICA architecture and interface.
Possible collaboration with Clausthal Technical University, with Interface remotely connected to their process simulation apparatus.
Conclusion
AMEBICA will attempt to provide Interface designers with guidelines on using adaptive systems.
AMEBICA attempts to present the Operator with the most salient information in a timely fashion.
AMEBICA attempts to investigate the usefulness of Adaptive Interfaces in a Process Control Environment.