October 8, 2019 Sam Siewert

CS415Human Computer Interaction

Learning Objectives

Preparation for CS 415 - SE’sC (CS125) and C++ (CS225)C for CLI, with starter code for fork (CS420)QtCreator (C/C++) - WIMP GUIOpenCV - C/C++ - 3D and 4DOther VHLL’s for HCI prototyping as you wish - Project

Sam Siewert 2

Learning Objectives1D Interaction: CLI and Scripting - Useful in Data Centers, Automation (strings, best effort)

2D Interaction: Windowed GUIs, Mobile Touchscreen -Current State of Practic (X,Y pointer and bitmaps, best effort)

3D Interaction: Machine Vision, AR/VR, Rendering, Domain Specific (X,Y,Z or X,Y and time constrained)

4D & AI: Intelligent Systems - Computers Acting more like Humans

– 3D Computer Vision for HCI (X,Y,Z, real-time, intelligent)– Natural Language Processing (X,Y, real-time, intelligent)– Machine Learning and Rule-based inference (X,Y,Z. intelligent)

Design for Usability– Metrics, Evaluation, Design for Quality (non-functional)– Standards, Guidelines, Rules (Expert research and gurus)

Design & Build or Improve an HCI Prototype, Evaluate– Independent and Dependent Variables– Test Scenario– Significance of results Sam Siewert 3

HCI Complexity Dimensions

1…3 - Space, X, Y, Z

4 - Time• Best effort• Constrained (interactive)• Real-time

Intelligence• Regular (state machine)• Context Free• Context Sensitive• Recursively Enumerable

Usability• Cognitive load• Ability to complete tasks• Look and feel• Evaluation• Standards & Guidelines• History

HCI and HMI (from Computer History)1. ENIAC – Electronic Computer - 19462. Punch Cards, Switches, LEDs, Line Printer – 19503. Artificial Intelligence – 19564. Serial Terminals and Minicomputers - 19605. Command Line Interface (glass TTY, Unix) - 1965-706. Early Computer Vision - 19667. Scripting (Unix) - 19708. Graphic Visualization, Animation, Flight Simulators – 19769. Word Processing, (Wang) WYSIWYG – 1971, 197510. Home PC – 1976 (Apple I, PET)11. MS DOS - 1981 12. WIMP (Windows, Icons, Menus, Pointers - Xerox PARC, Apple Mac) - 198513. Virtual Reality, 3D Graphics – 199014. Palm Computing (Apple Newton), Web Browser – 199315. Machine Vision (Automatix, SRI), Machine Learning, Rule-based Automation -

1983-199516. GhZ Computing, ILOVEYOU Virus, Y2K - 200017. Mobile WIMP (PDA, mobile touchscreen, voice recognition - iPhone) – 200518. SmartPhone, Tablet PC, SmartTV, VR CAVE, Gesturing - 201019. Augmented Reality (Pokemon Go), Wearable Computing, IoT, Practical NLP -

201520. Future?

Sam Siewert 4

Assignment Strategy – Usability!Assignment #1 [1D] – Shells and Command Line Interfaces – Prototype Code

Assignment #2 [2D] – WIMP GUI Building for Interactive Apps – Prototype Code

Assignment #3 [3D] –Beyond WIMP with CV/MV & 3D – Play with Code

EXAM-1

Assignment #4 [4D] – Interactive and Real-Time Systems – Prototype System

Assignment #5 – Propose Proof-of-Concept HCI of Your Interest – Design Focus and Design of Experiments

EXAM-2 - On Canvas

Assignment #6 – Build HCI Proof-of-Concept, Test

FINAL EXAM - Present Results from Assignment #6

[Harder Programming, Easier Programming, Medium Programming]

Sam Siewert 5

Overall Learning ObjectiveQualities of a Software Application or System– E.g. Mobile App– Desktop App– VR/AR System– Game– Mission Critical HCI (Avionics,

Medical, etc.)Quality is a “non-functional” requirementWe want and need quality to succeed, but difficult to design in and hard to directly testMust involve users and design of experimentsCan leverage past experience and wisdom of UX Gurus

Sam Siewert 6

Quality of a Software Application or SystemFor the User - User Experience (UX)• Methods of Design and Prototyping to

Assess and Improve UX• Design of Experiments to Test UX

Assessing Usability

1) Light-bulb (just Grok it)2) Standards and Guidelines3) Gurus (Do as they do)4) Science - Design UX Experiment

We know itWhen we see it