IEEE-SAP2020

Kick-OffMeeting

20September2016,AutoWorld,

Brussels,Belgium

Agenda

• CalltoOrder&Introductions– RobertStead

• ScopeandPurposeofWorkingGroup– RobertStead

• IEEEPatentPolicy– MichaelKipness

• ApprovalofWorkingGroupP&Ps– RobertSteadandMichaelKipness

• AppointmentofOfficers– RobertStead

• TechnicalDiscussion– SvenFleck

• Adjourn

Introductions

•RobertStead,SenseMediaGroup

•BenjaminMay,AMX13

•SvenFleck,SmartSurv

•PatrickDenny,Valeo VisionSystems

•MichaelKipness,IEEE-SA

•CPIQWGmembers

AffiliationDeclarations

•Name

• Jobtitle

•Declarationofwhichentityissupportingyourparticipationinthisworkinggroup(company,individualorotherorganisation)

PARSummary

• SponsoringSocietyandCommittee:IEEEVehicularTechnologySociety/IntelligentTransportationSystems(VT/ITS)

• PARlink:https://development.standards.ieee.org/get-file/P2020.pdf?t=89521200003

• Projectinformation:https://standards.ieee.org/develop/project/2020.html

• ContactInformationforIEEE-SALiaisonName:MichaelKipnessEmailAddress:m.Kipness@ieee.org Phone:+1732-562-3810

• ContactInformationforStandardsRepresentativeName:ThomasKuriharaEmailAddress:t.kurihara@ieee.org

ScopeofPAR

Thisstandard

addressesthefundamentalattributesthatcontributetoimageandqualityforautomotiveAdvancedDriverAssistanceSystems(ADAS)applications,

aswellas

identifyingexistingmetricsandotherusefulinformationrelatingtotheseattributes.

Itdefinesa

standardizedsuiteofobjectiveandsubjectivetestmethodsformeasuringautomotivecameraimagequalityattributes,

andit

specifiestoolsandtestmethodstofacilitatestandards-basedcommunicationandcomparisonamongOEMandTier1systemintegratorsandcomponentvendors

regardingautomotiveADASimagequality.

PurposeofthePAR

Purpose:

• Thisstandardspecifiesmethodsandmetricsformeasuringandtestingautomotiveimagequalitytoensureconsistencyandcreatecross-industryreferencepoints.

NeedfortheProject:

• Camerasarebeingusedingreaternumbersinautomotiveapplications.Mostofthesesystemshavebeendevelopedindependently,withnostandardisedcalibrationormeasurementofimagequality.Consumershavenostandardreferencepointwhenusingcameraenabledsystems,andOEM/Tier1developerscannotcomparecamerasystemssidebyside.

StakeholdersfortheStandard:

• AutomotiveOEMs,AutomotiveTier1suppliers,imageprocessingsoftwareandhardwarecompanies,opticscompanies,sensormanufacturers,safetycertification

Today’sMeetingandGeneralExpectations

SeeQ4&Q7onsurveyfordetails…

•Definestandardterminology,testmethodsandKPIs

• Industrycollaborationacrosssupplychain

• Increaseknowledgetransferandharmonisation

•Definescope,rolesandresponsibilities

•Meettheotherparticipants

• Establishsub-groupsandobjectives

IEEEPatentPolicy

• MKslides

P2020PoliciesandProcedures

• Reviewofdocument

• Q&A

AppointmentofP2020Officers

Chair RobertStead

+442081335116

rob@sensemedia-events.com

ViceChair Dr. SvenFleck

+4917661040825

fleck@smartsurv.de

Secretary BenjaminMay

+491732386833

Benjamin.may@amx13.com

Treasurer Prof. PatrickDenny

+3539323184

patrick.denny@valeo.com

TechnicalDiscussion

• Reviewofsurveyresults

• Responsetoproposedworkpackages

• Newpackagesproposed

• DraftOutline– reviewandfeedback

• Establishmentofworkpackages

• Include/excludeinP2020

• Proposalandnominationofworkpackageleaders

• Goalsof‘workpackage’group

Exampleofworkpacketaims

•Definitionsofrelevantterms

•Reviewofexistingrelevantstandards

•Reviewofexistingrelevanttechnicalstudies

•Definitionofproposedstandardtest/method/KPI/measurement

•Objectivemeasurementoutcomes

Nextmeetings?

• Teleconference– 6weeks?

• Finaliseworkpacketteamswithbalancedrepresentation

• Presentproposeddraftoutlineforworkpacket

• Completedefinitionofterms

• Proposeandconfirmoutstandingworkpacketleaders

• FacetoFace

• 6months?

• Presentreviewofrelevantstandardsandstudies

• ???

IEEE-SAProject2020SubprojectSummary

2016-09-20

M.Kipness,R.Stead,S.Fleck,B.May,P.Denny

Agenda

QuestionnaireFeedback

DiscussionofProjectProposals

Expectations

Locations

NextSteps

Letsmakeamotion…

...fortheagendaofcourse.

IEEE P2020 AUTOMOTIVE SYSTEM IMAGE QUALITY

ROBERT STEAD (CHAIR), DR. SVEN FLECK (VICE CHAIR),BENJAMIN MAY (SECRETARY), PROF. DR. PATRICK DENNY (TREASURER)

Q1 SUGGESTED IMAGE QUALITY WORK PACKAGES

Q2 IMAGE QUALITY WORK PACKAGES – ADDITIONAL PROPOSALS

Q3 LEADING A SUB-GROUP

Q4 WHAT DO YOU EXPECT MOST FROM P2020?

Q5/6 P2020 MEETINGS [EVERY N WEEKS] ? 1. WEB, 2. FACE TO FACE

IEEE P2020 AUTOMOTIVE SYSTEM IMAGE QUALITY

ROBERT STEAD (CHAIR), DR. SVEN FLECK (VICE CHAIR),BENJAMIN MAY (SECRETARY), PROF. DR. PATRICK DENNY (TREASURER)

Q7 EXPECTATION OF P2020 MEETING @AUTOSENS CONFERENCE

Q8 BEST LOCATION FOR THE NEXT FACE-TO-FACE MEETING?

Q9 CONTACT INFORMATION

Questionaire Feedback

Q1-3: WorkingGroups,AdditionalProposals,LeadersofSubGroups

Q4: Expectations

Q5&6: MeetingCadence

Q7: ExpectationofMeeting

Q8: LocationforF2Fmeeting

Q9: ContactInformation

IEEE P2020 AUTOMOTIVE SYSTEM IMAGE QUALITY

ROBERT STEAD (CHAIR), DR. SVEN FLECK (VICE CHAIR),BENJAMIN MAY (SECRETARY), PROF. DR. PATRICK DENNY (TREASURER)

Q1 SUGGESTED IMAGE QUALITY WORK PACKAGES

Q2 IMAGE QUALITY WORK PACKAGES – ADDITIONAL PROPOSALS

Q3 LEADING A SUB-GROUP

Q4 WHAT DO YOU EXPECT MOST FROM P2020?

Q5/6 P2020 MEETINGS [EVERY N WEEKS] ? 1. WEB, 2. FACE TO FACE

TopicSummary

• [proj #1]LEDflickerstandards

• [proj #2.X]IQforviewing

• [proj #3.X]IQforcomputervision

• [proj #4]Camerasysteminterfacestandards

• [proj #5]IQsafetystandardsbeyondISO26262

• [proj #6] MappingP2020standards->SAElevels

• [proj #7]Customerperceptionqualitystandards

• [proj #8]Videoquality

• [proj #9]Calibrationqualitystandards

• [proj #10]IQrequirements/specificationstandards

Initialproposals

additionalproposals

TopicSummary

ProjectGoal- [proj #1]LEDflickerstandards

Harmonizationofdifferentsettingsasthisreducesimpactonimageandmachinevisionfunctionssuchas:

• vehicleillumination

• streetillumination

• trafficsigncontrol

[proj #2.X]IQforviewing

Twosubprojectsproposed:

[proj #2.1]IQforviewing- componentlevel

• KPIstandardsandtestsetups

[proj #2.2]IQforviewing- systemlevel

• KPIstandardsandtestsetups

[proj #3.X]IQforcomputervision

Twosubprojectsproposed:

[proj #3.1]IQforcomputervision- componentlevel

• KPIstandardsandtestsetups

[proj #3.2]IQforcomputervision- systemlevel

• KPIstandardsandtestsetups

[proj #4]Camerasysteminterfacestandards

especiallytomeasurementsystemsincluding:

• firmwarerequirements

• "ONVIFforautomotive"

[proj #5]IQsafetystandardsbeyondISO26262

PotentialextensionofISO26262forimagequalityduetonewapplicationsforviewingsystemsinautomotive

[proj #6] MappingP2020standards->SAElevels

minimumimagequalityrequirementsforeachSAElevel

Linktoautonomousdriving

[proj #7]Customerperceptionqualitystandards

Endcustomerstudiesandcorrelationwithdefinedsystem-levelstandards(e.g.proj #2.2)

[proj #8]Videoquality

• framerate,jitter,lag,etc.

• motionrelatedissues(artefacts,motionblur,rollingshutter,etc.)

• videocodingstandardsandtools

[proj #9]Calibrationqualitystandards

• KPIstandardsforintrinsic+extrinsiccalibration

• componentandsystemcalibration

• plantandonlinecalibrationinthefield

[proj #10]IQrequirements/specificationstandards

• standardizationofvariables,termsandsystemdescriptions

Q4:WhattoExpect…?

KPI-drivendevelopment

IndustryExchange

IQStandardization

EUH2020projects

ConvergenceofViewingandProcessing

ViewingandPerception

Automotivespecificrequirements

HarmonizationofExpectations

UnifiedTestingEnd-to-endautomotive

systemdescription

Automotivelighting

standardization

(on- &offboard)

Terminology

harmonization

BestInClass

Deeplearning

Q5&6:MeetingCadence

• MeanforWebmeeting: Every7.5weeks

• MeanforF2FMeeting: Every20weeks

Q8:LOCATION– Wherenext?

Q8:LOCATION– Wherenext?

NextSteps

• OrganizationofSubGroupmeetings

• DefineFuturemilestonesofSubGroups

• IntroductionofSubGroupprioritiesandtheirrespectiveleaders

• BeerandFun…

KeyContacts– P2020Officers

Chair RobertStead

+442081335116

rob@sensemedia-events.com

ViceChair Dr.SvenFleck

+4917661040825

fleck@smartsurv.de

Secretary BenjaminMay

+491732386833

Benjamin.may@amx13.com

Treasurer Prof.PatrickDenny

+3539323184

patrick.denny@valeo.com