Embed Size (px)
Citation preview
1© 2015 The MathWorks, Inc.
Computer Vision System Design
2
Computer Vision
3
Computer Visionfor
Autonomous Systems
4
Computer vision for autonomous systems
An increasingly important part of the pipeline
One of the key sensors in many applications is the camera
Other sensors also provide vision– Depth sensors– Infrared– LiDAR– RADAR
5
More Sensors
Infrared Depth
6
Multi sensor fusion
7
Computer vision system design
Files
Databases
Sensors
ACCESS AND EXPLOREDATA
DEVELOP AND TESTALGORITHMS
Hardware-Accelerated Training
Parameter Tuning
Visualization
LABEL AND PREPROCESSDATA
Data Augmentation/ Transformation
Labeling Automation
Integrate Existing Research
INTEGRATE MODELS WITHSYSTEMS
Desktop Apps
Enterprise Scale Systems
Embedded Devices and Hardware
8
Full System Design Example
9
Original ImageOriginal Image
ROI detection
Pixel classification
10
Semantic Segmentation
CamVid Dataset
1. Segmentation and Recognition Using Structure from Motion Point Clouds, ECCV 20082. Semantic Object Classes in Video: A High-Definition Ground Truth Database ,Pattern Recognition Letters
11
Image Classification Network
Boat
Airplane
Other classes
12
Semantic Segmentation Network
13
Access and Explore Data
14
Access image/video data
15
Access pixel label data
16
Label and Preprocess Data
17
Using image labeling tools
18
Develop and Test Algorithms
19
Prepare the network for training
20
Train and test the network
21
Evaluate algorithm performance
22
More evaluation
23
Challenges we addressed
Accessing data
Labeling and preprocessing
Using previous research
Developing an algorithm
Evaluating the algorithm
What’s next?
24
Computer vision system design
Files
Databases
Sensors
ACCESS AND EXPLOREDATA
DEVELOP AND TESTALGORITHMS
Hardware-Accelerated Training
Parameter Tuning
Visualization
LABEL AND PREPROCESSDATA
Data Augmentation/ Transformation
Labeling Automation
Integrate Existing Research
INTEGRATE MODELS WITHSYSTEMS
Desktop Apps
Enterprise Scale Systems
Embedded Devices and Hardware
25© 2015 The MathWorks, Inc.
