49
© 2018 Cognex Confidential 1 INTRODUCTION TO MACHINE VISION Thibaut van Baer | February 2018

INTRODUCTION TO MACHINE VISION - cognex.com€¦ · Machine vision algorithms. All within just one to tens of milliseconds! Algorithms used by Vision Tools transform raw numbers into

  • Upload
    others

  • View
    4

  • Download
    0

Embed Size (px)

Citation preview

  • © 2018 Cognex Confidential1

    INTRODUCTION TO MACHINE VISION

    Thibaut van Baer | February 2018

  • © 2018 Cognex Confidential2

    Agenda

    ▪ What is machine vision?

    ▪ Why use machine vision?

    ▪ Machine vision applications

    ▪ Types of machine vision systems

    ▪ Vision system components

    ▪ Machine vision terms

    ▪ Improving vision system performance

    ▪ Summary

    ▪ Q&A

  • © 2018 Cognex Confidential3

    What is machine vision?

    The camera lens and sensor

    capture images…

    Cognex advanced vision tools

    interpret what’s being seen

  • © 2018 Cognex Confidential4

    Proprietary Box

    Embedded

    Boards

    Modular

    Vision

    Barcode

    Readers

    PC Vision

    Vision

    Sensors

    1982 Today

    3D Displacement

    Sensors

    Evolution of machinevision

  • © 2018 Cognex Confidential5

    Machine vision systems:

    1. Analyze images

    2. Makes decisions and returns results about each image

    Simple examples

    The center tab on this bracket is

    37.255 mm wide

    Good Oil Filter:

    All holes are

    open

    Bad Oil Filter:

    Some holes

    are blocked

  • © 2018 Cognex Confidential6

    Image analysis

    The primary purpose of machine vision is image analysis

    Image

    Decision

    Answer

    Location

  • © 2018 Cognex Confidential7

    Where is machine vision used?

    Automotive

    Industry

    Graphic Arts/ Packaging

    Consumer

    Products

    Semiconductor

    Industry

    Shipping

    Transportation

    Electronics

    Medical

    Pharmaceutical

    Food Packaging

    Industry

  • © 2018 Cognex Confidential8

    ▪ Automate manufacturing processes

    ▪ Improve product quality

    ▪ Protect brand image

    ▪ Reduce operational costs

    Why is machine vision used?

    ▪ Overcome inefficient manual inspection processes

    ▪ Increase manufacturing throughput

    ▪ Reduce material waste

    ▪ Minimize the risk of recalls

  • © 2018 Cognex Confidential9

    Critical for achieving strategic goals

    ▪ High speed production lines

    ▪ Clean room environments

    ▪ Hazardous environments

    ▪ Microscopic inspection

    ▪ Closed-loop process control

    ▪ Robot guidance

    ▪ Precise non-contact measurement

  • © 2018 Cognex Confidential10

    Manufacturing Goal Machine Vision Applications

    Improved product quality Inspection, measurement, gauging, and

    assembly verification

    Increased productivity Repetitive tasks done manually are

    automated with machine vision

    Production flexibility and

    less machine downtime

    Automatic product changeovers

    Increased manufacturing

    throughput

    High-speed inspection keeps up with the

    fastest production lines

    Reduce manufacturing

    waste

    Detecting defects earlier in the process

    prevents adding value to defective

    products

    Benefits of machine vision

  • © 2018 Cognex Confidential11

    MACHINE VISION APPLICATIONS

  • © 2018 Cognex Confidential12

    What does machine vision do?

    GUIDE INSPECT GAUGE IDENTIFY

    © 2016 Cognex Confidential12

  • © 2018 Cognex Confidential13

    Determines part position (x, y, and angle)

    Automates handling of parts for machines:

    ▪Alignment & Placement

    ▪2D & 3D Picking

    ▪Eliminates need for fixturing & improves robot flexibility

    Vision tool alignment, fixturing

    ▪Locate at least one feature on a part for the purpose of calculating the (x, y) position and rotation of the part to position other vision tools precisely

    Guidance

    Delta Robot - PackExpo 03.mpg

  • © 2018 Cognex Confidential14

    Trained Image Out of focus

    Uneven LightingOcclusions

    Confusing Background

    Rotation and Scale Changes

    Geometric pattern matching

  • © 2018 Cognex Confidential15

    Appearance Changes

    Part location challenges

  • © 2018 Cognex Confidential16

    Part location challenges

    Variation in part appearance

    1

    6

  • © 2018 Cognex Confidential17

    Correct location

    ▪Orientation

    ▪Skew

    Quality

    ▪Defect Detection

    ▪Surface Inspection

    ▪Contaminants

    Completeness

    ▪Fill Level

    ▪Feature Presence

    ▪Counting

    ▪Assembly Verification

    Inspection

  • © 2018 Cognex Confidential18

    Precise dimensioning

    ▪ Automated metrology and data recording

    Ensures tolerances

    ▪ Diameters

    ▪ Gaps

    ▪ Bushings

    ▪ Threads, etc.

    Gauging

  • © 2018 Cognex Confidential19

    Read Codes

    ▪ Printed 1-D Barcodes & 2-D Matrix

    ▪ Direct Part Mark

    Read Characters

    ▪ OCR / OCV

    Recognize Objects

    ▪ Based on color, shape, or size

    Identification

  • © 2018 Cognex Confidential20

    MACHINE VISION PRINCIPLE

  • © 2018 Cognex Confidential21

    1D machine vision

    ▪ 100% continuous web inspection and classification

    ▪ Uses line-scan cameras

    ▪ Materials inspected include:Metals, non-wovensPlastics, Paper

  • © 2018 Cognex Confidential22

    1. Unwrap cylindrical objects for inspection

    2. Add vision to space-constrained environments

    3. Meet high-resolution inspection requirements

    4. Inspect objects in continuous motion

    Four reasons to use line scan

  • © 2018 Cognex Confidential23

    2D machine vision – area scan

  • © 2018 Cognex Confidential24

    3D Machine Vision

  • © 2018 Cognex Confidential25

    Profiler principle of operation

  • © 2018 Cognex Confidential26

    Displacement sensor

  • © 2018 Cognex Confidential27

    VISION SYSTEMS AND SENSORS

  • © 2018 Cognex Confidential28

    COGNEX VISION SENSOR

    Compact, modular

    body design fits into

    tight spaces

    Field changeable, high power,

    diffuse illumination

    Powerful, proven In-Sight®

    vision tools for reliable

    inspection performance

    Field changeable

    lenses and filters

    for optimal image

    quality

    Step-by-step setup

    with EasyBuilder®

  • © 2018 Cognex Confidential29

    ▪ Industry-leading image acquisition and optical character recognition

    ▪Powerful and precise pattern matching algorithms

    ▪Most reliable and flexible inspection systems

    Cognex 2D Vision

  • © 2018 Cognex Confidential30

    Cognex 3D Vision

    ▪ 3D laser displacement sensors provide three dimensional inspection of products to optimize quality

    ▪ Measure height, volume or tilt with cross section and plane fitting tools –regardless of contrast or light variations

    ▪ Expanded range of 3D sensors, factory calibrated to deliver real-world values

  • © 2018 Cognex Confidential31

    SYSTEM COMPONENTS

  • © 2018 Cognex Confidential32

    Key parts of a vision system

    Light Source

    Vision System

    Vision Software

    I/O Comm.

    CameraLensPOWER

    A- BALLEN- BRADLEY

    I NPUT

    10

    23

    4567

    SLC 5/04 CPURUNFLTBAT

    FORCDH+RS232

    RUN REM PROG

    I NPUT

    10

    23

    4567

    O UTPUT

    10

    23

    4567

    Inputs/Outputs: switches, PLCs, robots, lights

    Communication

  • © 2018 Cognex Confidential33

    Putting it all together

    Camera

    Monitor

    Operator Pointing Device

    (Trackball, Mouse, Touchscreen)

    Parts

    Light Source

    Vision System

    Output:

    •Serial

    •Parallel

    •ISA, PCI, VME bus

    Input:

    •Serial

    •Parallel

    •ISA, PCI, VME busa

    Lens

  • © 2018 Cognex Confidential34

    How the system works

    1. Part arrives at inspection station

    5. Software algorithms running on vision systemperforms image processing and/or image analysison acquired image

    6. Vision system sends signal along a discrete output line which activates a diverter if the part is bad

    7. Operator can view rejected parts and ongoing statistics on display,and can take system off-line if necessary

    2. Sensor detects part and sends a trigger to the vision system3. Strobe is flashed to illuminate part 4. Vision System acquires the image from the sensor.

    FAIL

  • © 2018 Cognex Confidential35

    Machine vision algorithms

    All within just one to tens of milliseconds!

    Algorithms used by Vision Tools transform raw numbers into

    useful higher level features …

    - Raw numbers turned into edges, colors, characters, and

    other characteristics

    … then makes decisions

    - Returns answers such as position, similarity, distance,

    presence, quality

  • © 2018 Cognex Confidential37

    TERMINOLOGY

  • © 2018 Cognex Confidential38

    Vision definitions

    Field of View (FOV)

    ▪ The part which can be seen by the machine vision system at one moment.

    ▪ The field of view depends on the lens of the system and the working distance between object and camera.

    5” x 7”

  • © 2018 Cognex Confidential39

    Field of view

    What is my field of view?3”

    4”

    8”

    15”

  • © 2018 Cognex Confidential40

    Working distance and resolution

    Working Distance (WD)

    ▪Distance between the FRONT of the lens and the target

    Resolution

    ▪The minimum feature size of the object under inspection.

    10”

  • © 2018 Cognex Confidential41

    Correlation working distance/FOV

  • © 2018 Cognex Confidential42

    Depth of field

    Depth of Field (DOF)

    ▪ The distance in front of and behind the object which appears to be in focus

    3”

    More DOF with a small aperture

    (high f/number) than with a large

    aperture (low f/number)

  • © 2018 Cognex Confidential43

    SYSTEM COMPONENTS

  • © 2018 Cognex Confidential44

    Different lens … same image?

    ▪ Lighting

    ▪ Depth of field

    ▪ Working distance

    ▪ Line speed

    ▪ Exposure time

    ▪ Aperture

    ▪ Budget

  • © 2018 Cognex Confidential45

    Lighting techniques

    4

    5

    Bright FieldDark Field

    Back Lighting

    Diffuse Dome

    Axial Diffuse

    Light can be structured in different ways. Angle and direction of the light determine how the mark and space is seen by the camera.

    Structured

  • © 2018 Cognex Confidential46

    Optics

    To learn more about choosing the right optics go to

    Cognex.com > Resources > On-Demand Webinars

  • © 2018 Cognex Confidential47

    Filtering techniques

    ▪ Control quality and quantity of

    light

    ▪ Block all unwanted

    ambient lighting

    ▪ Pass only the output of

    lighting used for inspection

    ▪ Increase contrast

    and resolution

    For more on optical filters, go to Cognex.com >

    Resources > On-Demand Webinars

  • © 2018 Cognex Confidential48

    Image pre-processing tools

    To learn more about image pre-processing, go to Cognex.com > Resources > On-Demand Webinars

  • © 2018 Cognex Confidential49

    Summary

    ▪ Make products better, faster, and less expensively

    ▪ Gauging, Inspection, Guidance, and Identification are the key applications

    ▪ Key components are the lens, camera, lighting, vision software and communications

    ▪ Learn more about optics, lighting, filters and image pre-processing to improve system performance

    ▪ Don’t go it alone…get help from experts!

  • © 2018 Cognex Confidential50

    QUESTIONS?

    [email protected] | www.Cognex.com

    mailto:[email protected]