TOWARDS AN EFFICIENT DISTRIBUTED OBJECT RECOGNITION SYSTEM

  • Upload
    amritj

  • View
    217

  • Download
    0

Embed Size (px)

Citation preview

  • 8/7/2019 TOWARDS AN EFFICIENT DISTRIBUTED OBJECT RECOGNITION SYSTEM

    1/15

    TOWARDS AN EFFICIENTTOWARDS AN EFFICIENT

    DISTRIBUTED OBJECTDISTRIBUTED OBJECTRECOGNITION SYSTEM INRECOGNITION SYSTEM IN

    WIRELESS SMART CAMERAWIRELESS SMART CAMERA

    NETWORKSNETWORKS

    Nikhil Naikal, Allen Y. Yang, and S. Shankar SastryNikhil Naikal, Allen Y. Yang, and S. Shankar Sastry

    Department of EECS, University of California, Berkeley, CADepartment of EECS, University of California, Berkeley, CA

    AMRIT JAISWAL

    706/IT/071

  • 8/7/2019 TOWARDS AN EFFICIENT DISTRIBUTED OBJECT RECOGNITION SYSTEM

    2/15

    INTRODUCTIONINTRODUCTION

    y Distributed object recognition is a fast-growing research topic mainly motivatedby portable camera devices and their

    integration with modern wireless sensornetwork technologies

    y It can be summarised in 3 related areas:

    1. Development of smart camera platform.

    2. Extraction of dominant image features.

    3. Correspondence and compression ofimage features extracted.

    2

  • 8/7/2019 TOWARDS AN EFFICIENT DISTRIBUTED OBJECT RECOGNITION SYSTEM

    3/15

    PROPOSED WORKPROPOSED WORK

    y The paper proposes an efficient

    distributed object recognition system for

    recognition of 3-D objects using a

    network of wireless smart cameras.

    y If a common object is observed by

    multiple cameras from different vantage

    points, the corresponding features can beefficiently retrieved.

    3

  • 8/7/2019 TOWARDS AN EFFICIENT DISTRIBUTED OBJECT RECOGNITION SYSTEM

    4/15

    y For this purpose the authors have

    proposed and formulated:1. Berkeley Multi-view wireless database.

    2. Joint Sparsity Model.

    Distributed Encoding of JS signals. Decoding of Sparse signals.

    3. Multiple view Object recognition using a

    hierarchical Vocabulary Tree.

    4. Experiment and results.

    4

  • 8/7/2019 TOWARDS AN EFFICIENT DISTRIBUTED OBJECT RECOGNITION SYSTEM

    5/15

    BERKELEY MULTIBERKELEY MULTI--VIEWVIEW

    WI

    RELESS DATABASE.WI

    RELESS DATABASE.

    y The BMW database consists of multiple-

    view images of 20 landmark buildings on

    where 16 different vantage points have

    been selected to measure the 3-D

    appearance of the building.

    y Its purpose is to aid peer evaluation ofdistributed object recognition methods

    for the wireless surveillance scenario.

    5

  • 8/7/2019 TOWARDS AN EFFICIENT DISTRIBUTED OBJECT RECOGNITION SYSTEM

    6/15

    y The database provides a two-tier multiple-

    view relationship to systematicallybenchmark the performance of multiple-view object recognition algorithms asshown in figure (a) and(b).

    6

  • 8/7/2019 TOWARDS AN EFFICIENT DISTRIBUTED OBJECT RECOGNITION SYSTEM

    7/15

    JOINT SPARSITY MODELJOINT SPARSITY MODEL

    y The flowchart for the JS Model used for

    object recognition is shown below:

    7

  • 8/7/2019 TOWARDS AN EFFICIENT DISTRIBUTED OBJECT RECOGNITION SYSTEM

    8/15

    Multiple view Object recognitionMultiple view Object recognition

    using a hierarchical Vocabulary Tree.using a hierarchical Vocabulary Tree.y The authors have proposed an efficient

    multiple-view object recognition

    algorithm that takes multiple-view

    features as the input, and outputs a labelas the classification of the object in 3-D.

    y The joint classification algorithm is

    employed to recover a label of the objectthat minimizes the multiple-view

    relevance score i.e., relates it to the

    closest match in the vocabulary tree of

    the training set . 8

  • 8/7/2019 TOWARDS AN EFFICIENT DISTRIBUTED OBJECT RECOGNITION SYSTEM

    9/15

    EXPERIMENT AND RESULTSEXPERIMENT AND RESULTS

    y Based on the BMW database, the authorscompare how discriminative three existing robustfeature descriptors are in representing the imageappearance of objects, namely SIFT [1], SURF [2],

    and CHOG [3] on two testing scenarios :1. Small-baseline scenario.

    2. Large-baseline scenario.

    [1] SIFT :Object recognition from local scale-invariant features.

    [2] SURF: Speededup robust features.

    [3]CHOG: Compressed histogramofgradients a low bit-ratefeature descriptor.

    9

  • 8/7/2019 TOWARDS AN EFFICIENT DISTRIBUTED OBJECT RECOGNITION SYSTEM

    10/15

    SMALLSMALL--BASELINE SCENARIOBASELINE SCENARIO

    Overall, CHOG features yield the bestrecognition rates compared to the other twofeature descriptors. The authors find this totheir benefit, as CHOG features have beendesigned for distributed wireless camera

    application. 10

  • 8/7/2019 TOWARDS AN EFFICIENT DISTRIBUTED OBJECT RECOGNITION SYSTEM

    11/15

    y We observe that, with small projection dimensionsclose to 1000, the recognition rates using two or

    three cameras improves significantly compared to thesingle-view recognition rates.

    y It is also important to note that the improvedrecognition rates using the multiple-view informationare also higher than merely increasing the projectiondimension in the single-camera scenario.

    11

  • 8/7/2019 TOWARDS AN EFFICIENT DISTRIBUTED OBJECT RECOGNITION SYSTEM

    12/15

    LARGELARGE--BASELINE SCENARIOBASELINE SCENARIO

    y The result demonstrates that multiple large-

    baseline images contain much more informationabout a common object in 3-D than a set ofsmall-baseline images.

    y Specifically, there is about 10% improvement in

    the recognition rates in the 3-camera case. 12

  • 8/7/2019 TOWARDS AN EFFICIENT DISTRIBUTED OBJECT RECOGNITION SYSTEM

    13/15

    y As shown in the plot, the recognition rates at the lowprojection dimension of 1000 are lower than those of the

    small-baseline scenario for the 2 and 3-cam cases.y However, as the projection dimension increases, the multiple-

    view recognition rates reach about 95% and begin to plateau.Such rates are never achieved even without randomprojection in the single view case.

    13

  • 8/7/2019 TOWARDS AN EFFICIENT DISTRIBUTED OBJECT RECOGNITION SYSTEM

    14/15

    CONCLUSION ANDCONCLUSION AND

    F

    UTURE WORKF

    UTURE WORKy The authors have presented a framework tojointly classify objects observed from multiplevantage points in a distributed wireless cameranetwork where the multiple-view information of

    the object is available to boost the globalrecognition.

    y The best recognition rate based on the images of

    the 20 landmarks is about 95%. To successfullydeploy such systems in real-world surveillanceapplications, the recognition rates have to beimproved dramatically (e.g., > 99%).

    14

  • 8/7/2019 TOWARDS AN EFFICIENT DISTRIBUTED OBJECT RECOGNITION SYSTEM

    15/15

    THANK YOU

    15