Section 4- Project Discussion

CS231ASection:CourseProjectOutline

AmirSadeghianJanuary2018

1Amir Sadeghian

Section 4- Project Discussion

Overview

• ProjectLogistics• TypesofProjects• ClassCoverageandIdeas• WheretoGetProjects• HelpfulResources

Amir Sadeghian 2

Section 4- Project Discussion

ProjectLogistics

• Teamsof1-3:Numberofpeopleistakenintoaccountwhengradingproject

• Moremembersà Morework

• Suggestionsforprojectdirection• Replicate aninteresting paper• Comparedifferentmethods toabenchmark• Useanewapproachtoanexisting problem• Implement aninteresting system• Originalresearch

Amir Sadeghian 3

Section 4- Project Discussion

SharingaProjectwithAnotherClass

• Sharingprojectsisgenerallyallowed• Specifyinreports• Mustbeapprovedbybothourstaffandtheothercoursestaff• Projectmustbeprofoundenoughthatyoucanclarifywhichpartsoftheprojectweredoneforwhichclass

• Eachpartmustbesubstantial enoughtoholdasasingleproject• Technical partsandexperiments shouldsufficient anddifferent• IfusingCNNforflowerclassification includesome othercomponents relatedtothiscourse(e.g.geometry,…)

• Willneedaseparatewrite-upforeachclass

Amir Sadeghian 4

Section 4- Project Discussion

ProjectGrading- ImportantDates

• Courseproject:38%• Projectproposal1%(dueFeb1)• Midtermmilestone 5%(dueFeb26)• Presentation 7%(willbeheldonMarch19and21)• Finalreport25%(due March22,11:59pm)

Amir Sadeghian 5

Section 4- Project Discussion

ProjectProposal

• Maximumof2pages• SubmitthereportasaPDFdocumentthroughGradescope• Includethefollowing:

• Title andauthors• Sec.Introduction:Problemyouwanttosolveandwhy• Sec.Technical Approach:Howdoyouproposetosolveit?• Sec.Milestones (datesandsub-goals)• References

• Youwillbeassignedaprojectmentor

Amir Sadeghian 6

Section 4- Project Discussion

ProjectMilestoneReport

• Maximumof4pages• SubmitthereportasaPDFdocumentthroughGradescope• Includethefollowing:

• Title andauthors• Sec.Introduction:Problemyouwanttosolveandwhy• Sec.Technical Approach:Howdoyouproposetosolveit?• Sec.Milestones achievedsofar• Sec.RemainingMilestones (datesandsub-goals)• References

Amir Sadeghian 7

Section 4- Project Discussion

ProjectPresentations

• ShortpresentationwithtimeforabriefQ&A• Includethefollowing:

• ProblemMotivation/Description• Technical Approach• Results• Maybedemo(+)!

Amir Sadeghian 8

Section 4- Project Discussion

ProjectFinalReport

• Maximumof10pages• SubmitthereportasaPDFdocumentthroughGradescope• EmailyourcodetoTBA.• Includethefollowing:

• Title andauthors• Abstract• Sec.Introduction• Sec.Previouswork• Sec.Technical Approach• Sec.Experiments• Sec.Conclusions• References

Amir Sadeghian 9

Section 4- Project Discussion

ClassCoverage:Geometry,Recognition

• Cameramodelsandcalibration• Singlecameraandhowwemodel it

• Singleviewmetrology• Estimating geometryfromasingle view

• Epipolar Geometry(StereoVision)• Estimating geometryfromtwoviewpoints

• StructurefromMotion• Usingmotion/several viewpoints toestimate structure

• VolumetricStereo• Usingmultiple viewstomap3Dpoints

Amir Sadeghian 10

Section 4- Project Discussion

ViewMorphing

Amir Sadeghian 11

S. M. Seitz and C. R. Dyer, Proc. SIGGRAPH 96, 1996, 21-30

Image morphing techniques can generate compelling 2D transitions between images.

Section 4- Project Discussion

ViewMorphing

Amir Sadeghian 12

Section 4- Project Discussion

AutomaticPhotoPop-Up

Amir Sadeghian 13

A fully automatic method for creating a 3D model from a single photograph

Hoiem, D., Efros, A. A., and Herbert, M, “Automatic Photo Pop-Up”, SIGGRAPH 2005.

Section 4- Project Discussion

PhotoTourism

Amir Sadeghian 14

Snavely, N., Seitz, S. M., Szeliski, R. “Photo Tourism: Exploring Photo Collections in 3D”, SIGGRAPH 2006.

Browsing and exploring large unstructured collections of photographs of a scene using a novel 3D interface

Section 4- Project Discussion

NovelHardware

Amir Sadeghian 15

Section 4- Project Discussion

MobileDevices

Amir Sadeghian 16

Can you take an existing vision algorithm and adapt it to a mobile device to make it more useful?

Section 4- Project Discussion

CourseCoverage:Geometry,Recognition

• Fittingandmatching• Detectorsanddescriptors• Objectclassification• 2D/3Dobjectdetection• 2D/3Dsceneunderstanding

Amir Sadeghian 17

Section 4- Project Discussion

RecognizingPanoramas

Amir Sadeghian 18

Brown, M. and Lowe, D. G., “Recognizing Panoramas”, ICCV 2003.

Section 4- Project Discussion

ImageSegmentation

Amir Sadeghian 19

Partition an image into multiple segments (sets of pixels) in order to make it easier to analyze

Section 4- Project Discussion

ImageCompletion

Amir Sadeghian 20

Hays, J and Efros, A. A., “Scene Completion Using Millions of Photographs”, SIGGRAPH 2007.

Section 4- Project Discussion

2D/3DObjectRecognition

Amir Sadeghian 21

Or a 3D point cloud?

Can you recognize an object in a 2D image?

Section 4- Project Discussion

Tracking

Amir Sadeghian 22

Section 4- Project Discussion

FaceDetection– FaceIdentification

Amir Sadeghian 23

Section 4- Project Discussion

OtherTopics

• PoseEstimation:Estimatetheskeletonanglesforapersonfromanimage/video

• ActionandGestureRecognition: Isapersonstanding,walking,orsittinginanimage/video? Ishe/shewaving?

• SceneUnderstanding:Canyouclassifyascene?Canyourecognizeand/orsegmenteachcomponentofthescene?

• TrajectoryForecasting• ...

Amir Sadeghian 24

Section 4- Project Discussion

Negativeprojectexamples

• Projectswithoutcomponentsrelatedtothecourse• ApplyingAlexnet forimageclassification• FindingandrunninganexistingGithub code• OnlyrunningOpenCV librariesforatask• …

Amir Sadeghian 25

Section 4- Project Discussion

WheretogetProjectIdeas

• CourseStaff:Officehours,alsopostedonwebsite• Computervisionpapersandconferences

• CVPR• ICCV• ECCV

• ComputervisionresearchgroupsatStanford• SilvioSavarese• Fei-FeiLi• JuanCarlosNiebles

• Lastyear’sprojects:Seecoursewebsite• Comeupwithyourown!

Amir Sadeghian 26

Section 4- Project Discussion

Datasets

• Manyareavailableontheweb• Seethefollowingaggregators:

• CVDatasetsontheWeb• YetAnotherComputerVision IndexToDatasets(YACVID)

• Referencesfoundinpapers• CourseCA’s

Amir Sadeghian 27

Section 4- Project Discussion

ProjectAdvice

• Chooseyourteamwell• Makesurethescopeofyourprojectfitsaquarter

• Setaminimumgoal,desired goal,andamoonshot

• Constrainyourproblemsmartly• Seewhatdatasetsareavailableifyouaredoingarecognitionproject

• Speciallyfordeep learningprojects

• Youmayneedtoplanahead/learnoutsidematerials• Usesoftwarewhenavailable

• OpenCV,MATLAB,Deep learningframeworks

• Comeaskquestions– We’rehappytotalk!

Amir Sadeghian 28

Section 4- Project Discussion

AnyQuestions?

29Amir Sadeghian