38
THE VIRTUAL FISH PROJECT Summer Update Catherine Harrell | July 2009

Virtual Fish 2009 Research Update

Embed Size (px)

Citation preview

Page 1: Virtual Fish 2009 Research Update

THE VIRTUAL FISH PROJECTSummer Update

Catherine Harrell | July 2009

Page 2: Virtual Fish 2009 Research Update

OVERVIEW

MODEL

ANIMATION

TESTING

INTERACTIVITY

SUGGESTIONS

Page 3: Virtual Fish 2009 Research Update

OVERVIEW

MODEL

ANIMATION

TESTING

INTERACTIVITY

SUGGESTIONS

Page 4: Virtual Fish 2009 Research Update

Pipeline

Goal: Create an animated fish to use in behavioral studies

Model Texture Animation

Game Engine

DisplayInterface

Skeleton

Project the video on a screen in front of the fish. Execute a sequence of

pre-determined behaviors.

Page 5: Virtual Fish 2009 Research Update
Page 6: Virtual Fish 2009 Research Update

OVERVIEW

MODEL

ANIMATION

TESTING

INTERACTIVITY

SUGGESTIONS

Page 7: Virtual Fish 2009 Research Update

Eye

Stripes

Top fin

Opercular fins

Eye bar

Fin spots

Red patches

Yellow belly

Key Characteristics

Page 8: Virtual Fish 2009 Research Update

Model

QuickTime™ and aH.264 decompressor

are needed to see this picture.

Page 9: Virtual Fish 2009 Research Update

OVERVIEW

MODEL

ANIMATION

TESTING

INTERACTIVITY

SUGGESTIONS

Page 10: Virtual Fish 2009 Research Update

Video Sequence

1. HAPLOBLU Video clip

from two years ago

2. SWIM CYCLE Basic clip of a

swimming pattern

3. APPROACH Current model swims closer

Page 11: Virtual Fish 2009 Research Update

Video Sequence

QuickTime™ and aAnimation decompressor

are needed to see this picture.

Page 12: Virtual Fish 2009 Research Update

Video Sequence

1. HAPLOBLU Video clip

from two years ago

2. SWIM CYCLE Basic clip of a

swimming pattern

3. APPROACH Current model swims closer

Page 13: Virtual Fish 2009 Research Update

QuickTime™ and aAnimation decompressor

are needed to see this picture.

Page 14: Virtual Fish 2009 Research Update

Video Sequence

1. HAPLOBLU Video clip

from two years ago

2. SWIM CYCLE Basic clip of a

swimming pattern

3. APPROACH Current model swims closer

Page 15: Virtual Fish 2009 Research Update

Video Sequence

QuickTime™ and aAnimation decompressor

are needed to see this picture.

Page 16: Virtual Fish 2009 Research Update

Video Sequence

1. HAPLOBLU Video clip

from two years ago

2. SWIM CYCLE Basic clip of a

swimming pattern

3. APPROACH Current model swims closer

Page 17: Virtual Fish 2009 Research Update

OVERVIEW

MODEL

ANIMATION

TESTING

INTERACTIVITY

SUGGESTIONS

Page 18: Virtual Fish 2009 Research Update

The Setup

Page 19: Virtual Fish 2009 Research Update

The Setup

Fish compartment

Page 20: Virtual Fish 2009 Research Update

The Setup

Fish compartment

Monitor

Page 21: Virtual Fish 2009 Research Update

The Setup

Fish compartment

Monitor

Camcorder

Page 22: Virtual Fish 2009 Research Update

The Setup

Tank and cameras in the Observation Room downstairs

Page 23: Virtual Fish 2009 Research Update

Testing Cycle

Present model to the fish

Observe reactions

Study strengths and weaknesses,

seek improvements

Generate a new model

Page 24: Virtual Fish 2009 Research Update

OVERVIEW

MODEL

ANIMATION

TESTING

INTERACTIVITY

SUGGESTIONS

Page 25: Virtual Fish 2009 Research Update

Interface Sketch

Page 26: Virtual Fish 2009 Research Update

Interface Sketch

Possible layout for video screen and task bar

Page 27: Virtual Fish 2009 Research Update

Interface Sketch

Add to a list of behaviors

Page 28: Virtual Fish 2009 Research Update

Interface Sketch

Add to a list of behaviors

Page 29: Virtual Fish 2009 Research Update

Interface Sketch

Add to a list of behaviors

Page 30: Virtual Fish 2009 Research Update

Interface Sketch

Save a sequence for later experiments

Page 31: Virtual Fish 2009 Research Update

Interface Sketch

Play through a sequence

Page 32: Virtual Fish 2009 Research Update

Interface Sketch

Play through a sequence

Page 33: Virtual Fish 2009 Research Update

Interface Sketch

Play through a sequence

Page 34: Virtual Fish 2009 Research Update

Behavior List

1. Approach2. Bite3. Chase4. Frontal Threat5. Side threat6. Mouth-to-mouth contact7. Border fight8. Court9. Lead10. Dig11. Spawn12. Chafe13. Sift/Feed14. Flee15. Back down16. Yawn

17. Free swim18. Restless swim19. Still20. Turn left21. Turn right22. Rotate X axis23. Rotate Y axis24. Rotate Z axis25. Pause26. Zoom in• Zoom out• Enter screen• Exit screen• Change color• Toggle eye bar

Page 35: Virtual Fish 2009 Research Update

OVERVIEW

MODEL

ANIMATION

TESTING

INTERACTIVITY

SUGGESTIONS

Page 36: Virtual Fish 2009 Research Update

Things To Work On

Realism of motion (reference footage)

Variety of animated behaviors

Graphic realism (fins and scales)

Making the interactive controls

Page 37: Virtual Fish 2009 Research Update

Suggestions?

What behaviors would you like to see?

What kind of controls would you use?

Would it be helpful to include multiple fish?

How about NT and female fish?

Length of video?

Page 38: Virtual Fish 2009 Research Update

Software Credits

Russ FernaldVictor Hung

Julie Desjardins

Everyone at the Fernald lab!

Autodesk Maya 2009Panda3DQuickTimeKomodo Edit

Photoshop Elements 6EndNote 2.0

Special Thanks