1
Communication System for Defending against Attacks of Media Clones Channel Protection Shield (Media recognition and understanding) Physical / Cyber Fake Information Sender Media generation Eve (Malice) Media Clone Authentic Media Bio/Privacy Information Appearance (Figure, Face) Behavioral Feature (Gesture, Gait) Physical Feature (Voice, Fingerprint, Iris) Internal Aspect (Interest, Tendency) Environmental Information Bob Real world/society Signal from humans Signal from sensors Signal from social media Real world/society Signal from humans Signal from sensors Signal from social media Interprete and Learn × Multimedia data (2D/3D image, video, sound, and text) Receiver Multimedia data (2D/3D image, video, sound, and text) Privacy protection Communication Model Alice Video 1 Video 2 Video n Action videos on the web (annotated by text-tags) Action model Motion prediction Input video “golf swing” Action recognition Noboru Babaguchi, Professor (E-mail: [email protected]Naoko Nitta, Associate Professor (E-mail: [email protected]) Kazuaki Nakamura, Assistant Professor (E-mail: [email protected]) Seiko Myojin, Specially Appointed Researcher (E-mail: [email protected]) Real-world Sensing via Microblogs Car accident near Shutoko Shibuya Huge traffic jam on Shutoko 2 work Microblogs Post real-world observations Post Location Estimation Related Posts Extraction Monitor the real-world by using posts to microblogs from millions of people around the world Action Recognition and Understanding Extract a set of frames containing a common action Media Integrated Communication Area (Babaguchi Laboratory) Department of Information and Communications Technology, Division of Electrical, Electronic and Information Engineering, Graduate School of Engineering Staff The keyword for our laboratory is Multimedia. We are mainly working on the development of a communication system for defending against attacks of media clones, whose fundamental technologies are recognition, understanding, and generation of multimedia content and privacy protection.

Media Integrated Communication Area (Babaguchi Laboratory

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Media Integrated Communication Area (Babaguchi Laboratory

Communication System for Defending against Attacks of Media Clones

Channel

Protection Shield(Media recognition

and understanding)

Physical / C

yber

Fake Information

Sender

Mediageneration

Eve(Malice)

MediaClone

Authentic Media

Bio/Privacy Information

Appearance (Figure, Face)

Behavioral Feature(Gesture, Gait)

Physical Feature(Voice, Fingerprint, Iris)

Internal Aspect(Interest, Tendency)

Environmental Information Bob

Real world/society

Signal from humans

Signal from sensors

Signal fromsocial media

Real world/society

Signal from humans

Signal from sensors

Signal fromsocial media

Interpreteand Learn

×

Multimedia data(2D/3D image, video,sound, and text)

Receiver

Multimedia data(2D/3D image,video, sound,and text)

Privacyprotection

Communication Model

Alice

Video 1

Video 2

Video n

Action videos on the web (annotated by text-tags)

Actionmodel

Motionprediction

Input video

“golf swing”Actionrecognition

Noboru Babaguchi, Professor (E-mail: [email protected]

Naoko Nitta, Associate Professor (E-mail: [email protected])Kazuaki Nakamura, Assistant Professor (E-mail: [email protected])Seiko Myojin, Specially Appointed Researcher (E-mail: [email protected])

Real-world Sensing via Microblogs

Car accident

near Shutoko ShibuyaHuge traffic jam

on Shutoko 2 work

Microblogs

Post real-worldobservations

Post Location Estimation

Related Posts Extraction

Monitor the real-world

by using posts to microblogs

from millions of people

around the world

Action Recognition and Understanding

Extract a setof framescontaining acommon action

Media Integrated Communication Area (Babaguchi Laboratory)Department of Information and Communications Technology,

Division of Electrical, Electronic and Information Engineering, Graduate School of Engineering

Staff

The keyword for our laboratory is Multimedia. We are mainly working on the development of a communication system for defending against attacks

of media clones, whose fundamental technologies are recognition, understanding, and generation of multimedia content and privacy protection.