Upload
everardo-reyes-garcia
View
97
Download
3
Tags:
Embed Size (px)
DESCRIPTION
Slides from DataWiz | ACM Hypertext 2014. Santiago de Chile. September 1, 2014. PUC, Campus Casa Central.
Citation preview
Explorations in Media Visualization
Dr. Everardo Reyes-Garcia
Université de Paris 13
!
PUC Santiago de Chile, September 1, 2014.
Datawiz 2014 | Data Visualization Workshop | ACM Hypertext
Part 1.
Brief review of dataviz
visual models
Cartesian
Networks
Infographics
Experimental
180+ links on dataviz | La liste des listes... de graphiques Claude-Henri Meledo, Visual Decision, 2011-2014
http://linkd.in/1lDsVbm
kinds of data
metadata
social records
transactions
preferences
hours
locations
connections
texts
… media
tools & software
D3.js
Two.js
Three.js
Processing.js
CartoDB
Quadrigram
RAW
Tableau
Vega
AntiType
CodeCity
Gephi
http://d3js.org/
http://jonobr1.github.io/two.js/
http://threejs.org/
http://processingjs.org/
http://cartodb.com/
http://www.quadrigram.com/
http://raw.densitydesign.org/
http://www.tableausoftware.com/
http://trifacta.github.io/vega/
http://www.anitype.com/
http://www.inf.usi.ch/phd/wettel/codecity.html
https://gephi.github.io/
Part 2.
Historical Review of Dataviz
graphical representation of movement
Development of Mathematics and Geometry Euclid, The Elements, c. 300 BC
First Representation of Movement Nicolas Oresme, Tractatus de configurationibus qualitatum et motuum, c. 1360
Geometry and Algebra: Cartesian Plane René Descartes, La Géométrie, 1637
capture of movement
Myograph Étienne-Jules Marey, La méthode graphique, 1876
Myograph Étienne-Jules Marey, La méthode graphique, 1876
Sequence of Photographs Eadweard Muybridge, The Horse in motion, 1878
From Image to its Abstraction Étienne-Jules Marey, Movement, 1895
Chronophotograph Étienne-Jules Marey, 1896
Precise Capture of Movement Frank Gilbreth, cyclographs, 1912
models of movement
Sculpture of Seagull in Successive Attitudes Étienne-Jules Marey, 1880
Cyclograph Constructed of Wire Frank Gilbreth, 1912
art and movement
Forms Appear Side by Side or Overlapping Marcel Duchamp, Nu descendant un escalier, 1912
Form of Movement Becomes of an Object of Expression Paul Klee, Blumen Mythos, 1918
Abstraction and Symbolism of Forms Wassily Kandinsky, Composition VIII, 1923
Representación artística de movimiento Joan Miró, Harlequin's Carnival, 1925
Part 3.
Media Visualization
principles & objectives
• an idea originated in 2005
• currently developed by the Software Studies Initiative
• analyzing visual media through visual media
• takes advantage of visual analytics and image processing
techniques to construct visual spaces of the information analyzed
some techniques
Pixelation from the Cover of Nevermind Music Performed by Nirvana. Produced by Butch Vig, 1991
E. Reyes, 2013
Image Averaging of the Video Clip Smells Like Teen Spirit Performed by Nirvana. Directed by S. Bayer, 1991
E. Reyes, 2013
Image Mosaic of the Video Clip Smells Like Teen Spirit Performed by Nirvana. Directed by S. Bayer, 1991
E. Reyes, 2013
Several Image Slicing Visualizations Music Performed by Nirvana. Directors: S. Bayer and K. Kerslake, 1991-1992
E. Reyes, 2013
Image Plot of the 2000 Rock Albums Data from AllMusic.com, E. Reyes, 2013
Interactive Explorations Hybrid Media Visualization, E. Reyes, 2013
Interactive Explorations Software Studies Initiative, 2014
related work
• Pixelation: Pixel art, Goldberg and Flegal, 1982
• Averaging: Eigenfaces, Sirovich and Kirby, 1987
• Slicing: Slit-scan photographs, William Larson, 1967- 1970
• Slicing: Cinema Redux, Brendan Dawes, 2004
tools & software
• plotting and measuring: scripts for ImageJ
• plotting: scripts for MathLab
• analyzing: VisualSense
• analyzing: QtImageProcessing
• data handling: Mondrian (statistical operations)
• data handling and management: OpenRefine
• representation: custom tools with development tools
(Processing, Max/MSP, NodeBox, etc.)
Part 4.
Explorations in Media Visualization
see how other domains use images
Video segmentation Video Object Segmentation with Shortest Path
Zhang, Zao & Cao, 2012
Video traces Sequence from 2001: A Space Odyssey (Kubrick, 1968)
MovieBarCode
Video summarization Video summarization using singular value decomposition
Gong & Liu, 2000
Video annotation Software application Lignes de Temps
IRI Centre Pompidou, Paris, 2009
Video cubes Fels & Mase, 1999
3D visualization & models
The RGB Color Space Image from Wikipedia
Simulation of the Rayleigh-Taylor instability Lawrence Livermore National Laboratory, 2007
Webforager Stuart Card et al, 1996
3D Hyperbolic Tree Tamara Munzner, 1997
XanaduSpace Ted Nelson, 2005
OntoSphere3D Alesio Bosca, 2008
The Lava Visualization Tool Stéfan Sinclair, 2010
http://voyeurtools.org/tool/Lava/
The invisible shape of things past Art+Com, 1997
Field-Works Masaki Fujihata, 2000
Post Mémoires Fred Murie, 2011
http://www.fredmurie.net/travaux/2011/post-memoires1/face/
CLOUDS James George & Jonathan Minard, 2012-2013
motion structures
VFX in the Film Inception (Nolan, 2010) E. Reyes, 2011
Game of Thrones (Benioff & Weiss, 2011-2014) E. Reyes, 2011
Game of Thrones (Benioff & Weiss, 2011-2014) E. Reyes, 2011
Game of Thrones (Benioff & Weiss, 2011-2014) E. Reyes, 2011
Charles Csuri, Hummingbird, 1967 E. Reyes, 2011
Charles Csuri, Hummingbird, 1967 E. Reyes, 2011
Peter Weibel, Endless Sandwich, 1969 E. Reyes, 2011
Bill Viola, Acceptance, 2008 E. Reyes, 2011
Game of Thrones (Benioff & Weiss, 2011-2014) E. Reyes, 2011
3D Print of Motion Structure E. Reyes, 2011
disruptions
Disrupting 3D Models E. Reyes, 2013
handmade & analog
Decomposing Parts. Exploded Views and Visual Ontography Damián Ortega, Cosmic Thing, 2002
Hand-drawn Architectural Structures François Blanciak, Siteless, 2008
Printed Text. Cut and Pasted According to Words Ruecker et al, 2008
4D & non-euclidean geometry
Elliptic and Hyperbolic Geometry
Kinetic Geometry (Hyperboloids of 2 and 1 Faces)
Polytopes, polyhedra, polychorons, tesselations
Manifolds
Rotation in 4D and Sphere Eversion
examples from art
Construction de l’espace-temps III Theo van Doesburg, 1929
Composición Cósmica Oscar Domínguez, 1938
Relativity M.C. Escher, 1953
L'étang de No Matta Echaurren, 1958
Museo Soumaya, México DF Fernando Romero, 2011
examples of experimental projects
Messages vers le Futur E. Reyes, 2012
Experimental Media Visualizations E. Reyes, 2014
Miegakure Marc Ten Bosch, 2014
Let’s imagine Miegakure + Oculus Rift.
Virtual Worlds allow to rethink, disrupt and experiment
the representation of reality as it has been perceived
by our senses so far
Conclusions
• close relationship between art, science and technology in
the evolution of data representation in graphical forms
!
• are we more interested in developing workflows rather than
new inventions, as it happened in early 20th Century?
!
• are we becoming more interested in representing space
rather than time?