Embed Size (px)
Citation preview
Music to computersBrian Whitman
(MIT Media Lab)
1. Be patient.
2. Listen to the computer.
3. Synthesis is fast composition.
4. Don’t tell it anything you don’t already know.
5. It won’t work. (5a. Don’t give up.)
6. Why are you doing it?
7. Don’t tell anyone how it works.
1. Be patient.
“Chiclet” (2002-)Bordeaux, Recht, Vawter, Whitman
Eigeneverything (2004)
17cm
“Concrete Music” (2003)Vida 6.0, ARCO
Bordeaux, Recht, Vawter, Whitman
1 2 3 4
5 6 7 8 9 10 11
12 13 14 17 18
19 20 21 22 23 24 25
26 27 28 29 30 31
S M T W R F S
BASE NOTELENGTH
+,- 850t
15
THURSDAY
WEDNESDAY
BASE Hz-1/2 step
APRIL 2004
MARCH 2004sin0
sin1
sin2
sin3
sin4
tri0
tri1
lfsin0
lfsin1
noise0
noise1
imp0
imp1
imp2
ks0
ks1 ks2
LFOmod3,16Hz
frequency
LFO78Hz
s0 s1
INITIAL CONDITIONS
phase
+,-3ms
duration
1 HOUR8 MINUTES
REMIXER
note+,-25t
>>seq
THIRTY YEARS
Concrete Music
{2187 DSP, 1885 codec, circuit, cement mixture}
Ethan Bordeaux, Ben Recht, Noah Vawter, Brian Whitman
October 2003.
t1/48000s
2. Listen to the computer.
Vawter 2003
Rotsynth (Bordeaux 2003)
Rotating fishtank
3. Synthesis is fast composition.
Eigenradio (2003)
“I hate it when artists try to be scientists”
Radio
station
Radio
station Radio
station
Radio
station
.
.
...
s1
s2
...
.
.
...
PCA
f W
fw
... ...
t2 f
t1 f
M
... ...
t2 W
t1 W
O
ACB
tn W
b
DTW
... ...
tn W
tn W
N
NMF
tn V
tw
V W
e
V f
s
Frequency-domain Reduced-rank STFT Generalized audioPCA (freq) PCA (time)
4. Don’t tell it anything you don’t already know.
Music Acquisition (2001-)
ThoughtTreasure (Mueller)
Short term music model: auditory scene to events
Structural music model: recurring patterns in music streams
Language of music: relating artists to descriptions (cultural representation)
Music acceptance models: path of music through social network
Grounding sound, “what does loud mean?”
Semantics of music: “what does rock mean?”
What makes a song popular?
Semantic synthesis
Community Metadata (Whitman / Lawrence 2002)
Good terms Bad terms
Electronic 33% Annoying 0%
Digital 29% Dangerous 0%
Gloomy 29% Fictional 0%
Unplugged 30% Magnetic 0%
Acoustic 23% Pretentious 1%
Dark 17% Gator 0%
Female 32% Breaky 0%
Romantic 23% Sexy 1%
Vocal 18% Wicked 0%
Happy 13% Lyrical 0%
Classical 27% Worldwide 2%
Baseline = 0.14%
Query by description(2002-)
Review Regression (2004)
5. It won’t work.
(5a. Don’t give up.)
They get stuck.
epoch1 epoch2 epoch3 epoch4
pca fitness
Our Automatic Madonna (2004)
all possible Soundsis currently cataloging 198048 sounds / 109.14 gigabytes / 9.27 days. log out
Go to search mode instead.
Back up to browse.
DANZON 128 DEJA VU 58 DEJA VU 80
DRUM COMB. 4 DANCE KIT 03 DANCE KIT 04
DRUM COMB. 5 DRUMULATOR DANCE KIT 05
DYNA.KIT #06 DANCE KIT 06 DANCE KIT 07
DANCE CLAVI DANCE KIT 08 DANCE KIT 09
DANCE DANCE DRUM FILLS DYNA.KIT #07
DDD1 KIT 1 DDD1 KIT 2 DDD1 KIT 3
DR550 #1 DR550 #2 DYNA.KIT #08
DR550 #3 DR550 #4 DR550 #5
DR550 PERCS DYNA.KIT #09 DS BELLS
DR110A DS+RAMA DR220A
DR-55 A DR-55 B DDR-30 A
DDR-30 B DDR-30 C DR.BOHM DRUM
DYNA.KIT #01 DANCE KIT 02 DYNA.KIT #02
DRY KIT #01 DRY KIT #02 DRY KIT #03
DRY KIT #04 DRY KIT #05 DRY KIT #06
DRY KIT #07 DYNA.KIT #03 DRY KIT #08
DRY KIT #09 DEEP 1 DRY KIT #11
DRY KIT #12 DRY KIT #13 DRY KIT #14
DEEP 2 DRY KIT #15 DRY KIT #16
DRY KIT #17 DRY KIT #18 DRY KIT #21
DRY KIT #22 DRY KIT #23 DRY KIT #24
DRY KIT #25 DRY KIT #26 DULL- DRY
DRY KIT #31 DRY KIT #32 DRY KIT #33
DRY KIT #34 DRY KIT #35 DRY KIT #41
DRY KIT #42 DRY KIT #43 DRY KIT #44
DRY KIT #51 DRY KIT #52 DRY KIT #53
DRY KIT #54 DRY KIT #55 DRY KIT #61
DRY KIT #62 DRY KIT #63 DANCE KIT 31
DRY KIT #64 DRY KIT #65 DANCE KIT 32
DYNA.KIT #04 DANCE KIT 33 DONKAMA #1
DONKAMA #2 DANCE KIT 34 DANCE KIT 35
DANCE KIT 36 D110 KIT #1 DANCE KIT 37
D110 KIT #2 D110 KIT #3 DANCE KIT 38
D110 KIT #4 D110 KIT #5 DANCE KIT 39
D110 KIT #6 D70 KIT 01 DANCE KIT 40
D70 KIT 02 D70 KIT 03 DANCE KIT 41
D70 KIT 04 D70 KIT 05 DANCE KIT 42
D70 KIT 06 D70 KIT 07 DANCE KIT 43
D70 KIT 08 DANCE FX DRUM COMB. 1
DYNA.KIT #05 DRUM COMB. 2 DANCE PERC A
DANCE PERC B DANCE PERC C DANCE PERC D
D-P-A H D-P-B H D-P-C H
D-P-D H D-P-A E D-P-B E
D-P-C E D-P-D E D-P-LAYER
D-P-LAYER C D-P-LAYER E DRUM COMB. 3
DANCE KIT 01 DONNA DO MELO
DISCOL.A 100 DISCOL.F#140 DISCOL.A 140
DISCOL.G 100 DISCOL.G 120 DISCOL.G 140
DISCOL.G#140 DISCOL.G#120 DISCOL.G#100
DISCOL.A 120 DYNA TOMS DYN RIDE 2
DYN RIDE 1 DYN CRASH 1 DYN OH 1
DYN HH 1 DYN RIM 2 DYN RIM 1
DYNA KIT 1 DYNA 1 HH DYNA KIT 2
DYNA 2 HH DYNA KIT 3 DYNA SD 4
DYNA 3 HH DYNA SD 3 DYNA SD 2
DYNA SD 1 DYNA BD 1 DYNA BD 2
DANCE KIT1 DANCE KIT2 DANCE KIT3
DANCE KIT4 DANCE KIT5 DANCE KIT6
DANCE KIT7 DANCE KIT8 DANCE KIT9
DISCO KIT3 DISCO KIT16 DISCO KIT15
DISCO KIT14 DISCO KIT13 DISCO KIT12
DISCO KIT11 DISCO KIT10 DISCO KIT9
DISCO KIT8 DISCO KIT7 DISCO KIT6
DISCO KIT1 DISCO KIT5 DISCO KIT2
DISCO KIT4 DJEMBE MENU DJEMBE VEL
DJEMBE CRM DJEMBE TND DUNBEK MENU
DUNBEK VEL DUNBEK CRM DUNBEK CERAM
DUNBEK TND DAGBAR DIST GTR BLU
DIGI LOG 1A DIGI LOG 1B DIGI.LOG 2
DIST GTR FX DIST GTR WMY DIST PWR CHD
DIST.PWR CHD DIST PWR CH2 DIST.PWR CH2
D MUTE CLS1A D MUTE CLS1B D MUTE CLS1C
D MUTE OPN1A D MUTE OPN1B D MUTE OPN1C
D MUTE SGL1A D MUTE SGL1B DIGITAL EP 1
D MUTE SGL1C DIGITAL EP 2 DEEP UAE 2
DEEP UAE 1 DEEP HMM DEEP SHOUTS
DELTA LD05L DELTA LD05M DELTA LD05S
6. Why are you doing it?
“Fish / Cut bait”
Handheld-music (1998-2001)
CAMUS uses both cellular automata in parallel to produce music.
Humdrum (Huron 1999)
SQ80 OS CGI (Buchty 2000)
7. Don’t tell anyone how it works.
STRANGER RECOMMENDATION
Forever Sadness (2004)
CommunitySADNESSmodel
100 200 300 400 500 600 700 800 900
2
4
6
100 200 300 400 500 600 700 800 900
2
4
6
100 200 300 400 500 600 700 800 900
2
4
6
100 200 300 400 500 600 700 800 900
2
4
6
100 200 300 400 500 600 700 800 900
2
4
6
Frames
100 200 300 400 500 600 700 800 900
2
4
6
1
3 4
5
6
2
Help & Thanks: Kelly Dobson, Dan Ellis, Noah Vawter, Ethan Bordeaux, Ben Recht, Kurt Ralske,
Doug Repetto, Adam Berenzweig, Claire Montgomery
