Data types for the Real World ™

Eric TorreborreYOW LambdaJam 2015

Yaron MinskyMake illegal

state unrepresentabl

e!

Make illegal state

unrepresentable!

Make illegal state

unrepresentable!

Make illegal state

unrepresentable!

Real World

?

Constraints

CS

Data

structures

“File line”

Errors

interpret

Errors

Data

structures

Non-empty list

CS

Parser

Real World?

S3 EC2

EMR

sync

sync

sync

storage

execution execution

sync

storage

execution

“Local”

storage

execution

“Local - test”

sync

storage“Hadoop”

execution

sync

storage

execution

“Hadoop - test”

sync

storage

“Hadoop – half sync”

execution

main

Location

Run application

“sync” files

download?where?how?upload?

“sync” files

sync dir valid?

sync

sync

sync

storage

execution execution

Execution location

“sync” directory

unrepre

sentable!

“sync” locations

download?where?

location executionlocal local

hdfs

S3

localhdfs

hdfs localhdfs

Synchronized location

createSynchronizedLocation

9 cases

unrepre

sentable!

synchronize

efficient!

Locations

Location

ExecutionLocation

SynchronizedLocation

Datatypes arecheap!

Make illegal state

unrepresentable!

Make illegal state

unrepresentable!

For the Real World ™