83
The Soul in The Machine - Developing for Humans Chris Heilmann @codepo8, Confoo, Montréal - February 2017

The Soul in The Machine - Developing for Humans

Embed Size (px)

Citation preview

Page 1: The Soul in The Machine - Developing for Humans

The Soul in The Machine - Developing for Humans

Chris Heilmann @codepo8, Confoo, Montréal - February 2017

Page 2: The Soul in The Machine - Developing for Humans

CHRIS HEILMANN @CODEPO8

HTTPS://CHRISTIANHEILMANN.COM

Page 3: The Soul in The Machine - Developing for Humans

Today, I want us to think a bit about what we are doing as developers. 🤔

Page 4: The Soul in The Machine - Developing for Humans

Because, I think we’re wasting a lot of energy on the wrong things…🔋

Page 5: The Soul in The Machine - Developing for Humans

I remember when writing code for the web was mostly about building interfaces for humans and making sure they work.🤹

Page 6: The Soul in The Machine - Developing for Humans

But with better computers, less confusing browsers and fast connections we lost that focus.🚀

Page 7: The Soul in The Machine - Developing for Humans

And this is dangerous and not helpful.🌵

Page 8: The Soul in The Machine - Developing for Humans

We have become disconnected from our users.✂

Page 9: The Soul in The Machine - Developing for Humans

Our computers work, our connections are great, we’re always up-to-date and often ahead of the curve.🏁

Page 10: The Soul in The Machine - Developing for Humans

So we’ve become introspective. Most of the headlines we read and get excited about are about improving our tools.🛠

Page 11: The Soul in The Machine - Developing for Humans

We seem to be at a break-neck pace to empower ourselves to create more in a shorter amount of time.⏳

Page 12: The Soul in The Machine - Developing for Humans

Creating more in a shorter amount of time always comes with some cost.🗑

Page 13: The Soul in The Machine - Developing for Humans

We create for the sake of creation and to cater to a culture of perpetual growth…🎰

Page 14: The Soul in The Machine - Developing for Humans

Where are we going with this?🤔

Page 15: The Soul in The Machine - Developing for Humans

For now, we’re good. Our jobs are safe, we have more freedom than we know what to do with and we work in the world others are scared of.😎

Page 16: The Soul in The Machine - Developing for Humans

Have we created machines that are too clever?

Page 17: The Soul in The Machine - Developing for Humans

I do not fear computers. I fear the lack of them.

— Isaac Asimov

http://www.zmescience.com/other/economics/china-factory-robots-03022017/

Page 18: The Soul in The Machine - Developing for Humans

https://www.bloomberg.com/news/articles/2017-02-28/jpmorgan-marshals-an-army-of-developers-to-automate-high-finance

Page 19: The Soul in The Machine - Developing for Humans

http://www.bbc.com/news/technology-34066941http://www.oxfordmartin.ox.ac.uk/downloads/academic/The_Future_of_Employment.pdf

The robot takeover

Page 20: The Soul in The Machine - Developing for Humans

http://www.bbc.com/news/technology-34066941http://www.oxfordmartin.ox.ac.uk/downloads/academic/The_Future_of_Employment.pdf

The robot takeover

Page 21: The Soul in The Machine - Developing for Humans

http://www.bbc.com/news/technology-34066941http://www.oxfordmartin.ox.ac.uk/downloads/academic/The_Future_of_Employment.pdf

The robot takeover

Page 22: The Soul in The Machine - Developing for Humans

http://www.bbc.com/news/technology-34066941http://www.oxfordmartin.ox.ac.uk/downloads/academic/The_Future_of_Employment.pdf

The robot takeover

Page 23: The Soul in The Machine - Developing for Humans

http://www.bbc.com/news/technology-34066941http://www.oxfordmartin.ox.ac.uk/downloads/academic/The_Future_of_Employment.pdf

How safe is my job?

Abstract thinking

Working with humans

Images

Words

Numbers

Routine Variety

You’re out

Get nervous

You’re OK

Page 24: The Soul in The Machine - Developing for Humans

This also applies to us, as the more predictable we get, the easier it is to replace us.

Page 25: The Soul in The Machine - Developing for Humans

https://www.technologyreview.com/s/603381/ai-software-learns-to-make-ai-software/

Page 26: The Soul in The Machine - Developing for Humans

http://www.wired.co.uk/article/ai-write-code-microsoft

Page 27: The Soul in The Machine - Developing for Humans

https://openreview.net/pdf?id=ByldLrqlx

Page 28: The Soul in The Machine - Developing for Humans

We’re in a post-production world. We use other people’s products instead of writing new code from scratch…

Page 29: The Soul in The Machine - Developing for Humans

Which is totally fine. Boring, repetitive and tedious work is where computers excel and humans make mistakes.

Page 30: The Soul in The Machine - Developing for Humans

So here’s what I think we should be considering…🤔

Page 31: The Soul in The Machine - Developing for Humans

The saddest aspect of life right now is that science gathers knowledge faster than society gathers wisdom.

— Isaac Asimov

Page 32: The Soul in The Machine - Developing for Humans

All personal data on the web has been harvested and analysed.

Page 33: The Soul in The Machine - Developing for Humans

For years we used “free” systems that spied on us - heck, we even bought the devices that recorded our every move.

-

📱

Page 34: The Soul in The Machine - Developing for Humans

Our data and information has already been recorded and filed. It is almost impossible not to have left a track.

📷✏🎙➡🗄

Page 35: The Soul in The Machine - Developing for Humans

Technological progress has merely provided us with more efficient means for going backwards.

— Aldous Huxley

Page 36: The Soul in The Machine - Developing for Humans

The Power of Big Data and Psychographics

https://youtu.be/Yu3Vxy6lQwg

Page 37: The Soul in The Machine - Developing for Humans

The Power of Big Data and Psychographics

https://youtu.be/Yu3Vxy6lQwg

Page 38: The Soul in The Machine - Developing for Humans

The Power of Big Data and Psychographics

https://youtu.be/Yu3Vxy6lQwg

Page 39: The Soul in The Machine - Developing for Humans

The future is already here – it’s just not very evenly distributed.

— William Gibson

Page 40: The Soul in The Machine - Developing for Humans

Here is where we come in. 4

Page 41: The Soul in The Machine - Developing for Humans

The interfaces we build today condition the users of now and of tomorrow…

Page 42: The Soul in The Machine - Developing for Humans

The interfaces we build today condition the users of now and of tomorrow…

Page 43: The Soul in The Machine - Developing for Humans

It is time for us to see machine learning as a tool in our belt to built great, human interfaces.🌈

Page 44: The Soul in The Machine - Developing for Humans

There is no such thing as a perfect user - think inclusive.

https://www.microsoft.com/en-us/Design/inclusive

It isn’t about allowing access but about avoiding barriers.

Page 45: The Soul in The Machine - Developing for Humans

Here are some great examples…🦄

Page 46: The Soul in The Machine - Developing for Humans
Page 47: The Soul in The Machine - Developing for Humans
Page 48: The Soul in The Machine - Developing for Humans

“Selfies” (Auto category) https://photos.google.com

Page 49: The Soul in The Machine - Developing for Humans

“Katze” (cat) https://photos.google.com

Page 50: The Soul in The Machine - Developing for Humans

“Essen” (food) https://photos.google.com

Page 51: The Soul in The Machine - Developing for Humans

https://qz.com/920857/netflix-nflx-uses-ai-in-its-new-codec-to-compress-video-scene-by-scene/

Page 52: The Soul in The Machine - Developing for Humans

http://www.theverge.com/2017/2/8/14549798/pinterest-lens-visual-discovery-shazam

Page 53: The Soul in The Machine - Developing for Humans

https://www.youtube.com/watch?v=XMdct-5bERQ

Page 54: The Soul in The Machine - Developing for Humans

aipoly.com

Page 55: The Soul in The Machine - Developing for Humans

https://blogs.office.com/2016/12/02/accessibility-in-office-365-enabling-greater-digital-inclusion/

Cognitive services in Microsoft Office

Page 56: The Soul in The Machine - Developing for Humans

Facebook’s alternatives…

Image may contain: dog, outdoor and nature

https://code.facebook.com/posts/561187904071636

Page 57: The Soul in The Machine - Developing for Humans

Adding automated content in context…

https://research.googleblog.com/2016/05/aw-so-cute-allo-helps-you-respond-to.html

Page 58: The Soul in The Machine - Developing for Humans

https://www.videobreakdown.com/

Understanding and fixing video automatically…

Page 59: The Soul in The Machine - Developing for Humans

https://www.videobreakdown.com/

Transcripts were just a start…

Page 60: The Soul in The Machine - Developing for Humans

https://www.videobreakdown.com/

People, topics, sentiments…

Page 61: The Soul in The Machine - Developing for Humans

https://www.newscientist.com/article/2113299-googles-deepmind-ai-can-lip-read-tv-shows-better-than-a-pro/?sf43896303=1

https://arxiv.org/pdf/1611.05358v1.pdf

46.8% vs 12.4% success rate

Page 62: The Soul in The Machine - Developing for Humans

It is time for us to go and play!🕹

Page 63: The Soul in The Machine - Developing for Humans

The question of whether computers can think is like the question of whether submarines can swim.

— Edsger W. Dijkstra

Page 64: The Soul in The Machine - Developing for Humans

People are freaking out!

Page 65: The Soul in The Machine - Developing for Humans

https://www.bleepingcomputer.com/news/security/researcher-breaks-recaptcha-using-googles-speech-recognition-api/

Page 66: The Soul in The Machine - Developing for Humans

Learning from data… http://image-net.org/

Page 67: The Soul in The Machine - Developing for Humans

Understanding the human aspect… https://github.com/openimages/dataset

Page 68: The Soul in The Machine - Developing for Humans

Refining the data with language

https://research.googleblog.com/2016/09/show-and-tell-image-captioning-open.html

Page 69: The Soul in The Machine - Developing for Humans

Compare and enhance…

Page 70: The Soul in The Machine - Developing for Humans

Detect syntax, mix and match

Page 71: The Soul in The Machine - Developing for Humans

Add visual information

Page 72: The Soul in The Machine - Developing for Humans

http://captionbot.ai

More APIs and demos to use…

Page 73: The Soul in The Machine - Developing for Humans
Page 74: The Soul in The Machine - Developing for Humans
Page 75: The Soul in The Machine - Developing for Humans

Verification Result:JSON:[{"isIdentical":false,"confidence":0.01 }]

Verify Faces

Page 76: The Soul in The Machine - Developing for Humans

Cluster automatically…

Page 77: The Soul in The Machine - Developing for Humans
Page 78: The Soul in The Machine - Developing for Humans

Add quality by filtering with context…

https://www.microsoft.com/cognitive-services/en-us/custom-recognition-intelligent-service-cris

Page 79: The Soul in The Machine - Developing for Humans

Our job right now is to create interfaces that are simple, human and fun to use…

Page 80: The Soul in The Machine - Developing for Humans

Machines and code are there to help humans communicate better.

The more useful our “intelligent” solutions are, the easier it will be for people to stop fearing innovation…

🎙

Page 81: The Soul in The Machine - Developing for Humans

We need to use our skills, knowledge and products to give people a sense of interaction and data ownership.

🔬

Page 82: The Soul in The Machine - Developing for Humans

It is up to us to make this revolution one that improves all mankind, and not only makes some quick money and shows us more ads.

9

Page 83: The Soul in The Machine - Developing for Humans

CHRIS HEILMANN

@CODEPO8

CHRISTIANHEILMANN.COM

THANKS!