Barsha ShresthaInsight Data Engineering

Motivation:

APIs:

>300GB

DATA INGESTION FILE SYSTEM/

FRONT-END

BATCH PROCESSING

DATABASE

DATA INGESTION FILE SYSTEM/

BATCH PROCESSING

DATABASE

FRONT-END

PRODUCER

PRODUCER

CONSUMER

DATA INGESTION FILE SYSTEM/

BATCH PROCESSING

DATABASE

FRONT-END

TMDB

DATA INGESTION FILE SYSTEM/

FRONT-END

BATCH PROCESSING

DATABASE

Challenges1. Learning new technologies!2. Next steps

About me:

Barsha Shrestha

Chemistry and Computer Science Movies, Soccer, Science Jokes, Bad puns

http://www.youtube.com/watch?v=NkI5zrbC9W4