47
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16 ML Ops on AWS

ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Makoto Shimura

Analytics Specialist SA, Amazon Web Services Japan

2-H1-3-16

ML Ops on AWS

Page 2: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

About Me

��� (Makoto Shimura)

• �������� �������� ������• ���.'�!��%"�����)+• (&����' -$*����.',• #������

• Amazon Athena• AWS Glue• Amazon SageMaker

Page 3: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Key Take AwayML ���������5������5���)�(�$�5��"'%��1�7��;=���

�� ��� ��� �6�2���8��+<�:4�AWS ���� ��9.�?����

������������&�)�0,�3/��������*#�!* �->

Page 4: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Agenda• ML �������������

• ML��������������

• ������������� ����

• ML ������� ����

Page 5: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

ML����� �������

Page 6: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

�����

����

�������ML

���������

�����������

Page 7: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

ML =:�8� 3�5������

1. ���+,���&!%"*4��19 �

2. ML �'$( -6 ������?/�$�#� ��2;�����<>���

3. ML '$(�)7.��0����,����

Page 8: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

1.

M

L

L

Page 9: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

2. ML �$!&/<��I1�!� �A(.ML ��:J�)-!� ������DG�;�E8����,C�������!� �23

!� �=5�����+H����@F���#� !� �%"&�BK�9>���

3� !� �74H��B6�(0'?������7�����!� �H*��

Page 10: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

3. ML �($)�*.3��7������<��64�1�������/?�($)���&����EF�8��

5:�;0�G,��������C ($)�=B�9��A+���

<��'"%#-@�8�����<��!� )�2>�1��������DH���

Page 11: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

�����

����

�������ML

���������

�����������

Page 12: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

�����

ML

� ��������� Kinesis S3

EMR Glue

Redshift Athena QuickSight

Page 13: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

����&0

ML

�� ����#���� Kinesis S3

EMR Glue

Redshift Athena QuickSight

�� .�$1�!���'������"���(),2�3+���6/*%�-�����45

Page 14: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

ML ����� ������

Page 15: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

�����

����

�������ML

���������

�����������

Page 16: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

��

����

Page 17: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

0B• 6?��ML (#)����-��0B23�FI���%*�',����"&#�$���D��0B239>�5<�8�@�GE�B=

• ����0B23�6?&+ ��9A. ��FI���

• ���6?7��#�!*����FI�#�!�C�;�/4�1:H�#�! "$�8�FI���

Page 18: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

6A• ����.(0�����PD�.(0"6A����EK"N5� ���L�.(0���*#+�+/-�'�Q��3 H �=J�G"F?�

• ��.(0�Q�����C �(�'�I2�!�>�<6A";������

• �� �8�R �6A,1&%"�=B9�@7$%)�4M$%)�:T�;� OS��

Page 19: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

DQ�=6A• 6A��:4�'+/����:4�,)$-0!�8OH��

AB &"(�<���EI�B�������/�.*% ���

• K�,'.���'�$�G3�M��'+/���� ���������'+/�+/#"�?J2

• :4�1��,'.�=6A��C��@N�> ���5L79�=;F�P���

Page 20: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

��

����

Page 21: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

��� ������������

Page 22: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

ML ����/����G:F�K�• �%���'&����������

• 4M69�?BN� Tensorflow��PO69� 1.4 ���• PO69�3E-�)-.�L2������

• �%���'&��"���!$�����• %�#���1$�"&� R �A���'���1!(��PO69R� Java �>@D

• #������ ���� �������• PO69��1!(��75��QH�8���� ����• ML +%/��*.�� ,1���'J�C�=������I<$"&�;�� %*0�����

Page 23: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

ML �%"$5���V@U�Z� cont.• ������ ��� �����%�������

• [L%�.'�2*5!Y9 API %�-I�0'+����• E\�K��2*5!X����� CUDA -�&37!I������S%�.'�2*5�#4�!W���

• �&�"����� ����• Y�*�(�Y�2*5!=G �������8�B<�…

• #������������'!�)$�(����• =GD�OH^!>8���QP)1�2*5!=G����• F;�TN:?��JC�.&,'R�_A��*/6"/ M�]�!��� ������

Page 24: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

DevOps ���%����H�\• Infrastructure as Code: KXA�3�*8=E^�/+1�GQW$=/';�)8=��")+/6E^�?]��#5<�.�����E^@������immutable �NR�)+/6"[����CY

• Microservices: #�%/&.7+-$:��������L��(�4+�P�I!����S>�DZ��#5<�.

• Continuous Delivery: KXA� �99�+5<,+"U���O �3�*8=�JP�"05<$��4*2+M�BT"VF��

Page 25: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

DevOps �rV��ML �*&'9$L�!• Infrastructure as Code:

ML �P�7&278�iO�<XDF$Q�����@c�ne�b�CE$l�����5.9W_^ �aN������7&278�1�,6;gd�k#!���o?S��CE$K\�!mBR

• Microservices: %38(�+6;U[�]��ML 5.9�hj�Y);4�0;/�3:-'/�JS*&'9�fp� "!HI�CE`�=�!��Z�

• Continuous Delivery: S��5.9RM�q�T>$��!����RM�neCE��"�����#����W_A�G>��!������!

Page 26: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

[T� DevOps �ML Ops �?�"]• C`FI�����fU�8.<���3:7+$gn�B��cD$L�����5=*)�WP

• 2�(9>Gm$�"O��'�0�FI�������ES.�+�M#��Gm$�"ek�"�� ���� ES.�+$X�8.<��Nlj���

• .�+Vd�8.<KZ�%5;C`�Aj����4(1)�fU,�6H_�"J��" �Y�

• ibFI�fU8.<� AB -)/$RQ�"�@a\��!h��fU8.<$@^�.5=&�"ek�"

Page 27: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

ML Ops ���$&<F�2• Infrastructure as Code:

ML A4E�,�6!K[/B;YUW�9C@1�YULO�Tah����8�/BGMr�YU��K[/B;Xe Mr���4�1 DWH h�"Zj�$)(D!�4�1Xe 1*%���iHg�Mr

• micsoservices: ML �`t]r%=')F-�:0���ks��$�ML lm�2�?�&<D+�.BG�2�?%n���J��R�1'>G*�DD�0

• Continuous Delivery: _�aI%\Q�$Vc������AB 305_�d"�$P�^���oS����:/70�qf�N ��"��b#p�

Page 28: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

ML Ops �����C<�)/��• Infrastructure as Code:

• *>,-�B?,-�"��"#�&�C<• '=+7�!�$�20����C<

• micsoservices: • *>,-�B?,-�61,-5;����&�C<• 8�!�$�3 ������ %�����C<• �������!�$�� %��:�����(.��C<

• Continuous Delivery: • 8�!�$�� %���@4�D9�A�����C<

Page 29: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

ML Ops � ������ AWS ���

Infrastructure as Code microservices Continuous Deploy

AmazonECR

AWSCodeBuild

AWS StepFunctions

AmazonSageMaker

AWSGreengrass

AWSCodeCommit

AmazonECS

AmazonSageMaker

Page 30: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

��

����

Page 31: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Amazon SageMakerML

P

D

I

I BA D S

A aI M

/

/ /

Page 32: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

ML ���������

Page 33: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

ML ����� ��������� ��

Page 34: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

��������� �� �������������������� ��������

Kinesis Firehose

S3

SageMaker

Glue

Athena QuickSight

AppServers

Page 35: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

����������� EC ���������������������� ������

Kinesis Firehose

S3

EMR

Glue

Athena QuickSight

AppServers DynamoDB

Page 36: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

��� �������(������������ "�������!��&'%�$#

Camera Device

Detection App

GPU

Greengrass Core

Camera

AWS IoT

Glue

Athena QuickSight

S3 SageMaker

Greengrass

Page 37: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

ML �����������

Page 38: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

StepFunctions���ML � ������

Start

CodeBuildStartBuild�����

SageMakerCreateTrainingJob

CodeBuildStartBuild�����

SageMakerCreateModel

SageMakerCreateEndpointConfig

SageMakerCreateEndpointUndateEndpoint

wait

wait

wait wait

SNS�����

SNS����

GreengrassCreateDeployment

Page 39: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

���%,;= *�� StepFunctions�)@

RDS

S3

RedShift

Glue(2>9B���.4

S3

Glue�������)@

RDS������

��� $*��)@

SageMaker(2� �1-���!��"�

�������<3+'(2����87A�0���/5�

�6#���"��$�$�?>���� &:

Page 40: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

#��ML ���������"�

Start

SageMakerCreateTrainingJob

CloudWatchLogs��������

Lambda������� ��

DB �����

QuickSight������ #�����!�

SageMakerCreateTrainingJob

SageMakerCreateTrainingJob...

...

RDS

Page 41: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

*#-�2�,���4�1H

08G#� �6<�������1H#� F>� S3 �@� ���"�1H#� �:���;��#� �A/���) #� �EC RDS �9����

Start

������"���!�����"�1HCreateTrainingJob� CreateModel�?����7B�������� � JSON (��-D�5�1H

08�G���������� ID �1H�."%�)���'-$���� Dockerfile�1H

CodeCommit

S3

SageMaker

ECR

DVCGit LFS

3=�#� �&��+.1H!�-

Page 42: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

=9"%�� AB ����(!/6

���>�?/1;$

83A� ���

���>�?/1�'!+,

Elasticsearch Service���'!�

����� )�

Lambda���'!�,&

SNS���52

�1���'!

S3���'!�@B<0

Athena & QuickSight4#7�����,&�� )�

SageMaker:.�������-* AB ���

AppServers

Kinesis

Page 43: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

���� / �#�"��� ��

�#�"10&)

ML ��!�(� ������� AWS /�'2S3 �%�� AWS ��#�"�3*

�#�"10&)

-.,�ML ��!���� ���$+� SageMaker�'2S3 �%���#�"� AWS �3*

SageMaker S3CodeBuild

SageMakerS3

Direct Connect

Direct Connect

Page 44: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

���

Page 45: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

���ML ���������6�� ���6���*�)�%�6��#(&��2�8��<>���

�� ��� ��� �7�3���9��,=�;5�AWS ���� ��:/�@����

������������' *�1-�40��������+$�"+!�.?

Page 46: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

k W 3R SF a bW A

Q b F A

a bW c e b W 3 d

Page 47: ML Ops on AWS - Amazon S3© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Makoto Shimura Analytics Specialist SA, Amazon Web Services Japan 2-H1-3-16

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.