[AWS Black Belt Online Seminar] Amazon CloudWatch Container … · 2019-11-27 · AWS Webinar ......

© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark

AWS Webinar

https://amzn.to/JPWebinar https://amzn.to/JPArchive

Amazon CloudWatch Container Insights

[AWS Black Belt Online Seminar]

Solutions Architect

2019/11/27

AWS LambdaAWS Fargate

AWS Black Belt Online Seminar

• Q&A blog

①吹き出しをクリック②質問を入力③ Sendをクリック

Twitter

#awsblackbelt

• 2019 11 27

AWS (http://aws.amazon.com)

• AWS

• AWS does not offer binding price quotes. AWS pricing is publicly available and is subject to

change in accordance with the AWS Customer Agreement available at

http://aws.amazon.com/agreement/. Any pricing information included in this document is provided

only as an estimate of usage charges for AWS services based on certain information that you

have provided. Monthly charges will be based on your actual use of AWS services, and may vary

from the estimates provided.

• Production

• :•

• Container Insights

••

• Amazon ECS

• Container Insights• Container Insights

••

• Amazon ECS

Amazon ECS

Amazon Elastic Container

Service

Amazon Elastic

Kubernetes ServiceKubernetes

Amazon EC2

Amazon ECS

グローバル展開

強力なスケジュールエンジン

オートスケーリング

CloudWatch 連携(ログ/メトリクス/イベント)

ロードバランサー

コンテナレベルのネットワーク構成

高度なタスク配置戦略

他のAWSサービスとの連携

ECS CLILinux & Windows

コントロールプレーンとして提供

Amazon ECS

• コンテナ(群)の実行単位

• タスクおよび各コンテナのCPUとメモリ

上限を指定し、それを元にスケジュールされる

• 指定されたタスク数の維持

• ELBとの連携

• メトリクスに応じたオートスケール

• コンテナ実行環境である論理的なグループ

Elastic Load

Balancing

Container Insights

• CloudWatch

Container Insights

A B C Amazon CloudWatch

CPU 50%

CPU : 25% CPU : 99% CPU : 25%

• ECS

CloudWatch

Amazon CloudWatch

ECS ECS ECS

Container Insights

App App

••

• Amazon ECS

Container Insights

CloudWatch

• CloudWatch

• AWS Amazon

ECS Amazon EKS Amazon EC2 Kubernetes

※ 2019/11/27 AWS Batch Container Insights

• Amazon CloudWatch

CPU : 25% CPU : 99% CPU : 25%

• CloudWatch Logs Insights X-Ray

Container Insights

Amazon CloudWatch

Logs InsightsAWS X-Ray

CloudWatch Logs Insights

Container Insights

Container Insights (1)

• CloudWatch Container

Insights

• ECS Clusters

• ECS Instances *1

• ECS Services

• ECS Tasks

*1 Fargate ECS Instances

• ECS Clusters

• ECS Instances *1

• ECS Services

• ECS Tasks

(container-demo

ecsdemo-frontend )

• ECS Task

• Task performance CloudWatch Logs Insights X-Ray

Amazon CloudWatch

Logs Insights

AWS X-Ray

• Cloudwatch Logs Insights

) Exception

Amazon CloudWatch

Logs Insights

• CloudWatch Logs Insights

Amazon CloudWatch

Logs Insights

Amazon CloudWatch

Logs Insights

Amazon CloudWatch

Logs Insights•

for EKS

https://docs.aws.amazon.com/ja_jp/AmazonCloudWatch/latest/monitoring/Container-Insights-view-metrics.html

◼︎Container Insights

stats pct(container_cpu_usage_total, 50) as CPUPercMedian by kubernetes.container_name

| filter Type="Container"

CPU ( )

stats avg(cluster_failed_node_count) as CountOfNodeFailures | filter Type="Cluster" | sort @timestamp

STATS avg(node_cpu_utilization) as avg_node_cpu_utilization by NodeName | SORT

avg_node_cpu_utilization DESC

CPU ( )

Count by container name: stats count() as countoferrors by kubernetes.container_name | filter

stream="stderr" | sort countoferrors desc

Amazon CloudWatch

Logs Insights

AWS X-Ray

• ..etc

• Container Insights X-Ray

AppX-Ray

request

response

AWS X-Ray

) X-Ray

◼◼AWS X-Ray

https://docs.aws.amazon.com/ja_jp/xray/latest/devguide/aws-xray.html

AWS X-Ray

Container Insights

Container Insights ECS

• 2:

Container Insights

• AWS CloudFormation AWS Cloud Development Kit(CDK)

• IAM IAM

Container Insights

Container Insights•

• IAM

Container Insights

Container Insights AWS CLI

aws ecs put-account-setting-default --name containerInsights --value enabled --region us-

east-1

aws ecs put-account-setting --name containerInsights --value enabled --principal-arn

arn:aws:iam::aws_account_id:user/userName --region us-east-1

aws ecs put-account-setting --name containerInsights --value enabled --principal-arn

arn:aws:iam::aws_account_id:role/roleName --region us-east-1

• Container Insights Amazon ECS

• Container Insights AWS CLI

$ aws ecs update-cluster-settings --cluster <myCICluster> --settings

name=containerInsights,value=enabled

※ AWS CLI 1.16.200

https://docs.aws.amazon.com/ja_jp/AmazonCloudWatch/latest/monitoring/deploy-container-insights-ECS.html

◼◼Amazon ECS Container Insights

• Container Insights ECS Container

Insights

Container Insights EKS Kubernetes on

Container Insights

https://docs.aws.amazon.com/ja_jp/AmazonCloudWatch/latest/monitoring/Container-Insights-prerequisites.html

◼◼Amazon EKS Kubernetes Container Insights

• EKS / Kubernetes on EC2

Container Insights

kubectl kubectl apply

• Kubernetes on EC2

Kubernetes (RBAC)

kubelet Webhook

Docker

Container Insights EKS Kubernetes on

Container Insights

https://docs.aws.amazon.com/ja_jp/AmazonCloudWatch/latest/monitoring/deploy-container-insights-EKS.html

◼◼Amazon EKS Kubernetes Container Insights

• CloudWatch CloudWatch DaemonSet

• CloudWatch Logs DaemonSet FluentD

• Amazon EKS (

CloudWatch Logs )

• StatsD CloudWatch (StatsD

CloudWatch Logs

• CloudWatch Logs Insights

Amazon CloudWatch

Container Insights

https://docs.aws.amazon.com/ja_jp/AmazonCloudWatch/latest/monitoring/Container-Insights-reference-performance-logs-ECS.html

https://docs.aws.amazon.com/ja_jp/AmazonCloudWatch/latest/monitoring/Container-Insights-reference-performance-logs-EKS.html

◼︎Amazon ECS Container Insights

MemoryUtilized / MemoryReserved * 100

= 295 / 400

= 75 % [ ]..

◼︎Amazon EKS Container Insights

• CloudWatch Logs

• ECS /aws/ecs/containerinsights/< >/performance

• EKS /aws/containerInsights/< >/performance

) container-demo cluster container

CloudWatch Logs Insights

• @message

• CpuUtilezed message.CpuUtilezed

) CpuUtilzed MemoryUtilized

Nginx Rails

256MiB

768MiB

CPU : 1024

: 1024MB

512MiB

1536MiB

CPU : 2048

: 2048MB

Nginx Rails

Container Insights

Nginx Rails

680MiB

344MiB

Nginx Rails

256MiB

768MiB

CPU : 1024

: 1024MB

Container Insights

CPU : 1024

: 1024MB

1. Container

• Container Insights ECS Tasks Container

.2 Container

• ECS

container-a 256MB/CPU 128

container-b 256MB/CPU 128

container-a 384MB/CPU 192

container-b 128MB/CPU 64

3. Container

2. CPU

@message

Container Insights

ECS Container Insights

10 Amazon EC2 50 20 5

CloudWatch :

8 + (6 * 20 ) + (11

* 5 ) = 183 CloudWatch

183 * 0.30USD = 54.90 USD

CloudWatch Logs :

Amazon ECS 1 13 KB

(13 KB/1024/1024) GB * 183 * 730 = 1.66 GB

1.66 GB * 0.50USD = 0.83USD

: 55.73 USD

https://aws.amazon.com/jp/cloudwatch/pricing/

◼︎AWS CloudWatch

CloudWatch

• CloudWatch

AWS Japan Blog https://aws.amazon.com/jp/blogs/news/

AWS AWS

https://amzn.to/JPArchive

個別技術相談会

AWS Webinar

https://amzn.to/JPWebinar https://amzn.to/JPArchive

[AWS Black Belt Online Seminar] Amazon CloudWatch Container … · 2019-11-27 · AWS Webinar ......

Documents

Amazon CloudWatch Logs · instâncias do Amazon Elastic Compute Cloud (Amazon EC2), do AWS CloudTrail, do Route 53 e de outras origens. O CloudWatch Logs permite centralizar os logs

Standardized Architecture for PCI DSS on the AWS … Architecture for PCI DSS on the AWS Cloud ... Logging, monitoring, and alerts using AWS CloudTrail, Amazon CloudWatch, and AWS

Amazon CloudWatch - API Reference - AWS … CloudWatch API Reference DescribeAlarmHistory DescribeAlarmHistory Retrieves the history for the speciﬁed alarm. You can ﬁlter the results

Amazon CloudWatch Events - AWS Documentation · Amazon CloudWatch Events User Guide ... D ﬁ nM ut iSo rc sTh C B U dvP I y . 109 ... see Logging Amazon CloudWatch Events API Calls

How to deploy DSH-PREDMNT in proprietary AWS account · AWS services by class AWS Lambda Amazon DynamoDB Amazon CloudWatch AWS CloudFormation AWS IoT Core AWS IoT Greengrass Amazon

Introduction to Auditing the Use of AWS Web Services – Introduction to Auditing the Use of AWS October 2015 Page 2 of 28 ... Verifiable- Using AWS CloudTrail, Amazon CloudWatch,

S2 L1 CloudWatch Introduction…restricted to just AWS resources. Can be on premise too. Just need to download and install the SSM agent and Cloudwatch agent. CloudWatch Exam Tips

NYKAA - tothenew.com · Used AWS Identity & Access Managment (IAM) for securely controlling access to AWS services Used Amazon CloudWatch to collect information,

Revision A Protecting Public Cloud Infrastructure - Amazon CloudWatch monitors the AWS resources and the applications run on AWS in real time. CloudWatch collects and tracks metrics,

Yinlin Chen, Jim Tuttle, William A. Ingram Information ...AWS Lambda Amazon DynamoDB Amazon CloudFront Amazon Route 53 Amazon CloudWatch AWS CloudTrail AWS CloudFormation IAM Amazon

1.Executive Summary · Web viewUsing AWS Cloudwatch, one can easily view system metrics and function logs to check if the data is being streamed properly. Navigate to Cloudwatch ->

SUMMIT - Amazon Web Services... · • Amazon CloudWatch Logs • AWS CodeBuild • Amazon EC2 API • Elastic Load Balancing API • AWS Key Management Service • Amazon Kinesis

Up near the clouds · WorkMail Amazon CloudWatch Administration & Security Analytics AWS Data Pipeline Networking Amazon vpc AWS AWSIAM AWS Trusted Advisor Amazon CloudFront AWS Config

Amazon CloudWatch Events - AWS Documentation · 2018-09-01 · Amazon CloudWatch Events User Guide ... events and route them to one or more target functions or streams. ... A single

CIS AWS Foundations Benchmark - Amazon S3 Web Services – CIS AWS Foundations Benchmark December 2017 Page 6 of 20 Lambda functions – All custom AWS Config and CloudWatch Events

AWS Trusted Advisor Explorer · The Trusted Advisor Recommendations data lake block contains Amazon S3, AWS Glue crawlers, Amazon Athena, AWS Lambda, and CloudWatch Events rules

Cloudreach Voices AWS CloudWatch and Smart Monitoring

Using Amazon CloudWatch Events, AWS Lambda and Spark Streaming to Process EC2 Events (June 2016)

(SDD418) Amazon CloudWatch Deep Dive | AWS re:Invent 2014

AWS re:Invent 2016: Amazon CloudWatch Logs and AWS Lambda: A Match Made in Heaven (DEV301)