This is an English translation of a Japanese blog. Some content may not be fully translated.

Checking EMR Errors from S3 Logs

Published on 2021/05/20 📖 1 min read

AWS

EMR

mkdir j-3PS6MU0W27GMG
cd j-3PS6MU0W27GMG

Note: j-3PS6MU0W27GMG is the Cluster ID

aws s3 sync s3://aws-logs-xxx-ap-northeast-1/elasticmapreduce/j-3PS6MU0W27GMG .

find . -type f -exec gunzip {} \;

Sort in chronological order

find . | grep log | xargs egrep "WARN|ERROR" | sort -k2

Suggest an edit on GitHub

AWS

EMR

Related articles