적절한 파티셔닝이 없으면 Athena는 큰 데이터 세트를 스캔하므로 많은 비용이 들 수 있습니다. 데이터를 올바르게 분할하는 것이 매우 중요합니다.
https://docs.aws.amazon.com/athena/latest/ug/partitions.html
Partitioning data in Athena - Amazon Athena
Partitioning data in Athena By partitioning your data, you can restrict the amount of data scanned by each query, thus improving performance and reducing cost. You can partition your data by any key. A common practice is to partition the data based on time
docs.aws.amazon.com
추천예제
Using Athena Partition Projection to Query CloudTrail and Other AWS Logs (linkedin.com)
Using Athena Partition Projection to Query CloudTrail and Other AWS Logs
Many AWS services log data to S3 where Amazon Athena can be used to query them. It's a powerful approach but there's a learning curve and some setup to do to reap all the rewards.
www.linkedin.com
'CLOUD > AWS' 카테고리의 다른 글
| AWS private 서버(jenkins)와 public ec2 연결 (0) | 2022.07.08 |
|---|---|
| cloudformation stack status 상태설명 및 trouble shooting (0) | 2022.07.06 |
| [AWS SDK] sdk(maven) 를 이용하여 Athena query 하기 (0) | 2022.06.23 |
| AWS Cloudwatch loggroup(aws-cli) 로컬에서 보는법 (0) | 2022.06.23 |
| aws step function (0) | 2022.06.23 |
댓글