[
https://issues.apache.org/jira/browse/HUDI-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu resolved HUDI-2387.
------------------------------
Resolution: Information Provided
> Too many HEAD requests from Hudi to S3
> ---------------------------------------
>
> Key: HUDI-2387
> URL: https://issues.apache.org/jira/browse/HUDI-2387
> Project: Apache Hudi
> Issue Type: Improvement
> Components: Usability
> Affects Versions: 0.8.0
> Environment: AWS Glue with PySpark
> Reporter: Sourav T
> Priority: Major
> Labels: AWS
>
> We are using Apache Hudi from AWS Glue (with PySpark runtime) to store data
> on S3 bucket. We are observing a very high number of S3 HEAD requests
> originating from what we believe from Hudi.
> Many a time due to this high number of requests, S3 throws "Status Code: 503;
> Error Code: SlowDown" causing data losses.
> Is there any any out-of-box feature to debug this further to confirm which
> Hudi feature causing this?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
