steveloughran commented on pull request #33332: URL: https://github.com/apache/spark/pull/33332#issuecomment-880601741
> I did see this log printed on s3 yesterday ooh. s3a URL? Which committer and file output format? S3 no longer has 404 caching, and listings are fully consistent. So it isn't happening due to s3 state....something else is up. If it's not the output format skipping 0 byte files, something could be wrong. can you grab the cloudstore jar, run its `storediag` command against your bucket (ideally with -j for a JAR listing) & attach here, or email to me stevel@ at apache.org so I can see it: https://github.com/steveloughran/cloudstore -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
