abmo-x commented on issue #4168:
URL: https://github.com/apache/iceberg/issues/4168#issuecomment-1188045274
Wanted to also add that we are seeing similar behavior for file which
BaseTaskWriter logs as successfully completed and I don't see any errors for s3
upload in the logs around that time frame.
But the data file does not exist on S3, but the below log is logged which
then adds the data file to the manifest.
```
logger_name: org.apache.iceberg.io.BaseTaskWriter
Complete data file GenericDataFile{content=data,
file_path=PATH_TO_FILE_THAT_DOESN'T EXIST file_format=PARQUET, spec_id=0,
partition=PartitionData{date=2022-07-15, hour=14}
```
Our S3 bucket is versioned, no versions exists in s3 for that file.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
