chennurchaitanya opened a new issue, #8338:
URL: https://github.com/apache/iceberg/issues/8338
### Apache Iceberg version
1.1.0
### Query engine
Spark
### Please describe the bug 🐞
My Job was running fine for a long time and today we got this exception.
Getting exception "Caused by: java.io.FileNotFoundException: No such file or
directory", while accessing data from iceberg table using below code snippet.
val df = spark.read.format("iceberg").option("start-snapshot-id",
start_snapshot).option("end-snapshot-id", end_snapshot).load("mytablename")
We are using minio as our storage backend. We have file_path entry in
mytable.files but physical file is not present. As per my understanding iceberg
have strong write consistency , unless all files are written into storage
backend, snapshot will not be created.
We tried to run orphan file removal, but doesn't help.
Can someone from iceberg SME's , let us know why this would happen and how
to resolve ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
