sivabalan narayanan created HUDI-5444:
-----------------------------------------
Summary: FileNotFound issue w/ metadata enabled
Key: HUDI-5444
URL: https://issues.apache.org/jira/browse/HUDI-5444
Project: Apache Hudi
Issue Type: Bug
Components: metadata
Reporter: sivabalan narayanan
stacktrace
{code:java}
Caused by: java.io.FileNotFoundException: File not found:
gs://TBL_PATH/op_cmpny_cd=WMT.COM/order_placed_dt=2022-12-08/441e7909-6a62-45ac-b9df-dd0386574f52-0_607-17-2433_20221208132316380.parquet
at
com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase.getFileStatus(GoogleHadoopFileSystemBase.java:1082)
{code}
20221208133227028 (RB_C10)
20221208133227028001 MDT compaction
20221208132316380 (C10)
20221208133647230
DT
8 │ 20221202234515099 │ rollback │ COMPLETED │ Rolls back │ 12-02
15:45:18 │ 12-02 15:45:18 │ 12-02 15:45:33 ║
║ │ │ │ │ 20221202222413756 │
│ │ ║
╟─────┼───────────────────┼──────────┼───────────┼───────────────────┼────────────────┼────────────────┼────────────────╢
║ 9 │ 20221208133227028 │ rollback │ COMPLETED │ Rolls back │ 12-08
05:32:33 │ 12-08 05:32:33 │ 12-08 05:32:44 ║
║ │ │ │ │ 20221208132316380 │
│ │ ║
╟─────┼───────────────────┼──────────┼───────────┼───────────────────┼────────────────┼────────────────┼────────────────╢
║ 10 │ 20221208133647230 │ rollback │ COMPLETED │ Rolls back │ 12-08
05:36:47 │ 12-08 05:36:48 │ 12-08 05:36:57 ║
║ │ │ │ │ 20221208133222583 │
│ │ ║
╟─────┼───────────────────┼──────────┼───────────┼───────────────────┼────────────────┼────────────────┼────────────────╢
MDT timeline:
-rw-r--r--@ 1 nsb staff 0 Dec 8 05:32
20221208133227028.deltacommit.requested
-rw-r--r--@ 1 nsb staff 548 Dec 8 05:32
20221208133227028.deltacommit.inflight
-rw-r--r--@ 1 nsb staff 6042 Dec 8 05:32 20221208133227028.deltacommit
-rw-r--r--@ 1 nsb staff 1938 Dec 8 05:34
20221208133227028001.compaction.requested
-rw-r--r--@ 1 nsb staff 0 Dec 8 05:34
20221208133227028001.compaction.inflight
-rw-r--r--@ 1 nsb staff 7556 Dec 8 05:34 20221208133227028001.commit
-rw-r--r--@ 1 nsb staff 0 Dec 8 05:34
20221208132316380.deltacommit.requested
-rw-r--r--@ 1 nsb staff 3049 Dec 8 05:34
20221208132316380.deltacommit.inflight
-rw-r--r--@ 1 nsb staff 8207 Dec 8 05:35 20221208132316380.deltacommit
-rw-r--r--@ 1 nsb staff 0 Dec 8 05:36
20221208133647230.deltacommit.requested
-rw-r--r--@ 1 nsb staff 548 Dec 8 05:36
20221208133647230.deltacommit.inflight
-rw-r--r--@ 1 nsb staff 6042 Dec 8 05:36 20221208133647230.deltacommit
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
