tooptoop4 opened a new issue #1785:
URL: https://github.com/apache/hudi/issues/1785
hudi 0.5.3 is giving this error (first time using 0.5.3), all of the data
before was written by hoodie 0.4.6.
2 Qs:
1. is this new error something introduced in new version? is there some
config I can use to disable that error check?
2. I assume hive/presto.etc when querying this COW table does not see any
data from the inflight files? can I safely delete the inflight files manually
without risk of data loss/corruption (I'm talking about versus data that is
currently queryable, not data that failed to be inserted in the past)
2020-07-02 18:46:45,130 [main] INFO
org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Loaded instants
[[==>20190928011208__commit__INFLIGHT], [==>20190928034716__commit__INFLIGHT],
[==>20190928200315__commit__INFLIGHT], [==>20190930151449__commit__INFLIGHT],
[20191001132843__clean__COMPLETED], [20191001132843__commit__COMPLETED],
[20191001132911__clean__COMPLETED], [20191001132911__commit__COMPLETED],
[20191001133118__clean__COMPLETED], [20191001133118__commit__COMPLETED],
[20191001133148__clean__COMPLETED], [20191001133148__commit__COMPLETED],
[20191001133355__clean__COMPLETED], [20191001133355__commit__COMPLETED],
[20191001133427__clean__COMPLETED], [20191001133427__commit__COMPLETED],
[20191001133631__clean__COMPLETED], [20191001133631__commit__COMPLETED],
[20191001133659__clean__COMPLETED], [20191001133659__commit__COMPLETED],
[20191001133901__clean__COMPLETED], [20191001133901__commit__COMPLETED],
[20191001133931__clean__COMPLETED], [20191001133931__commit__COMPLETED],
[20191001134052__clean__COMPLETED], [20191001134052__commit__COMPLETED],
[20191001134120__clean__COMPLETED], [20191001134120__commit__COMPLETED],
[20191001134247__clean__COMPLETED], [20191001134247__commit__COMPLETED],
[20191001134319__clean__COMPLETED], [20191001134319__commit__COMPLETED],
[20191002120546__clean__COMPLETED], [20191002120546__commit__COMPLETED],
[20191002120745__clean__COMPLETED], [20191002120745__commit__COMPLETED],
[20191002122157__clean__COMPLETED], [20191002122157__commit__COMPLETED],
[==>20191002122317__commit__INFLIGHT], [20191002122537__clean__COMPLETED],
[20191002122537__commit__COMPLETED], [20191002122618__clean__COMPLETED],
[20191002122618__commit__COMPLETED], [20191002123141__clean__COMPLETED],
[20191002123141__commit__COMPLETED], [==>20191002123247__commit__INFLIGHT],
[20191002132703__clean__COMPLETED], [20191002132703__commit__COMPLETED],
[20191002132746__clean__COMPLETED], [20191002132746__commit__COMPLETED],
[20191003112112__clean__COMPLETED], [20191003112112__commit__COMPLETED],
[20191003112202__clean__COMPLETED], [20191003112202__commit__COMPLETED],
[==>20191202224953__commit__INFLIGHT], [20191202225507__clean__COMPLETED],
[20191202225507__commit__COMPLETED], [20191202230001__clean__COMPLETED],
[20191202230001__commit__COMPLETED], [20191202231318__clean__COMPLETED],
[20191202231318__commit__COMPLETED], [20191202231401__clean__COMPLETED],
[20191202231401__commit__COMPLETED]]
Exception in thread "main"
org.apache.hudi.exception.HoodieRollbackException: Found commits after time
:20191202224953, please rollback greater commits first
at
org.apache.hudi.client.AbstractHoodieWriteClient.doRollbackAndGetStats(AbstractHoodieWriteClient.java:358)
at
org.apache.hudi.client.AbstractHoodieWriteClient.rollbackInternal(AbstractHoodieWriteClient.java:322)
at
org.apache.hudi.client.HoodieWriteClient.rollback(HoodieWriteClient.java:716)
at
org.apache.hudi.client.HoodieWriteClient.rollbackPendingCommits(HoodieWriteClient.java:1017)
at
org.apache.hudi.client.HoodieWriteClient.startCommit(HoodieWriteClient.java:846)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]