codejoyan opened a new issue #4177:
URL: https://github.com/apache/hudi/issues/4177
Facing an issue with 0.9.0 hudi version
I bulk inserted into a hudi table (say 100 partitions). Then I am trying to
upsert data to the last partition.
But instead of upserting, by mistake I used bulk_insert and it failed with
the below error (which is expected). I see successful rollback action in the
.hoodie timeline. All fine till this point.
But any subsequent upsert attempts continue to fail saying
`org.apache.hudi.exception.HoodieException: Unknown versionCode:2`
**Initial Error Message**
21/11/30 17:04:16 ERROR
org.apache.spark.sql.execution.datasources.v2.AppendDataExec: Data source write
support
org.apache.hudi.spark3.internal.HoodieDataSourceInternalBatchWrite@b8a68aa is
aborting.
21/11/30 17:04:16 ERROR
org.apache.hudi.internal.DataSourceInternalWriterHelper: Commit 20211130165954
aborted
21/11/30 17:04:41 ERROR
org.apache.spark.sql.execution.datasources.v2.AppendDataExec: Data source write
support
org.apache.hudi.spark3.internal.HoodieDataSourceInternalBatchWrite@b8a68aa
aborted.
org.apache.spark.SparkException: Writing job aborted.
Caused by: org.apache.hudi.exception.HoodieException: Error syncing to
metadata table.
at
org.apache.hudi.internal.DataSourceInternalWriterHelper.commit(DataSourceInternalWriterHelper.java:86)
at
org.apache.hudi.spark3.internal.HoodieDataSourceInternalBatchWrite.commit(HoodieDataSourceInternalBatchWrite.java:93)
at
org.apache.spark.sql.execution.datasources.v2.V2TableWriteExec.writeWithV2(WriteToDataSourceV2Exec.scala:371)
... 117 more
Subsequent error message:
org.apache.hudi.exception.HoodieException: Unknown versionCode:2
at
org.apache.hudi.common.table.HoodieTableVersion.lambda$versionFromCode$1(HoodieTableVersion.java:52)
at java.util.Optional.orElseThrow(Optional.java:290)
at
org.apache.hudi.common.table.HoodieTableVersion.versionFromCode(HoodieTableVersion.java:52)
at
org.apache.hudi.common.table.HoodieTableConfig.getTableVersion(HoodieTableConfig.java:241)
Looking at the source code it appears that versionCode passed is 2 where as
possible values of HoodieTableVersion is 0 and 1. Any quick way to fix and
unblock me?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
