RajasekarSribalan edited a comment on issue #1794:
URL: https://github.com/apache/hudi/issues/1794#issuecomment-654588991
@bhasudha just an update, our jobs are not failing but we get this error
for hard delete operation and below is the command that we use on dataframe for
delete operation.
My concern is, whether hudi is doing rollback because of the error? I hope
it is not, pls confirm.
ERROR hive.HiveSyncTool: Got runtime exception when hive syncing
18039 java.lang.IllegalArgumentException: Could not find any data file
written for commit [20200705101913__commit__COMPLETED], could not get schema
for table /user/admin/hudi/users, Metadata
:HoodieCommitMetadata{partitionToWriteStats={}, compacted=false,
extraMetadata={ROLLING_STAT={
18040 "partitionToRollingStats" : {
18041 "" : {
18042 "d398058e-f8f4-4772-9fcb-012318ac8f47-0" : {
18043 "fileId" : "d398058e-f8f4-4772-9fcb-012318ac8f47-0",
18044 "inserts" : 989333,
deleteDataframe.write
.format("hudi")
.options(getQuickstartWriteConfigs)
.option(OPERATION_OPT_KEY, "delete")
.option(PRECOMBINE_FIELD_OPT_KEY, hudi_precombine_key)
.option(RECORDKEY_FIELD_OPT_KEY, hudi_key)
.option(PARTITIONPATH_FIELD_OPT_KEY, "")
.option(TABLE_NAME, tablename)
.option(TABLE_TYPE_OPT_KEY, "COPY_ON_WRITE")
.option(HIVE_SYNC_ENABLED_OPT_KEY, "true")
.option(HIVE_URL_OPT_KEY,
"jdbc:hive2://XXXXXX:10000/;principal=XXXX/XXXXXXX)
.option(HIVE_DATABASE_OPT_KEY, hudi_db)
.option(HIVE_TABLE_OPT_KEY, tablename)
.option(HIVE_PARTITION_EXTRACTOR_CLASS_OPT_KEY,
classOf[NonPartitionedExtractor].getName)
.option(PAYLOAD_CLASS_OPT_KEY,
"org.apache.hudi.EmptyHoodieRecordPayload")
.mode(Append)
.save("/user/XXXXX/hudi/" + tablename)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
