Vinish Reddy created HUDI-9217:
----------------------------------
Summary: Include table version check in
isPartialUpdateActionForMOR for MERGE_INTO
Key: HUDI-9217
URL: https://issues.apache.org/jira/browse/HUDI-9217
Project: Apache Hudi
Issue Type: Bug
Components: spark, spark-sql
Reporter: Vinish Reddy
Assignee: Vinish Reddy
1.x upsert MERGE INTO with table version 6 is trying to write partial updates
and failing with above exception.
{{2025-03-24T06:38:09.2610233Z Caused by: java.lang.RuntimeException:
Error executing sql: MERGE INTO hudi_local_index_mor t
2025-03-24T06:38:09.2610317Z USING source_updates s
2025-03-24T06:38:09.2610404Z ON t.record_key = s.record_key
2025-03-24T06:38:09.2610488Z WHEN MATCHED THEN
2025-03-24T06:38:09.2610560Z UPDATE SET
2025-03-24T06:38:09.2610652Z department = s.department,
2025-03-24T06:38:09.2610731Z salary = s.salary,
2025-03-24T06:38:09.2610810Z ts = s.ts
2025-03-24T06:38:09.2610887Z WHEN NOT MATCHED THEN
2025-03-24T06:38:09.2610963Z INSERT *
2025-03-24T06:38:09.2610968Z
2025-03-24T06:38:09.2611248Z
integrationTests.sql.HiveConnection.runQueryAndFetchResultsInCsv(HiveConnection.java:125)
2025-03-24T06:38:09.2611542Z
integrationTests.validation.SqlQueryValidatorV2.lambda$runTests$0(SqlQueryValidatorV2.java:90)
2025-03-24T06:38:09.2611772Z
integrationTests.util.RetryUtils.lambda$executeWithRetryVoid$0(RetryUtils.java:127)
2025-03-24T06:38:09.2611979Z
integrationTests.util.RetryUtils.executeWithRetry(RetryUtils.java:51)
2025-03-24T06:38:09.2612215Z
integrationTests.util.RetryUtils.executeWithRetryVoid(RetryUtils.java:125)
2025-03-24T06:38:09.2612328Z [...]
2025-03-24T06:38:09.2613089Z Caused by: java.sql.SQLException:
org.apache.hive.service.cli.HiveSQLException: Error running query:
org.apache.hudi.exception.HoodieNotSupportedException: Partial updates are not
supported for table versions < 8. Please unset
hoodie.write.partial.update.schema}}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
