Ranga Reddy created HUDI-9079:
---------------------------------

             Summary: Log the exception message properly to handle the 
"default" partition value migration steps.
                 Key: HUDI-9079
                 URL: https://issues.apache.org/jira/browse/HUDI-9079
             Project: Apache Hudi
          Issue Type: Bug
    Affects Versions: 1.0.0, 0.15.0, 0.14.0, 0.13.0, 0.12.0
            Reporter: Ranga Reddy


In the step for deleting the default partition, we need to specify the format 
as Hudi during the Spark writing process; otherwise, it will be treated as a 
normal Parquet file.

 
{code:java}
df.write.option(\"hoodie.datasource.write.operation\",\"delete\").options(writeOptions).mode(Append).save(HUDI_TABLE_PATH);{code}
https://github.com/apache/hudi/blob/master/hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/upgrade/FourToFiveUpgradeHandler.java#L59

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to