sivabalan narayanan created HUDI-2494:
-----------------------------------------

             Summary: Fix usage of different key generators with metadata 
enabled
                 Key: HUDI-2494
                 URL: https://issues.apache.org/jira/browse/HUDI-2494
             Project: Apache Hudi
          Issue Type: Improvement
          Components: Spark Integration
            Reporter: sivabalan narayanan
            Assignee: sivabalan narayanan
             Fix For: 0.10.0


With sync metadata patch, when metadata is enabled by default, some spark 
datasource tests failed which were using timestamp based key gen and custom key 
gen. Metadata table's records are getting picked up when we do 

 

spark.read.format(hudi).load(basePath + "/*/*")

For now, I have disabled metadata for these tests. 

testSparkPartitonByWithTimestampBasedKeyGenerator

testSparkPartitonByWithCustomKeyGenerator

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to