[ 
https://issues.apache.org/jira/browse/HUDI-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

sivabalan narayanan updated HUDI-2741:
--------------------------------------
    Description: 
Validate metadata config for all readers

 

Ensure default is false. and metadata is not enabled. 

When enabled, ensure metadata table is used for file listing. 

 

 

  was:
Validate metadata config for all readers

 

Ensure default is false. and metadata is not enabled. 

When enabled, ensure metadata table is used for file listing. 

 

Hive: added log statements and verified w/ docker set up. 

If not set, default reader value of false is taken. 

If set to true, metadata is enabled.

 

Verified for spark-shell (using spark-sql, our docker set up): 

If not set, default reader value of false is taken. 

If set to true, metadata is enabled.

 

[~codope]  is working on a fix for presto and trino and so gonna take up the 
verification on this end. 


> Validate metadata config for all readers
> ----------------------------------------
>
>                 Key: HUDI-2741
>                 URL: https://issues.apache.org/jira/browse/HUDI-2741
>             Project: Apache Hudi
>          Issue Type: Sub-task
>            Reporter: sivabalan narayanan
>            Assignee: sivabalan narayanan
>            Priority: Blocker
>              Labels: pull-request-available
>             Fix For: 0.10.0
>
>
> Validate metadata config for all readers
>  
> Ensure default is false. and metadata is not enabled. 
> When enabled, ensure metadata table is used for file listing. 
>  
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to