Tao Meng created HUDI-3742:
------------------------------

             Summary: Enable parquet  enableVectorizedReader for spark 
incremental read to prevent pef regression
                 Key: HUDI-3742
                 URL: https://issues.apache.org/jira/browse/HUDI-3742
             Project: Apache Hudi
          Issue Type: Improvement
          Components: spark
            Reporter: Tao Meng
             Fix For: 0.11.0


now we disable parquet  enableVectorizedReader for mor incremental read,

and set "spark.sql.parquet.recordLevelFilter.enabled" = "true"  to achieve data 
filter

which is slow



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to