Tao Meng created HUDI-3742:
------------------------------
Summary: Enable parquet enableVectorizedReader for spark
incremental read to prevent pef regression
Key: HUDI-3742
URL: https://issues.apache.org/jira/browse/HUDI-3742
Project: Apache Hudi
Issue Type: Improvement
Components: spark
Reporter: Tao Meng
Fix For: 0.11.0
now we disable parquet enableVectorizedReader for mor incremental read,
and set "spark.sql.parquet.recordLevelFilter.enabled" = "true" to achieve data
filter
which is slow
--
This message was sent by Atlassian Jira
(v8.20.1#820001)