Jonathan Vexler created HUDI-7066:
-------------------------------------
Summary: Only push down all filters to mor base reader
Key: HUDI-7066
URL: https://issues.apache.org/jira/browse/HUDI-7066
Project: Apache Hudi
Issue Type: Bug
Reporter: Jonathan Vexler
Assignee: Jonathan Vexler
{code:java}
val preMergeBaseFileReader = if (isMOR) {
readerFormat.buildReaderWithPartitionValues(sparkSession, dataSchema,
StructType(Seq.empty),
requiredSchemaWithMandatory, requiredFilters, options, new
Configuration(hadoopConf))
} else {
_: PartitionedFile => Iterator.empty
} {code}
requiredFilters can only have recorkey filters
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
