vinothchandar commented on code in PR #13300:
URL: https://github.com/apache/hudi/pull/13300#discussion_r2121944860
##########
hudi-common/src/main/java/org/apache/hudi/avro/HoodieAvroReaderContext.java:
##########
@@ -80,12 +87,34 @@ public ClosableIterator<IndexedRecord>
getFileRecordIterator(
long length,
Schema dataSchema,
Schema requiredSchema,
- HoodieStorage storage
- ) throws IOException {
+ HoodieStorage storage) throws IOException {
HoodieAvroFileReader reader = (HoodieAvroFileReader)
HoodieIOFactory.getIOFactory(storage)
.getReaderFactory(HoodieRecord.HoodieRecordType.AVRO).getFileReader(new
HoodieConfig(),
- filePath, HoodieFileFormat.PARQUET, Option.empty());
- return reader.getIndexedRecordIterator(dataSchema, requiredSchema);
+ filePath, baseFileFormat, Option.empty());
+ if (keyFilterOpt.isEmpty()) {
+ return reader.getIndexedRecordIterator(dataSchema, requiredSchema);
+ } else {
+ // Currently predicate is only supported for HFile reader.
+ if (!(reader instanceof HoodieAvroHFileReaderImplBase)) {
Review Comment:
can we gracefully degrade vs special casing things like this?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
