guanziyue commented on issue #2648: URL: https://github.com/apache/hudi/issues/2648#issuecomment-846419072
@nsivabalan @n3nash Actually this problem is not totally equivalent to the issue 2633. Just like I mentioned before, the method buildFileIndex in MergeOnReadSnapshotRelation assume all file group must have a base file. Even though issue 2633 is fixed, an index with canLogIndexFile will still generate file group w/o base file. I think the logic in MergeOnReadSnapshotRelation should have a small fix. Method groupLogsByBaseFile of HoodieRealtimeInputFormatUtils may group logs by fileID rather than Base file. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
