xushiyan edited a comment on issue #3581: URL: https://github.com/apache/hudi/issues/3581#issuecomment-922412247
@codejoyan after diving into the code, i saw the logic to enable HoodieFileIndex, which we should have clearly stated somewhere in the docs. Please try loading the dataset without glob path, like reading from `"gs://udp-hudi-storage3/store_visit_scan_hudi_spark_3_tgt_v3"`. Also to make sure partition pruning works, can you see if your `hoodie.properties` file contains `hoodie.table.partition.fields= cntry,part_date` ? If not, please add it manually there. Let us know how it works for you. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
