vinothchandar commented on issue #2461: URL: https://github.com/apache/hudi/issues/2461#issuecomment-765188290
@vrtrepp you could potentially modify your existing glue step to run the hive-sync tool as an additonal step? At a high level, without the `HoodieParquetInputFormat` as the registered format, its impossible for athena to do the filtering necessary to just give you the latest records. Just saw this today : https://aws.amazon.com/blogs/big-data/writing-to-apache-hudi-tables-using-aws-glue-connector/ , not sure if its directly helpful for you ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
