agrawaldevesh commented on pull request #4563: URL: https://github.com/apache/hudi/pull/4563#issuecomment-1014649282
Thanks Todd ! Can you share more details about this catalog remapping service ? Would it be a must have before we deprecate the existing the hive-Hudi way ? I am also curious how the proposed design for the Hudi connector differs from the approach taken by the iceberg and delta connectors in presto ? Thanks On Mon, Jan 17, 2022 at 12:36 AM Todd Gao ***@***.***> wrote: > @agrawaldevesh <https://github.com/agrawaldevesh> > > For the first question, users will need to change their queries to use the > hudi connector at first. For example, change select * from > hive.schema.hudi_table to select * from hudi.shema.hudi_table. While, we > also proposed <https://github.com/prestodb/presto/issues/17006> the > catalog remapping service, which would automatically change the catalog > name without user effort. This might work as a new plugin in Presto. > > The features like predicate pushdown are going to be also supported in > hudi connector. Presto codebase makes a good abstraction on manipulation to > parquet (, orc and other formats). We will reuse the good parts of existing > code. > > The performance of the hudi connector will be on par with hudi connector. > In the early versions, hudi connector will have almost the same read path > as hive connector. But we are going to add some specified optimization to > get better performance for hudi queries. > > Exactly, the new connector opens up the possibility to write into Hudi > tables via Presto. Further designs will be added in future. > > — > Reply to this email directly, view it on GitHub > <https://github.com/apache/hudi/pull/4563#issuecomment-1014264458>, or > unsubscribe > <https://github.com/notifications/unsubscribe-auth/AE44R777YH7QTVNZOWQIZYTUWPIKNANCNFSM5LVTOLIQ> > . > You are receiving this because you were mentioned.Message ID: > ***@***.***> > -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
