Hi Yi, Supporting multiple HMSs or hive warehouses sounds interesting. I do understand the need for accessing different hive data sources within a single query in real-world cases.
So far, the Kyuubi community has already supported several Spark Datasource V2 implementations, such as TPC-DS, TPCH, and kudu, on the Kyuubi extension layer. And I believe we will support more and more connectors with the community effort in the future. The only thing that worries me is that the source code of spark builtin hive catalog itself is a mess. I don't know whether it will put a huge maintenance burden on our community or not. But I am +1 for it as it's worth trying. BR Kent zhaomin <zhaomin1...@163.com> 于2022年8月16日周二 17:57写道： > > I'm also interested in it. > > > > Best Regards, > Min Zhao > > > > > ---- Replied Message ---- > | From | kaifei yi<yikaif...@gmail.com> | > | Date | 08/16/2022 17:42 | > | To | dev@kyuubi.apache.org<dev@kyuubi.apache.org> | > | Cc | | > | Subject | Support Hive V2 DataSource in Kyuubi | > Hi, kyuubi community: > > Currently, Users are clamoring for the ability to federated queries in > Lakehouse architecture, we probably need a serval datasource to meet this. > > In practice, some user services need to access other hive warehouse for > federated queries. currently, Apache Spark supports access to hive data > sources. however, in federated scenarios, some capabilities may be > disabled, for example, users may need to access different hive warehouse at > the single job to perform federated query, and the hive versions are > different, this requirement can be met by a hive V2 datasource > > Does the Kyuubi community have any idea how to include hive V2 in the > feature list?
