Hi Kylin developers, Currently, Kylin will load the hive configuration from the HIVE_DEPENDENCY classpath. That means Kylin supports only one hive source. KYLIN-1826 aims to support multiple hive data sources, but the design is a little complicated by introducing the EXTERNAL HIVE concepts.
The data source management becomes more tricky when multiple hive clusters and multiple kafka clusters are needed. I just rise the question today without specific solution yet, all suggestions are welcomed. I think it could be very useful if Kylin could support data source management. It should have the following features: 1. Defines Hive Cluster/Kafka Cluster as the data source factory under Project. 2. One Project could have more than one Hive/Kafka/SparkSQL Cluster definitions. 3. When "Load Table/Streaming", Kylin could load the TABLE(Hive) and Topic(Kafka) definition from Hive/Kafka directly. 4. The following model design and cube build are the same as before still. I know it's not a critical requirement, but maybe someone wants it too. Thank you a lot. -- With Warm regards Yiming Liu (刘一鸣)
