Re: How does Kylin communicate with underlying Hadoop services ?

[Billy(Yiming) Liu]

Hive is the data source, not the query engine for Kylin. Kylin is the query
engine itself.
The Hive command you found is the command to retrieve the data source, not
user query.

2016-09-14 10:42 GMT+08:00 udana pathirana :

> So basically you execute Beeline or Hive command to send queries to
> Hive.(according to the logs , I could see  the same thing).
> I am just curious, you didn't you use JDBC connection to HiveServer2
> (thrift server) instead , without executing system commands.
> Something like :
>
> Connection con = DriverManager.getConnection("jdbc:hive://hive-server.
> hadoop.local:1/", "", "");
> Statement stmt = con.createStatement();
> String tableName = "testHiveDriverTable";
>
> On Mon, Sep 12, 2016 at 9:46 PM, Yiming Liu 
> wrote:
>
>> 1. Yes
>> 2. Both Hive CLI and Beeline are supported. check kylin.hive.client in
>> kylin.properties
>> 3. Yes. ZK works as a lock service for cube build.
>>
>> 2016-09-12 10:00 GMT+08:00 udana pathirana :
>>
>>> I have some questions about how Kylin connects to different services
>>>
>>> 1) Does Kylin communicate with HBase using hbase-client library
>>> (org.apache.hadoop.hbase.client.Connection) ? I assume it reads HBase
>>> master node/port from the hbase-site.xml ?
>>>
>>> 2) Does Kylin communicate with Hive using JDBC/SQL protocol? Same as
>>> Beeline ? If so, does it read Hive server/port from hive-site.xml ?
>>>
>>> 3) Does Kylin connect to ZK ? IF so why ? How does it connect ; using
>>> zkCli or client library ?
>>>
>>
>>
>>
>> --
>> With Warm regards
>>
>> Yiming Liu (刘一鸣)
>>
>
>


-- 
With Warm regards

Yiming Liu (刘一鸣)

Re: How does Kylin communicate with underlying Hadoop services ?

[udana pathirana]

So basically you execute Beeline or Hive command to send queries to
Hive.(according to the logs , I could see  the same thing).
I am just curious, you didn't you use JDBC connection to HiveServer2
(thrift server) instead , without executing system commands.
Something like :

Connection con = DriverManager.getConnection(
"jdbc:hive://hive-server.hadoop.local:1/", "", "");
Statement stmt = con.createStatement();
String tableName = "testHiveDriverTable";

On Mon, Sep 12, 2016 at 9:46 PM, Yiming Liu  wrote:

> 1. Yes
> 2. Both Hive CLI and Beeline are supported. check kylin.hive.client in
> kylin.properties
> 3. Yes. ZK works as a lock service for cube build.
>
> 2016-09-12 10:00 GMT+08:00 udana pathirana :
>
>> I have some questions about how Kylin connects to different services
>>
>> 1) Does Kylin communicate with HBase using hbase-client library
>> (org.apache.hadoop.hbase.client.Connection) ? I assume it reads HBase
>> master node/port from the hbase-site.xml ?
>>
>> 2) Does Kylin communicate with Hive using JDBC/SQL protocol? Same as
>> Beeline ? If so, does it read Hive server/port from hive-site.xml ?
>>
>> 3) Does Kylin connect to ZK ? IF so why ? How does it connect ; using
>> zkCli or client library ?
>>
>
>
>
> --
> With Warm regards
>
> Yiming Liu (刘一鸣)
>

Re: How does Kylin communicate with underlying Hadoop services ?

[Yiming Liu]

1. Yes
2. Both Hive CLI and Beeline are supported. check kylin.hive.client in
kylin.properties
3. Yes. ZK works as a lock service for cube build.

2016-09-12 10:00 GMT+08:00 udana pathirana :

> I have some questions about how Kylin connects to different services
>
> 1) Does Kylin communicate with HBase using hbase-client library
> (org.apache.hadoop.hbase.client.Connection) ? I assume it reads HBase
> master node/port from the hbase-site.xml ?
>
> 2) Does Kylin communicate with Hive using JDBC/SQL protocol? Same as
> Beeline ? If so, does it read Hive server/port from hive-site.xml ?
>
> 3) Does Kylin connect to ZK ? IF so why ? How does it connect ; using
> zkCli or client library ?
>



-- 
With Warm regards

Yiming Liu (刘一鸣)