Re: kylin-1.5.4同步hive元数据报错

[Li Yang]

We may not be able to reproduce the problem (at least I cannot). Both 1.5.4
and 1.5.3 works for me.

By my experience, the root cause is often HBASE_CLASSPATH was swallowed. As
a test, try below in command shell.

[root@sandbox]# export HBASE_CLASSPATH=*ABCDE*
[root@sandbox]# hbase classpath
/usr/hdp/2.2.4.2-2/hbase/conf:/usr/lib/jvm/java-1.7.0-openjdk.x86_64/lib/tools.jar:/usr/hdp/2.2.4.2-2/hbase:/usr/hdp/2.2.4.2-2/hbase/lib/activation-1.1.jar:/usr/hdp/2.2.4.2-2/hbase/lib/aopalliance-1.0.jar.:/usr/hdp/2.2.4.2-2/zookeeper/*:/usr/hdp/2.2.4.2-2/zookeeper/lib/*:
*ABCDE*

If you don't get ABCDE from 'hbase classpath', that confirms
HBASE_CLASSPATH was lost inside hbase shell.

Cheers
Yang

On Tue, Sep 20, 2016 at 9:07 AM, ShaoFeng Shi 
wrote:

> Hi Tongxin,
>
> 1.5.4 has no special requirement on hive version; From 1.5.3 to 1.5.4, the
> kylin.sh has some change, please check whether it was the shell script
> which wasn't able to detect the dependency jars correctly. Please share
> with us about your finding, or if you can fix that and contribute a patch,
> that would be great.
>
>
>
> 2016-09-19 15:30 GMT+08:00 仇同心 :
>
>> 大家好：
>> 今天在使用kylin1.5.4版本时，在同步hive元数据时报错：
>> Load Hive Table Metadata From Tree页面一直显示：Loading Databases.
>>
>>
>> 错误信息打印在kylin.out文件
>>
>> SEVERE: Servlet.service() for servlet [kylin] in context with path
>> [/kylin] threw exception [Handler processing failed;
>> nested exception is java.lang.NoClassDefFoundError:
>> org/apache/hadoop/hive/ql/session/SessionState] with root cause
>> java.lang.ClassNotFoundException: org.apache.hadoop.hive.ql.sess
>> ion.SessionState
>> at org.apache.catalina.loader.WebappClassLoaderBase.loadClass(W
>> ebappClassLoaderBase.java:1858)
>> at org.apache.catalina.loader.WebappClassLoaderBase.loadClass(W
>> ebappClassLoaderBase.java:1701)
>> at org.apache.kylin.rest.controller.TableController.showHiveDat
>> abases(TableController.java:315)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAcce
>> ssorImpl.java:57)
>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMe
>> thodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:606)
>> at org.springframework.web.method.support.InvocableHandlerMetho
>> d.doInvoke(InvocableHandlerMethod.java:221)
>> at org.springframework.web.method.support.InvocableHandlerMetho
>> d.invokeForRequest(InvocableHandlerMethod.java:13
>> 6)
>>
>> 但是hive能正常使用，如果换成kylin 1.5.3版本没问题，Load Hive Table Metadata From
>> Tree页面能显示出hive里的db.
>> 我使用的hive版本是1.2.1，不知道kylin 1.5.4是否对hive 版本有要求？
>>
>>
>> 谢谢！
>>
>>
>
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
>
>

Re: kylin-1.5.4同步hive元数据报错

[ShaoFeng Shi]

Hi Tongxin,

1.5.4 has no special requirement on hive version; From 1.5.3 to 1.5.4, the
kylin.sh has some change, please check whether it was the shell script
which wasn't able to detect the dependency jars correctly. Please share
with us about your finding, or if you can fix that and contribute a patch,
that would be great.



2016-09-19 15:30 GMT+08:00 仇同心 :

> 大家好：
> 今天在使用kylin1.5.4版本时，在同步hive元数据时报错：
> Load Hive Table Metadata From Tree页面一直显示：Loading Databases.
>
>
> 错误信息打印在kylin.out文件
>
> SEVERE: Servlet.service() for servlet [kylin] in context with path
> [/kylin] threw exception [Handler processing failed;
> nested exception is java.lang.NoClassDefFoundError:
> org/apache/hadoop/hive/ql/session/SessionState] with root cause
> java.lang.ClassNotFoundException: org.apache.hadoop.hive.ql.
> session.SessionState
> at org.apache.catalina.loader.WebappClassLoaderBase.loadClass(
> WebappClassLoaderBase.java:1858)
> at org.apache.catalina.loader.WebappClassLoaderBase.loadClass(
> WebappClassLoaderBase.java:1701)
> at org.apache.kylin.rest.controller.TableController.
> showHiveDatabases(TableController.java:315)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(
> NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.springframework.web.method.support.InvocableHandlerMethod.
> doInvoke(InvocableHandlerMethod.java:221)
> at org.springframework.web.method.support.InvocableHandlerMethod.
> invokeForRequest(InvocableHandlerMethod.java:13
> 6)
>
> 但是hive能正常使用，如果换成kylin 1.5.3版本没问题，Load Hive Table Metadata From
> Tree页面能显示出hive里的db.
> 我使用的hive版本是1.2.1，不知道kylin 1.5.4是否对hive 版本有要求？
>
>
> 谢谢！
>
>


-- 
Best regards,

Shaofeng Shi 史少锋

Re: Kylin and BI Tools

[Luke Han]

Very nice, thanks Alberto


Best Regards!
-

Luke Han

On Mon, Sep 19, 2016 at 10:21 PM, Billy(Yiming) Liu  wrote:

> So cool, impressive. Thank you, Alberto.
>
> 2016-09-19 21:42 GMT+08:00 Alberto Ramón :
>
>> Hello
>>
>> This is the end of all my previous articles, about Kylin and differents
>> tools
>> With some successful and some failures   :)
>>
>>
>> https://github.com/albertoRamon/Kylin/tree/master/KylinWithMain
>>
>>
>>
>> If you have any comment / improvement, feel free to indicate me the
>> changes
>> A lot of thanks to the "Kylin Team", Alb
>>
>
>
>
> --
> With Warm regards
>
> Yiming Liu (刘一鸣)
>

Re: group by on varchar column

[Sandeep Khurana]

btw, we are using Kylin version 1.5.2

On Tue, Sep 20, 2016 at 2:03 AM, Sandeep Khurana 
wrote:

> Hello
>
> I have a query where i do group by on a varchar column. The column values
> are long sentences (not just single words). This column is part of a
> dimension table.
>
> When i select just from dimension table with this group by then I do
> get ~2000 records   .
>
> But when I join this dimension with the fact table and run the group by
> query then I get just 1 record as Kylin somehow assumes the VARCHAR column
> values as NULL. There is not even a single row which has value of this
> VARCHAR field as null.
>
> Same query I copy paste and run on the Hive tables, I do get more than
> thousand records.
>
> Strange thing is when I change the aggregate column to another VARCHAR
> column (city_name) whose values are just one word and run on kylin SQL
> editor then I do get proper records .
>
> 2 questions
>
> - Any idea why such behaviour ? Especially when Hive gives proper records
> whereas kylin returns just one record which has value of this big varchar
> field as NULL.
>
> - Is there any work around?
>
>

Re: Kylin and BI Tools

[Billy(Yiming) Liu]

So cool, impressive. Thank you, Alberto.

2016-09-19 21:42 GMT+08:00 Alberto Ramón :

> Hello
>
> This is the end of all my previous articles, about Kylin and differents
> tools
> With some successful and some failures   :)
>
>
> https://github.com/albertoRamon/Kylin/tree/master/KylinWithMain
>
>
>
> If you have any comment / improvement, feel free to indicate me the changes
> A lot of thanks to the "Kylin Team", Alb
>



-- 
With Warm regards

Yiming Liu (刘一鸣)

Kylin and BI Tools

[Alberto Ramón]

Hello

This is the end of all my previous articles, about Kylin and differents
tools
With some successful and some failures   :)


https://github.com/albertoRamon/Kylin/tree/master/KylinWithMain



If you have any comment / improvement, feel free to indicate me the changes
A lot of thanks to the "Kylin Team", Alb

Kylin Web Interface bug on CDH 5.7

[fanz...@zhiziyun.com]

Hi,

I recently installed Kylin on CDH 5.7. I tried both Kylin version 1.5.3 on CDH 
5.7 and 1.5.4 on CDH 5.7, there are both the same problem.

When configuring data cube, at step 3, Measures, the interface looks weird on 
Chrome browser and there is no place to add or edit measures. The screenshot is 
attached at the bottom. There is no problem when I switched to Windows Edge.

Regards,

Zhou



fanz...@zhiziyun.com

kylin-1.5.4同步hive元数据报错

[仇同心]

大家好：
今天在使用kylin1.5.4版本时，在同步hive元数据时报错：
Load Hive Table Metadata From Tree页面一直显示：Loading Databases.


错误信息打印在kylin.out文件

SEVERE: Servlet.service() for servlet [kylin] in context with path [/kylin] 
threw exception [Handler processing failed;
nested exception is java.lang.NoClassDefFoundError: 
org/apache/hadoop/hive/ql/session/SessionState] with root cause
java.lang.ClassNotFoundException: org.apache.hadoop.hive.ql.session.SessionState
at 
org.apache.catalina.loader.WebappClassLoaderBase.loadClass(WebappClassLoaderBase.java:1858)
at 
org.apache.catalina.loader.WebappClassLoaderBase.loadClass(WebappClassLoaderBase.java:1701)
at 
org.apache.kylin.rest.controller.TableController.showHiveDatabases(TableController.java:315)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at 
org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:221)
at 
org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:13
6)

但是hive能正常使用，如果换成kylin 1.5.3版本没问题，Load Hive Table Metadata From 
Tree页面能显示出hive里的db.
我使用的hive版本是1.2.1，不知道kylin 1.5.4是否对hive 版本有要求？


谢谢！