kylin-yarn-ClassNotFoundException

2017-04-08 Thread chenping...@keruyun.com 
my environment is CDH 5.8.4  and kylin is  apache-kylin-1.6.0-cdh5.7-bin.tar.gz
I make the "Quick Start with Sample Cube"
YARN MR2 have the flow exception
2017-04-07 15:06:34,630 ERROR [IPC Server handler 4 on 24149] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: 
attempt_1490945407994_0217_m_00_1 - exited : 
java.lang.ClassNotFoundException: 
org.apache.hadoop.hive.serde2.typeinfo.TypeInfo
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:274)
at 
org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:2138)
at 
org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2103)
at 
org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2197)
at 
org.apache.hadoop.mapreduce.task.JobContextImpl.getInputFormatClass(JobContextImpl.java:184)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:749)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1783)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

my environment have the jar of hive-serde.jar,why ClassNotFoundException？is 
this kylin problem？thanks.




陈平  DBA工程师
 
成都时时客科技有限责任公司
地址：成都市高新区天府大道1268号1栋3层
邮编：610041
手机：15108456581
在线：QQ 625852056
官网：www.keruyun.com
客服：4006-315-666

Re: Re: kylin 监控JMX

2017-12-21 Thread chenping...@keruyun.com 


I have this problem
"export JMX_PORT=port_number in kylin.sh, It doesn't work and the port doesn't
come up", How to solve ?
 



陈平  DBA工程师
 
成都时时客科技有限责任公司
地址：成都市高新区天府大道1268号1栋3层
邮编：610041
手机：15108456581
在线：QQ 625852056
官网：www.keruyun.com
客服：4006-315-666
 
 
From: jun
Date: 2017-12-18 20:18
To: dev
Subject: Re: kylin 监控JMX
export JMX_PORT=port_number in kylin.sh, It doesn't work and the port doesn't
come up
 
--
Sent from: http://apache-kylin.74782.x6.nabble.com/

Re: Re: kylin 监控JMX

2017-12-24 Thread chenping...@keruyun.com 

I have set kylin.server.query-metrics-enabled in kylin.properties ,and  I have 
set export JMX_PORT=9001 in  kylin.sh,But the port 9001 doesn't come up,why? 
kylin verison :1.6   hadoop:CDH 8.4   jmx-collection-client:JConsole

my kylin log:
2017-12-25 14:05:02,864 INFO  [localhost-startStop-1] 
init.InitialTaskManager:37 : Kylin service is starting.
2017-12-25 14:05:02,898 WARN  [localhost-startStop-1] impl.MetricsConfig:124 : 
Cannot locate configuration: tried hadoop-metrics2-kylin.properties,hadoop
-metrics2.properties
2017-12-25 14:05:02,917 INFO  [localhost-startStop-1] 
impl.MetricsSystemImpl:377 : Scheduled snapshot period at 10 second(s).
2017-12-25 14:05:02,918 INFO  [localhost-startStop-1] 
impl.MetricsSystemImpl:191 : Kylin metrics system started
2017-12-25 14:05:03,185 DEBUG [localhost-startStop-1] hbase.HBaseConnection:277 
: HTable 'kylin_metadata_user' already exists
2017-12-25 14:05:03,371 INFO  [localhost-startStop-1] 
filter.AnnotationSizeOfFilter:53 : Using regular expression provided through VM 
argument net.sf.ehc
ache.pool.sizeof.ignore.pattern for IgnoreSizeOf annotation : 
^.*cache\..*IgnoreSizeOf$
2017-12-25 14:05:03,390 INFO  [localhost-startStop-1] sizeof.JvmInformation:446 
: Detected JVM data model settings of: 64-Bit HotSpot JVM with Compressed
 OOPs and Concurrent Mark-and-Sweep GC





陈平  DBA工程师
 
成都时时客科技有限责任公司
地址：成都市高新区天府大道1268号1栋3层
邮编：610041
手机：15108456581
在线：QQ 625852056
官网：www.keruyun.com
客服：4006-315-666
 
 
From: kangkaisen
Date: 2017-12-20 11:53
To: dev
Subject: Re: kylin 监控JMX
After setting kylin.server.query-metrics-enabled to true, kylin query metrics
will send to JMX.
As for How to collect JMX info:
For prod, you could use any well-known jmxtools to collect JMX info.
For debug and test, you could use jconsole tools:
1. set following commands to setenv.sh
 
export KYLIN_DEBUG_SETTINGS="-Dcom.sun.management.jmxremote
-Dcom.sun.management.jmxremote.authenticate=false
-Dcom.sun.management.jmxremote.ssl=false
-Dcom.sun.management.jmxremote.port=8416 -Djava.rmi.server.hostname=your
server IP -Dcom.sun.management.jmxremote.rmi.port=8416
-Dcom.sun.management.jmxremote.local.only=false"
 
2. restart kylin server
3. test a query
4. run jconsole on your local computer
5. connect remote kylin server with ip:port
6. click MBean button and find Hadoop-kylin-*** MBeans.
 
 
 
 
--
Sent from: http://apache-kylin.74782.x6.nabble.com/

Re: Re: kylin 监控JMX

2017-12-24 Thread chenping...@keruyun.com 
I have soulved this problem,I set -Dcom.sun.management.jmxremote.port= 
-Dcom.sun.management.
jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false  of 
KYLIN_JVM_SETTINGSin setenv.sh 



陈平  DBA工程师
 
成都时时客科技有限责任公司
地址：成都市高新区天府大道1268号1栋3层
邮编：610041
手机：15108456581
在线：QQ 625852056
官网：www.keruyun.com
客服：4006-315-666
 
 
发件人： [email protected]
发送时间： 2017-12-25 14:06
收件人： dev
主题： Re: Re: kylin 监控JMX

I have set kylin.server.query-metrics-enabled in kylin.properties ,and  I have 
set export JMX_PORT=9001 in  kylin.sh,But the port 9001 doesn't come up,why? 
kylin verison :1.6   hadoop:CDH 8.4   jmx-collection-client:JConsole

my kylin log:
2017-12-25 14:05:02,864 INFO  [localhost-startStop-1] 
init.InitialTaskManager:37 : Kylin service is starting.
2017-12-25 14:05:02,898 WARN  [localhost-startStop-1] impl.MetricsConfig:124 : 
Cannot locate configuration: tried hadoop-metrics2-kylin.properties,hadoop
-metrics2.properties
2017-12-25 14:05:02,917 INFO  [localhost-startStop-1] 
impl.MetricsSystemImpl:377 : Scheduled snapshot period at 10 second(s).
2017-12-25 14:05:02,918 INFO  [localhost-startStop-1] 
impl.MetricsSystemImpl:191 : Kylin metrics system started
2017-12-25 14:05:03,185 DEBUG [localhost-startStop-1] hbase.HBaseConnection:277 
: HTable 'kylin_metadata_user' already exists
2017-12-25 14:05:03,371 INFO  [localhost-startStop-1] 
filter.AnnotationSizeOfFilter:53 : Using regular expression provided through VM 
argument net.sf.ehc
ache.pool.sizeof.ignore.pattern for IgnoreSizeOf annotation : 
^.*cache\..*IgnoreSizeOf$
2017-12-25 14:05:03,390 INFO  [localhost-startStop-1] sizeof.JvmInformation:446 
: Detected JVM data model settings of: 64-Bit HotSpot JVM with Compressed
 OOPs and Concurrent Mark-and-Sweep GC





陈平  DBA工程师
 
成都时时客科技有限责任公司
地址：成都市高新区天府大道1268号1栋3层
邮编：610041
手机：15108456581
在线：QQ 625852056
官网：www.keruyun.com
客服：4006-315-666
 
 
From: kangkaisen
Date: 2017-12-20 11:53
To: dev
Subject: Re: kylin 监控JMX
After setting kylin.server.query-metrics-enabled to true, kylin query metrics
will send to JMX.
As for How to collect JMX info:
For prod, you could use any well-known jmxtools to collect JMX info.
For debug and test, you could use jconsole tools:
1. set following commands to setenv.sh
 
export KYLIN_DEBUG_SETTINGS="-Dcom.sun.management.jmxremote
-Dcom.sun.management.jmxremote.authenticate=false
-Dcom.sun.management.jmxremote.ssl=false
-Dcom.sun.management.jmxremote.port=8416 -Djava.rmi.server.hostname=your
server IP -Dcom.sun.management.jmxremote.rmi.port=8416
-Dcom.sun.management.jmxremote.local.only=false"
 
2. restart kylin server
3. test a query
4. run jconsole on your local computer
5. connect remote kylin server with ip:port
6. click MBean button and find Hadoop-kylin-*** MBeans.
 
<http://apache-kylin.74782.x6.nabble.com/file/t705/1.1> 
<http://apache-kylin.74782.x6.nabble.com/file/t705/2.2> 
 
--
Sent from: http://apache-kylin.74782.x6.nabble.com/

kylin前端业务查询问题

2017-12-28 Thread chenping...@keruyun.com 

各位好，我现在遇到一个比较大的问题，前端有很多查询同时过来，我想知道怎么去查看当前的kylin实例正在运行哪些查询并且怎么去kill掉运行时间很久的查询？



陈平  DBA工程师
 
成都时时客科技有限责任公司
地址：成都市高新区天府大道1268号1栋3层
邮编：610041
手机：15108456581
在线：QQ 625852056
官网：www.keruyun.com
客服：4006-315-666