[jira] [Created] (KYLIN-4375) After kylin is started in hdp3.0 environment, the web page is blank and ClassNotFoundException is seen in kylin.log

[Yaqian Zhang (Jira)]

Yaqian Zhang created KYLIN-4375:
---

 Summary: After kylin is started in hdp3.0 environment, the web 
page is blank and ClassNotFoundException is seen in kylin.log
 Key: KYLIN-4375
 URL: https://issues.apache.org/jira/browse/KYLIN-4375
 Project: Kylin
  Issue Type: Bug
  Components: Environment 
Affects Versions: v2.6.5, v3.0.1
 Environment: HDP3
Reporter: Yaqian Zhang
 Fix For: Future


After kylin is started in hdp3.0 environment，it looks like it started 
successfully on the surface. But the web page is black.

Kylin.log output is as follows：

```

Caused by: java.lang.NoClassDefFoundError: 
org/apache/commons/configuration/ConfigurationException

```



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (KYLIN-4244) ClassNotFoundException while use org.apache.kylin.engine.mr.common.CubeStatsReader in bash

[ZhouKang (Jira)]

ZhouKang created KYLIN-4244:
---

 Summary: ClassNotFoundException while use 
org.apache.kylin.engine.mr.common.CubeStatsReader in bash
 Key: KYLIN-4244
 URL: https://issues.apache.org/jira/browse/KYLIN-4244
 Project: Kylin
  Issue Type: Bug
Reporter: ZhouKang


use kylin.sh

 
{code:java}
// code placeholder
bash ./kylin.sh org.apache.kylin.engine.mr.common.CubeStatsReader 
caifeng_usage_cube
{code}
get an Exception
{code:java}
// code placeholder
Exception in thread "main" java.lang.NoClassDefFoundError: 
com/tdunning/math/stats/TDigest
at 
org.apache.kylin.measure.percentile.PercentileSerializer.current(PercentileSerializer.java:62)
at 
org.apache.kylin.measure.percentile.PercentileSerializer.getStorageBytesEstimate(PercentileSerializer.java:52)
at 
org.apache.kylin.metadata.datatype.DataType.getStorageBytesEstimate(DataType.java:256)
at 
org.apache.kylin.engine.mr.common.CubeStatsReader.estimateCuboidStorageSize(CubeStatsReader.java:251)
at 
org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMapFromRowCount(CubeStatsReader.java:211)
at 
org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMap(CubeStatsReader.java:170)
at 
org.apache.kylin.engine.mr.common.CubeStatsReader.print(CubeStatsReader.java:273)
at 
org.apache.kylin.engine.mr.common.CubeStatsReader.main(CubeStatsReader.java:435)
Caused by: java.lang.ClassNotFoundException: com.tdunning.math.stats.TDigest
at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 8 more
{code}
 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (KYLIN-3194) Tolerate broken job metadata caused by executable ClassNotFoundException

[liyang (JIRA)]

liyang created KYLIN-3194:
-

 Summary: Tolerate broken job metadata caused by executable 
ClassNotFoundException
 Key: KYLIN-3194
 URL: https://issues.apache.org/jira/browse/KYLIN-3194
 Project: Kylin
  Issue Type: Improvement
Reporter: liyang
Assignee: liyang


As Kylin evolves, many executable class was renamed or deprecated. These lead 
to broken job metadata and ClassNotFoundException can be thrown from many 
places in the code. Better to tolerate these error metadata once for all.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: kylin-yarn-ClassNotFoundException

[Alberto Ramón]

Hi

I think cdh 5.8 isn't supported yet
See that there is a binary of 5.7 but not 5.8


El 9 abr. 2017 2:10 a. m., "chenping...@keruyun.com" <
chenping...@keruyun.com> escribió:

my environment is CDH 5.8.4  and kylin is  apache-kylin-1.6.0-cdh5.7-
bin.tar.gz
I make the "Quick Start with Sample Cube"
YARN MR2 have the flow exception

2017-04-07 15:06:34,630 ERROR [IPC Server handler 4 on 24149]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task:
attempt_1490945407994_0217_m_00_1 - exited :
java.lang.ClassNotFoundException:
org.apache.hadoop.hive.serde2.typeinfo.TypeInfo
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:274)
at 
org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:2138)
at 
org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2103)
at 
org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2197)
at 
org.apache.hadoop.mapreduce.task.JobContextImpl.getInputFormatClass(JobContextImpl.java:184)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:749)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1783)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

my environment have the jar of hive-serde.jar,why ClassNotFoundException？is
this kylin problem？thanks.


--

陈平  DBA工程师



成都时时客科技有限责任公司

地址：成都市高新区天府大道1268号1栋3层

邮编：610041

手机：15108456581 <(510)%20845-6581>

在线：QQ 625852056

官网：www.keruyun.com

客服：4006-315-666

kylin-yarn-ClassNotFoundException

[chenping...@keruyun.com]

my environment is CDH 5.8.4  and kylin is  apache-kylin-1.6.0-cdh5.7-bin.tar.gz
I make the "Quick Start with Sample Cube"
YARN MR2 have the flow exception
2017-04-07 15:06:34,630 ERROR [IPC Server handler 4 on 24149] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: 
attempt_1490945407994_0217_m_00_1 - exited : 
java.lang.ClassNotFoundException: 
org.apache.hadoop.hive.serde2.typeinfo.TypeInfo
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:274)
at 
org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:2138)
at 
org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2103)
at 
org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2197)
at 
org.apache.hadoop.mapreduce.task.JobContextImpl.getInputFormatClass(JobContextImpl.java:184)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:749)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1783)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

my environment have the jar of hive-serde.jar,why ClassNotFoundException？is 
this kylin problem？thanks.




陈平  DBA工程师
 
成都时时客科技有限责任公司
地址：成都市高新区天府大道1268号1栋3层
邮编：610041
手机：15108456581
在线：QQ 625852056
官网：www.keruyun.com
客服：4006-315-666
 

Re: ClassNotFoundException

[hongbin ma]

are you using CHD, kylin 1.5.0?

take a look at
http://apache-kylin.74782.x6.nabble.com/Stuck-with-ClassNotFoundException-HCatInputFormat-td4032.html

it can be found if you search google

On Wed, Apr 13, 2016 at 6:01 PM, 耳东 <775620...@qq.com> wrote:

> Hi all：   when I built the cube, this exception occured. Is there any
> solution to this excepiton. I am using Kylin on a cluster.
>
>
>
>
> Error: java.lang.RuntimeException: java.lang.ClassNotFoundException:
> Class  org.apache.hive.hcatalog.mapreduce.HCatInputFormat not found at
> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2112) at
> org.apache.hadoop.mapreduce.task.JobContextImpl.getInputFormatClass(JobContextImpl.java:184)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:749) at
> org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) at
> org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163) at
> java.security.AccessController.doPrivileged(Native Method) at
> javax.security.auth.Subject.doAs(Subject.java:415) at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1776)
> at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) Caused by:
> java.lang.ClassNotFoundException: Class
> org.apache.hive.hcatalog.mapreduce.HCatInputFormat not found at
> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2018)
> at  org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2110)
> ... 8  more




-- 
Regards,

*Bin Mahone | 马洪宾*
Apache Kylin: http://kylin.io
Github: https://github.com/binmahone

ClassNotFoundException

[????]

Hi all??   when I built the cube, this exception occured. Is there any 
solution to this excepiton. I am using Kylin on a cluster.




Error: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class  
org.apache.hive.hcatalog.mapreduce.HCatInputFormat not found at  
org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2112) at  
org.apache.hadoop.mapreduce.task.JobContextImpl.getInputFormatClass(JobContextImpl.java:184)
  at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:749) at  
org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) at  
org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163) at  
java.security.AccessController.doPrivileged(Native Method) at  
javax.security.auth.Subject.doAs(Subject.java:415) at  
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1776)
  at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) Caused by:  
java.lang.ClassNotFoundException: Class  
org.apache.hive.hcatalog.mapreduce.HCatInputFormat not found at  
org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2018) at 
 org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2110) ... 8  
more

Re:Re: Stuck with ClassNotFoundException ( HCatInputFormat)

[钱巧能]

Add some info related to this bug, it happens on Kylin 1.3 as well. not just 
1.5. Wish this info will benefit other 1.3 users.


At 2016-04-05 06:13:41, "Jins George"  wrote:
>Thanks! It worked.
>
>-Jins
>
>On 04/04/2016 06:49 AM, Li Yang wrote:
>> https://issues.apache.org/jira/browse/KYLIN-1507
>>
>> On Sat, Apr 2, 2016 at 9:34 PM, ShaoFeng Shi > > wrote:
>>
>> this is a bug in 1.5.0, pls google this error there is a reported
>> JIRA on this, and there is a workaround for it.
>>
>> Regards，
>>
>> Shaofeng Shi
>>
>> shaofeng...@gmail.com 
>>
>> From Outlook Mobile 
>>
>>
>>
>>
>> On Fri, Apr 1, 2016 at 3:57 PM -0700, "Jins George"
>> > wrote:
>>
>> Hello Kylin Community,
>>
>> I am stuck with setting up kylin and running sample cube building. I 
>> am getting class not found exception for HCatInputFormat  in the "Extract 
>> Fact Table Distinct Columns" step of kylin_sales_cube build.
>>
>> I verified that hive-catalog 
>> jar(hive-hcatalog-core-1.1.0-cdh5.6.0.jar) is present in the  
>> hive_dependency also it is available in the path also.
>>
>> I am using Kylin 1.5.0 and CDH 5.6 distribution on a single node.
>>
>> Exception
>> 
>>
>> 2016-04-01 22:43:21,361 ERROR [IPC Server handler 1 on 35754] 
>> org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: 
>> attempt_1459550167892_0002_m_00_0 - exited :
>> java.lang.RuntimeException: java.lang.ClassNotFoundException: Class 
>> org.apache.hive.hcatalog.mapreduce.HCatInputFormat not found
>>  at 
>> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2199)
>>  at 
>> org.apache.hadoop.mapreduce.task.JobContextImpl.getInputFormatClass(JobContextImpl.java:184)
>>  at 
>> org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:749)
>>  at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
>>  at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
>>  at java.security.AccessController.doPrivileged(Native Method)
>>  at javax.security.auth.Subject.doAs(Subject.java:415)
>>  at 
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1707)
>>  at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
>> Caused by: java.lang.ClassNotFoundException: Class 
>> org.apache.hive.hcatalog.mapreduce.HCatInputFormat not found
>>  at 
>> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2105)
>>  at 
>> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2197)
>>  ... 8 more
>>
>> 
>>
>>
>> Any help is highly appreciated.
>>
>> Thanks,
>> Jins George
>>
>>
>

Stuck with ClassNotFoundException ( HCatInputFormat)

[Jins George]

Hello Kylin Community,

I am stuck with setting up kylin and running sample cube building. I am getting class not 
found exception for HCatInputFormat  in the "Extract Fact Table Distinct 
Columns" step of kylin_sales_cube build.

I verified that hive-catalog jar(hive-hcatalog-core-1.1.0-cdh5.6.0.jar) is 
present in the  hive_dependency also it is available in the path also.

I am using Kylin 1.5.0 and CDH 5.6 distribution on a single node.

Exception


2016-04-01 22:43:21,361 ERROR [IPC Server handler 1 on 35754] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: 
attempt_1459550167892_0002_m_00_0 - exited :
java.lang.RuntimeException: java.lang.ClassNotFoundException: Class 
org.apache.hive.hcatalog.mapreduce.HCatInputFormat not found
at 
org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2199)
at 
org.apache.hadoop.mapreduce.task.JobContextImpl.getInputFormatClass(JobContextImpl.java:184)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:749)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1707)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
Caused by: java.lang.ClassNotFoundException: Class 
org.apache.hive.hcatalog.mapreduce.HCatInputFormat not found
at 
org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2105)
at 
org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2197)
... 8 more




Any help is highly appreciated.

Thanks,
Jins George

Re: ClassNotFoundException in apache-kylin-1.5.0

[Li Yang]

UpdateCubeInfoAfterIndex I cannot find this class in v1.5.0 source
code, neither in v1.3.0

On Mon, Mar 14, 2016 at 2:20 PM, hongbin ma <mahong...@apache.org> wrote:

> what is the current version you're using?
>
> 1.5.0 is not release yet, and the metadata migration tool for 1.2.x =>
> 1.5.0 or 1.3.0 => 1.5.0 is still under developping.
>
> On Mon, Mar 14, 2016 at 1:52 PM, zeLiu <liu...@wanda.cn> wrote:
>
> > hi,hongbin
> > Installation for the first time in a clean environment.create a new
> > cube,when building ,it maked this eror.
> > Another question,I can not find the script for metadata automaticly
> > upgrade($KYLIN_HOME/bin/upgrade_v2.sh) in 1.5.0.
> >
> > --
> > View this message in context:
> >
> http://apache-kylin.74782.x6.nabble.com/ClassNotFoundException-in-apache-kylin-1-5-0-tp3882p3888.html
> > Sent from the Apache Kylin mailing list archive at Nabble.com.
> >
>
>
>
> --
> Regards,
>
> *Bin Mahone | 马洪宾*
> Apache Kylin: http://kylin.io
> Github: https://github.com/binmahone
>

Re: ClassNotFoundException in apache-kylin-1.5.0

[hongbin ma]

what is the current version you're using?

1.5.0 is not release yet, and the metadata migration tool for 1.2.x =>
1.5.0 or 1.3.0 => 1.5.0 is still under developping.

On Mon, Mar 14, 2016 at 1:52 PM, zeLiu <liu...@wanda.cn> wrote:

> hi,hongbin
> Installation for the first time in a clean environment.create a new
> cube,when building ,it maked this eror.
> Another question,I can not find the script for metadata automaticly
> upgrade($KYLIN_HOME/bin/upgrade_v2.sh) in 1.5.0.
>
> --
> View this message in context:
> http://apache-kylin.74782.x6.nabble.com/ClassNotFoundException-in-apache-kylin-1-5-0-tp3882p3888.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>



-- 
Regards,

*Bin Mahone | 马洪宾*
Apache Kylin: http://kylin.io
Github: https://github.com/binmahone

Re: ClassNotFoundException in apache-kylin-1.5.0

[hongbin ma]

; at
> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950)
> at
>
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)
> at
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421)
> at
>
> org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074)
> at
>
> org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611)
> at
>
> org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:314)
> at
>
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at
>
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.kylin.job.cube.UpdateCubeInfoAfterIndex
> at
>
> org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1720)
> at
>
> org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1571)
> at java.lang.Class.forName0(Native Method)
> at java.lang.Class.forName(Class.java:190)
> at
> org.apache.kylin.common.util.ClassUtil.forName(ClassUtil.java:67)
> at
>
> org.apache.kylin.job.manager.ExecutableManager.parseTo(ExecutableManager.java:339)
>
> --
> View this message in context:
> http://apache-kylin.74782.x6.nabble.com/ClassNotFoundException-in-apache-kylin-1-5-0-tp3882.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>



-- 
Regards,

*Bin Mahone | 马洪宾*
Apache Kylin: http://kylin.io
Github: https://github.com/binmahone

Re: ClassNotFoundException: org.apache.kylin.common.mr.KylinMapper

[杨海乐]

You are right,The jar ball is in the tmp dir,So the jar is deleted.  It's all
my fault.

--
View this message in context: 
http://apache-kylin.74782.x6.nabble.com/ClassNotFoundException-org-apache-kylin-common-mr-KylinMapper-tp2885p2928.html
Sent from the Apache Kylin mailing list archive at Nabble.com.