[
https://issues.apache.org/jira/browse/KYLIN-4040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16866180#comment-16866180
]
Marc Wu commented on KYLIN-4040:
--------------------------------
[~hit_lacus]
Hi XiaoXiang,
I tested Kylin 2.5.x on HDP Sandbox 2.4, it seems got error because of Spark
version.
{code:java}
Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/spark/scheduler/SparkListenerInterface
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at org.apache.kylin.common.util.SparkEntry.main(SparkEntry.java:35)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at
org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731)
at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)
at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: java.lang.ClassNotFoundException:
org.apache.spark.scheduler.SparkListenerInterface
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 12 more
{code}
HDP Sandbox 2.4 doesn't have Spark2. Did you install it manually or what?
> Couldn't Pass the Integration Test on 2.6.x
> -------------------------------------------
>
> Key: KYLIN-4040
> URL: https://issues.apache.org/jira/browse/KYLIN-4040
> Project: Kylin
> Issue Type: Bug
> Components: Integration, Tools, Build and Test
> Affects Versions: v2.6.2
> Environment: HDP Sandbox 2.6.5
> Reporter: Marc Wu
> Priority: Major
> Attachments: mvnverify.zip
>
>
> Hi Kylin Team:
>
> I've been working on integration testing recently. Because the version 2.4.0
> of HDP Sandbox is not provided anymore. I used the HDP 2.6.5 to do the
> testing.
>
> After I adjusting some configurations and files to fit the 2.6.5 environment.
> I found I couldn't pass the integration testing due to the failure of some
> test cases.
>
> {code:java}
> [ERROR] Failures:
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testCachedQuery:259->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query01, row=0, col=CAL_DT)
> expected:<2012-01-02> but was:<2012-01-02>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testCachedQuery:259->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query01, row=0, col=CAL_DT)
> expected:<2012-01-02> but was:<2012-01-02>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testCommonQuery:176->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query09, row=0, col=WEEK_BEG_DT)
> expected:<2012-01-01> but was:<2012-01-01>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testCommonQuery:176->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query09, row=0, col=WEEK_BEG_DT)
> expected:<2012-01-01> but was:<2012-01-01>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testDateTimeQuery:186->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query00, row=0, col=TEST_DATE)
> expected:<2010-09-20> but was:<2010-09-20>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testDateTimeQuery:186->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query00, row=0, col=TEST_DATE)
> expected:<2010-09-20> but was:<2010-09-20>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testDerivedColumnQuery:264->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query01, row=0, col=WEEK_BEG_DT)
> expected:<2012-05-26> but was:<2012-05-26>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testDerivedColumnQuery:264->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query01, row=0, col=WEEK_BEG_DT)
> expected:<2012-05-26> but was:<2012-05-26>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testDynamicQuery:368->KylinTestBase.execAndCompDynamicQuery:686->KylinTestBase.assertTableEquals:693
> value (table=query result of query01, row=0, col=WEEK_BEG_DT)
> expected:<2013-05-05> but was:<2013-05-05>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testDynamicQuery:368->KylinTestBase.execAndCompDynamicQuery:686->KylinTestBase.assertTableEquals:693
> value (table=query result of query01, row=0, col=WEEK_BEG_DT)
> expected:<2013-05-05> but was:<2013-05-05>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testLookupQuery:234->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query01, row=0, col=CAL_DT)
> expected:<2012-01-01> but was:<2012-01-01>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testLookupQuery:234->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query01, row=0, col=CAL_DT)
> expected:<2012-01-01> but was:<2012-01-01>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testMultiModelQuery:303->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query01, row=0, col=CAL_DT)
> expected:<2012-01-01> but was:<2012-01-01>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testOrderByQuery:225->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query01, row=0, col=WEEK_BEG_DT)
> expected:<2013-06-09> but was:<2013-06-09>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testOrderByQuery:225->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query01, row=0, col=WEEK_BEG_DT)
> expected:<2013-06-09> but was:<2013-06-09>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testPreciselyDistinctCountQuery:279->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query00, row=0, col=CAL_DT)
> expected:<2012-01-01> but was:<2012-01-01>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testPreciselyDistinctCountQuery:279->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query00, row=0, col=CAL_DT)
> expected:<2012-01-01> but was:<2012-01-01>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testPreciselyDistinctCountRollupQuery:286->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query03, row=0, col=WEEK_BEG_DT)
> expected:<2013-05-05> but was:<2013-05-05>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testRawQuery:393->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query03, row=0, col=CAL_DT)
> expected:<2012-01-01> but was:<2012-01-01>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testRawQuery:393->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query03, row=0, col=CAL_DT)
> expected:<2012-01-01> but was:<2012-01-01>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testStreamingTableQuery:315->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query03, row=0, col=H) expected:<2012-01-0[2
> 04]:00:00.0> but was:<2012-01-0[1 20]:00:00.0>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testStreamingTableQuery:315->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query03, row=0, col=H) expected:<2012-01-0[2
> 04]:00:00.0> but was:<2012-01-0[1 20]:00:00.0>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testSubQuery:325->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query00, row=0, col=WEEK_BEG_DT)
> expected:<2012-01-01> but was:<2012-01-01>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testSubQuery:325->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query00, row=0, col=WEEK_BEG_DT)
> expected:<2012-01-01> but was:<2012-01-01>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testTimeStampAdd:254->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query01, row=0, col=CAL_DT)
> expected:<2012-01-01> but was:<2012-01-01>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testTimeStampAdd:254->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query01, row=0, col=CAL_DT)
> expected:<2012-01-01> but was:<2012-01-01>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testTopNQuery:274->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query81, row=0, col=WEEK_BEG_DT)
> expected:<2013-09-01> but was:<2013-09-01>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testTopNQuery:274->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query81, row=0, col=WEEK_BEG_DT)
> expected:<2013-09-01> but was:<2013-09-01>
> [ERROR] Errors:
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testLimitCorrectness:387->KylinTestBase.execLimitAndValidate:531->KylinTestBase.assertTableContains:700
> » IllegalState
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testLimitCorrectness:387->KylinTestBase.execLimitAndValidate:531->KylinTestBase.assertTableContains:700
> » IllegalState
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
