Confirm that org.apache.httpcomponents classes were excluded in kylin job jar in 2.0 package.
However this is as designed since we believe the httpcomponents are widely available in hadoop cluster and must not be shipped again to avoid version conflict. Cheers Yang On Mon, Apr 24, 2017 at 11:44 AM, menghuaDuan <[email protected]> wrote: > Kylin v1.5.3-Hbase1.x works well in our cluster. > But when i try to upgrade kylin from v1.5.3 to v2.0.0-beta3, > NoClassDefFoundError is find in hadoop job error log. > HttpEntity exist in my kylin binary package too , > I have not idea why this happen. > > Follow the guid of : https://issues.apache.org/jira/browse/KYLIN-1507, > my problem is solved . > > > Thanks anyway! > > > > > ________________________________ > 段孟华 > > 发件人： Yang [via Apache Kylin]<mailto:[email protected]> > 发送时间： 2017-04-24 11:16 > 收件人： 段孟华<mailto:[email protected]> > 主题： Re: NoClassDefFoundError while cube building > I cannot reproduce the problem. The missing class 'HttpEntity' is part of > the beta3 package. > > [root@sandbox apache-kylin-2.0.0-SNAPSHOT-bin]# jar -tf > tomcat/webapps/kylin/WEB-INF/lib/httpcore-4.2.4.jar | grep HttpEntity > org/apache/http/entity/AbstractHttpEntity.class > org/apache/http/entity/BufferedHttpEntity.class > org/apache/http/entity/HttpEntityWrapper.class > org/apache/http/entity/BasicHttpEntity.class > org/apache/http/HttpEntityEnclosingRequest.class > org/apache/http/HttpEntity.class > org/apache/http/message/BasicHttpEntityEnclosingRequest.class > > > Yang > > On Sun, Apr 23, 2017 at 5:27 PM, menghuaDuan <[hidden > email]</user/SendEmail.jtp?type=node&node=7745&i=0>> wrote: > > > Dear Kylin: > > I am using Kylin version 2.0.0-beta3 (hadoop v2.6.0; hbase v1.1.2; > > hive > > v2.0.0). > > While trying to build the sample cube, I meet an erron on Step 3 "Extract > > Fact Table Distinct Columns". > > There is noting help in kylin.log, but i found an error in hadoop job > error > > log. > > Can some one help me, Thanks. > > > > > > hadoop job error log: > > > > Log Type: stderr > > Log Length: 0 > > Log Type: stdout > > Log Length: 0 > > Log Type: syslog > > Log Length: 12306 > > Showing 4096 bytes of 12306 total. Click here for the full log. > > Initializing CubeManager with config > > /data5/yarn1/local/usercache/mart_cmo/appcache/application_ > > 1484104330432_3772865/container_1484104330432_3772865_01_000002/meta > > 2017-04-23 17:00:17,551 INFO [main] > > org.apache.kylin.common.persistence.ResourceStore: Using metadata url > > /data5/yarn1/local/usercache/mart_cmo/appcache/application_ > > 1484104330432_3772865/container_1484104330432_3772865_01_000002/meta > > for resource store > > 2017-04-23 17:00:17,553 INFO [main] org.apache.kylin.cube.CubeManager: > > Loading Cube from folder > > /data5/yarn1/local/usercache/mart_cmo/appcache/application_ > > 1484104330432_3772865/container_1484104330432_ > 3772865_01_000002/meta/cube > > 2017-04-23 17:00:17,804 INFO [main] org.apache.kylin.cube. > CubeDescManager: > > Initializing CubeDescManager with config > > /data5/yarn1/local/usercache/mart_cmo/appcache/application_ > > 1484104330432_3772865/container_1484104330432_3772865_01_000002/meta > > 2017-04-23 17:00:17,804 INFO [main] org.apache.kylin.cube. > CubeDescManager: > > Reloading Cube Metadata from folder > > /data5/yarn1/local/usercache/mart_cmo/appcache/application_ > > 1484104330432_3772865/container_1484104330432_ > 3772865_01_000002/meta/cube_ > > desc > > 2017-04-23 17:00:17,844 INFO [main] > > org.apache.kylin.metadata.project.ProjectManager: Initializing > > ProjectManager with metadata url > > /data5/yarn1/local/usercache/mart_cmo/appcache/application_ > > 1484104330432_3772865/container_1484104330432_3772865_01_000002/meta > > 2017-04-23 17:00:17,852 FATAL [pool-3-thread-1] > > org.apache.hadoop.yarn.YarnUncaughtExceptionHandler: Thread > > Thread[pool-3-thread-1,5,main] threw an Error. Shutting down now... > > java.lang.NoClassDefFoundError: org/apache/http/HttpEntity > > at > > org.apache.kylin.metadata.cachesync.Broadcaster$1.run( > > Broadcaster.java:117) > > at > > java.util.concurrent.ThreadPoolExecutor.runWorker( > > ThreadPoolExecutor.java:1145) > > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run( > > ThreadPoolExecutor.java:615) > > at java.lang.Thread.run(Thread.java:745) > > Caused by: java.lang.ClassNotFoundException: org.apache.http.HttpEntity > > at java.net.URLClassLoader$1.run(URLClassLoader.java:366) > > at java.net.URLClassLoader$1.run(URLClassLoader.java:355) > > at java.security.AccessController.doPrivileged(Native Method) > > at java.net.URLClassLoader.findClass(URLClassLoader.java:354) > > at java.lang.ClassLoader.loadClass(ClassLoader.java:425) > > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) > > at java.lang.ClassLoader.loadClass(ClassLoader.java:358) > > ... 4 more > > 2017-04-23 17:00:17,853 INFO [pool-3-thread-1] > > org.apache.hadoop.util.ExitUtil: Exiting with status -1 > > 2017-04-23 17:00:17,866 INFO [main] > > org.apache.kylin.measure.MeasureTypeFactory: Checking custom measure > types > > from kylin config > > 2017-04-23 17:00:17,867 INFO [main] > > org.apache.kylin.measure.MeasureTypeFactory: registering > > COUNT_DISTINCT(hllc), class > > org.apache.kylin.measure.hllc.HLLCMeasureType$Factory > > 2017-04-23 17:00:17,879 INFO [main] > > org.apache.kylin.measure.MeasureTypeFactory: registering > > COUNT_DISTINCT(bitmap), class > > org.apache.kylin.measure.bitmap.BitmapMeasureType$Factory > > 2017-04-23 17:00:17,883 INFO [main] > > org.apache.kylin.measure.MeasureTypeFactory: registering TOP_N(topn), > > class > > org.apache.kylin.measure.topn.TopNMeasureType$Factory > > 2017-04-23 17:00:17,886 INFO [main] > > org.apache.kylin.measure.MeasureTypeFactory: registering RAW(raw), class > > org.apache.kylin.measure.raw.RawMeasureType$Factory > > 2017-04-23 17:00:17,887 INFO [main] > > org.apache.kylin.measure.MeasureTypeFactory: registering > > EXTENDED_COLUMN(extendedcolumn), class > > org.apache.kylin.measure.extendedcolumn.ExtendedColumnMeasureType$ > Factory > > 2017-04-23 17:00:17,888 INFO [main] > > org.apache.kylin.measure.MeasureTypeFactory: registering > > PERCENTILE(percentile), class > > org.apache.kylin.measure.percentile.PercentileMeasureType$Factory > > 2017-04-23 17:00:17,943 INFO [main] org.apache.kylin.cube. > CubeDescManager: > > Loaded 1 Cube(s) > > 2017-04-23 17:00:17,944 INFO [main] org.apache.kylin.cube.CubeManager: > > Reloaded cube kylin_sales_cube being CUBE[name=kylin_sales_cube] having 3 > > segments > > 2017-04-23 17:00:17,944 INFO [main] org.apache.kylin.cube.CubeManager: > > Loaded 1 cubes, fail on 0 cubes > > > > > > > > > > [hidden email]</user/SendEmail.jtp?type=node&node=7745&i=1> > > > > -- > > View this message in context: http://apache-kylin.74782.x6.nabble.com/ > > NoClassDefFoundError-while-cube-building-tp7736.html > > Sent from the Apache Kylin mailing list archive at Nabble.com. > > > > > ________________________________ > If you reply to this email, your message will be added to the discussion > below: > http://apache-kylin.74782.x6.nabble.com/NoClassDefFoundError-while- > cube-building-tp7736p7745.html > To start a new topic under Apache Kylin, email [email protected] > To unsubscribe from Apache Kylin, click here<http://apache-kylin. > 74782.x6.nabble.com/template/NamlServlet.jtp?macro= > unsubscribe_by_code&node=1&code=ZHVhbm1lbmdodWFAamQuY29tfDF8LT > M3MzE2NDE0MA==>. > NAML<http://apache-kylin.74782.x6.nabble.com/template/ > NamlServlet.jtp?macro=macro_viewer&id=instant_html% > 21nabble%3Aemail.naml&base=nabble.naml.namespaces. > BasicNamespace-nabble.view.web.template.NabbleNamespace- > nabble.view.web.template.NodeNamespace&breadcrumbs= > notify_subscribers%21nabble%3Aemail.naml-instant_emails% > 21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml> > > > -- > View this message in context: http://apache-kylin.74782.x6.nabble.com/Re- > NoClassDefFoundError-while-cube-building-tp7748.html > Sent from the Apache Kylin mailing list archive at Nabble.com. >
