Re: Kylin 2.6.0 fails to build cube with spark

2019-01-14 Thread hubert stefani
yes we finally had to add other jars to make it work. I was waiting for the official release of v2.6.0 to see whether we had a problem with our packaging process or not but the issue remains and we had to patch it the same way. Are we doing something wrong  in configuring our Kylin/Aws

Re: Kylin 2.6.0 fails to build cube with spark

2019-01-11 Thread ShaoFeng Shi
Hi Hubert, In the original log file, I see hbase-server and hbase-common are on the spark command: --jars

Re: Kylin 2.6.0 fails to build cube with spark

2019-01-11 Thread hubert stefani
indeed. By adding the hbase-server and hbase common jars the pb seems to be fixed. Le vendredi 11 janvier 2019 à 11:11:40 UTC+1, ShaoFeng Shi a écrit : It seems missing some HBase class; The HFile.class should be in hbase-server-.jar, not sure whether it is EMR's package issue. You

Re: Kylin 2.6.0 fails to build cube with spark

2019-01-11 Thread ShaoFeng Shi
It seems missing some HBase class; The HFile.class should be in hbase-server-.jar, not sure whether it is EMR's package issue. You can unzip the HBase jar files to see which jar has the class, and then add it to spark/lib folder. java.lang.NoClassDefFoundError: Could not initialize class

Kylin 2.6.0 fails to build cube with spark

2019-01-11 Thread hubert stefani
hello, we are testing the 2.6 RC and we are facing a systematic issue when building cubes with spark engine (even with sample cube), whereas the MapReduce engin succeeds. The job process fails at step #8 Step Name: Convert Cuboid Data to HFile with the following error  (full log is available as