Good catch; Yes the dependency on Hcatalog was introduced since 0.7; Having all nodes has the same map reduce class path is a basic requirement;
On 3/4/15, 11:30 PM, "dong wang" <[email protected]> wrote: >currently, the 2nd issue is also gone, it is caused by that I just >installed "hive-hcatalog" in MASTER node when kylin-0.71 instead of ALL >the >nodes in the cluster(actually, when kylin-0.6x, it is not necessary for >user to install the "hive-hcatalog" in ANY node with CDH 5.3.1 before), >therefore, in the cluster's DATA nodes, it says "Error: >java.lang.RuntimeException: java.lang.ClassNotFoundException: Class >org.apache.hive.hcatalog.mapreduce.HCatInputFormat not found". > >2015-03-04 22:29 GMT+08:00 dong wang <[email protected]>: > >> 1, " Job init failed : java.lang.SecurityException: Invalid signature >> file digest for Manifest main attributes" is GONE after updating the >> pom.xml with adding "<exclude>META-INF/*.SF</exclude>" mentioned above >> under "job" directory for the job.jar >> >> 2, to the 2nd error mentioned above, as checked the job log, it shows: >> Error: java.lang.RuntimeException: java.lang.ClassNotFoundException: >>Class >> org.apache.hive.hcatalog.mapreduce.HCatInputFormat not found >> >> >> however, in tomcat/logs/kylin.log as below, we have actually added the >> hcatalog lib for the job and >> >>/usr/lib/hive-hcatalog/share/hcatalog/hive-hcatalog-core-0.13.1-cdh5.3.2. >>jar >> indeeded exists. >> >> >> [pool-7-thread-4]:[2015-03-04 >> >>22:08:15,357][INFO][org.apache.kylin.job.hadoop.AbstractHadoopJob.setJobC >>lasspath(AbstractHadoopJob.java:146)] >> - append job jar: >> >>/home/user/workspace/kylin-0.7.1-SNAPSHOT/./lib/kylin-job-0.7.1-SNAPSHOT. >>jar >> [pool-7-thread-4]:[2015-03-04 >> >>22:08:15,357][INFO][org.apache.kylin.job.hadoop.AbstractHadoopJob.setJobC >>lasspath(AbstractHadoopJob.java:152)] >> - append kylin.hive.dependency: >> >>/usr/lib/hive/conf:/usr/lib/hive/lib/*:/usr/lib/hive-hcatalog/share/hcata >>log/hive-hcatalog-core-0.13.1-cdh5.3.2.jar >> to mapreduce.application.classpath >>
