I cannot reproduce the java.lang.LinkageError in kylin.out. Anyone meet the same error? Please let us know. We want to fix issues in the 2.0 beta.
As to the pending jobs. I suspect the job engine was not started. Search kylin.log for any error about the job engine. Cheers Yang On Mon, Mar 13, 2017 at 5:10 PM, 王双 <[email protected]> wrote: > Hi All， > I'm new to kylin2.0.0-beta, the cluster env of our company is cdh5.4.3, > because of kylin2.0.0 has not supplied special version for cdh5.4.3, so I > modified some jars'version number of pom.xml in tag branch > kylin-2.0.0-bata, replace these version numbers: > > <!-- Hadoop versions --> > <hadoop2.version>2.7.1</hadoop2.version> > <yarn.version>2.7.1</yarn.version> > <!-- Hive versions --> > <hive.version>1.2.1</hive.version> > <hive-hcatalog.version>1.2.1</hive-hcatalog.version> > <!-- HBase versions --> > <hbase-hadoop2.version>1.1.1</hbase-hadoop2.version> > <!-- Hadoop Common deps, keep compatible with hadoop2.version --> > <zookeeper.version>3.4.6</zookeeper.version> > with: > <hadoop2.version>2.6.0-cdh5.4.3</hadoop2.version> > <yarn.version>2.6.0-cdh5.4.3</yarn.version> > <zookeeper.version>3.4.5-cdh5.4.3</zookeeper.version> > <hive.version>1.1.0-cdh5.4.3</hive.version> > <hive-hcatalog.version>1.1.0-cdh5.4.3</hive-hcatalog.version> > <hbase-hadoop2.version>1.0.0-cdh5.4.3</hbase-hadoop2.version> > > And, passed complier ,package and install correctly, when start kylin > (deploy kylin.war to tomcat), I have seen info in kylin.out as below: > > INFO: Initializing Spring root WebApplicationContext > Exception in thread "Thread-10" java.lang.LinkageError: loader constraint > violation: loader (instance of sun/misc/Launcher$AppClassLoader) > previously initiated loading for a different type with name > "org/apache/curator/RetryPolicy" > at java.lang.ClassLoader.defineClass1(Native Method) > at java.lang.ClassLoader.defineClass(ClassLoader.java:760) > at java.security.SecureClassLoader.defineClass( > SecureClassLoader.java:142) > at java.net.URLClassLoader.defineClass(URLClassLoader.java:467) > at java.net.URLClassLoader.access$100(URLClassLoader.java:73) > at java.net.URLClassLoader$1.run(URLClassLoader.java:368) > at java.net.URLClassLoader$1.run(URLClassLoader.java:362) > at java.security.AccessController.doPrivileged(Native Method) > at java.net.URLClassLoader.findClass(URLClassLoader.java:361) > at java.lang.ClassLoader.loadClass(ClassLoader.java:424) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) > at java.lang.ClassLoader.loadClass(ClassLoader.java:357) > at org.apache.curator.CuratorZookeeperClient.<init>( > CuratorZookeeperClient.java:97) > at org.apache.curator.framework.imps.CuratorFrameworkImpl.< > init>(CuratorFrameworkImpl.java:108) > at org.apache.curator.framework.CuratorFrameworkFactory$ > Builder.build(CuratorFrameworkFactory.java:124) > at org.apache.kylin.storage.hbase.util.ZookeeperJobLock. > lock(ZookeeperJobLock.java:70) > at org.apache.kylin.job.impl.threadpool.DefaultScheduler. > init(DefaultScheduler.java:208) > at org.apache.kylin.rest.service.JobService$1.run(JobService. > java:119) > at java.lang.Thread.run(Thread.java:745) > Mar 13, 2017 3:50:09 PM org.apache.catalina.core.ApplicationContext log > INFO: Initializing Spring FrameworkServlet 'kylin' > Mar 13, 2017 3:50:09 PM org.apache.catalina.startup.HostConfig deployWAR > INFO: Deployment of web application archive /data/M00/tandem/ > wangshuangshuang/kylin-workspace/apache-kylin-2.0.0- > SNAPSHOT-bin/tomcat/webapps/kylin.war has finished in 10,935 ms > Mar 13, 2017 3:50:09 PM org.apache.coyote.AbstractProtocol start > INFO: Starting ProtocolHandler [http-nio-7171] > Mar 13, 2017 3:50:09 PM org.apache.coyote.AbstractProtocol start > INFO: Starting ProtocolHandler [ajp-nio-9009] > Mar 13, 2017 3:50:09 PM org.apache.catalina.startup.Catalina start > INFO: Server startup in 11102 ms > > But, I found that the org.apache.curator 's scope is provided in pom.xml, > so i have no idea with it and i selected ignore this exception temporarily. > > Then, i have created model, cube successfully , In addition, when sync > table into datasource, cardinality does not calculate, as far as I know, > this does not affect cube's build in kylin1.5. At last, when i submit build > job, the monitor process is always on pending, kylin.log is as below: > > 2017-03-13 16:21:41,779 INFO [http-nio-7171-exec-6] cube.CubeManager:365 > : Updating cube instance 'TC_INCOME_SALE' > > 2017-03-13 16:21:41,780 WARN [http-nio-7171-exec-6] > cube.CubeValidator:102 : NEW segment start does not fit/connect with other > segments: TC_INCOME_SALE[20170220000000_20170221000000] > > 2017-03-13 16:21:41,780 WARN [http-nio-7171-exec-6] > cube.CubeValidator:104 : NEW segment end does not fit/connect with other > segments: TC_INCOME_SALE[20170220000000_20170221000000] > > 2017-03-13 16:21:41,788 INFO [pool-5-thread-1] cachesync.Broadcaster:122 > : Announcing new broadcast event: BroadcastEvent{entity=cube, event=update, > cacheKey=TC_INCOME_SALE} > > 2017-03-13 16:21:41,793 DEBUG [http-nio-7171-exec-9] > cachesync.Broadcaster:188 : Broadcasting metadata change: entity=cube, > event=UPDATE, cacheKey=TC_INCOME_SALE, listeners=[org.apache.kylin. > cube.CubeManager$CubeSyncListener@1e440780, org.apache.kylin.rest.service. > CacheService$1@6d6933af] > > 2017-03-13 16:21:41,795 INFO [http-nio-7171-exec-9] cube.CubeManager:784 > : Reloaded cube TC_INCOME_SALE being CUBE[name=TC_INCOME_SALE] having 1 > segments > > 2017-03-13 16:21:41,796 DEBUG [http-nio-7171-exec-9] > cachesync.Broadcaster:188 : Broadcasting metadata change: > entity=project_data, event=UPDATE, cacheKey=Test, > listeners=[org.apache.kylin.metadata.project.ProjectManager$ > ProjectSyncListener@5a13b11a, org.apache.kylin.metadata.MetadataManager$ > SrcTableSyncListener@244c1673, org.apache.kylin.metadata.MetadataManager$ > SrcTableExtSyncListener@1a0a7d7d, org.apache.kylin.metadata. > MetadataManager$DataModelSyncListener@3e5ad1d8, org.apache.kylin.metadata. > MetadataManager$ExtFilterSyncListener@79062c68, org.apache.kylin.cube. > CubeDescManager$CubeDescSyncListener@3d3d42b5, org.apache.kylin.cube. > CubeManager$CubeSyncListener@1e440780, org.apache.kylin.storage. > hybrid.HybridManager$HybridSyncListener@741531fa, > org.apache.kylin.metadata.realization.RealizationRegistry$1@1c29eab1, > org.apache.kylin.rest.service.CacheService$1@6d6933af] > > 2017-03-13 16:21:41,796 INFO [http-nio-7171-exec-9] > service.CacheService:135 : removeOLAPDataSource is called for project Test > > 2017-03-13 16:21:41,796 INFO [http-nio-7171-exec-9] > service.CacheService:117 : cleaning cache for projectTest (currently remove > all entries) > > 2017-03-13 16:21:41,797 DEBUG [http-nio-7171-exec-9] > cachesync.Broadcaster:218 : Done broadcasting metadata change: > entity=project_data, event=UPDATE, cacheKey=Test > > 2017-03-13 16:21:41,797 DEBUG [http-nio-7171-exec-9] > cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=cube, > event=UPDATE, cacheKey=TC_INCOME_SALE > > 2017-03-13 16:21:41,806 INFO [http-nio-7171-exec-6] > mr.BatchCubingJobBuilder2:50 : MR_V2 new job to BUILD segment > TC_INCOME_SALE[20170220000000_20170221000000] > > 2017-03-13 16:21:42,203 DEBUG [http-nio-7171-exec-6] > service.AclService:240 : ACL of > org.springframework.security.acls.domain.ObjectIdentityImpl[Type: > org.apache.kylin.job.JobInstance; Identifier: > 1db766fa-609b-450a-b52d-d2d05e42354c] > created successfully. > > 2017-03-13 16:21:42,220 DEBUG [http-nio-7171-exec-6] > service.AclService:307 : ACL of > org.springframework.security.acls.domain.ObjectIdentityImpl[Type: > org.apache.kylin.job.JobInstance; Identifier: > 1db766fa-609b-450a-b52d-d2d05e42354c] > updated successfully. > > 2017-03-13 16:21:45,090 DEBUG [http-nio-7171-exec-4] > controller.UserController:64 : authentication.getPrincipal() is > org.springframework.security.core.userdetails.User@3b40b2f: Username: > ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; > credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: > ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER > > 2017-03-13 16:21:45,158 DEBUG [http-nio-7171-exec-1] > badquery.BadQueryHistoryManager:84 > : Loaded 0 Bad Query(s) > > please help me to check it, thank you for all! > Best Regards! >
