Hi All??
I'm new to kylin2.0.0-beta, the cluster env of our company is cdh5.4.3,
because of kylin2.0.0 has not supplied special version for cdh5.4.3, so I
modified some jars'version number of pom.xml in tag branch kylin-2.0.0-bata,
replace these version numbers:
<!-- Hadoop versions -->
<hadoop2.version>2.7.1</hadoop2.version>
<yarn.version>2.7.1</yarn.version>
<!-- Hive versions -->
<hive.version>1.2.1</hive.version>
<hive-hcatalog.version>1.2.1</hive-hcatalog.version>
<!-- HBase versions -->
<hbase-hadoop2.version>1.1.1</hbase-hadoop2.version>
<!-- Hadoop Common deps, keep compatible with hadoop2.version -->
<zookeeper.version>3.4.6</zookeeper.version>
with:
<hadoop2.version>2.6.0-cdh5.4.3</hadoop2.version>
<yarn.version>2.6.0-cdh5.4.3</yarn.version>
<zookeeper.version>3.4.5-cdh5.4.3</zookeeper.version>
<hive.version>1.1.0-cdh5.4.3</hive.version>
<hive-hcatalog.version>1.1.0-cdh5.4.3</hive-hcatalog.version>
<hbase-hadoop2.version>1.0.0-cdh5.4.3</hbase-hadoop2.version>
And, passed complier ,package and install correctly, when start kylin (deploy
kylin.war to tomcat), I have seen info in kylin.out as below:
INFO: Initializing Spring root WebApplicationContext
Exception in thread "Thread-10" java.lang.LinkageError: loader constraint
violation: loader (instance of sun/misc/Launcher$AppClassLoader) previously
initiated loading for a different type with name
"org/apache/curator/RetryPolicy"
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:760)
at
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at
org.apache.curator.CuratorZookeeperClient.<init>(CuratorZookeeperClient.java:97)
at
org.apache.curator.framework.imps.CuratorFrameworkImpl.<init>(CuratorFrameworkImpl.java:108)
at
org.apache.curator.framework.CuratorFrameworkFactory$Builder.build(CuratorFrameworkFactory.java:124)
at
org.apache.kylin.storage.hbase.util.ZookeeperJobLock.lock(ZookeeperJobLock.java:70)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler.init(DefaultScheduler.java:208)
at org.apache.kylin.rest.service.JobService$1.run(JobService.java:119)
at java.lang.Thread.run(Thread.java:745)
Mar 13, 2017 3:50:09 PM org.apache.catalina.core.ApplicationContext log
INFO: Initializing Spring FrameworkServlet 'kylin'
Mar 13, 2017 3:50:09 PM org.apache.catalina.startup.HostConfig deployWAR
INFO: Deployment of web application archive
/data/M00/tandem/wangshuangshuang/kylin-workspace/apache-kylin-2.0.0-SNAPSHOT-bin/tomcat/webapps/kylin.war
has finished in 10,935 ms
Mar 13, 2017 3:50:09 PM org.apache.coyote.AbstractProtocol start
INFO: Starting ProtocolHandler [http-nio-7171]
Mar 13, 2017 3:50:09 PM org.apache.coyote.AbstractProtocol start
INFO: Starting ProtocolHandler [ajp-nio-9009]
Mar 13, 2017 3:50:09 PM org.apache.catalina.startup.Catalina start
INFO: Server startup in 11102 ms
But, I found that the org.apache.curator 's scope is provided in pom.xml, so i
have no idea with it and i selected ignore this exception temporarily.
Then, i have created model, cube successfully , In addition, when sync table
into datasource, cardinality does not calculate, as far as I know, this dose
not affect cube's build in kylin1.5.
At last, when i submit build job, the monitor process is always on pending,
kylin.log is as below:
2017-03-13 16:21:41,779 INFO [http-nio-7171-exec-6] cube.CubeManager:365 :
Updating cube instance 'TC_INCOME_SALE'
2017-03-13 16:21:41,780 WARN [http-nio-7171-exec-6] cube.CubeValidator:102 :
NEW segment start does not fit/connect with other segments:
TC_INCOME_SALE[20170220000000_20170221000000]
2017-03-13 16:21:41,780 WARN [http-nio-7171-exec-6] cube.CubeValidator:104 :
NEW segment end does not fit/connect with other segments:
TC_INCOME_SALE[20170220000000_20170221000000]
2017-03-13 16:21:41,788 INFO [pool-5-thread-1] cachesync.Broadcaster:122 :
Announcing new broadcast event: BroadcastEvent{entity=cube, event=update,
cacheKey=TC_INCOME_SALE}
2017-03-13 16:21:41,793 DEBUG [http-nio-7171-exec-9] cachesync.Broadcaster:188
: Broadcasting metadata change: entity=cube, event=UPDATE,
cacheKey=TC_INCOME_SALE,
listeners=[org.apache.kylin.cube.CubeManager$CubeSyncListener@1e440780,
org.apache.kylin.rest.service.CacheService$1@6d6933af]
2017-03-13 16:21:41,795 INFO [http-nio-7171-exec-9] cube.CubeManager:784 :
Reloaded cube TC_INCOME_SALE being CUBE[name=TC_INCOME_SALE] having 1 segments
2017-03-13 16:21:41,796 DEBUG [http-nio-7171-exec-9] cachesync.Broadcaster:188
: Broadcasting metadata change: entity=project_data, event=UPDATE,
cacheKey=Test,
listeners=[org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@5a13b11a,
org.apache.kylin.metadata.MetadataManager$SrcTableSyncListener@244c1673,
org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@1a0a7d7d,
org.apache.kylin.metadata.MetadataManager$DataModelSyncListener@3e5ad1d8,
org.apache.kylin.metadata.MetadataManager$ExtFilterSyncListener@79062c68,
org.apache.kylin.cube.CubeDescManager$CubeDescSyncListener@3d3d42b5,
org.apache.kylin.cube.CubeManager$CubeSyncListener@1e440780,
org.apache.kylin.storage.hybrid.HybridManager$HybridSyncListener@741531fa,
org.apache.kylin.metadata.realization.RealizationRegistry$1@1c29eab1,
org.apache.kylin.rest.service.CacheService$1@6d6933af]
2017-03-13 16:21:41,796 INFO [http-nio-7171-exec-9] service.CacheService:135 :
removeOLAPDataSource is called for project Test
2017-03-13 16:21:41,796 INFO [http-nio-7171-exec-9] service.CacheService:117 :
cleaning cache for projectTest (currently remove all entries)
2017-03-13 16:21:41,797 DEBUG [http-nio-7171-exec-9] cachesync.Broadcaster:218
: Done broadcasting metadata change: entity=project_data, event=UPDATE,
cacheKey=Test
2017-03-13 16:21:41,797 DEBUG [http-nio-7171-exec-9] cachesync.Broadcaster:218
: Done broadcasting metadata change: entity=cube, event=UPDATE,
cacheKey=TC_INCOME_SALE
2017-03-13 16:21:41,806 INFO [http-nio-7171-exec-6]
mr.BatchCubingJobBuilder2:50 : MR_V2 new job to BUILD segment
TC_INCOME_SALE[20170220000000_20170221000000]
2017-03-13 16:21:42,203 DEBUG [http-nio-7171-exec-6] service.AclService:240 :
ACL of org.springframework.security.acls.domain.ObjectIdentityImpl[Type:
org.apache.kylin.job.JobInstance; Identifier:
1db766fa-609b-450a-b52d-d2d05e42354c] created successfully.
2017-03-13 16:21:42,220 DEBUG [http-nio-7171-exec-6] service.AclService:307 :
ACL of org.springframework.security.acls.domain.ObjectIdentityImpl[Type:
org.apache.kylin.job.JobInstance; Identifier:
1db766fa-609b-450a-b52d-d2d05e42354c] updated successfully.
2017-03-13 16:21:45,090 DEBUG [http-nio-7171-exec-4]
controller.UserController:64 : authentication.getPrincipal() is
org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN;
Password: [PROTECTED]; Enabled: true; AccountNonExpired: true;
credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities:
ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER
2017-03-13 16:21:45,158 DEBUG [http-nio-7171-exec-1]
badquery.BadQueryHistoryManager:84 : Loaded 0 Bad Query(s)
please help me to check it, thank you for all!
Best Regards!
