[
https://issues.apache.org/jira/browse/KYLIN-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lim Sing Yik updated KYLIN-5018:
--------------------------------
Attachment: image-2021-06-28-17-41-56-617.png
Description:
Appreciate someone can help
Run sample cube from learn_kylin Project. Encounter error at step 6 Create
HTable.
I manage to create Hbase table "test" using Hbase Shell, and the kylin manage
to create upload the "kylin_metadata" into HBase.
!image-2021-06-28-17-41-56-617.png!
Env:
Hadoop 3.2.2
Hive 3.1.2
HBase 2.4.2
!image-2021-06-28-17-01-13-179.png!
Error msg:
java.lang.NoSuchMethodError:
org.apache.hadoop.hbase.client.TableDescriptorBuilder.setColumnFamily(Lorg/apache/hadoop/hbase/client/ColumnFamilyDescriptor;)Lorg/apache/hadoop/hbase/client/TableDescriptorBuilder;
at
org.apache.kylin.storage.hbase.steps.CubeHTableUtil.createHTable(CubeHTableUtil.java:100)
at
org.apache.kylin.storage.hbase.steps.CreateHTableJob.run(CreateHTableJob.java:121)
at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:93)
at
org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:64)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180)
at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:72)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:119)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Detail Kylin Log:
17:25:53.206 [Scheduler 1819501582 Job be5d023c-00f7-2270-0af1-10c2c38ed6f3-81]
ERROR org.apache.kylin.job.execution.AbstractExecutable - error running
Executable: HadoopShellExecutable\{id=be5d023c-00f7-2270-0af1-10c2c38ed6f3-05,
name=Create HTable, state=RUNNING}
17:25:53.240 [Scheduler 1819501582 Job be5d023c-00f7-2270-0af1-10c2c38ed6f3-81]
ERROR org.apache.kylin.job.execution.AbstractExecutable - error running
Executable: CubingJob\{id=be5d023c-00f7-2270-0af1-10c2c38ed6f3, name=BUILD CUBE
- kylin_sales_cube_clone - 20100101000000_20101231235500 - MYT 2021-06-28
13:37:38, state=RUNNING}
17:25:53.288 [pool-12-thread-1] ERROR
org.apache.kylin.job.impl.threadpool.DefaultScheduler - ExecuteException
job:be5d023c-00f7-2270-0af1-10c2c38ed6f3
org.apache.kylin.job.exception.ExecuteException:
org.apache.kylin.job.exception.ExecuteException: java.lang.NoSuchMethodError:
org.apache.hadoop.hbase.client.TableDescriptorBuilder.setColumnFamily(Lorg/apache/hadoop/hbase/client/ColumnFamilyDescriptor;)Lorg/apache/hadoop/hbase/client/TableDescriptorBuilder;
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:201)
~[kylin-core-job-3.1.2.jar:3.1.2]
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:119)
[kylin-core-job-3.1.2.jar:3.1.2]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[?:1.8.0_292]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[?:1.8.0_292]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_292]
Caused by: org.apache.kylin.job.exception.ExecuteException:
java.lang.NoSuchMethodError:
org.apache.hadoop.hbase.client.TableDescriptorBuilder.setColumnFamily(Lorg/apache/hadoop/hbase/client/ColumnFamilyDescriptor;)Lorg/apache/hadoop/hbase/client/TableDescriptorBuilder;
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:201)
~[kylin-core-job-3.1.2.jar:3.1.2]
at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:72)
~[kylin-core-job-3.1.2.jar:3.1.2]
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180)
~[kylin-core-job-3.1.2.jar:3.1.2]
... 4 more
Caused by: java.lang.NoSuchMethodError:
org.apache.hadoop.hbase.client.TableDescriptorBuilder.setColumnFamily(Lorg/apache/hadoop/hbase/client/ColumnFamilyDescriptor;)Lorg/apache/hadoop/hbase/client/TableDescriptorBuilder;
at
org.apache.kylin.storage.hbase.steps.CubeHTableUtil.createHTable(CubeHTableUtil.java:100)
~[kylin-storage-hbase-3.1.2.jar:3.1.2]
at
org.apache.kylin.storage.hbase.steps.CreateHTableJob.run(CreateHTableJob.java:121)
~[kylin-storage-hbase-3.1.2.jar:3.1.2]
at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:93)
~[kylin-engine-mr-3.1.2.jar:3.1.2]
at
org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:64)
~[kylin-engine-mr-3.1.2.jar:3.1.2]
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180)
~[kylin-core-job-3.1.2.jar:3.1.2]
at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:72)
~[kylin-core-job-3.1.2.jar:3.1.2]
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180)
~[kylin-core-job-3.1.2.jar:3.1.2]
... 4 more
was:
Appreciate someone can help
Run sample cube from learn_kylin Project. Encounter error at step 6 Create
HTable
Env:
Hadoop 3.2.2
Hive 3.1.2
HBase 2.4.2
!image-2021-06-28-17-01-13-179.png!
Error msg:
java.lang.NoSuchMethodError:
org.apache.hadoop.hbase.client.TableDescriptorBuilder.setColumnFamily(Lorg/apache/hadoop/hbase/client/ColumnFamilyDescriptor;)Lorg/apache/hadoop/hbase/client/TableDescriptorBuilder;
at
org.apache.kylin.storage.hbase.steps.CubeHTableUtil.createHTable(CubeHTableUtil.java:100)
at
org.apache.kylin.storage.hbase.steps.CreateHTableJob.run(CreateHTableJob.java:121)
at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:93)
at
org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:64)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180)
at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:72)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:119)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
> Failed to create HTable
> -----------------------
>
> Key: KYLIN-5018
> URL: https://issues.apache.org/jira/browse/KYLIN-5018
> Project: Kylin
> Issue Type: Bug
> Components: Storage - HBase
> Affects Versions: v3.1.2
> Environment: Hadoop 3.2.2
> Hive 3.1.2
> HBase 2.4.2
> Reporter: Lim Sing Yik
> Priority: Major
> Attachments: image-2021-06-28-17-01-13-179.png,
> image-2021-06-28-17-41-56-617.png
>
>
> Appreciate someone can help
> Run sample cube from learn_kylin Project. Encounter error at step 6 Create
> HTable.
> I manage to create Hbase table "test" using Hbase Shell, and the kylin
> manage to create upload the "kylin_metadata" into HBase.
>
> !image-2021-06-28-17-41-56-617.png!
>
> Env:
> Hadoop 3.2.2
> Hive 3.1.2
> HBase 2.4.2
> !image-2021-06-28-17-01-13-179.png!
> Error msg:
> java.lang.NoSuchMethodError:
> org.apache.hadoop.hbase.client.TableDescriptorBuilder.setColumnFamily(Lorg/apache/hadoop/hbase/client/ColumnFamilyDescriptor;)Lorg/apache/hadoop/hbase/client/TableDescriptorBuilder;
> at
> org.apache.kylin.storage.hbase.steps.CubeHTableUtil.createHTable(CubeHTableUtil.java:100)
> at
> org.apache.kylin.storage.hbase.steps.CreateHTableJob.run(CreateHTableJob.java:121)
> at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:93)
> at
> org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:64)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180)
> at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:72)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180)
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:119)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
>
>
> Detail Kylin Log:
> 17:25:53.206 [Scheduler 1819501582 Job
> be5d023c-00f7-2270-0af1-10c2c38ed6f3-81] ERROR
> org.apache.kylin.job.execution.AbstractExecutable - error running Executable:
> HadoopShellExecutable\{id=be5d023c-00f7-2270-0af1-10c2c38ed6f3-05,
> name=Create HTable, state=RUNNING}
> 17:25:53.240 [Scheduler 1819501582 Job
> be5d023c-00f7-2270-0af1-10c2c38ed6f3-81] ERROR
> org.apache.kylin.job.execution.AbstractExecutable - error running Executable:
> CubingJob\{id=be5d023c-00f7-2270-0af1-10c2c38ed6f3, name=BUILD CUBE -
> kylin_sales_cube_clone - 20100101000000_20101231235500 - MYT 2021-06-28
> 13:37:38, state=RUNNING}
> 17:25:53.288 [pool-12-thread-1] ERROR
> org.apache.kylin.job.impl.threadpool.DefaultScheduler - ExecuteException
> job:be5d023c-00f7-2270-0af1-10c2c38ed6f3
> org.apache.kylin.job.exception.ExecuteException:
> org.apache.kylin.job.exception.ExecuteException: java.lang.NoSuchMethodError:
> org.apache.hadoop.hbase.client.TableDescriptorBuilder.setColumnFamily(Lorg/apache/hadoop/hbase/client/ColumnFamilyDescriptor;)Lorg/apache/hadoop/hbase/client/TableDescriptorBuilder;
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:201)
> ~[kylin-core-job-3.1.2.jar:3.1.2]
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:119)
> [kylin-core-job-3.1.2.jar:3.1.2]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> [?:1.8.0_292]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> [?:1.8.0_292]
> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_292]
> Caused by: org.apache.kylin.job.exception.ExecuteException:
> java.lang.NoSuchMethodError:
> org.apache.hadoop.hbase.client.TableDescriptorBuilder.setColumnFamily(Lorg/apache/hadoop/hbase/client/ColumnFamilyDescriptor;)Lorg/apache/hadoop/hbase/client/TableDescriptorBuilder;
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:201)
> ~[kylin-core-job-3.1.2.jar:3.1.2]
> at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:72)
> ~[kylin-core-job-3.1.2.jar:3.1.2]
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180)
> ~[kylin-core-job-3.1.2.jar:3.1.2]
> ... 4 more
> Caused by: java.lang.NoSuchMethodError:
> org.apache.hadoop.hbase.client.TableDescriptorBuilder.setColumnFamily(Lorg/apache/hadoop/hbase/client/ColumnFamilyDescriptor;)Lorg/apache/hadoop/hbase/client/TableDescriptorBuilder;
> at
> org.apache.kylin.storage.hbase.steps.CubeHTableUtil.createHTable(CubeHTableUtil.java:100)
> ~[kylin-storage-hbase-3.1.2.jar:3.1.2]
> at
> org.apache.kylin.storage.hbase.steps.CreateHTableJob.run(CreateHTableJob.java:121)
> ~[kylin-storage-hbase-3.1.2.jar:3.1.2]
> at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:93)
> ~[kylin-engine-mr-3.1.2.jar:3.1.2]
> at
> org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:64)
> ~[kylin-engine-mr-3.1.2.jar:3.1.2]
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180)
> ~[kylin-core-job-3.1.2.jar:3.1.2]
> at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:72)
> ~[kylin-core-job-3.1.2.jar:3.1.2]
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180)
> ~[kylin-core-job-3.1.2.jar:3.1.2]
> ... 4 more
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
