[
https://issues.apache.org/jira/browse/KYLIN-4673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shiyu reopened KYLIN-4673:
--------------------------
> apache-kylin-3.1.0 Caused by: com.jcraft.jsch.JSchException: Auth fail
> ----------------------------------------------------------------------
>
> Key: KYLIN-4673
> URL: https://issues.apache.org/jira/browse/KYLIN-4673
> Project: Kylin
> Issue Type: Bug
> Components: Tools, Build and Test
> Affects Versions: v3.1.0
> Environment: Windows7
> IntelliJ IDEA 2018.3.6 x64
> Java version "1.8.0_71"
> Scala version 2.11.12
> Hadoop version hadoop-3.0.2
> Spark version 2.4.5
> CHD 6.0.1
> Reporter: shiyu
> Assignee: Yaqian Zhang
> Priority: Minor
> Attachments: 3.png
>
>
> when run it in IDEA to test development kylin3.1.0:
> 2020-07-31 15:40:08,947 INFO [Scheduler 755913288 Job
> da16f72e-1eae-204e-2a79-1a274c17e39c-86] hive.CreateFlatHiveTableStep:41 :
> hive -e "set mapreduce.job.name=Create Intermediate Flat Hive Table book_c
> da16f72e-1eae-204e-2a79-1a274c17e39c-00;2020-07-31 15:40:08,947 INFO
> [Scheduler 755913288 Job da16f72e-1eae-204e-2a79-1a274c17e39c-86]
> hive.CreateFlatHiveTableStep:41 : hive -e "set mapreduce.job.name=Create
> Intermediate Flat Hive Table book_c
> da16f72e-1eae-204e-2a79-1a274c17e39c-00;USE default;
> DROP TABLE IF EXISTS
> kylin_intermediate_book_c_1754969e_31ab_f4dc_62cd_f0a7aeae3c49;CREATE
> EXTERNAL TABLE IF NOT EXISTS
> kylin_intermediate_book_c_1754969e_31ab_f4dc_62cd_f0a7aeae3c49(\`BOOK_KEY\`
> bigint,\`BOOK_BOOKID\` bigint,\`BOOK_BOOKNAME\` string,\`BOOK_PRESS\`
> string,\`BOOK_WRITER\` string,\`BOOK_PRICE\` double)STORED AS
> SEQUENCEFILELOCATION
> 'hdfs://nameservice1/kylin/kylin_metadata_learn/kylin-da16f72e-1eae-204e-2a79-1a274c17e39c/kylin_intermediate_book_c_1754969e_31ab_f4dc_62cd_f0a7aeae3c49';ALTER
> TABLE kylin_intermediate_book_c_1754969e_31ab_f4dc_62cd_f0a7aeae3c49 SET
> TBLPROPERTIES('auto.purge'='true');INSERT OVERWRITE TABLE
> \`kylin_intermediate_book_c_1754969e_31ab_f4dc_62cd_f0a7aeae3c49\`
> SELECT\`BOOK\`.\`KEY\` as \`BOOK_KEY\`,\`BOOK\`.\`BOOKID\` as
> \`BOOK_BOOKID\`,\`BOOK\`.\`BOOKNAME\` as \`BOOK_BOOKNAME\`,\`BOOK\`.\`PRESS\`
> as \`BOOK_PRESS\`,\`BOOK\`.\`WRITER\` as \`BOOK_WRITER\`,\`BOOK\`.\`PRICE\`
> as \`BOOK_PRICE\` FROM \`TEST\`.\`BOOK\` as \`BOOK\`WHERE 1=1;
> " --hiveconf
> mapreduce.map.output.compress.codec=org.apache.hadoop.io.compress.SnappyCodec
> --hiveconf dfs.replication=2 --hiveconf
> hive.exec.compress.output=true2020-07-31 15:40:08,948 INFO [Scheduler
> 755913288 Job da16f72e-1eae-204e-2a79-1a274c17e39c-86] util.SSHClient:262 :
> [root@bd135] Execute command: hive -e "set mapreduce.job.name=Create
> Intermediate Flat Hive Table book_c
> da16f72e-1eae-204e-2a79-1a274c17e39c-00;USE default;
> DROP TABLE IF EXISTS
> kylin_intermediate_book_c_1754969e_31ab_f4dc_62cd_f0a7aeae3c49;CREATE
> EXTERNAL TABLE IF NOT EXISTS
> kylin_intermediate_book_c_1754969e_31ab_f4dc_62cd_f0a7aeae3c49(\`BOOK_KEY\`
> bigint,\`BOOK_BOOKID\` bigint,\`BOOK_BOOKNAME\` string,\`BOOK_PRESS\`
> string,\`BOOK_WRITER\` string,\`BOOK_PRICE\` double)STORED AS
> SEQUENCEFILELOCATION
> 'hdfs://nameservice1/kylin/kylin_metadata_learn/kylin-da16f72e-1eae-204e-2a79-1a274c17e39c/kylin_intermediate_book_c_1754969e_31ab_f4dc_62cd_f0a7aeae3c49';ALTER
> TABLE kylin_intermediate_book_c_1754969e_31ab_f4dc_62cd_f0a7aeae3c49 SET
> TBLPROPERTIES('auto.purge'='true');INSERT OVERWRITE TABLE
> \`kylin_intermediate_book_c_1754969e_31ab_f4dc_62cd_f0a7aeae3c49\`
> SELECT\`BOOK\`.\`KEY\` as \`BOOK_KEY\`,\`BOOK\`.\`BOOKID\` as
> \`BOOK_BOOKID\`,\`BOOK\`.\`BOOKNAME\` as \`BOOK_BOOKNAME\`,\`BOOK\`.\`PRESS\`
> as \`BOOK_PRESS\`,\`BOOK\`.\`WRITER\` as \`BOOK_WRITER\`,\`BOOK\`.\`PRICE\`
> as \`BOOK_PRICE\` FROM \`TEST\`.\`BOOK\` as \`BOOK\`WHERE 1=1;
> " --hiveconf
> mapreduce.map.output.compress.codec=org.apache.hadoop.io.compress.SnappyCodec
> --hiveconf dfs.replication=2 --hiveconf
> hive.exec.compress.output=true2020-07-31 15:40:10,733 ERROR [Scheduler
> 755913288 Job da16f72e-1eae-204e-2a79-1a274c17e39c-86]
> hive.CreateFlatHiveTableStep:101 :
> job:da16f72e-1eae-204e-2a79-1a274c17e39c-00 execute finished with
> exceptionjava.io.IOException: Auth fail at
> org.apache.kylin.common.util.CliCommandExecutor.runRemoteCommand(CliCommandExecutor.java:115)
> at
> org.apache.kylin.common.util.CliCommandExecutor.execute(CliCommandExecutor.java:91)
> at
> org.apache.kylin.source.hive.CreateFlatHiveTableStep.createFlatHiveTable(CreateFlatHiveTableStep.java:59)
> at
> org.apache.kylin.source.hive.CreateFlatHiveTableStep.doWork(CreateFlatHiveTableStep.java:97)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:178)
> at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:71)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:178)
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)Caused by:
> com.jcraft.jsch.JSchException: Auth fail at
> com.jcraft.jsch.Session.connect(Session.java:519) at
> com.jcraft.jsch.Session.connect(Session.java:183) at
> org.apache.kylin.common.util.SSHClient.execCommand(SSHClient.java:268) at
> org.apache.kylin.common.util.CliCommandExecutor.runRemoteCommand(CliCommandExecutor.java:108)
> ... 10 more2020-07-31 15:40:10,754 INFO [Scheduler 755913288 Job
> da16f72e-1eae-204e-2a79-1a274c17e39c-86] execution.ExecutableManager:479 :
> job id:da16f72e-1eae-204e-2a79-1a274c17e39c-00 from RUNNING to
> ERROR2020-07-31 15:40:10,758 ERROR [Scheduler 755913288 Job
> da16f72e-1eae-204e-2a79-1a274c17e39c-86] execution.AbstractExecutable:180 :
> error running Executable: CubingJob\{id=da16f72e-1eae-204e-2a79-1a274c17e39c,
> name=BUILD CUBE - book_c - FULL_BUILD - GMT+08:00 2020-07-31 15:34:30,
> state=RUNNING}2020-07-31 15:40:10,774 DEBUG [pool-5-thread-1]
> cachesync.Broadcaster:119 : Servers in the cluster:
> [localhost:7070]2020-07-31 15:40:10,774 DEBUG [pool-5-thread-1]
> cachesync.Broadcaster:129 : Announcing new broadcast to all:
> BroadcastEvent\{entity=execute_output, event=update,
> cacheKey=da16f72e-1eae-204e-2a79-1a274c17e39c}2020-07-31 15:40:10,782 DEBUG
> [http-bio-7070-exec-6] cachesync.Broadcaster:267 : Broadcasting UPDATE,
> execute_output, da16f72e-1eae-204e-2a79-1a274c17e39c2020-07-31 15:40:10,785
> INFO [Scheduler 755913288 Job da16f72e-1eae-204e-2a79-1a274c17e39c-86]
> execution.ExecutableManager:479 : job id:da16f72e-1eae-204e-2a79-1a274c17e39c
> from RUNNING to ERROR2020-07-31 15:40:10,785 DEBUG [Scheduler 755913288 Job
> da16f72e-1eae-204e-2a79-1a274c17e39c-86] execution.AbstractExecutable:331 :
> no need to send email, user list is empty2020-07-31 15:40:10,786 DEBUG
> [pool-5-thread-1] cachesync.Broadcaster:119 : Servers in the cluster:
> [localhost:7070]2020-07-31 15:40:10,786 DEBUG [pool-5-thread-1]
> cachesync.Broadcaster:129 : Announcing new broadcast to all:
> BroadcastEvent\{entity=execute_output, event=update,
> cacheKey=da16f72e-1eae-204e-2a79-1a274c17e39c}2020-07-31 15:40:10,788 DEBUG
> [http-bio-7070-exec-6] cachesync.Broadcaster:301 : Done broadcasting UPDATE,
> execute_output, da16f72e-1eae-204e-2a79-1a274c17e39c2020-07-31 15:40:10,791
> ERROR [pool-11-thread-2] threadpool.DefaultScheduler:116 : ExecuteException
> job:da16f72e-1eae-204e-2a79-1a274c17e39corg.apache.kylin.job.exception.ExecuteException:
> org.apache.kylin.job.exception.ExecuteException: java.io.IOException: Auth
> fail at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:193)
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)Caused by:
> org.apache.kylin.job.exception.ExecuteException: java.io.IOException: Auth
> fail at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:193)
> at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:71)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:178)
> ... 4 moreCaused by: java.io.IOException: Auth fail at
> org.apache.kylin.common.util.CliCommandExecutor.runRemoteCommand(CliCommandExecutor.java:115)
> at
> org.apache.kylin.common.util.CliCommandExecutor.execute(CliCommandExecutor.java:91)
> at
> org.apache.kylin.source.hive.CreateFlatHiveTableStep.createFlatHiveTable(CreateFlatHiveTableStep.java:59)
> at
> org.apache.kylin.source.hive.CreateFlatHiveTableStep.doWork(CreateFlatHiveTableStep.java:97)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:178)
> ... 6 moreCaused by: com.jcraft.jsch.JSchException: Auth fail at
> com.jcraft.jsch.Session.connect(Session.java:519) at
> com.jcraft.jsch.Session.connect(Session.java:183) at
> org.apache.kylin.common.util.SSHClient.execCommand(SSHClient.java:268) at
> org.apache.kylin.common.util.CliCommandExecutor.runRemoteCommand(CliCommandExecutor.java:108)
> ... 10 more
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
