[
https://issues.apache.org/jira/browse/SPARK-22794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
KaiXinXIaoLei updated SPARK-22794:
--
Description:
I run a job in yarn mode, the job is failed:
{noformat}
17/12/15 11:55:16 INFO SharedState: Warehouse path is '/apps/hive/warehouse'.
Exception in thread "main" org.apache.spark.sql.AnalysisException: Path does
not exist: hdfs://node1.huleilei.h3c.com:8020/user/hdfs/sss;
at
org.apache.spark.sql.execution.datasources.DataSource$$anonfun$14.apply(DataSource.scala:382)
at
org.apache.spark.sql.execution.datasources.DataSource$$anonfun$14.apply(DataSource.scala:370)
{noformat}
but in the yarn web, the job state is succeeded.
was:
I run a job in yarn mode, the job is failed:
{noformat}
17/12/15 11:55:16 INFO SharedState: Warehouse path is '/apps/hive/warehouse'.
Exception in thread "main" org.apache.spark.sql.AnalysisException: Path does
not exist: hdfs://node1.huleilei.h3c.com:8020/user/hdfs/sss;
at
org.apache.spark.sql.execution.datasources.DataSource$$anonfun$14.apply(DataSource.scala:382)
at
org.apache.spark.sql.execution.datasources.DataSource$$anonfun$14.apply(DataSource.scala:370)
{noformat}
but in the yarn web, the job state is succeeded:
!C:\Users\g15071\Downloads\task_is_succeeded_in_yarn_web.png!
> Spark Job failed, but the state is succeeded in Yarn Web
>
>
> Key: SPARK-22794
> URL: https://issues.apache.org/jira/browse/SPARK-22794
> Project: Spark
> Issue Type: Bug
> Components: YARN
>Affects Versions: 2.2.1
>Reporter: KaiXinXIaoLei
>
> I run a job in yarn mode, the job is failed:
> {noformat}
> 17/12/15 11:55:16 INFO SharedState: Warehouse path is '/apps/hive/warehouse'.
> Exception in thread "main" org.apache.spark.sql.AnalysisException: Path does
> not exist: hdfs://node1.huleilei.h3c.com:8020/user/hdfs/sss;
> at
> org.apache.spark.sql.execution.datasources.DataSource$$anonfun$14.apply(DataSource.scala:382)
> at
> org.apache.spark.sql.execution.datasources.DataSource$$anonfun$14.apply(DataSource.scala:370)
> {noformat}
> but in the yarn web, the job state is succeeded.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
