[
https://issues.apache.org/jira/browse/SPARK-12166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-12166:
------------------------------
Assignee: Jeff Zhang
> Unset hadoop related environment in testing
> --------------------------------------------
>
> Key: SPARK-12166
> URL: https://issues.apache.org/jira/browse/SPARK-12166
> Project: Spark
> Issue Type: Improvement
> Components: Tests
> Affects Versions: 1.5.2
> Reporter: Jeff Zhang
> Assignee: Jeff Zhang
> Priority: Minor
> Fix For: 1.6.1, 2.0.0
>
>
> I try to do test on HiveSparkSubmitSuite on local box, but fails. The cause
> is that spark is still using my local single node cluster hadoop when doing
> the unit test. I don't think it make sense to do that. These environment
> variable should be unset before the testing. And I suspect dev/run-tests also
> didn't do that either.
> Here's the error message:
> {code}
> Cause: java.lang.RuntimeException: java.lang.RuntimeException: The root
> scratch dir: /tmp/hive on HDFS should be writable. Current permissions are:
> rwxr-xr-x
> [info] at
> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:522)
> [info] at
> org.apache.spark.sql.hive.client.ClientWrapper.<init>(ClientWrapper.scala:171)
> [info] at
> org.apache.spark.sql.hive.HiveContext.executionHive$lzycompute(HiveContext.scala:162)
> [info] at
> org.apache.spark.sql.hive.HiveContext.executionHive(HiveContext.scala:160)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
