[
https://issues.apache.org/jira/browse/SPARK-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15102178#comment-15102178
]
Amir Gur edited comment on SPARK-10528 at 1/15/16 5:54 PM:
-----------------------------------------------------------
Thanks [~kgawrys] for the confirmation.
[~srowen], thanks for the note, yes agree it is specific for windows and hive.
Since this seems to be a bug in Hive per [#comment-14739302] and
[#comment-15093151] - should we re-open this one and file a hive bug blocking
it to track resolution?
And can also keep looking for a spark level workaround or fix as [~srowen]
suggested.
And also recalling that in the spark 1.5 presentations of Spark SQL and
DataFrames, there were mentions of getting rid of the significant dependency on
hive codebase and a re-write of the stack which was aparently a great success
overall on functionality and performance.
This dependency however is still around, I am not familiar enough with the
codebase to tell, and am just estimating this one is unrelated to successful
spark sql re-design/re-write.
was (Author: agur):
Thanks [~kgawrys] for the confirmation.
[~srowen], thanks for the note, yes agree it is specific for windows and hive.
Since this seems to be a bug in Hive per [#comment-14739302] and
[#comment-15093151] - should we re-open this one and file a hive bug blocking
it to track resolution?
> spark-shell throws java.lang.RuntimeException: The root scratch dir:
> /tmp/hive on HDFS should be writable.
> ----------------------------------------------------------------------------------------------------------
>
> Key: SPARK-10528
> URL: https://issues.apache.org/jira/browse/SPARK-10528
> Project: Spark
> Issue Type: Bug
> Components: Spark Shell
> Affects Versions: 1.5.0
> Environment: Windows 7 x64
> Reporter: Aliaksei Belablotski
> Priority: Minor
>
> Starting spark-shell throws
> java.lang.RuntimeException: java.lang.RuntimeException: The root scratch dir:
> /tmp/hive on HDFS should be writable. Current permissions are: rw-rw-rw-
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
