Yuming Wang created SPARK-25330:
-----------------------------------
Summary: Permission issue after upgrade hadoop version to 2.7.7
Key: SPARK-25330
URL: https://issues.apache.org/jira/browse/SPARK-25330
Project: Spark
Issue Type: Bug
Components: Build
Affects Versions: 2.3.2, 2.4.0
Reporter: Yuming Wang
How to reproduce:
{code:java}
# build spark
./dev/make-distribution.sh --name HADOOP-14919 --tgz -Phadoop-2.7 -Phive
-Phive-thriftserver -Pyarn
cd spark-2.4.0-SNAPSHOT-bin-HADOOP-14919
export HADOOP_PROXY_USER=user_a
spark-sql
export HADOOP_PROXY_USER=user_b
spark-sql{code}
{noformat}
Exception in thread "main" java.lang.RuntimeException:
org.apache.hadoop.security.AccessControlException: Permission denied:
user=b_slng, access=EXECUTE,
inode="/tmp/hive-$%7Buser.name%7D/b_slng/668748f2-f6c5-4325-a797-fd0a7ee7f4d4":user_b:hadoop:drwx------
at
org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319)
at
org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkTraverse(FSPermissionChecker.java:259)
at
org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:205)
at
org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190){noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
