Saisai Shao created SPARK-20172:
-----------------------------------
Summary: Event log without read permission should be filtered out
before actually reading it
Key: SPARK-20172
URL: https://issues.apache.org/jira/browse/SPARK-20172
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 2.2.0
Reporter: Saisai Shao
Priority: Minor
In the current Spark's HistoryServer, we expected to check file permission when
listing all the files, and filter out this files with no read permission. That
was not worked because we actually doesn't check the access permission, so we
defer this permission check until reading files, that is not necessary and the
exception is printed out in every 10 seconds by default.
So to avoid this problem we should add a access check logic in listing files.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
