Rafal Kwasny created SPARK-4454:
---
Summary: Race condition in DAGScheduler
Key: SPARK-4454
URL: https://issues.apache.org/jira/browse/SPARK-4454
Project: Spark
Issue Type: Bug
Affects
[
https://issues.apache.org/jira/browse/SPARK-4454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rafal Kwasny updated SPARK-4454:
Description:
It seems to be a race condition in DAGScheduler that manifests on jobs with
high
[
https://issues.apache.org/jira/browse/SPARK-5348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287295#comment-14287295
]
Rafal Kwasny commented on SPARK-5348:
-
Unfortunately I am not a licensing expert
Looks
[
https://issues.apache.org/jira/browse/SPARK-5348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rafal Kwasny updated SPARK-5348:
Description:
Hadoop 2.6.0+ includes new s3a library which is a lot better than the old one.
Rafal Kwasny created SPARK-5348:
---
Summary: s3a:// protocol and hadoop-aws dependency
Key: SPARK-5348
URL: https://issues.apache.org/jira/browse/SPARK-5348
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-4454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14325653#comment-14325653
]
Rafal Kwasny commented on SPARK-4454:
-
Thanks for looking into this
The problem
[
https://issues.apache.org/jira/browse/SPARK-5348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rafal Kwasny closed SPARK-5348.
---
Resolution: Not a Problem
s3a:// protocol and hadoop-aws dependency
[
https://issues.apache.org/jira/browse/SPARK-5348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289080#comment-14289080
]
Rafal Kwasny commented on SPARK-5348:
-
Indeed spark does not require S3 libraries to
