[
https://issues.apache.org/jira/browse/SPARK-15779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15367977#comment-15367977
]
Jonathan Kelly commented on SPARK-15779:
Is there a well-defined list of properties we should
[
https://issues.apache.org/jira/browse/SPARK-16080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340722#comment-15340722
]
Jonathan Kelly commented on SPARK-16080:
[~vanzin], thank you very much for the quick fix! You
Jonathan Kelly created SPARK-16080:
--
Summary: Config archive not properly added to YARN classpath
Key: SPARK-16080
URL: https://issues.apache.org/jira/browse/SPARK-16080
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-12514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15131439#comment-15131439
]
Jonathan Kelly commented on SPARK-12514:
As of Spark 1.6.0, there don't seem to be *any* Spark
[
https://issues.apache.org/jira/browse/SPARK-12514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15131439#comment-15131439
]
Jonathan Kelly edited comment on SPARK-12514 at 2/4/16 12:58 AM:
-
As of
[
https://issues.apache.org/jira/browse/SPARK-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jonathan Kelly updated SPARK-10789:
---
Summary: spark-submit in cluster mode can't use third-party libraries
(was: Cluster mode
[
https://issues.apache.org/jira/browse/SPARK-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15074225#comment-15074225
]
Jonathan Kelly edited comment on SPARK-10789 at 12/29/15 8:13 PM:
--
Yes,
[
https://issues.apache.org/jira/browse/SPARK-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15074225#comment-15074225
]
Jonathan Kelly commented on SPARK-10789:
Yes, using this patch requires a rebuild. If you are
[
https://issues.apache.org/jira/browse/SPARK-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15074246#comment-15074246
]
Jonathan Kelly commented on SPARK-10789:
Thanks, [~srowen], that makes sense and was something
[
https://issues.apache.org/jira/browse/SPARK-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073193#comment-15073193
]
Jonathan Kelly commented on SPARK-10789:
Here's another patch that can be applied to v1.6.0:
[
https://issues.apache.org/jira/browse/SPARK-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jonathan Kelly updated SPARK-10789:
---
Attachment: SPARK-10789.v1.6.0.diff
Here's another patch that can be applied to v1.6.0.
>
[
https://issues.apache.org/jira/browse/SPARK-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jonathan Kelly updated SPARK-10789:
---
Comment: was deleted
(was: Here's another patch that can be applied to v1.6.0.)
> Cluster
[
https://issues.apache.org/jira/browse/SPARK-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073194#comment-15073194
]
Jonathan Kelly commented on SPARK-10789:
An alternative to this change could be to have another
[
https://issues.apache.org/jira/browse/SPARK-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jonathan Kelly updated SPARK-10789:
---
Attachment: SPARK-10789.diff
> Cluster mode SparkSubmit classpath only includes Spark
[
https://issues.apache.org/jira/browse/SPARK-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066797#comment-15066797
]
Jonathan Kelly commented on SPARK-10789:
[~roireshef], sure, here's a patch for my workaround:
[
https://issues.apache.org/jira/browse/SPARK-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jonathan Kelly updated SPARK-10789:
---
Affects Version/s: 1.6.0
> Cluster mode SparkSubmit classpath only includes Spark assembly
>
[
https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965484#comment-14965484
]
Jonathan Kelly commented on SPARK-8332:
---
Oh, you might be right. I was thinking that I had tried
[
https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965459#comment-14965459
]
Jonathan Kelly commented on SPARK-8332:
---
[~srowen], isn't this still a problem? It seems odd that
[
https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965703#comment-14965703
]
Jonathan Kelly commented on SPARK-8332:
---
Good news! I tried compiling Spark with Jackson 2.5.3
[
https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965900#comment-14965900
]
Jonathan Kelly commented on SPARK-8332:
---
Sorry, yes, I should have checked to see what the latest
[
https://issues.apache.org/jira/browse/SPARK-10790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14939060#comment-14939060
]
Jonathan Kelly commented on SPARK-10790:
Thank you for the explanation and for such a quick fix,
[
https://issues.apache.org/jira/browse/SPARK-10790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14906047#comment-14906047
]
Jonathan Kelly commented on SPARK-10790:
I did search through all dynamicAllocation-related JIRAs
[
https://issues.apache.org/jira/browse/SPARK-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jonathan Kelly updated SPARK-10789:
---
Component/s: Spark Submit
> Cluster mode SparkSubmit classpath only includes Spark classpath
Jonathan Kelly created SPARK-10790:
--
Summary: Dynamic Allocation does not request any executors if
first stage needs less than or equal to spark.dynamicAllocation.initialExecutors
Key: SPARK-10790
URL:
[
https://issues.apache.org/jira/browse/SPARK-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jonathan Kelly updated SPARK-10789:
---
Description:
When using cluster deploy mode, the classpath of the SparkSubmit process that
Jonathan Kelly created SPARK-10789:
--
Summary: Cluster mode SparkSubmit classpath only includes Spark
classpath
Key: SPARK-10789
URL: https://issues.apache.org/jira/browse/SPARK-10789
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jonathan Kelly updated SPARK-10789:
---
Summary: Cluster mode SparkSubmit classpath only includes Spark assembly
(was: Cluster mode
[
https://issues.apache.org/jira/browse/SPARK-10790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14906505#comment-14906505
]
Jonathan Kelly commented on SPARK-10790:
Yes, this is on Spark 1.5.0. That's why I chose 1.5.0
[
https://issues.apache.org/jira/browse/SPARK-10790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14906912#comment-14906912
]
Jonathan Kelly commented on SPARK-10790:
I can reproduce it with minExecutors=N and
Jonathan Kelly created SPARK-10500:
--
Summary: sparkr.zip cannot be created if $SPARK_HOME/R/lib is
unwritable
Key: SPARK-10500
URL: https://issues.apache.org/jira/browse/SPARK-10500
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-10500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14736223#comment-14736223
]
Jonathan Kelly commented on SPARK-10500:
Ah, I was not aware that the Spark packages ended up in
[
https://issues.apache.org/jira/browse/SPARK-6392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662189#comment-14662189
]
Jonathan Kelly commented on SPARK-6392:
---
Are you sure this is fixed by
[
https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621067#comment-14621067
]
Jonathan Kelly commented on SPARK-8332:
---
Thanks, Sean. Is there any reason why
[
https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14603881#comment-14603881
]
Jonathan Kelly commented on SPARK-8332:
---
Actually, it seems like it may have been
[
https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14603751#comment-14603751
]
Jonathan Kelly commented on SPARK-8332:
---
I was running into the same issue, so I
[
https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14603751#comment-14603751
]
Jonathan Kelly edited comment on SPARK-8332 at 6/26/15 11:15 PM:
[
https://issues.apache.org/jira/browse/SPARK-4438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594092#comment-14594092
]
Jonathan Kelly commented on SPARK-4438:
---
This API was added in 1.4.0, right? Should
[
https://issues.apache.org/jira/browse/SPARK-4924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555062#comment-14555062
]
Jonathan Kelly commented on SPARK-4924:
---
I tried upgrading my environment to Spark
[
https://issues.apache.org/jira/browse/SPARK-4924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555131#comment-14555131
]
Jonathan Kelly commented on SPARK-4924:
---
I think the idea was probably so that any
[
https://issues.apache.org/jira/browse/SPARK-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107131#comment-14107131
]
Jonathan Kelly commented on SPARK-1981:
---
The code here is a cleaned up version of
[
https://issues.apache.org/jira/browse/SPARK-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057763#comment-14057763
]
Jonathan Kelly commented on SPARK-1981:
---
I work for Amazon, but unfortunately I
[
https://issues.apache.org/jira/browse/SPARK-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14053232#comment-14053232
]
Jonathan Kelly commented on SPARK-1981:
---
If you use the AWS Java SDK for the code
[
https://issues.apache.org/jira/browse/SPARK-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14049442#comment-14049442
]
Jonathan Kelly commented on SPARK-1981:
---
Chris,
Has there been any more progress on
[
https://issues.apache.org/jira/browse/SPARK-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14049578#comment-14049578
]
Jonathan Kelly commented on SPARK-1981:
---
Awesome, thanks! I was at the summit as
44 matches
Mail list logo
