[jira] [Commented] (SPARK-21570) File __spark_libs__XXX.zip does not exist on networked file system w/ yarn

2017-08-03 Thread Albert Chu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112868#comment-16112868 ] Albert Chu commented on SPARK-21570: There's no scheme. Just using "file://" to treat like a local

[jira] [Commented] (SPARK-21570) File __spark_libs__XXX.zip does not exist on networked file system w/ yarn

2017-08-02 Thread Albert Chu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111701#comment-16111701 ] Albert Chu commented on SPARK-21570: My setup is unique. The primary unique part is when configuring

[jira] [Commented] (SPARK-21570) File __spark_libs__XXX.zip does not exist on networked file system w/ yarn

2017-07-30 Thread Albert Chu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106609#comment-16106609 ] Albert Chu commented on SPARK-21570: Yeah, that's understandable. IIRC, on most network file

[jira] [Comment Edited] (SPARK-21570) File __spark_libs__XXX.zip does not exist on networked file system w/ yarn

2017-07-30 Thread Albert Chu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106607#comment-16106607 ] Albert Chu edited comment on SPARK-21570 at 7/30/17 6:57 PM: - (Oops,

[jira] [Comment Edited] (SPARK-21570) File __spark_libs__XXX.zip does not exist on networked file system w/ yarn

2017-07-30 Thread Albert Chu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106607#comment-16106607 ] Albert Chu edited comment on SPARK-21570 at 7/30/17 6:56 PM: - (Oops,

[jira] [Commented] (SPARK-21570) File __spark_libs__XXX.zip does not exist on networked file system w/ yarn

2017-07-30 Thread Albert Chu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106607#comment-16106607 ] Albert Chu commented on SPARK-21570: FWIW (and my scala and Spark code knowledge is not elite), in

[jira] [Commented] (SPARK-21570) File __spark_libs__XXX.zip does not exist on networked file system w/ yarn

2017-07-30 Thread Albert Chu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106585#comment-16106585 ] Albert Chu commented on SPARK-21570: My assumption was the "__spark_libs__695301535722158702.zip"

[jira] [Comment Edited] (SPARK-21570) File __spark_libs__XXX.zip does not exist on networked file system w/ yarn

2017-07-29 Thread Albert Chu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106157#comment-16106157 ] Albert Chu edited comment on SPARK-21570 at 7/29/17 3:42 PM: - The file was

[jira] [Comment Edited] (SPARK-21570) File __spark_libs__XXX.zip does not exist on networked file system w/ yarn

2017-07-29 Thread Albert Chu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106157#comment-16106157 ] Albert Chu edited comment on SPARK-21570 at 7/29/17 3:41 PM: - The file was

[jira] [Comment Edited] (SPARK-21570) File __spark_libs__XXX.zip does not exist on networked file system w/ yarn

2017-07-29 Thread Albert Chu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106157#comment-16106157 ] Albert Chu edited comment on SPARK-21570 at 7/29/17 3:41 PM: - The file was

[jira] [Commented] (SPARK-21570) File __spark_libs__XXX.zip does not exist on networked file system w/ yarn

2017-07-29 Thread Albert Chu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106157#comment-16106157 ] Albert Chu commented on SPARK-21570: The file was confirmed to show up, although at the time I did

[jira] [Commented] (SPARK-21570) File __spark_libs__XXX.zip does not exist on networked file system w/ yarn

2017-07-28 Thread Albert Chu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105900#comment-16105900 ] Albert Chu commented on SPARK-21570: Oh, and because it will likely be asked and may likely be

[jira] [Created] (SPARK-21570) File __spark_libs__XXX.zip does not exist on networked file system w/ yarn

2017-07-28 Thread Albert Chu (JIRA)
Albert Chu created SPARK-21570: -- Summary: File __spark_libs__XXX.zip does not exist on networked file system w/ yarn Key: SPARK-21570 URL: https://issues.apache.org/jira/browse/SPARK-21570 Project:

[jira] [Updated] (SPARK-2116) Load spark-defaults.conf from directory specified by SPARK_CONF_DIR

2014-06-11 Thread Albert Chu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Albert Chu updated SPARK-2116: -- Attachment: SPARK-2116.patch Load spark-defaults.conf from directory specified by SPARK_CONF_DIR

[jira] [Created] (SPARK-2116) Load spark-defaults.conf from directory specified by SPARK_CONF_DIR

2014-06-11 Thread Albert Chu (JIRA)
Albert Chu created SPARK-2116: - Summary: Load spark-defaults.conf from directory specified by SPARK_CONF_DIR Key: SPARK-2116 URL: https://issues.apache.org/jira/browse/SPARK-2116 Project: Spark

[jira] [Created] (SPARK-1559) Add conf dir to CLASSPATH in compute-classpath.sh dependent on whether SPARK_CONF_DIR is set

2014-04-21 Thread Albert Chu (JIRA)
Albert Chu created SPARK-1559: - Summary: Add conf dir to CLASSPATH in compute-classpath.sh dependent on whether SPARK_CONF_DIR is set Key: SPARK-1559 URL: https://issues.apache.org/jira/browse/SPARK-1559

[jira] [Updated] (SPARK-693) Let deploy scripts set alternate conf, work directories

2014-04-21 Thread Albert Chu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Albert Chu updated SPARK-693: - Attachment: SPARK-693.patch We required this support in our environment. Attached is my patch to