[jira] [Commented] (SPARK-24818) Ensure all the barrier tasks in the same stage are launched together

2019-02-20 Thread luzengxiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773729#comment-16773729 ] luzengxiang commented on SPARK-24818: - "cannot fulfill task locality requirements" keeps happening!

[jira] [Resolved] (SPARK-26886) Proper termination of external processes launched by the worker

2019-02-18 Thread luzengxiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luzengxiang resolved SPARK-26886. - Resolution: Won't Do > Proper termination of external processes launched by the worker >

[jira] [Updated] (SPARK-26886) Proper termination of external processes launched by the worker

2019-02-17 Thread luzengxiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luzengxiang updated SPARK-26886: Issue Type: Story (was: New JIRA Project) > Proper termination of external processes launched by

[jira] [Commented] (SPARK-26886) Proper termination of external processes launched by the worker

2019-02-15 Thread luzengxiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16769165#comment-16769165 ] luzengxiang commented on SPARK-26886: - [~mengxr] Let's discuss about it. > Proper termination of

[jira] [Updated] (SPARK-26886) Proper termination of external processes launched by the worker

2019-02-14 Thread luzengxiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luzengxiang updated SPARK-26886: Description: When Embedding Deeplearning Framework in spark, spark worker has to launch external

[jira] [Updated] (SPARK-26886) Proper termination of external processes launched by the worker

2019-02-14 Thread luzengxiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luzengxiang updated SPARK-26886: External issue URL: (was: https://issues.apache.org/jira/browse/SPARK-24374) > Proper

[jira] [Updated] (SPARK-26886) Proper termination of external processes launched by the worker

2019-02-14 Thread luzengxiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luzengxiang updated SPARK-26886: External issue URL: https://issues.apache.org/jira/browse/SPARK-24374 > Proper termination of

[jira] [Created] (SPARK-26886) Proper termination of external processes launched by the worker

2019-02-14 Thread luzengxiang (JIRA)
luzengxiang created SPARK-26886: --- Summary: Proper termination of external processes launched by the worker Key: SPARK-26886 URL: https://issues.apache.org/jira/browse/SPARK-26886 Project: Spark

[jira] [Updated] (SPARK-26886) Proper termination of external processes launched by the worker

2019-02-14 Thread luzengxiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luzengxiang updated SPARK-26886: Description: When Embedding Deeplearning Framework in spark, spark worker has to launch external

[jira] [Updated] (SPARK-26886) Proper termination of external processes launched by the worker

2019-02-14 Thread luzengxiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luzengxiang updated SPARK-26886: Description: When Embedding Deeplearning Framework in spark, spark worker has to launch external

[jira] [Commented] (SPARK-24374) SPIP: Support Barrier Execution Mode in Apache Spark

2019-02-11 Thread luzengxiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16765694#comment-16765694 ] luzengxiang commented on SPARK-24374: - Hi [~mengxr], I am using Scala API.  > SPIP: Support Barrier

[jira] [Comment Edited] (SPARK-24374) SPIP: Support Barrier Execution Mode in Apache Spark

2019-01-08 Thread luzengxiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737849#comment-16737849 ] luzengxiang edited comment on SPARK-24374 at 1/9/19 4:45 AM: - Hi [~mengxr]:

[jira] [Commented] (SPARK-24374) SPIP: Support Barrier Execution Mode in Apache Spark

2019-01-08 Thread luzengxiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737849#comment-16737849 ] luzengxiang commented on SPARK-24374: - I am tryging embedding MPI in barrier mode to support