[jira] [Commented] (SPARK-24981) ShutdownHook timeout causes job to fail when succeeded when SparkContext stop() not called by user program

[ https://issues.apache.org/jira/browse/SPARK-24981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190336#comment-17190336 ] Hieu Tri Huynh commented on SPARK-24981: As far as I know, InterruptedException is considered as

[jira] [Created] (SPARK-28394) Performance Metrics for Driver

Hieu Tri Huynh created SPARK-28394: -- Summary: Performance Metrics for Driver Key: SPARK-28394 URL: https://issues.apache.org/jira/browse/SPARK-28394 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-2387) Remove the stage barrier for better resource utilization

[ https://issues.apache.org/jira/browse/SPARK-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839752#comment-16839752 ] Hieu Tri Huynh commented on SPARK-2387: --- [~lirui], [~sandyr], [~lianhuiwang], [~xuefuz],

[jira] [Created] (SPARK-24992) spark should randomize yarn local dir selection

Hieu Tri Huynh created SPARK-24992: -- Summary: spark should randomize yarn local dir selection Key: SPARK-24992 URL: https://issues.apache.org/jira/browse/SPARK-24992 Project: Spark Issue

[jira] [Updated] (SPARK-24981) ShutdownHook timeout causes job to fail when succeeded when SparkContext stop() not called by user program

[ https://issues.apache.org/jira/browse/SPARK-24981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hieu Tri Huynh updated SPARK-24981: --- Priority: Minor (was: Major) > ShutdownHook timeout causes job to fail when succeeded when

[jira] [Updated] (SPARK-24981) ShutdownHook timeout causes job to fail when succeeded when SparkContext stop() not called by user program

[ https://issues.apache.org/jira/browse/SPARK-24981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hieu Tri Huynh updated SPARK-24981: --- Summary: ShutdownHook timeout causes job to fail when succeeded when SparkContext stop()

[jira] [Created] (SPARK-24981) ShutdownHook timeout causes job to fail when succeeded when SparkContext stop() not called

Hieu Tri Huynh created SPARK-24981: -- Summary: ShutdownHook timeout causes job to fail when succeeded when SparkContext stop() not called Key: SPARK-24981 URL: https://issues.apache.org/jira/browse/SPARK-24981

[jira] [Comment Edited] (SPARK-13343) speculative tasks that didn't commit shouldn't be marked as success

[ https://issues.apache.org/jira/browse/SPARK-13343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16536409#comment-16536409 ] Hieu Tri Huynh edited comment on SPARK-13343 at 7/8/18 9:04 PM: While

[jira] [Comment Edited] (SPARK-13343) speculative tasks that didn't commit shouldn't be marked as success

[ https://issues.apache.org/jira/browse/SPARK-13343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16536409#comment-16536409 ] Hieu Tri Huynh edited comment on SPARK-13343 at 7/8/18 9:02 PM: While

[jira] [Updated] (SPARK-13343) speculative tasks that didn't commit shouldn't be marked as success

[ https://issues.apache.org/jira/browse/SPARK-13343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hieu Tri Huynh updated SPARK-13343: --- Attachment: image.png > speculative tasks that didn't commit shouldn't be marked as success

[jira] [Commented] (SPARK-13343) speculative tasks that didn't commit shouldn't be marked as success

[ https://issues.apache.org/jira/browse/SPARK-13343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16536409#comment-16536409 ] Hieu Tri Huynh commented on SPARK-13343: While working on this issue, I noticed another problem

[jira] [Updated] (SPARK-13343) speculative tasks that didn't commit shouldn't be marked as success

[ https://issues.apache.org/jira/browse/SPARK-13343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hieu Tri Huynh updated SPARK-13343: --- Attachment: image.png > speculative tasks that didn't commit shouldn't be marked as success

[jira] [Updated] (SPARK-13343) speculative tasks that didn't commit shouldn't be marked as success

[ https://issues.apache.org/jira/browse/SPARK-13343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hieu Tri Huynh updated SPARK-13343: --- Attachment: Screen Shot 2018-07-08 at 3.49.52 PM.png > speculative tasks that didn't commit

[jira] [Comment Edited] (SPARK-24755) Executor loss can cause task to not be resubmitted

[ https://issues.apache.org/jira/browse/SPARK-24755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535956#comment-16535956 ] Hieu Tri Huynh edited comment on SPARK-24755 at 7/8/18 3:05 AM: Hi

[jira] [Commented] (SPARK-24755) Executor loss can cause task to not be resubmitted

[ https://issues.apache.org/jira/browse/SPARK-24755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535956#comment-16535956 ] Hieu Tri Huynh commented on SPARK-24755: Hi [~mridulm80], since fixing this might affect my

[jira] [Commented] (SPARK-10781) Allow certain number of failed tasks and allow job to succeed

[ https://issues.apache.org/jira/browse/SPARK-10781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16517716#comment-16517716 ] Hieu Tri Huynh commented on SPARK-10781: I attached a proposed solution for this Jira. Hope to

[jira] [Updated] (SPARK-10781) Allow certain number of failed tasks and allow job to succeed

[ https://issues.apache.org/jira/browse/SPARK-10781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hieu Tri Huynh updated SPARK-10781: --- Attachment: SPARK_10781_Proposed_Solution.pdf > Allow certain number of failed tasks and

[jira] [Created] (SPARK-24519) MapStatus has 2000 hardcoded

Hieu Tri Huynh created SPARK-24519: -- Summary: MapStatus has 2000 hardcoded Key: SPARK-24519 URL: https://issues.apache.org/jira/browse/SPARK-24519 Project: Spark Issue Type: Improvement