[jira] [Commented] (SPARK-19698) Race condition in stale attempt task completion vs current attempt task completion when task is doing persistent state changes

[ https://issues.apache.org/jira/browse/SPARK-19698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881771#comment-15881771 ] Jisoo Kim commented on SPARK-19698: --- Ah, I see what you mean. I don't use Spark's speculation feature,

[jira] [Commented] (SPARK-19698) Race condition in stale attempt task completion vs current attempt task completion when task is doing persistent state changes

[ https://issues.apache.org/jira/browse/SPARK-19698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881644#comment-15881644 ] Jisoo Kim commented on SPARK-19698: --- [~kayousterhout] If the failed task gets re-tried, as long as

[jira] [Commented] (SPARK-19698) Race condition in stale attempt task completion vs current attempt task completion when task is doing persistent state changes

[ https://issues.apache.org/jira/browse/SPARK-19698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881525#comment-15881525 ] Jisoo Kim commented on SPARK-19698: --- [~kayousterhout] Thanks for linking the JIRA ticket, I agree that

[jira] [Commented] (SPARK-19698) Race condition in stale attempt task completion vs current attempt task completion when task is doing persistent state changes

[ https://issues.apache.org/jira/browse/SPARK-19698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15879068#comment-15879068 ] Jisoo Kim commented on SPARK-19698: --- I don't think it's only limited to Mesos coarse-grained executor.

[jira] [Comment Edited] (SPARK-19698) Race condition in stale attempt task completion vs current attempt task completion when task is doing persistent state changes

[ https://issues.apache.org/jira/browse/SPARK-19698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15879068#comment-15879068 ] Jisoo Kim edited comment on SPARK-19698 at 2/22/17 7:43 PM: I don't think

[jira] [Commented] (SPARK-19316) Spark event logs are huge compared to 1.5.2

[ https://issues.apache.org/jira/browse/SPARK-19316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15840348#comment-15840348 ] Jisoo Kim commented on SPARK-19316: --- Found the duplicate and made a PR to resolve the issue

[jira] [Commented] (SPARK-19316) Spark event logs are huge compared to 1.5.2

[ https://issues.apache.org/jira/browse/SPARK-19316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15832710#comment-15832710 ] Jisoo Kim commented on SPARK-19316: --- I suspect this is due to "SparkListenrTaskEnd" event log having

[jira] [Commented] (SPARK-19111) S3 Mesos history upload fails silently if too large

[ https://issues.apache.org/jira/browse/SPARK-19111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15832473#comment-15832473 ] Jisoo Kim commented on SPARK-19111: --- Related to https://issues.apache.org/jira/browse/SPARK-19316. >

[jira] [Commented] (SPARK-19316) Spark event logs are huge compared to 1.5.2

[ https://issues.apache.org/jira/browse/SPARK-19316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15832470#comment-15832470 ] Jisoo Kim commented on SPARK-19316: --- Related to https://issues.apache.org/jira/browse/SPARK-19111 >

[jira] [Commented] (SPARK-19111) S3 Mesos history upload fails silently if too large

[ https://issues.apache.org/jira/browse/SPARK-19111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15832458#comment-15832458 ] Jisoo Kim commented on SPARK-19111: --- Thanks [~ste...@apache.org] for information, using S3a helped with

[jira] [Created] (SPARK-19316) Spark event logs are huge compared to 1.5.2

Jisoo Kim created SPARK-19316: - Summary: Spark event logs are huge compared to 1.5.2 Key: SPARK-19316 URL: https://issues.apache.org/jira/browse/SPARK-19316 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-12221) Add CPU time metric to TaskMetrics

[ https://issues.apache.org/jira/browse/SPARK-12221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179173#comment-15179173 ] Jisoo Kim commented on SPARK-12221: --- I made this backward-compatible, so it should be able to read

[jira] [Created] (SPARK-12221) Add CPU time metric to TaskMetrics

Jisoo Kim created SPARK-12221: - Summary: Add CPU time metric to TaskMetrics Key: SPARK-12221 URL: https://issues.apache.org/jira/browse/SPARK-12221 Project: Spark Issue Type: Improvement