[jira] [Comment Edited] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-08 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16195813#comment-16195813 ] Michael N edited comment on SPARK-22163 at 10/8/17 4:08 PM: S

[jira] [Comment Edited] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-07 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16195813#comment-16195813 ] Michael N edited comment on SPARK-22163 at 10/7/17 6:06 PM: S

[jira] [Comment Edited] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-07 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16195813#comment-16195813 ] Michael N edited comment on SPARK-22163 at 10/7/17 6:05 PM: S

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-07 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16195814#comment-16195814 ] Michael N commented on SPARK-21999: --- Shixiong, Vadim, per your requests for the code,,

[jira] [Commented] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-07 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16195813#comment-16195813 ] Michael N commented on SPARK-22163: --- Sean, my text description in the ticket clearly sa

[jira] [Updated] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-07 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N updated SPARK-22163: -- Description: The application objects can contain List and can be modified dynamically as well. Howev

[jira] [Updated] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-07 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N updated SPARK-22163: -- Description: The application objects can contain List and can be modified dynamically as well. Howev

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-07 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16195810#comment-16195810 ] Michael N commented on SPARK-21999: --- Steve, your claim that I told the project "their d

[jira] [Updated] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-05 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N updated SPARK-22163: -- Description: The application objects can contain List and can be modified dynamically as well. Howev

[jira] [Comment Edited] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-05 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16193907#comment-16193907 ] Michael N edited comment on SPARK-22163 at 10/6/17 12:24 AM: -

[jira] [Comment Edited] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-05 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16193907#comment-16193907 ] Michael N edited comment on SPARK-22163 at 10/6/17 12:21 AM: -

[jira] [Comment Edited] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-05 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16193907#comment-16193907 ] Michael N edited comment on SPARK-22163 at 10/6/17 12:18 AM: -

[jira] [Updated] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-05 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N updated SPARK-22163: -- Description: The application objects can contain List and can be modified dynamically as well. Howev

[jira] [Comment Edited] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-05 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16193907#comment-16193907 ] Michael N edited comment on SPARK-22163 at 10/5/17 11:47 PM: -

[jira] [Comment Edited] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-05 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16193907#comment-16193907 ] Michael N edited comment on SPARK-22163 at 10/5/17 11:42 PM: -

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-05 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16193923#comment-16193923 ] Michael N commented on SPARK-21999: --- Vadim, It relates to serialization. I confirmed th

[jira] [Commented] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-05 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16193907#comment-16193907 ] Michael N commented on SPARK-22163: --- Vadim Semenov and Steve Loughran, per your inquiri

[jira] [Comment Edited] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-05 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16193840#comment-16193840 ] Michael N edited comment on SPARK-21999 at 10/5/17 10:33 PM: -

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-05 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16193840#comment-16193840 ] Michael N commented on SPARK-21999: --- Steve, I'd keep personal opinions of another perso

[jira] [Commented] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16192395#comment-16192395 ] Michael N commented on SPARK-22163: --- Committers: The actual issues are with Seam Owen h

[jira] [Comment Edited] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16192394#comment-16192394 ] Michael N edited comment on SPARK-21999 at 10/5/17 2:38 AM: C

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16192394#comment-16192394 ] Michael N commented on SPARK-21999: --- The actual issues are with Seam Owen himself where

[jira] [Comment Edited] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16192352#comment-16192352 ] Michael N edited comment on SPARK-22163 at 10/5/17 2:11 AM: I

[jira] [Reopened] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N reopened SPARK-21999: --- Sean, this issue occurs in both the slave nodes and the driver. No, my app is not modifying a collectio

[jira] [Comment Edited] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16192348#comment-16192348 ] Michael N edited comment on SPARK-21999 at 10/5/17 1:46 AM: N

[jira] [Comment Edited] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16192348#comment-16192348 ] Michael N edited comment on SPARK-21999 at 10/5/17 1:43 AM: N

[jira] [Comment Edited] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16192352#comment-16192352 ] Michael N edited comment on SPARK-22163 at 10/5/17 1:42 AM: I

[jira] [Comment Edited] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16192348#comment-16192348 ] Michael N edited comment on SPARK-21999 at 10/5/17 1:39 AM: N

[jira] [Reopened] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N reopened SPARK-22163: --- It is obvious that you don't understand the differences between design flaws vs coding bugs, particularl

[jira] [Reopened] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N reopened SPARK-21999: --- No, my app is *not* modifying a collection asynchronously w.r.t. Spark. You misunderstood the issue co

[jira] [Comment Edited] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16192110#comment-16192110 ] Michael N edited comment on SPARK-22163 at 10/4/17 10:33 PM: -

[jira] [Comment Edited] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16192135#comment-16192135 ] Michael N edited comment on SPARK-21999 at 10/4/17 10:32 PM: -

[jira] [Comment Edited] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16192135#comment-16192135 ] Michael N edited comment on SPARK-21999 at 10/4/17 10:31 PM: -

[jira] [Comment Edited] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16192110#comment-16192110 ] Michael N edited comment on SPARK-22163 at 10/4/17 10:12 PM: -

[jira] [Comment Edited] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16192135#comment-16192135 ] Michael N edited comment on SPARK-21999 at 10/4/17 10:13 PM: -

[jira] [Issue Comment Deleted] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N updated SPARK-21999: -- Comment: was deleted (was: The posted questions were intended to show why this is a design issue. You

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16192131#comment-16192131 ] Michael N commented on SPARK-21999: --- The posted questions were intended to show why thi

[jira] [Reopened] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N reopened SPARK-21999: --- The posted questions were intended to show why this is a design issue. You have not been able to provide

[jira] [Comment Edited] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16192110#comment-16192110 ] Michael N edited comment on SPARK-22163 at 10/4/17 10:02 PM: -

[jira] [Reopened] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N reopened SPARK-22163: --- Please distinguish between code bug vs design flaws. That is why this ticket is separate from the other

[jira] [Comment Edited] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-09-29 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16186682#comment-16186682 ] Michael N edited comment on SPARK-21999 at 9/29/17 11:35 PM: -

[jira] [Reopened] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-09-29 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N reopened SPARK-22163: --- This ticket is *not* duplicate of ticket https://issues.apache.org/jira/browse/SPARK-21999. This ticket

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-09-29 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16186682#comment-16186682 ] Michael N commented on SPARK-21999: --- You were looking at the mechanics of locking. How

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-09-28 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185130#comment-16185130 ] Michael N commented on SPARK-21999: --- Thanks Shixiong Zhu for tracking this issue to DS

[jira] [Created] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-09-28 Thread Michael N (JIRA)
Michael N created SPARK-22163: - Summary: Design Issue of Spark Streaming that Causes Random Run-time Exception Key: SPARK-22163 URL: https://issues.apache.org/jira/browse/SPARK-22163 Project: Spark

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-09-14 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16166945#comment-16166945 ] Michael N commented on SPARK-21999: --- Some related questions that would provide insights

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-09-14 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16166516#comment-16166516 ] Michael N commented on SPARK-21999: --- My app was not asynchronously modifying an object

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-09-14 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16166316#comment-16166316 ] Michael N commented on SPARK-21999: --- Sean, this issue occurred on the master as well.

[jira] [Updated] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-09-14 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N updated SPARK-21999: -- Description: Hi, I am using Spark Streaming v2.1.0 with Kafka 0.8. I am getting ConcurrentModificati

[jira] [Updated] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-09-14 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N updated SPARK-21999: -- Summary: ConcurrentModificationException - Spark Streaming (was: ConcurrentModificationException - Mas

[jira] [Updated] (SPARK-21999) ConcurrentModificationException - Master

2017-09-14 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N updated SPARK-21999: -- Summary: ConcurrentModificationException - Master (was: ConcurrentModificationException - Error sendi

[jira] [Updated] (SPARK-21999) ConcurrentModificationException - Error sending message [message = Heartbeat

2017-09-13 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N updated SPARK-21999: -- Description: Hi, I am using Spark Streaming v2.1.0 with Kafka 0.8. I am getting ConcurrentModificati

[jira] [Updated] (SPARK-21999) ConcurrentModificationException - Error sending message [message = Heartbeat

2017-09-13 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N updated SPARK-21999: -- Description: Hi, I am using Spark Streaming v2.1.0 with Kafka 0.8. I am getting ConcurrentModificati

[jira] [Updated] (SPARK-21999) ConcurrentModificationException - Error sending message [message = Heartbeat

2017-09-13 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N updated SPARK-21999: -- Description: Hi, I am using Spark Streaming v2.1.0 with Kafka 0.8. I am getting ConcurrentModificati

[jira] [Updated] (SPARK-21999) ConcurrentModificationException - Error sending message [message = Heartbeat

2017-09-13 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N updated SPARK-21999: -- Description: Hi, I am using Spark Streaming v2.1.0 with Kafka 0.8. I am getting ConcurrentModificati

[jira] [Created] (SPARK-21999) ConcurrentModificationException - Error sending message [message = Heartbeat

2017-09-13 Thread Michael N (JIRA)
Michael N created SPARK-21999: - Summary: ConcurrentModificationException - Error sending message [message = Heartbeat Key: SPARK-21999 URL: https://issues.apache.org/jira/browse/SPARK-21999 Project: Spark