[jira] [Updated] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-09-14 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N updated SPARK-21999: -- Description: Hi, I am using Spark Streaming v2.1.0 with Kafka 0.8. I am getting

[jira] [Updated] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-09-14 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N updated SPARK-21999: -- Summary: ConcurrentModificationException - Spark Streaming (was: ConcurrentModificationException -

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-09-14 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166316#comment-16166316 ] Michael N commented on SPARK-21999: --- Sean, this issue occurred on the master as well.I updated the

[jira] [Updated] (SPARK-21999) ConcurrentModificationException - Master

2017-09-14 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N updated SPARK-21999: -- Summary: ConcurrentModificationException - Master (was: ConcurrentModificationException - Error

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-09-14 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166516#comment-16166516 ] Michael N commented on SPARK-21999: --- My app was not asynchronously modifying an object that your

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-09-14 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166945#comment-16166945 ] Michael N commented on SPARK-21999: --- Some related questions that would provide insights into this issue

[jira] [Updated] (SPARK-21999) ConcurrentModificationException - Error sending message [message = Heartbeat

2017-09-13 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N updated SPARK-21999: -- Description: Hi, I am using Spark Streaming v2.1.0 with Kafka 0.8. I am getting

[jira] [Updated] (SPARK-21999) ConcurrentModificationException - Error sending message [message = Heartbeat

2017-09-13 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N updated SPARK-21999: -- Description: Hi, I am using Spark Streaming v2.1.0 with Kafka 0.8. I am getting

[jira] [Created] (SPARK-21999) ConcurrentModificationException - Error sending message [message = Heartbeat

2017-09-13 Thread Michael N (JIRA)
Michael N created SPARK-21999: - Summary: ConcurrentModificationException - Error sending message [message = Heartbeat Key: SPARK-21999 URL: https://issues.apache.org/jira/browse/SPARK-21999 Project:

[jira] [Updated] (SPARK-21999) ConcurrentModificationException - Error sending message [message = Heartbeat

2017-09-13 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N updated SPARK-21999: -- Description: Hi, I am using Spark Streaming v2.1.0 with Kafka 0.8. I am getting

[jira] [Updated] (SPARK-21999) ConcurrentModificationException - Error sending message [message = Heartbeat

2017-09-13 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N updated SPARK-21999: -- Description: Hi, I am using Spark Streaming v2.1.0 with Kafka 0.8. I am getting

[jira] [Comment Edited] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192348#comment-16192348 ] Michael N edited comment on SPARK-21999 at 10/5/17 1:43 AM: No, my app is

[jira] [Comment Edited] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192352#comment-16192352 ] Michael N edited comment on SPARK-22163 at 10/5/17 1:42 AM: It is obvious

[jira] [Reopened] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N reopened SPARK-22163: --- It is obvious that you don't understand the differences between design flaws vs coding bugs,

[jira] [Reopened] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N reopened SPARK-21999: --- Sean, this issue occurs in both the slave nodes and the driver. No, my app is not modifying a

[jira] [Reopened] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N reopened SPARK-21999: --- No, my app is *not* modifying a collection asynchronously w.r.t. Spark. You misunderstood the issue

[jira] [Comment Edited] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192348#comment-16192348 ] Michael N edited comment on SPARK-21999 at 10/5/17 1:46 AM: No, my app is

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192394#comment-16192394 ] Michael N commented on SPARK-21999: --- The actual issues are with Seam Owen himself where 1. Sean Owen

[jira] [Comment Edited] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192394#comment-16192394 ] Michael N edited comment on SPARK-21999 at 10/5/17 2:38 AM: Committers: The

[jira] [Commented] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192395#comment-16192395 ] Michael N commented on SPARK-22163: --- Committers: The actual issues are with Seam Owen himself where 1.

[jira] [Comment Edited] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192348#comment-16192348 ] Michael N edited comment on SPARK-21999 at 10/5/17 1:39 AM: No, my app is

[jira] [Comment Edited] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192352#comment-16192352 ] Michael N edited comment on SPARK-22163 at 10/5/17 2:11 AM: It is obvious

[jira] [Comment Edited] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-08 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16195813#comment-16195813 ] Michael N edited comment on SPARK-22163 at 10/8/17 4:08 PM: Sean, my text

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-05 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193923#comment-16193923 ] Michael N commented on SPARK-21999: --- Vadim, It relates to serialization. I confirmed that it is due to

[jira] [Comment Edited] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-05 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193907#comment-16193907 ] Michael N edited comment on SPARK-22163 at 10/5/17 11:42 PM: - Vadim Semenov

[jira] [Comment Edited] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-05 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193907#comment-16193907 ] Michael N edited comment on SPARK-22163 at 10/6/17 12:18 AM: - Vadim Semenov

[jira] [Commented] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-05 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193907#comment-16193907 ] Michael N commented on SPARK-22163: --- Vadim Semenov and Steve Loughran, per your inquiries in ticket

[jira] [Comment Edited] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-05 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193840#comment-16193840 ] Michael N edited comment on SPARK-21999 at 10/5/17 10:33 PM: - Steve, I'd keep

[jira] [Comment Edited] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-05 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193907#comment-16193907 ] Michael N edited comment on SPARK-22163 at 10/5/17 11:47 PM: - Vadim Semenov

[jira] [Updated] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-05 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N updated SPARK-22163: -- Description: The application objects can contain List and can be modified dynamically as well.

[jira] [Comment Edited] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-05 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193907#comment-16193907 ] Michael N edited comment on SPARK-22163 at 10/6/17 12:24 AM: - Vadim Semenov

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-05 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193840#comment-16193840 ] Michael N commented on SPARK-21999: --- Steve, I'd keep personal opinions of another person separate from

[jira] [Updated] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-05 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N updated SPARK-22163: -- Description: The application objects can contain List and can be modified dynamically as well.

[jira] [Comment Edited] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-05 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193907#comment-16193907 ] Michael N edited comment on SPARK-22163 at 10/6/17 12:21 AM: - Vadim Semenov

[jira] [Created] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-09-28 Thread Michael N (JIRA)
Michael N created SPARK-22163: - Summary: Design Issue of Spark Streaming that Causes Random Run-time Exception Key: SPARK-22163 URL: https://issues.apache.org/jira/browse/SPARK-22163 Project: Spark

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-09-28 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16185130#comment-16185130 ] Michael N commented on SPARK-21999: --- Thanks Shixiong Zhu for tracking this issue to

[jira] [Reopened] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-09-29 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N reopened SPARK-22163: --- This ticket is *not* duplicate of ticket https://issues.apache.org/jira/browse/SPARK-21999. This

[jira] [Comment Edited] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-09-29 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16186682#comment-16186682 ] Michael N edited comment on SPARK-21999 at 9/29/17 11:35 PM: - You were

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-09-29 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16186682#comment-16186682 ] Michael N commented on SPARK-21999: --- You were looking at the mechanics of locking. However, let's look

[jira] [Reopened] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N reopened SPARK-22163: --- Please distinguish between code bug vs design flaws. That is why this ticket is separate from the

[jira] [Comment Edited] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192110#comment-16192110 ] Michael N edited comment on SPARK-22163 at 10/4/17 10:02 PM: - Please

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192131#comment-16192131 ] Michael N commented on SPARK-21999: --- The posted questions were intended to show why this is a design

[jira] [Issue Comment Deleted] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N updated SPARK-21999: -- Comment: was deleted (was: The posted questions were intended to show why this is a design issue. You

[jira] [Reopened] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N reopened SPARK-21999: --- The posted questions were intended to show why this is a design issue. You have not been able to

[jira] [Comment Edited] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192135#comment-16192135 ] Michael N edited comment on SPARK-21999 at 10/4/17 10:13 PM: - The posted

[jira] [Comment Edited] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192110#comment-16192110 ] Michael N edited comment on SPARK-22163 at 10/4/17 10:12 PM: - Please

[jira] [Comment Edited] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192135#comment-16192135 ] Michael N edited comment on SPARK-21999 at 10/4/17 10:31 PM: - The posted

[jira] [Comment Edited] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192135#comment-16192135 ] Michael N edited comment on SPARK-21999 at 10/4/17 10:32 PM: - The posted

[jira] [Comment Edited] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-04 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192110#comment-16192110 ] Michael N edited comment on SPARK-22163 at 10/4/17 10:33 PM: - Please

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-07 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16195810#comment-16195810 ] Michael N commented on SPARK-21999: --- Steve, your claim that I told the project "their design is wrong"

[jira] [Updated] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-07 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N updated SPARK-22163: -- Description: The application objects can contain List and can be modified dynamically as well.

[jira] [Updated] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-07 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N updated SPARK-22163: -- Description: The application objects can contain List and can be modified dynamically as well.

[jira] [Commented] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-07 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16195813#comment-16195813 ] Michael N commented on SPARK-22163: --- Sean, my text description in the ticket clearly says "My

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-10-07 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16195814#comment-16195814 ] Michael N commented on SPARK-21999: --- Shixiong, Vadim, per your requests for the code,, I posted the

[jira] [Comment Edited] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-07 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16195813#comment-16195813 ] Michael N edited comment on SPARK-22163 at 10/7/17 6:05 PM: Sean, my text

[jira] [Comment Edited] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-10-07 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16195813#comment-16195813 ] Michael N edited comment on SPARK-22163 at 10/7/17 6:06 PM: Sean, my text