[jira] [Commented] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2016-07-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15380024#comment-15380024 ] Sean Owen commented on SPARK-5569: -- I'm not sure it was fully resolved; see the last 3-4 comments. It is

[jira] [Commented] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2016-07-15 Thread Michael Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15379976#comment-15379976 ] Michael Li commented on SPARK-5569: --- It seems the PR (https://github.com/apache/spark/pull/8955) has

[jira] [Commented] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2016-01-07 Thread David Winters (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088794#comment-15088794 ] David Winters commented on SPARK-5569: -- I have encountered this issue also. I have a Spark streaming

[jira] [Commented] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2015-10-29 Thread Deming Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980492#comment-14980492 ] Deming Zhu commented on SPARK-5569: --- For OffsetRange ClassNotFound issue, I'm sure this patch could

[jira] [Commented] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2015-10-29 Thread Deming Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980493#comment-14980493 ] Deming Zhu commented on SPARK-5569: --- For OffsetRange ClassNotFound issue, I'm sure this patch could

[jira] [Commented] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2015-10-29 Thread Deming Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980490#comment-14980490 ] Deming Zhu commented on SPARK-5569: --- For OffsetRange ClassNotFound issue, I'm sure this patch could

[jira] [Commented] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2015-10-29 Thread Deming Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14980488#comment-14980488 ] Deming Zhu commented on SPARK-5569: --- For OffsetRange ClassNotFound issue, I'm sure this patch could

[jira] [Commented] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2015-10-29 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981718#comment-14981718 ] 周一帆 commented on SPARK-5569: I encountered the same problem when deseriable Array[Foo]() object from

[jira] [Commented] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2015-10-29 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981719#comment-14981719 ] 周一帆 commented on SPARK-5569: I encountered the same problem when deseriable Array[Foo]() object from

[jira] [Commented] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2015-10-27 Thread Deming Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976023#comment-14976023 ] Deming Zhu commented on SPARK-5569: --- since patch had been merged, we may set status to be fixed >

[jira] [Commented] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2015-10-22 Thread Deming Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14970326#comment-14970326 ] Deming Zhu commented on SPARK-5569: --- 1. create a class let's call it TestCls, and makes it serializable

[jira] [Commented] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2015-10-06 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945091#comment-14945091 ] Cody Koeninger commented on SPARK-5569: --- The gist I originally posted, linked at the top of this

[jira] [Commented] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2015-10-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14939447#comment-14939447 ] Apache Spark commented on SPARK-5569: - User 'maxwellzdm' has created a pull request for this issue:

[jira] [Commented] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2015-09-30 Thread Deming Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14939353#comment-14939353 ] Deming Zhu commented on SPARK-5569: --- I encount the exactly same problem with you, and I think it's an

[jira] [Commented] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2015-09-22 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14902692#comment-14902692 ] Cody Koeninger commented on SPARK-5569: --- I'm still not clear on what you're doing in

[jira] [Commented] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2015-09-21 Thread Jon Buffington (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901609#comment-14901609 ] Jon Buffington commented on SPARK-5569: --- Cody, We were able to work around the issue by

[jira] [Commented] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2015-09-21 Thread Jon Buffington (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901082#comment-14901082 ] Jon Buffington commented on SPARK-5569: --- Are there any work arounds for this limitation? We are

[jira] [Commented] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2015-09-21 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901106#comment-14901106 ] Cody Koeninger commented on SPARK-5569: --- The direct stream doesn't save offset ranges, it saves

[jira] [Commented] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2015-09-21 Thread Jon Buffington (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901320#comment-14901320 ] Jon Buffington commented on SPARK-5569: --- Cody, Thanks for the quick response. We are doing exactly

[jira] [Commented] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2015-09-21 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901364#comment-14901364 ] Cody Koeninger commented on SPARK-5569: --- You can typically use sbt's merge strategy to deal with

[jira] [Commented] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2015-09-21 Thread Jon Buffington (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901374#comment-14901374 ] Jon Buffington commented on SPARK-5569: --- Right. We added: assemblyMergeStrategy in assembly := {

[jira] [Commented] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2015-09-21 Thread Jon Buffington (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901387#comment-14901387 ] Jon Buffington commented on SPARK-5569: --- The only substantive difference in the build file you

[jira] [Commented] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2015-09-21 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901435#comment-14901435 ] Cody Koeninger commented on SPARK-5569: --- Yeah, spark-streaming can be marked as provided. Try to