[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15235538#comment-15235538 ] Shixiong Zhu commented on SPARK-12591: -- [~kerkero] mapWithState doesn't work with "s

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15235294#comment-15235294 ] Yuval Itzchakov commented on SPARK-12591: - Send me a DM on twitter if you need ad

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15235286#comment-15235286 ] Yuval Itzchakov commented on SPARK-12591: - No, there's no need to register parent

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15235262#comment-15235262 ] Ofir Kerker commented on SPARK-12591: - I am using {{SparkConf.registerKryoClasses}} f

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15235239#comment-15235239 ] Yuval Itzchakov commented on SPARK-12591: - Try registering your classes via `Spar

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15235204#comment-15235204 ] Ofir Kerker commented on SPARK-12591: - I'm sure. I also found the class that was spec

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15235170#comment-15235170 ] Yuval Itzchakov commented on SPARK-12591: - That's weird, I'm using mapWithState w

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15235051#comment-15235051 ] Ofir Kerker commented on SPARK-12591: - I also thought that Spark 1.6.1 should support

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15234880#comment-15234880 ] Yuval Itzchakov commented on SPARK-12591: - This workaround is already builtin Spa

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15234766#comment-15234766 ] Ofir Kerker commented on SPARK-12591: - [~zsxwing] - I'm running Spark *1.6.1* with Sc

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15195508#comment-15195508 ] Yuval Itzchakov commented on SPARK-12591: - After applying the fix, I'm still seei

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15136519#comment-15136519 ] Shixiong Zhu commented on SPARK-12591: -- Yes. You need to apply this patch for 1.6.0

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15136208#comment-15136208 ] Yuval Itzchakov commented on SPARK-12591: - I'm seeing this error as well running

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120023#comment-15120023 ] Shixiong Zhu commented on SPARK-12591: -- Where is LiveSequenceMergeTracker, in a sepa

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15119987#comment-15119987 ] Lin Zhao commented on SPARK-12591: -- I patched the server with branch-1.6, reverted the w

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15119907#comment-15119907 ] Lin Zhao commented on SPARK-12591: -- I'm not sure of the timing of the checkpointing. The

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15119888#comment-15119888 ] Shixiong Zhu commented on SPARK-12591: -- By the way, just want to confirm that: the e

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15118774#comment-15118774 ] Shixiong Zhu commented on SPARK-12591: -- That's weird. If it doesn't always happen, I

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15118724#comment-15118724 ] Lin Zhao commented on SPARK-12591: -- I want to add that this error happens very very rare

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15118705#comment-15118705 ] Lin Zhao commented on SPARK-12591: -- yarn-client mode and kyroserializer. Our events are

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15118687#comment-15118687 ] Shixiong Zhu commented on SPARK-12591: -- Which mode are you using? Is it work when di

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15118675#comment-15118675 ] Lin Zhao commented on SPARK-12591: -- Hi [~shixi...@databricks.com], I encountered this

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15088633#comment-15088633 ] Apache Spark commented on SPARK-12591: -- User 'zsxwing' has created a pull request fo

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15084412#comment-15084412 ] Shixiong Zhu commented on SPARK-12591: -- Ah, {{org.apache.spark.streaming.util.OpenHa

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15084101#comment-15084101 ] Apache Spark commented on SPARK-12591: -- User 'zsxwing' has created a pull request fo