[jira] [Commented] (SPARK-10109) NPE when saving Parquet To HDFS

2017-04-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15968934#comment-15968934 ] Steve Loughran commented on SPARK-10109: SPARK-20038 should stop the failure being so dramatic >

[jira] [Commented] (SPARK-10109) NPE when saving Parquet To HDFS

2017-03-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933340#comment-15933340 ] Steve Loughran commented on SPARK-10109: This is a bit related to the execution/commit mechanism;

[jira] [Commented] (SPARK-10109) NPE when saving Parquet To HDFS

2017-03-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933324#comment-15933324 ] Steve Loughran commented on SPARK-10109: I think the cause is actually that in some codepaths, if

[jira] [Commented] (SPARK-10109) NPE when saving Parquet To HDFS

2017-03-19 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15932154#comment-15932154 ] Hyukjin Kwon commented on SPARK-10109: -- Then, I think this should be resolvable when we upgrade

[jira] [Commented] (SPARK-10109) NPE when saving Parquet To HDFS

2017-02-21 Thread Laurent Hoss (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875960#comment-15875960 ] Laurent Hoss commented on SPARK-10109: -- seems related to SPARK-2984 (though closed, the last comment

[jira] [Commented] (SPARK-10109) NPE when saving Parquet To HDFS

2016-02-22 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157526#comment-15157526 ] Yin Huai commented on SPARK-10109: -- InternalParquetRecordWriter's close method can be only called once.

[jira] [Commented] (SPARK-10109) NPE when saving Parquet To HDFS

2016-02-22 Thread Virgil Palanciuc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15156702#comment-15156702 ] Virgil Palanciuc commented on SPARK-10109: -- I get this on spark 1.6.0 (EMR 4.3.0). I'm

[jira] [Commented] (SPARK-10109) NPE when saving Parquet To HDFS

2015-12-09 Thread Paul Zaczkieiwcz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048821#comment-15048821 ] Paul Zaczkieiwcz commented on SPARK-10109: -- Still seeing this in 1.5.1. My use case is the same.

[jira] [Commented] (SPARK-10109) NPE when saving Parquet To HDFS

2015-11-19 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1501#comment-1501 ] Yin Huai commented on SPARK-10109: -- I see. So, two concurrent jobs are writing to the same location.

[jira] [Commented] (SPARK-10109) NPE when saving Parquet To HDFS

2015-11-18 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15012402#comment-15012402 ] Yin Huai commented on SPARK-10109: -- Is it still a issue? Or, we can resolve this? > NPE when saving

[jira] [Commented] (SPARK-10109) NPE when saving Parquet To HDFS

2015-11-18 Thread Virgil Palanciuc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15013088#comment-15013088 ] Virgil Palanciuc commented on SPARK-10109: -- Haven't tried it lately - just ran it with parallel

[jira] [Commented] (SPARK-10109) NPE when saving Parquet To HDFS

2015-08-20 Thread Virgil Palanciuc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14704710#comment-14704710 ] Virgil Palanciuc commented on SPARK-10109: -- I think I know what caused this -

[jira] [Commented] (SPARK-10109) NPE when saving Parquet To HDFS

2015-08-19 Thread Virgil Palanciuc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14702917#comment-14702917 ] Virgil Palanciuc commented on SPARK-10109: -- Full version details (if it