[jira] [Commented] (SPARK-29497) Cannot assign instance of java.lang.invoke.SerializedLambda to field

2020-12-10 Thread Nathan Kronenfeld (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247482#comment-17247482 ] Nathan Kronenfeld commented on SPARK-29497: --- This is happening to us too.  We haven't figured

[jira] [Commented] (SPARK-22308) Support unit tests of spark code using ScalaTest using suites other than FunSuite

2017-11-02 Thread Nathan Kronenfeld (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237121#comment-16237121 ] Nathan Kronenfeld commented on SPARK-22308: --- ok, found the problem - it was the new tests, they

[jira] [Created] (SPARK-22399) reference in mllib-clustering.html is out of date

2017-10-30 Thread Nathan Kronenfeld (JIRA)
Nathan Kronenfeld created SPARK-22399: - Summary: reference in mllib-clustering.html is out of date Key: SPARK-22399 URL: https://issues.apache.org/jira/browse/SPARK-22399 Project: Spark

[jira] [Commented] (SPARK-22308) Support unit tests of spark code using ScalaTest using suites other than FunSuite

2017-10-22 Thread Nathan Kronenfeld (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214601#comment-16214601 ] Nathan Kronenfeld commented on SPARK-22308: --- ok, the documentation is taken out... I'll make a

[jira] [Commented] (SPARK-22308) Support unit tests of spark code using ScalaTest using suites other than FunSuite

2017-10-19 Thread Nathan Kronenfeld (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16211546#comment-16211546 ] Nathan Kronenfeld commented on SPARK-22308: --- > Sure, but aren't you saying that the ship has

[jira] [Commented] (SPARK-22308) Support unit tests of spark code using ScalaTest using suites other than FunSuite

2017-10-19 Thread Nathan Kronenfeld (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16211291#comment-16211291 ] Nathan Kronenfeld commented on SPARK-22308: --- That's a perfect example of what I'm talking

[jira] [Commented] (SPARK-22308) Support unit tests of spark code using ScalaTest using suites other than FunSuite

2017-10-19 Thread Nathan Kronenfeld (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16211207#comment-16211207 ] Nathan Kronenfeld commented on SPARK-22308: --- I can't disagree more strongly. What you get then

[jira] [Created] (SPARK-22308) Support unit tests of spark code using ScalaTest using suites other than FunSuite

2017-10-18 Thread Nathan Kronenfeld (JIRA)
Nathan Kronenfeld created SPARK-22308: - Summary: Support unit tests of spark code using ScalaTest using suites other than FunSuite Key: SPARK-22308 URL: https://issues.apache.org/jira/browse/SPARK-22308

[jira] [Comment Edited] (SPARK-22231) Support of map, filter, withColumn, dropColumn in nested list of structures

2017-10-10 Thread Nathan Kronenfeld (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198861#comment-16198861 ] Nathan Kronenfeld edited comment on SPARK-22231 at 10/10/17 7:39 PM: -

[jira] [Comment Edited] (SPARK-22231) Support of map, filter, withColumn, dropColumn in nested list of structures

2017-10-10 Thread Nathan Kronenfeld (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198861#comment-16198861 ] Nathan Kronenfeld edited comment on SPARK-22231 at 10/10/17 7:38 PM: -

[jira] [Commented] (SPARK-22231) Support of map, filter, withColumn, dropColumn in nested list of structures

2017-10-10 Thread Nathan Kronenfeld (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198861#comment-16198861 ] Nathan Kronenfeld commented on SPARK-22231: --- One couple related concerns... # I think

[jira] [Created] (SPARK-4848) On a stand-alone cluster, several worker-specific variables are read only on the master

2014-12-14 Thread Nathan Kronenfeld (JIRA)
Nathan Kronenfeld created SPARK-4848: Summary: On a stand-alone cluster, several worker-specific variables are read only on the master Key: SPARK-4848 URL: https://issues.apache.org/jira/browse/SPARK-4848

[jira] [Created] (SPARK-4772) Accumulators leak memory, both temporarily and permanently

2014-12-05 Thread Nathan Kronenfeld (JIRA)
Nathan Kronenfeld created SPARK-4772: Summary: Accumulators leak memory, both temporarily and permanently Key: SPARK-4772 URL: https://issues.apache.org/jira/browse/SPARK-4772 Project: Spark

[jira] [Commented] (SPARK-3885) Provide mechanism to remove accumulators once they are no longer used

2014-10-15 Thread Nathan Kronenfeld (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14173407#comment-14173407 ] Nathan Kronenfeld commented on SPARK-3885: -- I tried reusing accumulators and

[jira] [Commented] (SPARK-3783) The type parameters for SparkContext.accumulable are inconsistent Accumulable itself

2014-10-03 Thread Nathan Kronenfeld (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14158176#comment-14158176 ] Nathan Kronenfeld commented on SPARK-3783: --