Re: There is no space for new record

Hi, Will it be possible to overcome this with some spark configuration tweak , since EMR has spark version available only till 2.2.1 Regards, Snehasish On Tue, Feb 13, 2018 at 2:00 PM, Marco Gaido wrote: > You can check all the versions where the fix is available on

Re: There is no space for new record

You can check all the versions where the fix is available on the JIRA SPARK-23376. Anyway it will be available in the upcoming 2.3.0 release. Thanks. On 13 Feb 2018 9:09 a.m., "SNEHASISH DUTTA" wrote: > Hi, > > In which version of Spark will this fix be available ? >

Re: There is no space for new record

Hi, In which version of Spark will this fix be available ? The deployment is on EMR Regards, Snehasish On Fri, Feb 9, 2018 at 8:51 PM, Wenchen Fan wrote: > It should be fixed by https://github.com/apache/spark/pull/20561 soon. > > On Fri, Feb 9, 2018 at 6:16 PM, Wenchen

Re: There is no space for new record

It should be fixed by https://github.com/apache/spark/pull/20561 soon. On Fri, Feb 9, 2018 at 6:16 PM, Wenchen Fan wrote: > This has been reported before: http://apache-spark- > developers-list.1001551.n3.nabble.com/java-lang- >

Re: There is no space for new record

This has been reported before: http://apache-spark-developers-list.1001551.n3.nabble.com/java-lang-IllegalStateException-There-is-no-space-for-new-record-tc20108.html I think we may have a real bug here, but we need a reproduce. Can you provide one? thanks! On Fri, Feb 9, 2018 at 5:59 PM,

Re: There is no space for new record

Hi , I am facing the following when running on EMR Caused by: java.lang.IllegalStateException: There is no space for new record at org.apache.spark.util.collection.unsafe.sort. UnsafeInMemorySorter.insertRecord(UnsafeInMemorySorter.java:226) at