Hi all, Is there an estimated timeline for 1.6.1 release? Just wanted to check how the release is coming along. Thanks!
Mingyu From: Romi Kuntsman <r...@totango.com> Date: Tuesday, February 2, 2016 at 3:16 AM To: Michael Armbrust <mich...@databricks.com> Cc: Hamel Kothari <hamelkoth...@gmail.com>, Ted Yu <yuzhih...@gmail.com>, "dev@spark.apache.org" <dev@spark.apache.org> Subject: Re: Spark 1.6.1 Hi Michael, What about the memory leak bug? https://issues.apache.org/jira/browse/SPARK-11293 <https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira _browse_SPARK-2D11293&d=CwMFaQ&c=izlc9mHr637UR4lpLEZLFFS3Vn2UXBrZ4tFb6oOnmz8 &r=ennQJq47pNnObsDh-88a9YUrUulcYQoV8giPASqXB84&m=tI8Pjfii7XuX3Suiky8mImD7S5B oAq6fgOSdJ7rt2Wo&s=R_B4rDig-0VPE5Q4YeLEs2HUIg-A8St1OtDjD89d_zY&e=> Even after the memory rewrite in 1.6.0, it still happens in some cases. Will it be fixed for 1.6.1? Thanks, Romi Kuntsman, Big Data Engineer http://www.totango.com <https://urldefense.proofpoint.com/v2/url?u=http-3A__www.totango.com_&d=CwMF aQ&c=izlc9mHr637UR4lpLEZLFFS3Vn2UXBrZ4tFb6oOnmz8&r=ennQJq47pNnObsDh-88a9YUrU ulcYQoV8giPASqXB84&m=tI8Pjfii7XuX3Suiky8mImD7S5BoAq6fgOSdJ7rt2Wo&s=Z4TgGF0h7 oetD4O6u_3qjrYbe0ZtW2g_In7V8tkByPg&e=> On Mon, Feb 1, 2016 at 9:59 PM, Michael Armbrust <mich...@databricks.com> wrote: > We typically do not allow changes to the classpath in maintenance releases. > > On Mon, Feb 1, 2016 at 8:16 AM, Hamel Kothari <hamelkoth...@gmail.com> wrote: >> I noticed that the Jackson dependency was bumped to 2.5 in master for >> something spark-streaming related. Is there any reason that this upgrade >> can't be included with 1.6.1? >> >> According to later comments on this thread: >> https://issues.apache.org/jira/browse/SPARK-8332 >> <https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_ >> browse_SPARK-2D8332&d=CwMFaQ&c=izlc9mHr637UR4lpLEZLFFS3Vn2UXBrZ4tFb6oOnmz8&r= >> ennQJq47pNnObsDh-88a9YUrUulcYQoV8giPASqXB84&m=tI8Pjfii7XuX3Suiky8mImD7S5BoAq6 >> fgOSdJ7rt2Wo&s=i-ngQFHfxOmgkYx_5NiCaHdIlm7zi2LYpUxm9I3RfR4&e=> and my >> personal experience using with Spark with Jackson 2.5 hasn't caused any >> issues but it does have some useful new features. It should be fully >> backwards compatible according to the Jackson folks. >> >> On Mon, Feb 1, 2016 at 10:29 AM Ted Yu <yuzhih...@gmail.com> wrote: >>> SPARK-12624 has been resolved. >>> According to Wenchen, SPARK-12783 is fixed in 1.6.0 release. >>> >>> Are there other blockers for Spark 1.6.1 ? >>> >>> Thanks >>> >>> On Wed, Jan 13, 2016 at 5:39 PM, Michael Armbrust <mich...@databricks.com> >>> wrote: >>>> Hey All, >>>> >>>> While I'm not aware of any critical issues with 1.6.0, there are several >>>> corner cases that users are hitting with the Dataset API that are fixed in >>>> branch-1.6. As such I'm considering a 1.6.1 release. >>>> >>>> At the moment there are only two critical issues targeted for 1.6.1: >>>> - SPARK-12624 - When schema is specified, we should treat undeclared >>>> fields as null (in Python) >>>> - SPARK-12783 - Dataset map serialization error >>>> >>>> When these are resolved I'll likely begin the release process. If there >>>> are any other issues that we should wait for please contact me. >>>> >>>> Michael >>> >
smime.p7s
Description: S/MIME cryptographic signature
