Re: [VOTE] Release Apache Spark 1.0.2 (RC1)

2014-07-29 Thread Nicholas Chammas
   - spun up an EC2 cluster successfully using spark-ec2
   - tested S3 file access from that cluster successfully

+1
​


On Tue, Jul 29, 2014 at 1:46 AM, Henry Saputra henry.sapu...@gmail.com
wrote:

 NOTICE and LICENSE files look good
 Hashes and sigs look good
 No executable in the source distribution
 Compile source and run standalone

 +1

 - Henry

 On Fri, Jul 25, 2014 at 4:08 PM, Tathagata Das
 tathagata.das1...@gmail.com wrote:
  Please vote on releasing the following candidate as Apache Spark version
 1.0.2.
 
  This release fixes a number of bugs in Spark 1.0.1.
  Some of the notable ones are
  - SPARK-2452: Known issue is Spark 1.0.1 caused by attempted fix for
  SPARK-1199. The fix was reverted for 1.0.2.
  - SPARK-2576: NoClassDefFoundError when executing Spark QL query on
  HDFS CSV file.
  The full list is at http://s.apache.org/9NJ
 
  The tag to be voted on is v1.0.2-rc1 (commit 8fb6f00e):
 
 https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=8fb6f00e195fb258f3f70f04756e07c259a2351f
 
  The release files, including signatures, digests, etc can be found at:
  http://people.apache.org/~tdas/spark-1.0.2-rc1/
 
  Release artifacts are signed with the following key:
  https://people.apache.org/keys/committer/tdas.asc
 
  The staging repository for this release can be found at:
  https://repository.apache.org/content/repositories/orgapachespark-1024/
 
  The documentation corresponding to this release can be found at:
  http://people.apache.org/~tdas/spark-1.0.2-rc1-docs/
 
  Please vote on releasing this package as Apache Spark 1.0.2!
 
  The vote is open until Tuesday, July 29, at 23:00 UTC and passes if
  a majority of at least 3 +1 PMC votes are cast.
  [ ] +1 Release this package as Apache Spark 1.0.2
  [ ] -1 Do not release this package because ...
 
  To learn more about Apache Spark, please see
  http://spark.apache.org/



Re: [VOTE] Release Apache Spark 1.0.2 (RC1)

2014-07-28 Thread Andrew Or
+1 Tested on standalone and yarn clusters


2014-07-28 14:59 GMT-07:00 Tathagata Das tathagata.das1...@gmail.com:

 Let me add my vote as well.
 Did some basic tests by running simple projects with various Spark
 modules. Tested checksums.

 +1

 On Sun, Jul 27, 2014 at 4:52 PM, Matei Zaharia matei.zaha...@gmail.com
 wrote:
  +1
 
  Tested this on Mac OS X.
 
  Matei
 
  On Jul 25, 2014, at 4:08 PM, Tathagata Das tathagata.das1...@gmail.com
 wrote:
 
  Please vote on releasing the following candidate as Apache Spark
 version 1.0.2.
 
  This release fixes a number of bugs in Spark 1.0.1.
  Some of the notable ones are
  - SPARK-2452: Known issue is Spark 1.0.1 caused by attempted fix for
  SPARK-1199. The fix was reverted for 1.0.2.
  - SPARK-2576: NoClassDefFoundError when executing Spark QL query on
  HDFS CSV file.
  The full list is at http://s.apache.org/9NJ
 
  The tag to be voted on is v1.0.2-rc1 (commit 8fb6f00e):
 
 https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=8fb6f00e195fb258f3f70f04756e07c259a2351f
 
  The release files, including signatures, digests, etc can be found at:
  http://people.apache.org/~tdas/spark-1.0.2-rc1/
 
  Release artifacts are signed with the following key:
  https://people.apache.org/keys/committer/tdas.asc
 
  The staging repository for this release can be found at:
  https://repository.apache.org/content/repositories/orgapachespark-1024/
 
  The documentation corresponding to this release can be found at:
  http://people.apache.org/~tdas/spark-1.0.2-rc1-docs/
 
  Please vote on releasing this package as Apache Spark 1.0.2!
 
  The vote is open until Tuesday, July 29, at 23:00 UTC and passes if
  a majority of at least 3 +1 PMC votes are cast.
  [ ] +1 Release this package as Apache Spark 1.0.2
  [ ] -1 Do not release this package because ...
 
  To learn more about Apache Spark, please see
  http://spark.apache.org/
 



Re: [VOTE] Release Apache Spark 1.0.2 (RC1)

2014-07-28 Thread Mubarak Seyed
+1 (non-binding)

Tested this on Mac OS X.


On Mon, Jul 28, 2014 at 6:52 PM, Andrew Or and...@databricks.com wrote:

 +1 Tested on standalone and yarn clusters


 2014-07-28 14:59 GMT-07:00 Tathagata Das tathagata.das1...@gmail.com:

  Let me add my vote as well.
  Did some basic tests by running simple projects with various Spark
  modules. Tested checksums.
 
  +1
 
  On Sun, Jul 27, 2014 at 4:52 PM, Matei Zaharia matei.zaha...@gmail.com
  wrote:
   +1
  
   Tested this on Mac OS X.
  
   Matei
  
   On Jul 25, 2014, at 4:08 PM, Tathagata Das 
 tathagata.das1...@gmail.com
  wrote:
  
   Please vote on releasing the following candidate as Apache Spark
  version 1.0.2.
  
   This release fixes a number of bugs in Spark 1.0.1.
   Some of the notable ones are
   - SPARK-2452: Known issue is Spark 1.0.1 caused by attempted fix for
   SPARK-1199. The fix was reverted for 1.0.2.
   - SPARK-2576: NoClassDefFoundError when executing Spark QL query on
   HDFS CSV file.
   The full list is at http://s.apache.org/9NJ
  
   The tag to be voted on is v1.0.2-rc1 (commit 8fb6f00e):
  
 
 https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=8fb6f00e195fb258f3f70f04756e07c259a2351f
  
   The release files, including signatures, digests, etc can be found at:
   http://people.apache.org/~tdas/spark-1.0.2-rc1/
  
   Release artifacts are signed with the following key:
   https://people.apache.org/keys/committer/tdas.asc
  
   The staging repository for this release can be found at:
  
 https://repository.apache.org/content/repositories/orgapachespark-1024/
  
   The documentation corresponding to this release can be found at:
   http://people.apache.org/~tdas/spark-1.0.2-rc1-docs/
  
   Please vote on releasing this package as Apache Spark 1.0.2!
  
   The vote is open until Tuesday, July 29, at 23:00 UTC and passes if
   a majority of at least 3 +1 PMC votes are cast.
   [ ] +1 Release this package as Apache Spark 1.0.2
   [ ] -1 Do not release this package because ...
  
   To learn more about Apache Spark, please see
   http://spark.apache.org/
  
 



Re: [VOTE] Release Apache Spark 1.0.2 (RC1)

2014-07-28 Thread Xiangrui Meng
+1

Tested basic spark-shell and pyspark operations and MLlib examples on a Mac.

On Mon, Jul 28, 2014 at 8:29 PM, Mubarak Seyed spark.devu...@gmail.com wrote:
 +1 (non-binding)

 Tested this on Mac OS X.


 On Mon, Jul 28, 2014 at 6:52 PM, Andrew Or and...@databricks.com wrote:

 +1 Tested on standalone and yarn clusters


 2014-07-28 14:59 GMT-07:00 Tathagata Das tathagata.das1...@gmail.com:

  Let me add my vote as well.
  Did some basic tests by running simple projects with various Spark
  modules. Tested checksums.
 
  +1
 
  On Sun, Jul 27, 2014 at 4:52 PM, Matei Zaharia matei.zaha...@gmail.com
  wrote:
   +1
  
   Tested this on Mac OS X.
  
   Matei
  
   On Jul 25, 2014, at 4:08 PM, Tathagata Das 
 tathagata.das1...@gmail.com
  wrote:
  
   Please vote on releasing the following candidate as Apache Spark
  version 1.0.2.
  
   This release fixes a number of bugs in Spark 1.0.1.
   Some of the notable ones are
   - SPARK-2452: Known issue is Spark 1.0.1 caused by attempted fix for
   SPARK-1199. The fix was reverted for 1.0.2.
   - SPARK-2576: NoClassDefFoundError when executing Spark QL query on
   HDFS CSV file.
   The full list is at http://s.apache.org/9NJ
  
   The tag to be voted on is v1.0.2-rc1 (commit 8fb6f00e):
  
 
 https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=8fb6f00e195fb258f3f70f04756e07c259a2351f
  
   The release files, including signatures, digests, etc can be found at:
   http://people.apache.org/~tdas/spark-1.0.2-rc1/
  
   Release artifacts are signed with the following key:
   https://people.apache.org/keys/committer/tdas.asc
  
   The staging repository for this release can be found at:
  
 https://repository.apache.org/content/repositories/orgapachespark-1024/
  
   The documentation corresponding to this release can be found at:
   http://people.apache.org/~tdas/spark-1.0.2-rc1-docs/
  
   Please vote on releasing this package as Apache Spark 1.0.2!
  
   The vote is open until Tuesday, July 29, at 23:00 UTC and passes if
   a majority of at least 3 +1 PMC votes are cast.
   [ ] +1 Release this package as Apache Spark 1.0.2
   [ ] -1 Do not release this package because ...
  
   To learn more about Apache Spark, please see
   http://spark.apache.org/
  
 



Re: [VOTE] Release Apache Spark 1.0.2 (RC1)

2014-07-28 Thread Henry Saputra
NOTICE and LICENSE files look good
Hashes and sigs look good
No executable in the source distribution
Compile source and run standalone

+1

- Henry

On Fri, Jul 25, 2014 at 4:08 PM, Tathagata Das
tathagata.das1...@gmail.com wrote:
 Please vote on releasing the following candidate as Apache Spark version 
 1.0.2.

 This release fixes a number of bugs in Spark 1.0.1.
 Some of the notable ones are
 - SPARK-2452: Known issue is Spark 1.0.1 caused by attempted fix for
 SPARK-1199. The fix was reverted for 1.0.2.
 - SPARK-2576: NoClassDefFoundError when executing Spark QL query on
 HDFS CSV file.
 The full list is at http://s.apache.org/9NJ

 The tag to be voted on is v1.0.2-rc1 (commit 8fb6f00e):
 https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=8fb6f00e195fb258f3f70f04756e07c259a2351f

 The release files, including signatures, digests, etc can be found at:
 http://people.apache.org/~tdas/spark-1.0.2-rc1/

 Release artifacts are signed with the following key:
 https://people.apache.org/keys/committer/tdas.asc

 The staging repository for this release can be found at:
 https://repository.apache.org/content/repositories/orgapachespark-1024/

 The documentation corresponding to this release can be found at:
 http://people.apache.org/~tdas/spark-1.0.2-rc1-docs/

 Please vote on releasing this package as Apache Spark 1.0.2!

 The vote is open until Tuesday, July 29, at 23:00 UTC and passes if
 a majority of at least 3 +1 PMC votes are cast.
 [ ] +1 Release this package as Apache Spark 1.0.2
 [ ] -1 Do not release this package because ...

 To learn more about Apache Spark, please see
 http://spark.apache.org/


Re:[VOTE] Release Apache Spark 1.0.2 (RC1)

2014-07-27 Thread witgo
-1
The following bug should be fixed:
https://issues.apache.org/jira/browse/SPARK-2677‍





-- Original --
From:  Tathagata Das;tathagata.das1...@gmail.com;
Date:  Sat, Jul 26, 2014 07:08 AM
To:  dev@spark.apache.orgdev@spark.apache.org; 

Subject:  [VOTE] Release Apache Spark 1.0.2 (RC1)



Please vote on releasing the following candidate as Apache Spark version 1.0.2.

This release fixes a number of bugs in Spark 1.0.1.
Some of the notable ones are
- SPARK-2452: Known issue is Spark 1.0.1 caused by attempted fix for
SPARK-1199. The fix was reverted for 1.0.2.
- SPARK-2576: NoClassDefFoundError when executing Spark QL query on
HDFS CSV file.
The full list is at http://s.apache.org/9NJ

The tag to be voted on is v1.0.2-rc1 (commit 8fb6f00e):
https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=8fb6f00e195fb258f3f70f04756e07c259a2351f

The release files, including signatures, digests, etc can be found at:
http://people.apache.org/~tdas/spark-1.0.2-rc1/

Release artifacts are signed with the following key:
https://people.apache.org/keys/committer/tdas.asc

The staging repository for this release can be found at:
https://repository.apache.org/content/repositories/orgapachespark-1024/

The documentation corresponding to this release can be found at:
http://people.apache.org/~tdas/spark-1.0.2-rc1-docs/

Please vote on releasing this package as Apache Spark 1.0.2!

The vote is open until Tuesday, July 29, at 23:00 UTC and passes if
a majority of at least 3 +1 PMC votes are cast.
[ ] +1 Release this package as Apache Spark 1.0.2
[ ] -1 Do not release this package because ...

To learn more about Apache Spark, please see
http://spark.apache.org/

Re:[VOTE] Release Apache Spark 1.0.2 (RC1)

2014-07-27 Thread Andrew Ash
Is that a regression since 1.0.0?
On Jul 27, 2014 10:43 AM, witgo wi...@qq.com wrote:

 -1
 The following bug should be fixed:
 https://issues.apache.org/jira/browse/SPARK-2677‍





 -- Original --
 From:  Tathagata Das;tathagata.das1...@gmail.com;
 Date:  Sat, Jul 26, 2014 07:08 AM
 To:  dev@spark.apache.orgdev@spark.apache.org;

 Subject:  [VOTE] Release Apache Spark 1.0.2 (RC1)



 Please vote on releasing the following candidate as Apache Spark version
 1.0.2.

 This release fixes a number of bugs in Spark 1.0.1.
 Some of the notable ones are
 - SPARK-2452: Known issue is Spark 1.0.1 caused by attempted fix for
 SPARK-1199. The fix was reverted for 1.0.2.
 - SPARK-2576: NoClassDefFoundError when executing Spark QL query on
 HDFS CSV file.
 The full list is at http://s.apache.org/9NJ

 The tag to be voted on is v1.0.2-rc1 (commit 8fb6f00e):

 https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=8fb6f00e195fb258f3f70f04756e07c259a2351f

 The release files, including signatures, digests, etc can be found at:
 http://people.apache.org/~tdas/spark-1.0.2-rc1/

 Release artifacts are signed with the following key:
 https://people.apache.org/keys/committer/tdas.asc

 The staging repository for this release can be found at:
 https://repository.apache.org/content/repositories/orgapachespark-1024/

 The documentation corresponding to this release can be found at:
 http://people.apache.org/~tdas/spark-1.0.2-rc1-docs/

 Please vote on releasing this package as Apache Spark 1.0.2!

 The vote is open until Tuesday, July 29, at 23:00 UTC and passes if
 a majority of at least 3 +1 PMC votes are cast.
 [ ] +1 Release this package as Apache Spark 1.0.2
 [ ] -1 Do not release this package because ...

 To learn more about Apache Spark, please see
 http://spark.apache.org/


Re: [VOTE] Release Apache Spark 1.0.2 (RC1)

2014-07-27 Thread Patrick Wendell
SPARK-2677 is a long standing issue and not a regression. Also, as far
as I can see there is no patch for it or clear understanding of the
cause. This type of bug does not warrant holding a release. If we fix
SPARK-2677 we can just make another release with the fix.

On Sun, Jul 27, 2014 at 10:47 AM, Andrew Ash and...@andrewash.com wrote:
 Is that a regression since 1.0.0?
 On Jul 27, 2014 10:43 AM, witgo wi...@qq.com wrote:

 -1
 The following bug should be fixed:
 https://issues.apache.org/jira/browse/SPARK-2677





 -- Original --
 From:  Tathagata Das;tathagata.das1...@gmail.com;
 Date:  Sat, Jul 26, 2014 07:08 AM
 To:  dev@spark.apache.orgdev@spark.apache.org;

 Subject:  [VOTE] Release Apache Spark 1.0.2 (RC1)



 Please vote on releasing the following candidate as Apache Spark version
 1.0.2.

 This release fixes a number of bugs in Spark 1.0.1.
 Some of the notable ones are
 - SPARK-2452: Known issue is Spark 1.0.1 caused by attempted fix for
 SPARK-1199. The fix was reverted for 1.0.2.
 - SPARK-2576: NoClassDefFoundError when executing Spark QL query on
 HDFS CSV file.
 The full list is at http://s.apache.org/9NJ

 The tag to be voted on is v1.0.2-rc1 (commit 8fb6f00e):

 https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=8fb6f00e195fb258f3f70f04756e07c259a2351f

 The release files, including signatures, digests, etc can be found at:
 http://people.apache.org/~tdas/spark-1.0.2-rc1/

 Release artifacts are signed with the following key:
 https://people.apache.org/keys/committer/tdas.asc

 The staging repository for this release can be found at:
 https://repository.apache.org/content/repositories/orgapachespark-1024/

 The documentation corresponding to this release can be found at:
 http://people.apache.org/~tdas/spark-1.0.2-rc1-docs/

 Please vote on releasing this package as Apache Spark 1.0.2!

 The vote is open until Tuesday, July 29, at 23:00 UTC and passes if
 a majority of at least 3 +1 PMC votes are cast.
 [ ] +1 Release this package as Apache Spark 1.0.2
 [ ] -1 Do not release this package because ...

 To learn more about Apache Spark, please see
 http://spark.apache.org/


Re: [VOTE] Release Apache Spark 1.0.2 (RC1)

2014-07-27 Thread Matei Zaharia
+1

Tested this on Mac OS X.

Matei

On Jul 25, 2014, at 4:08 PM, Tathagata Das tathagata.das1...@gmail.com wrote:

 Please vote on releasing the following candidate as Apache Spark version 
 1.0.2.
 
 This release fixes a number of bugs in Spark 1.0.1.
 Some of the notable ones are
 - SPARK-2452: Known issue is Spark 1.0.1 caused by attempted fix for
 SPARK-1199. The fix was reverted for 1.0.2.
 - SPARK-2576: NoClassDefFoundError when executing Spark QL query on
 HDFS CSV file.
 The full list is at http://s.apache.org/9NJ
 
 The tag to be voted on is v1.0.2-rc1 (commit 8fb6f00e):
 https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=8fb6f00e195fb258f3f70f04756e07c259a2351f
 
 The release files, including signatures, digests, etc can be found at:
 http://people.apache.org/~tdas/spark-1.0.2-rc1/
 
 Release artifacts are signed with the following key:
 https://people.apache.org/keys/committer/tdas.asc
 
 The staging repository for this release can be found at:
 https://repository.apache.org/content/repositories/orgapachespark-1024/
 
 The documentation corresponding to this release can be found at:
 http://people.apache.org/~tdas/spark-1.0.2-rc1-docs/
 
 Please vote on releasing this package as Apache Spark 1.0.2!
 
 The vote is open until Tuesday, July 29, at 23:00 UTC and passes if
 a majority of at least 3 +1 PMC votes are cast.
 [ ] +1 Release this package as Apache Spark 1.0.2
 [ ] -1 Do not release this package because ...
 
 To learn more about Apache Spark, please see
 http://spark.apache.org/



Re: [VOTE] Release Apache Spark 1.0.2 (RC1)

2014-07-25 Thread Michael Armbrust
That query is looking at Fix Version not Target Version.  The fact that
the first one is still open is only because the bug is not resolved in
master.  It is fixed in 1.0.2.  The second one is partially fixed in 1.0.2,
but is not worth blocking the release for.


On Fri, Jul 25, 2014 at 4:23 PM, Nicholas Chammas 
nicholas.cham...@gmail.com wrote:

 TD, there are a couple of unresolved issues slated for 1.0.2
 
 https://issues.apache.org/jira/issues/?jql=project%20%3D%20SPARK%20AND%20fixVersion%20%3D%201.0.2%20AND%20resolution%20%3D%20Unresolved%20ORDER%20BY%20priority%20DESC
 .
 Should they be edited somehow?


 On Fri, Jul 25, 2014 at 7:08 PM, Tathagata Das 
 tathagata.das1...@gmail.com
 wrote:

  Please vote on releasing the following candidate as Apache Spark version
  1.0.2.
 
  This release fixes a number of bugs in Spark 1.0.1.
  Some of the notable ones are
  - SPARK-2452: Known issue is Spark 1.0.1 caused by attempted fix for
  SPARK-1199. The fix was reverted for 1.0.2.
  - SPARK-2576: NoClassDefFoundError when executing Spark QL query on
  HDFS CSV file.
  The full list is at http://s.apache.org/9NJ
 
  The tag to be voted on is v1.0.2-rc1 (commit 8fb6f00e):
 
 
 https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=8fb6f00e195fb258f3f70f04756e07c259a2351f
 
  The release files, including signatures, digests, etc can be found at:
  http://people.apache.org/~tdas/spark-1.0.2-rc1/
 
  Release artifacts are signed with the following key:
  https://people.apache.org/keys/committer/tdas.asc
 
  The staging repository for this release can be found at:
  https://repository.apache.org/content/repositories/orgapachespark-1024/
 
  The documentation corresponding to this release can be found at:
  http://people.apache.org/~tdas/spark-1.0.2-rc1-docs/
 
  Please vote on releasing this package as Apache Spark 1.0.2!
 
  The vote is open until Tuesday, July 29, at 23:00 UTC and passes if
  a majority of at least 3 +1 PMC votes are cast.
  [ ] +1 Release this package as Apache Spark 1.0.2
  [ ] -1 Do not release this package because ...
 
  To learn more about Apache Spark, please see
  http://spark.apache.org/
 



Re: [VOTE] Release Apache Spark 1.0.2 (RC1)

2014-07-25 Thread Patrick Wendell
The most important issue in this release is actually an ammendment to
an earlier fix. The original fix caused a deadlock which was a
regression from 1.0.0-1.0.1:

Issue:
https://issues.apache.org/jira/browse/SPARK-1097

1.0.1 Fix:
https://github.com/apache/spark/pull/1273/files (had a deadlock)

1.0.2 Fix:
https://github.com/apache/spark/pull/1409/files

I failed to correctly label this on JIRA, but I've updated it!

On Fri, Jul 25, 2014 at 5:35 PM, Michael Armbrust
mich...@databricks.com wrote:
 That query is looking at Fix Version not Target Version.  The fact that
 the first one is still open is only because the bug is not resolved in
 master.  It is fixed in 1.0.2.  The second one is partially fixed in 1.0.2,
 but is not worth blocking the release for.


 On Fri, Jul 25, 2014 at 4:23 PM, Nicholas Chammas 
 nicholas.cham...@gmail.com wrote:

 TD, there are a couple of unresolved issues slated for 1.0.2
 
 https://issues.apache.org/jira/issues/?jql=project%20%3D%20SPARK%20AND%20fixVersion%20%3D%201.0.2%20AND%20resolution%20%3D%20Unresolved%20ORDER%20BY%20priority%20DESC
 .
 Should they be edited somehow?


 On Fri, Jul 25, 2014 at 7:08 PM, Tathagata Das 
 tathagata.das1...@gmail.com
 wrote:

  Please vote on releasing the following candidate as Apache Spark version
  1.0.2.
 
  This release fixes a number of bugs in Spark 1.0.1.
  Some of the notable ones are
  - SPARK-2452: Known issue is Spark 1.0.1 caused by attempted fix for
  SPARK-1199. The fix was reverted for 1.0.2.
  - SPARK-2576: NoClassDefFoundError when executing Spark QL query on
  HDFS CSV file.
  The full list is at http://s.apache.org/9NJ
 
  The tag to be voted on is v1.0.2-rc1 (commit 8fb6f00e):
 
 
 https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=8fb6f00e195fb258f3f70f04756e07c259a2351f
 
  The release files, including signatures, digests, etc can be found at:
  http://people.apache.org/~tdas/spark-1.0.2-rc1/
 
  Release artifacts are signed with the following key:
  https://people.apache.org/keys/committer/tdas.asc
 
  The staging repository for this release can be found at:
  https://repository.apache.org/content/repositories/orgapachespark-1024/
 
  The documentation corresponding to this release can be found at:
  http://people.apache.org/~tdas/spark-1.0.2-rc1-docs/
 
  Please vote on releasing this package as Apache Spark 1.0.2!
 
  The vote is open until Tuesday, July 29, at 23:00 UTC and passes if
  a majority of at least 3 +1 PMC votes are cast.
  [ ] +1 Release this package as Apache Spark 1.0.2
  [ ] -1 Do not release this package because ...
 
  To learn more about Apache Spark, please see
  http://spark.apache.org/
 



Re: [VOTE] Release Apache Spark 1.0.2 (RC1)

2014-07-25 Thread Ted Yu
HADOOP-10456 is fixed in hadoop 2.4.1

Does this mean that synchronization
on HadoopRDD.CONFIGURATION_INSTANTIATION_LOCK can be bypassed for hadoop
2.4.1 ?

Cheers


On Fri, Jul 25, 2014 at 6:00 PM, Patrick Wendell pwend...@gmail.com wrote:

 The most important issue in this release is actually an ammendment to
 an earlier fix. The original fix caused a deadlock which was a
 regression from 1.0.0-1.0.1:

 Issue:
 https://issues.apache.org/jira/browse/SPARK-1097

 1.0.1 Fix:
 https://github.com/apache/spark/pull/1273/files (had a deadlock)

 1.0.2 Fix:
 https://github.com/apache/spark/pull/1409/files

 I failed to correctly label this on JIRA, but I've updated it!

 On Fri, Jul 25, 2014 at 5:35 PM, Michael Armbrust
 mich...@databricks.com wrote:
  That query is looking at Fix Version not Target Version.  The fact
 that
  the first one is still open is only because the bug is not resolved in
  master.  It is fixed in 1.0.2.  The second one is partially fixed in
 1.0.2,
  but is not worth blocking the release for.
 
 
  On Fri, Jul 25, 2014 at 4:23 PM, Nicholas Chammas 
  nicholas.cham...@gmail.com wrote:
 
  TD, there are a couple of unresolved issues slated for 1.0.2
  
 
 https://issues.apache.org/jira/issues/?jql=project%20%3D%20SPARK%20AND%20fixVersion%20%3D%201.0.2%20AND%20resolution%20%3D%20Unresolved%20ORDER%20BY%20priority%20DESC
  .
  Should they be edited somehow?
 
 
  On Fri, Jul 25, 2014 at 7:08 PM, Tathagata Das 
  tathagata.das1...@gmail.com
  wrote:
 
   Please vote on releasing the following candidate as Apache Spark
 version
   1.0.2.
  
   This release fixes a number of bugs in Spark 1.0.1.
   Some of the notable ones are
   - SPARK-2452: Known issue is Spark 1.0.1 caused by attempted fix for
   SPARK-1199. The fix was reverted for 1.0.2.
   - SPARK-2576: NoClassDefFoundError when executing Spark QL query on
   HDFS CSV file.
   The full list is at http://s.apache.org/9NJ
  
   The tag to be voted on is v1.0.2-rc1 (commit 8fb6f00e):
  
  
 
 https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=8fb6f00e195fb258f3f70f04756e07c259a2351f
  
   The release files, including signatures, digests, etc can be found at:
   http://people.apache.org/~tdas/spark-1.0.2-rc1/
  
   Release artifacts are signed with the following key:
   https://people.apache.org/keys/committer/tdas.asc
  
   The staging repository for this release can be found at:
  
 https://repository.apache.org/content/repositories/orgapachespark-1024/
  
   The documentation corresponding to this release can be found at:
   http://people.apache.org/~tdas/spark-1.0.2-rc1-docs/
  
   Please vote on releasing this package as Apache Spark 1.0.2!
  
   The vote is open until Tuesday, July 29, at 23:00 UTC and passes if
   a majority of at least 3 +1 PMC votes are cast.
   [ ] +1 Release this package as Apache Spark 1.0.2
   [ ] -1 Do not release this package because ...
  
   To learn more about Apache Spark, please see
   http://spark.apache.org/