[VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-17 Thread Arun C Murthy
Folks, I've created a release candidate (rc0) for hadoop-2.1.1-beta that I would like to get released - this release fixes a number of bugs on top of hadoop-2.1.0-beta as a result of significant amounts of testing. If things go well, this might be the last of the *beta* releases of hadoop-2.x.

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-17 Thread Alejandro Abdelnur
Thanks Arun. +1 * Downloaded source tarball. * Verified MD5 * Verified signature * run apache-rat:check ok after minor tweak (see NIT1 below) * checked CHANGES.txt headers (see NIT2 below) * built DIST from source * verified hadoop version of Hadoop JARs * configured pseudo cluster * tested

[jira] [Created] (HADOOP-9971) Pack hadoop compress native libs and upload it to maven for other projects to depend on

2013-09-17 Thread Liu Shaohui (JIRA)
Liu Shaohui created HADOOP-9971: --- Summary: Pack hadoop compress native libs and upload it to maven for other projects to depend on Key: HADOOP-9971 URL: https://issues.apache.org/jira/browse/HADOOP-9971

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-17 Thread Andrew Wang
Hey all, Sorry to hijack the vote thread, but it'd be good to get some input on my email from yesterday re: symlink support in branch-2.1. I think it really should be in GA one way or the other.

Re: symlink support in Hadoop 2 GA

2013-09-17 Thread Colin McCabe
I think it makes sense to finish symlinks support in the Hadoop 2 GA release. Colin On Mon, Sep 16, 2013 at 6:49 PM, Andrew Wang andrew.w...@cloudera.com wrote: Hi all, I wanted to broadcast plans for putting the FileSystem symlinks work (HADOOP-8040) into branch-2.1 for the pending Hadoop 2

Re: symlink support in Hadoop 2 GA

2013-09-17 Thread Suresh Srinivas
I agree that this is an important change. However, 2.2.0 GA is getting ready to rollout in weeks. I am concerned that these changes will add not only incompatible changes late in the game, but also possibly instability. Java API incompatibility is some thing we have avoided for the most part and I

Re: symlink support in Hadoop 2 GA

2013-09-17 Thread Colin McCabe
The issue is not modifying existing APIs. The issue is that code has been written that makes assumptions that are incompatible with the existence of things that are not files or directories. For example, there is a lot of code out there that looks at FileStatus#isFile, and if it returns false,

[jira] [Created] (HADOOP-9972) new APIs for listStatus and globStatus to deal with symlinks

2013-09-17 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HADOOP-9972: Summary: new APIs for listStatus and globStatus to deal with symlinks Key: HADOOP-9972 URL: https://issues.apache.org/jira/browse/HADOOP-9972

[jira] [Created] (HADOOP-9973) wrong dependencies

2013-09-17 Thread Nicolas Liochon (JIRA)
Nicolas Liochon created HADOOP-9973: --- Summary: wrong dependencies Key: HADOOP-9973 URL: https://issues.apache.org/jira/browse/HADOOP-9973 Project: Hadoop Common Issue Type: Bug Affects

Re: symlink support in Hadoop 2 GA

2013-09-17 Thread Andrew Wang
I encourage interested parties to read through HADOOP-9912 to get a feel for the issues. There really is no way to add symlink support without changing the behavior of existing APIs. Ultimately, anything that returns a FileStatus is going to be different. Even if we default to resolving symlinks,

[jira] [Created] (HADOOP-9975) Adding relogin() method to UGI

2013-09-17 Thread Kai Zheng (JIRA)
Kai Zheng created HADOOP-9975: - Summary: Adding relogin() method to UGI Key: HADOOP-9975 URL: https://issues.apache.org/jira/browse/HADOOP-9975 Project: Hadoop Common Issue Type: Improvement

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-17 Thread Karthik Kambatla
Not sure if this should be a blocker for 2.1.1, but filed HADOOP-9976 to have a single version of avro. On Tue, Sep 17, 2013 at 6:51 AM, Andrew Wang andrew.w...@cloudera.comwrote: Hey all, Sorry to hijack the vote thread, but it'd be good to get some input on my email from yesterday re:

[jira] [Created] (HADOOP-9976) Different versions of avro and avro-maven-plugin

2013-09-17 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created HADOOP-9976: Summary: Different versions of avro and avro-maven-plugin Key: HADOOP-9976 URL: https://issues.apache.org/jira/browse/HADOOP-9976 Project: Hadoop Common

[jira] [Created] (HADOOP-9977) Hadoop services won't start with different keypass and keystorepass when https is enabled

2013-09-17 Thread Yesha Vora (JIRA)
Yesha Vora created HADOOP-9977: -- Summary: Hadoop services won't start with different keypass and keystorepass when https is enabled Key: HADOOP-9977 URL: https://issues.apache.org/jira/browse/HADOOP-9977

Re: symlink support in Hadoop 2 GA

2013-09-17 Thread Eli Collins
(Looping in Arun since this impacts 2.x releases) I updated the versions on HADOOP-8040 and sub-tasks to reflect where the changes have landed. All of these changes (modulo HADOOP-9417) were merged to branch-2.1 and are in the 2.1.0 release. While symlinks are in 2.1.0 I don't think we can

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-17 Thread Roman Shaposhnik
On Mon, Sep 16, 2013 at 11:38 PM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created a release candidate (rc0) for hadoop-2.1.1-beta that I would like to get released - this release fixes a number of bugs on top of hadoop-2.1.0-beta as a result of significant amounts of testing.

[jira] [Created] (HADOOP-9978) Support range reads in s3n interface to split objects for mappers to read

2013-09-17 Thread Amandeep Khurana (JIRA)
Amandeep Khurana created HADOOP-9978: Summary: Support range reads in s3n interface to split objects for mappers to read Key: HADOOP-9978 URL: https://issues.apache.org/jira/browse/HADOOP-9978