[jira] [Resolved] (HADOOP-9506) Backport HADOOP-8329 to branch-1.0 (Build fails with Java 7)
[ https://issues.apache.org/jira/browse/HADOOP-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-9506. Resolution: Won't Fix I'm going to close this as a wontfix, current versions of branch-1 build on Java 7 Backport HADOOP-8329 to branch-1.0 (Build fails with Java 7) Key: HADOOP-9506 URL: https://issues.apache.org/jira/browse/HADOOP-9506 Project: Hadoop Common Issue Type: Bug Components: build Affects Versions: 1.0.4 Reporter: Роман Донченко Priority: Minor Please backport HADOOP-8329 to branch-1.0. The change doesn't affect behavior, and it would be nice to be able to build the stable version with Java 7. hadoop-8329-b1.txt from the original issue applies with no changes. -- This message was sent by Atlassian JIRA (v6.2#6252)
Build failed in Jenkins: Hadoop-Common-0.23-Build #1039
See https://builds.apache.org/job/Hadoop-Common-0.23-Build/1039/ -- [...truncated 8263 lines...] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:41) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20) at org.junit.runners.BlockJUnit4ClassRunner.runNotIgnored(BlockJUnit4ClassRunner.java:79) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:71) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:49) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:193) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:52) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:191) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:42) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:184) at org.junit.runners.ParentRunner.run(ParentRunner.java:236) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:252) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:141) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:112) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:189) at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:165) at org.apache.maven.surefire.booter.ProviderFactory.invokeProvider(ProviderFactory.java:85) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:115) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:75) Running org.apache.hadoop.io.TestVersionedWritable Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.074 sec Running org.apache.hadoop.io.TestMapFile Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.731 sec Running org.apache.hadoop.io.TestText Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.873 sec Running org.apache.hadoop.io.TestBloomMapFile Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.079 sec Running org.apache.hadoop.io.serializer.TestSerializationFactory Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.344 sec Running org.apache.hadoop.io.serializer.avro.TestAvroSerialization Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.661 sec Running org.apache.hadoop.io.serializer.TestWritableSerialization Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.375 sec Running org.apache.hadoop.io.TestDataByteBuffers Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.459 sec Running org.apache.hadoop.io.TestArrayFile Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.907 sec Running org.apache.hadoop.io.TestWritableName Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.174 sec Running org.apache.hadoop.io.TestIOUtils Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.326 sec Running org.apache.hadoop.io.TestSetFile Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.424 sec Running org.apache.hadoop.io.TestSequenceFile Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.749 sec Running org.apache.hadoop.io.TestObjectWritableProtos Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.413 sec Running org.apache.hadoop.io.TestMD5Hash Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.197 sec Running org.apache.hadoop.io.TestArrayWritable Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.074 sec Running org.apache.hadoop.io.retry.TestFailoverProxy Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.239 sec Running org.apache.hadoop.io.retry.TestRetryProxy Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.24 sec Running org.apache.hadoop.io.TestEnumSetWritable Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.472 sec Running org.apache.hadoop.io.TestSecureIOUtils Tests run: 4, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.587 sec Running org.apache.hadoop.io.TestBytesWritable Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.132 sec Running org.apache.hadoop.io.file.tfile.TestTFileNoneCodecsByteArrays Tests run: 25, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.819 sec Running org.apache.hadoop.io.file.tfile.TestTFileStreams Tests run: 19, Failures: 0, Errors: 0, Skipped: 0,
Re: [VOTE] Release Apache Hadoop 2.5.0 RC2
Thanks for trying the new binary out, Akira. I just updated the binary to include the site files as well. On Mon, Aug 11, 2014 at 11:28 PM, Akira AJISAKA ajisa...@oss.nttdata.co.jp wrote: Thanks Karthik for the update, but the some documents are not included. It looks to me that *.apt.vm files are not compiled. Would you please generate documents with 'mvn site site:stage /path/to/deploy'? I'm +1 (non-binding) if the documents are included. Thanks, Akira (2014/08/12 13:49), Karthik Kambatla wrote: I have updated the binary tar ball to include the docs, by building the docs locally and copying them over. Filed HADOOP-10956 to fix the create-release script to handle this. The RC is here: http://people.apache.org/~kasha/hadoop-2.5.0-RC2/ Please note that the binary tar ball is signed by a new gpg key, so please re-import keys. (I lost my original private key). The source tar ball, signature and checksum are untouched. On Mon, Aug 11, 2014 at 1:03 PM, Tsuyoshi OZAWA ozawa.tsuyo...@gmail.com wrote: Thank you for dealing with this problem, Karthik. It sounds reasonable to me to update binary tarball without modifying source code. +1(non-binding) to continue the voting. Thanks, - Tsuyoshi On Tue, Aug 12, 2014 at 3:47 AM, Karthik Kambatla ka...@cloudera.com wrote: Thanks Akira for catching the missing docs. Let me work on *updating* the binary tarball to include the docs *without* modifying the source. Will send an update as soon as I sort that out. The vote itself is on the source and the binary is just a convenience. I hope we can let the vote continue so long as we don't change the source. Thanks Karthik On Mon, Aug 11, 2014 at 5:51 AM, Tsuyoshi OZAWA ozawa.tsuyo...@gmail.com wrote: -1 (non-binding). * Downloaded source and verified signature. * Built from source. * Ran tests and some MR jobs. * Ran RM-HA with manual failover mode. - Documents are missing. Good catch, Akira. As he mentioned, the documents including javadocs are missing from the binary tar ball. We should include them. It only includes following docs: $ find . -name *.html ./share/doc/hadoop/httpfs/dependency-analysis.html ./share/doc/hadoop/httpfs/UsingHttpTools.html ./share/doc/hadoop/httpfs/project-reports.html ./share/doc/hadoop/httpfs/ServerSetup.html ./share/doc/hadoop/httpfs/index.html ./share/hadoop/httpfs/tomcat/webapps/ROOT/index.html ./share/hadoop/hdfs/webapps/secondary/status.html ./share/hadoop/hdfs/webapps/secondary/index.html ./share/hadoop/hdfs/webapps/hdfs/dfshealth.html ./share/hadoop/hdfs/webapps/hdfs/explorer.html ./share/hadoop/hdfs/webapps/hdfs/index.html ./share/hadoop/hdfs/webapps/journal/index.html ./share/hadoop/hdfs/webapps/datanode/index.html ./share/hadoop/tools/sls/html/showSimulationTrace.html Karthik, could you create new tar ball with the documentations? Thanks, - Tsuyoshi On Thu, Aug 7, 2014 at 5:59 AM, Karthik Kambatla ka...@cloudera.com wrote: Hi folks, I have put together a release candidate (rc2) for Hadoop 2.5.0. The RC is available at: http://people.apache.org/~kasha/hadoop-2.5.0-RC2/ The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/ release-2.5.0-rc2/ The maven artifacts are staged at: https://repository.apache.org/content/repositories/ orgapachehadoop-1009/ You can find my public key at: http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS Please try the release and vote. The vote will run for the now usual 5 days. Thanks -- - Tsuyoshi -- - Tsuyoshi
[jira] [Created] (HADOOP-10961) Use of deprecated Google Guava (v17) Stopwatch constructor in Hadoop FileInputFormat causes an exception
Daniel Nydegger created HADOOP-10961: Summary: Use of deprecated Google Guava (v17) Stopwatch constructor in Hadoop FileInputFormat causes an exception Key: HADOOP-10961 URL: https://issues.apache.org/jira/browse/HADOOP-10961 Project: Hadoop Common Issue Type: Bug Affects Versions: 2.4.1 Reporter: Daniel Nydegger With Google Guava 17 the Stopwatch() constructor is marked as deprecated. The use of the constructor in org.apache.hadoop.mapreduce.lib.input.FileInputFormat (Line 369) causes an exception Exception in thread main java.lang.IllegalAccessError: tried to access method com.google.common.base.Stopwatch.init()V from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:369) at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:493) at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:510) at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:394) at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1285) at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1282) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556) at org.apache.hadoop.mapreduce.Job.submit(Job.java:1282) at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1303) -- This message was sent by Atlassian JIRA (v6.2#6252)
Re: [VOTE] Migration from subversion to git for version control
+1 (binding). Tom On Friday, August 8, 2014 9:57 PM, Karthik Kambatla ka...@cloudera.com wrote: I have put together this proposal based on recent discussion on this topic. Please vote on the proposal. The vote runs for 7 days. 1. Migrate from subversion to git for version control. 2. Force-push to be disabled on trunk and branch-* branches. Applying changes from any of trunk/branch-* to any of branch-* should be through git cherry-pick -x. 3. Force-push on feature-branches is allowed. Before pulling in a feature, the feature-branch should be rebased on latest trunk and the changes applied to trunk through git rebase --onto or git cherry-pick commit-range. 4. Every time a feature branch is rebased on trunk, a tag that identifies the state before the rebase needs to be created (e.g. tag_feature_JIRA-2454_2014-08-07_rebase). These tags can be deleted once the feature is pulled into trunk and the tags are no longer useful. 5. The relevance/use of tags stay the same after the migration. Thanks Karthik PS: Per Andrew Wang, this should be a Adoption of New Codebase kind of vote and will be Lazy 2/3 majority of PMC members.
Re: [VOTE] Release Apache Hadoop 2.5.0 RC2
+1 (non-binding) * Verified checksums with new binary tar ball. * Checked the compiled *.apt.vm files are included Akira mentioned. Thanks for your quick updating, Karthik. Thanks, - Tsuyoshi On Tue, Aug 12, 2014 at 9:20 PM, Karthik Kambatla ka...@cloudera.com wrote: Thanks for trying the new binary out, Akira. I just updated the binary to include the site files as well. On Mon, Aug 11, 2014 at 11:28 PM, Akira AJISAKA ajisa...@oss.nttdata.co.jp wrote: Thanks Karthik for the update, but the some documents are not included. It looks to me that *.apt.vm files are not compiled. Would you please generate documents with 'mvn site site:stage /path/to/deploy'? I'm +1 (non-binding) if the documents are included. Thanks, Akira (2014/08/12 13:49), Karthik Kambatla wrote: I have updated the binary tar ball to include the docs, by building the docs locally and copying them over. Filed HADOOP-10956 to fix the create-release script to handle this. The RC is here: http://people.apache.org/~kasha/hadoop-2.5.0-RC2/ Please note that the binary tar ball is signed by a new gpg key, so please re-import keys. (I lost my original private key). The source tar ball, signature and checksum are untouched. On Mon, Aug 11, 2014 at 1:03 PM, Tsuyoshi OZAWA ozawa.tsuyo...@gmail.com wrote: Thank you for dealing with this problem, Karthik. It sounds reasonable to me to update binary tarball without modifying source code. +1(non-binding) to continue the voting. Thanks, - Tsuyoshi On Tue, Aug 12, 2014 at 3:47 AM, Karthik Kambatla ka...@cloudera.com wrote: Thanks Akira for catching the missing docs. Let me work on *updating* the binary tarball to include the docs *without* modifying the source. Will send an update as soon as I sort that out. The vote itself is on the source and the binary is just a convenience. I hope we can let the vote continue so long as we don't change the source. Thanks Karthik On Mon, Aug 11, 2014 at 5:51 AM, Tsuyoshi OZAWA ozawa.tsuyo...@gmail.com wrote: -1 (non-binding). * Downloaded source and verified signature. * Built from source. * Ran tests and some MR jobs. * Ran RM-HA with manual failover mode. - Documents are missing. Good catch, Akira. As he mentioned, the documents including javadocs are missing from the binary tar ball. We should include them. It only includes following docs: $ find . -name *.html ./share/doc/hadoop/httpfs/dependency-analysis.html ./share/doc/hadoop/httpfs/UsingHttpTools.html ./share/doc/hadoop/httpfs/project-reports.html ./share/doc/hadoop/httpfs/ServerSetup.html ./share/doc/hadoop/httpfs/index.html ./share/hadoop/httpfs/tomcat/webapps/ROOT/index.html ./share/hadoop/hdfs/webapps/secondary/status.html ./share/hadoop/hdfs/webapps/secondary/index.html ./share/hadoop/hdfs/webapps/hdfs/dfshealth.html ./share/hadoop/hdfs/webapps/hdfs/explorer.html ./share/hadoop/hdfs/webapps/hdfs/index.html ./share/hadoop/hdfs/webapps/journal/index.html ./share/hadoop/hdfs/webapps/datanode/index.html ./share/hadoop/tools/sls/html/showSimulationTrace.html Karthik, could you create new tar ball with the documentations? Thanks, - Tsuyoshi On Thu, Aug 7, 2014 at 5:59 AM, Karthik Kambatla ka...@cloudera.com wrote: Hi folks, I have put together a release candidate (rc2) for Hadoop 2.5.0. The RC is available at: http://people.apache.org/~kasha/hadoop-2.5.0-RC2/ The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/ release-2.5.0-rc2/ The maven artifacts are staged at: https://repository.apache.org/content/repositories/ orgapachehadoop-1009/ You can find my public key at: http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS Please try the release and vote. The vote will run for the now usual 5 days. Thanks -- - Tsuyoshi -- - Tsuyoshi -- - Tsuyoshi
Re: [VOTE] Release Apache Hadoop 2.5.0 RC2
+1 (binding) Verified sigs and ran sample jobs. Thanks for taking the lead on this Karthik. Arun On Aug 6, 2014, at 1:59 PM, Karthik Kambatla ka...@cloudera.com wrote: Hi folks, I have put together a release candidate (rc2) for Hadoop 2.5.0. The RC is available at: http://people.apache.org/~kasha/hadoop-2.5.0-RC2/ The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.5.0-rc2/ The maven artifacts are staged at: https://repository.apache.org/content/repositories/orgapachehadoop-1009/ You can find my public key at: http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS Please try the release and vote. The vote will run for the now usual 5 days. Thanks -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
Re: [VOTE] Release Apache Hadoop 2.5.0 RC2
Thanks everyone for trying out the RC and voting. The vote ends with 17 +1s (5 binding) and no -1s. I ll work on publishing the release. On Tue, Aug 12, 2014 at 8:46 AM, Arun C Murthy a...@hortonworks.com wrote: +1 (binding) Verified sigs and ran sample jobs. Thanks for taking the lead on this Karthik. Arun On Aug 6, 2014, at 1:59 PM, Karthik Kambatla ka...@cloudera.com wrote: Hi folks, I have put together a release candidate (rc2) for Hadoop 2.5.0. The RC is available at: http://people.apache.org/~kasha/hadoop-2.5.0-RC2/ The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.5.0-rc2/ The maven artifacts are staged at: https://repository.apache.org/content/repositories/orgapachehadoop-1009/ You can find my public key at: http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS Please try the release and vote. The vote will run for the now usual 5 days. Thanks -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
Re: [VOTE] Release Apache Hadoop 2.5.0 RC2
thanks for doing this Karthik for a release, talk to pr...@apache.org as they like to work on the announcements (and don't like to be left out, equally importantly) On 12 August 2014 17:16, Karthik Kambatla ka...@cloudera.com wrote: Thanks everyone for trying out the RC and voting. The vote ends with 17 +1s (5 binding) and no -1s. I ll work on publishing the release. On Tue, Aug 12, 2014 at 8:46 AM, Arun C Murthy a...@hortonworks.com wrote: +1 (binding) Verified sigs and ran sample jobs. Thanks for taking the lead on this Karthik. Arun On Aug 6, 2014, at 1:59 PM, Karthik Kambatla ka...@cloudera.com wrote: Hi folks, I have put together a release candidate (rc2) for Hadoop 2.5.0. The RC is available at: http://people.apache.org/~kasha/hadoop-2.5.0-RC2/ The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.5.0-rc2/ The maven artifacts are staged at: https://repository.apache.org/content/repositories/orgapachehadoop-1009/ You can find my public key at: http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS Please try the release and vote. The vote will run for the now usual 5 days. Thanks -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
[jira] [Resolved] (HADOOP-10725) Implement listStatus and getFileInfo in the native client
[ https://issues.apache.org/jira/browse/HADOOP-10725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HADOOP-10725. --- Resolution: Fixed Fix Version/s: HADOOP-10388 Implement listStatus and getFileInfo in the native client - Key: HADOOP-10725 URL: https://issues.apache.org/jira/browse/HADOOP-10725 Project: Hadoop Common Issue Type: Sub-task Components: native Affects Versions: HADOOP-10388 Reporter: Colin Patrick McCabe Assignee: Colin Patrick McCabe Fix For: HADOOP-10388 Attachments: HADOOP-10725-pnative.001.patch, HADOOP-10725-pnative.002.patch, HADOOP-10725-pnative.003.patch, HADOOP-10725-pnative.004.patch Implement listStatus and getFileInfo in the native client. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HADOOP-10962) Flags for posix_fadvise are not valid in some architectures
David Villegas created HADOOP-10962: --- Summary: Flags for posix_fadvise are not valid in some architectures Key: HADOOP-10962 URL: https://issues.apache.org/jira/browse/HADOOP-10962 Project: Hadoop Common Issue Type: Bug Components: native Affects Versions: 2.4.1 Environment: System z/Linux Reporter: David Villegas In org.apache.hadoop.io.nativeio.NativeIO.java, the posix_fadvise flag parameter is hardcoded to the most common values in fcntl.h. However, not all architectures use the same values (in this case, System z/Linux) A better approach would be to not make assumptions about fcntl.h values (or any other system constants). This bug results in calls to posix_fadvise failing in zLinux. -- This message was sent by Atlassian JIRA (v6.2#6252)
Re: [VOTE] Migration from subversion to git for version control
+1 binding. On Tue, Aug 12, 2014 at 6:08 AM, Thomas Graves tgra...@yahoo-inc.com.invalid wrote: +1 (binding). Tom On Friday, August 8, 2014 9:57 PM, Karthik Kambatla ka...@cloudera.com wrote: I have put together this proposal based on recent discussion on this topic. Please vote on the proposal. The vote runs for 7 days. 1. Migrate from subversion to git for version control. 2. Force-push to be disabled on trunk and branch-* branches. Applying changes from any of trunk/branch-* to any of branch-* should be through git cherry-pick -x. 3. Force-push on feature-branches is allowed. Before pulling in a feature, the feature-branch should be rebased on latest trunk and the changes applied to trunk through git rebase --onto or git cherry-pick commit-range. 4. Every time a feature branch is rebased on trunk, a tag that identifies the state before the rebase needs to be created (e.g. tag_feature_JIRA-2454_2014-08-07_rebase). These tags can be deleted once the feature is pulled into trunk and the tags are no longer useful. 5. The relevance/use of tags stay the same after the migration. Thanks Karthik PS: Per Andrew Wang, this should be a Adoption of New Codebase kind of vote and will be Lazy 2/3 majority of PMC members. -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
Thinking ahead to hadoop-2.6
Folks, With hadoop-2.5 nearly done, it's time to start thinking ahead to hadoop-2.6. Currently, here is the Roadmap per the wiki: • HADOOP • Credential provider HADOOP-10607 • HDFS • Heterogeneous storage (Phase 2) - Support APIs for using storage tiers by the applications HDFS-5682 • Memory as storage tier HDFS-5851 • YARN • Dynamic Resource Configuration YARN-291 • NodeManager Restart YARN-1336 • ResourceManager HA Phase 2 YARN-556 • Support for admin-specified labels in YARN YARN-796 • Support for automatic, shared cache for YARN application artifacts YARN-1492 • Support NodeGroup layer topology on YARN YARN-18 • Support for Docker containers in YARN YARN-1964 • YARN service registry YARN-913 My suspicion is, as is normal, some will make the cut and some won't. Please do add/subtract from the list as appropriate. Ideally, it would be good to ship hadoop-2.6 in a 6-8 weeks (say, October) to keep up a cadence. More importantly, as we discussed previously, we'd like hadoop-2.6 to be the *last* Apache Hadoop 2.x release which support JDK6. I'll start a discussion with other communities (HBase, Pig, Hive, Oozie etc.) and see how they feel about this. thanks, Arun -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
[jira] [Created] (HADOOP-10963) Move compile-time dependency to JDK7
Arun C Murthy created HADOOP-10963: -- Summary: Move compile-time dependency to JDK7 Key: HADOOP-10963 URL: https://issues.apache.org/jira/browse/HADOOP-10963 Project: Hadoop Common Issue Type: Bug Reporter: Arun C Murthy Fix For: 2.7.0 As discussed on the *-d...@hadoop.apache.org mailing list, this jira tracks moving to JDK7 and dropping support for JDK6. -- This message was sent by Atlassian JIRA (v6.2#6252)
Re: [VOTE] Migration from subversion to git for version control
+1 -C On Fri, Aug 8, 2014 at 7:57 PM, Karthik Kambatla ka...@cloudera.com wrote: I have put together this proposal based on recent discussion on this topic. Please vote on the proposal. The vote runs for 7 days. 1. Migrate from subversion to git for version control. 2. Force-push to be disabled on trunk and branch-* branches. Applying changes from any of trunk/branch-* to any of branch-* should be through git cherry-pick -x. 3. Force-push on feature-branches is allowed. Before pulling in a feature, the feature-branch should be rebased on latest trunk and the changes applied to trunk through git rebase --onto or git cherry-pick commit-range. 4. Every time a feature branch is rebased on trunk, a tag that identifies the state before the rebase needs to be created (e.g. tag_feature_JIRA-2454_2014-08-07_rebase). These tags can be deleted once the feature is pulled into trunk and the tags are no longer useful. 5. The relevance/use of tags stay the same after the migration. Thanks Karthik PS: Per Andrew Wang, this should be a Adoption of New Codebase kind of vote and will be Lazy 2/3 majority of PMC members.
Re: [VOTE] Release Apache Hadoop 2.5.0 RC2
Thanks Steve for pointing me to press@. I hadn't realized we need to include them. Just sent an email. On Tue, Aug 12, 2014 at 9:39 AM, Steve Loughran ste...@hortonworks.com wrote: thanks for doing this Karthik for a release, talk to pr...@apache.org as they like to work on the announcements (and don't like to be left out, equally importantly) On 12 August 2014 17:16, Karthik Kambatla ka...@cloudera.com wrote: Thanks everyone for trying out the RC and voting. The vote ends with 17 +1s (5 binding) and no -1s. I ll work on publishing the release. On Tue, Aug 12, 2014 at 8:46 AM, Arun C Murthy a...@hortonworks.com wrote: +1 (binding) Verified sigs and ran sample jobs. Thanks for taking the lead on this Karthik. Arun On Aug 6, 2014, at 1:59 PM, Karthik Kambatla ka...@cloudera.com wrote: Hi folks, I have put together a release candidate (rc2) for Hadoop 2.5.0. The RC is available at: http://people.apache.org/~kasha/hadoop-2.5.0-RC2/ The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.5.0-rc2/ The maven artifacts are staged at: https://repository.apache.org/content/repositories/orgapachehadoop-1009/ You can find my public key at: http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS Please try the release and vote. The vote will run for the now usual 5 days. Thanks -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
Re: [VOTE] Merge fs-encryption branch to trunk
+1 (non-binding) I've actively worked on developing and reviewing this feature and am happy to see it in its current state. I believe it is ready to be merged. Charles
Re: [VOTE] Release Apache Hadoop 2.5.0 RC2
We don't involve press@ typically... Arun On Aug 12, 2014, at 4:22 PM, Karthik Kambatla ka...@cloudera.com wrote: Thanks Steve for pointing me to press@. I hadn't realized we need to include them. Just sent an email. On Tue, Aug 12, 2014 at 9:39 AM, Steve Loughran ste...@hortonworks.com wrote: thanks for doing this Karthik for a release, talk to pr...@apache.org as they like to work on the announcements (and don't like to be left out, equally importantly) On 12 August 2014 17:16, Karthik Kambatla ka...@cloudera.com wrote: Thanks everyone for trying out the RC and voting. The vote ends with 17 +1s (5 binding) and no -1s. I ll work on publishing the release. On Tue, Aug 12, 2014 at 8:46 AM, Arun C Murthy a...@hortonworks.com wrote: +1 (binding) Verified sigs and ran sample jobs. Thanks for taking the lead on this Karthik. Arun On Aug 6, 2014, at 1:59 PM, Karthik Kambatla ka...@cloudera.com wrote: Hi folks, I have put together a release candidate (rc2) for Hadoop 2.5.0. The RC is available at: http://people.apache.org/~kasha/hadoop-2.5.0-RC2/ The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.5.0-rc2/ The maven artifacts are staged at: https://repository.apache.org/content/repositories/orgapachehadoop-1009/ You can find my public key at: http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS Please try the release and vote. The vote will run for the now usual 5 days. Thanks -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
