On Fri, Nov 11, 2011 at 1:41 PM, Nathan Roberts <nrobe...@yahoo-inc.com> wrote: > Hi Matt, > > I propose the following for consideration for 0.20.205.1: > > https://issues.apache.org/jira/browse/HADOOP-7816 Allow Hadoop warning > suppression to be specified in config > + Improves workaround for a common usability complaint > > https://issues.apache.org/jira/browse/MAPREDUCE-2980- Fetch failures and > other related issues in Jetty 6.1.26. > + The issues continues to be a source of significant operational pain >
The jetty version proposed in that JIRA doesn't actually fix the problem entirely. We've seen at least one more case of a spinning TT in test clusters with the "6.1.26.1" version mentioned there. The workaround we plan to use in CDH is MAPREDUCE-3184 (TT will monitor itself for this condition and commit suicide when it finds it) > https://issues.apache.org/jira/browse/HADOOP-7810 Move Hadoop archive to core > from tools > + Improves integration with pig and hcat that wish to use hadoop archives > without having to specifically callout the hadoop tools jar This seems like an incompatible change - probably a bad idea for a dot release of a dot release of a maintenance series.... > > https://issues.apache.org/jira/browse/mapreduce-3118 Backport Gridmix and > Rumen features from trunk to Hadoop 20-Security > + Originally slated for 205.0 but missed original code freeze > + Improves testability > > Thanks > Nathan > > On 11/9/11 8:36 PM, "Matt Foley" <mfo...@hortonworks.com> wrote: > > Hi all, > *So far, the following patches have been committed and accepted for > inclusion in 0.20.205.1:* > > *Key* *Assignee* *Reporter* *Summary* > HADOOP-5124<https://issues.apache.org/jira/browse/HADOOP-5124> Hairong > Kuang Hairong Kuang A few optimizations to FsNamesystem#RecentInvalidateSets > HADOOP-6840 <https://issues.apache.org/jira/browse/HADOOP-6840> Jitendra > Nath Pandey Nicolas Spiegelberg Support non-recursive create() in > FileSystem & SequenceFile.Writer > HADOOP-6886<https://issues.apache.org/jira/browse/HADOOP-6886> > Unassigned Nicolas Spiegelberg LocalFileSystem Needs createNonRecursive API > HADOOP-7664 <https://issues.apache.org/jira/browse/HADOOP-7664> Ravi > Prakash Ravi > Prakash o.a.h.conf.Configuration complains of overriding final parameter > even if the value with which its attempting to override is the same. > HADOOP-7711 <https://issues.apache.org/jira/browse/HADOOP-7711> Arpit > Gupta Arpit > Gupta hadoop-env.sh generated from templates has duplicate info > HADOOP-7715<https://issues.apache.org/jira/browse/HADOOP-7715> Eric > Yang Arpit Gupta see log4j Error when running mr jobs and certain dfs calls > HADOOP-7728 <https://issues.apache.org/jira/browse/HADOOP-7728> Ramya > Sunil Ramya > Sunil hadoop-setup-conf.sh should be modified to enable task memory manager > HADOOP-7740 <https://issues.apache.org/jira/browse/HADOOP-7740> Arpit > Gupta Arpit > Gupta security audit logger is not on by default, fix the log4j properties > to enable the logger > HADOOP-7765<https://issues.apache.org/jira/browse/HADOOP-7765> Eric > Yang Eric Yang Debian package contain both system and tar ball layout > HADOOP-7784 <https://issues.apache.org/jira/browse/HADOOP-7784> Eric Yang > Arpit > Gupta secure datanodes fail to come up stating jsvc not found > HDFS-611<https://issues.apache.org/jira/browse/HDFS-611> Zheng > Shao dhruba borthakur Heartbeats times from Datanodes increase when there > are plenty of blocks to delete > HDFS-617<https://issues.apache.org/jira/browse/HDFS-617> Kan > Zhang Kan Zhang Support for non-recursive create() in HDFS > HDFS-1257<https://issues.apache.org/jira/browse/HDFS-1257> Eric > Payne Ramkumar Vadali Race condition on FSNamesystem#recentInvalidateSets > introduced by HADOOP-5124 > HDFS-1943<https://issues.apache.org/jira/browse/HDFS-1943> Matt > Foley Wei Yongjun fail to start datanode while start-dfs.sh is executed by > root user HDFS-2065 <https://issues.apache.org/jira/browse/HDFS-2065> Uma > Maheswara Rao G Bharath Mundlapudi Fix NPE in DFSClient.getFileChecksum > HDFS-2316 <https://issues.apache.org/jira/browse/HDFS-2316> Tsz Wo > (Nicholas), SZE Tsz Wo (Nicholas), SZE webhdfs: a complete FileSystem > implementation for accessing HDFS over HTTP [[and sub-tasks]] > HDFS-2450<https://issues.apache.org/jira/browse/HDFS-2450> Daryn > Sharp Rajit Saha Only complete hostname is supported to access data via > hdfs:// MAPREDUCE-3374<https://issues.apache.org/jira/browse/MAPREDUCE-3374> > Unassigned Roman Shaposhnik src/c++/task-controller/configure is not set > executable in the tarball and that prevents task-controller from rebuilding > > *The following Jiras are targetted for 0.20.205.1, but have not yet been > committed:* > > *Key* *Assignee* *Reporter* *Summary* > HADOOP-6453<https://issues.apache.org/jira/browse/HADOOP-6453> Matt > Foley Chad Metcalf Hadoop wrapper script shouldn't ignore an existing > JAVA_LIBRARY_PATH > HADOOP-7732<https://issues.apache.org/jira/browse/HADOOP-7732> > Unassigned Arpit Gupta hadoop java docs missing hdfs package > HADOOP-7751<https://issues.apache.org/jira/browse/HADOOP-7751> Eric > Yang Arpit Gupta rpm version is not being picked from the -Dversion option > in 205 HADOOP-7804 <https://issues.apache.org/jira/browse/HADOOP-7804> Arpit > Gupta Arpit Gupta enable hadoop config generator to set > dfs.block.local-path-access.user to enable short circuit read > HADOOP-7809<https://issues.apache.org/jira/browse/HADOOP-7809> Matt > Foley Joydeep Sen Sarma Backport HADOOP-5839 to 0.20-security - fixes to > ec2 scripts to allow remote job submission > HDFS-2246<https://issues.apache.org/jira/browse/HDFS-2246> > Unassigned Sanjay Radia Shortcut a local client reads to a Datanodes files > directly HDFS-2433 <https://issues.apache.org/jira/browse/HDFS-2433> > Unassigned Robert Joseph Evans TestFileAppend4 fails intermittently > MAPREDUCE-3343 <https://issues.apache.org/jira/browse/MAPREDUCE-3343> > Unassigned Ahmed Radwan TaskTracker Out of Memory because of distributed > cache > > *Please review the items you are interested in, and complete all items by > Friday for the rc0 build.* > > Also, two unit tests are failing in the nightly builds. They passed in > Build #70 (Nov 4, 2011 12:47:00 AM GMT). > Please take a look if you committed to 205 branch after that time: > > org.apache.hadoop.streaming.TestUlimit.testCommandLine<https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-0.20.205-Build/76/testReport/org.apache.hadoop.streaming/TestUlimit/testCommandLine/> > > > org.apache.hadoop.mapred.TestJvmReuse.testTaskLogs<https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-0.20.205-Build/76/testReport/org.apache.hadoop.mapred/TestJvmReuse/testTaskLogs/> > > > Thank you, > --Matt (Release Manager) > > > On Fri, Nov 4, 2011 at 5:56 PM, Matt Foley <ma...@apache.org> wrote: > >> Hi all, >> I propose to make a 0.20.205.1 candidate soon, with the following sets of >> patches: >> >> - deficiencies in HBase support, pointed out by the HBase team and >> others >> - deficiencies in webhdfs support on secure clusters >> - a couple last-minute fixes submitted to branch-0.20-security-205 >> that were too late to be included in 205.0 >> >> If you would like other patches included, and you feel it is appropriate >> to have them in 205.1 rather than waiting for 206.0, please declare them by >> setting the "Target Versions" field in their Jiras, and they will receive >> due consideration, assuming that the proposed patch is actually >> contributed, tested, reviewed, approved, and committed >> to branch-0.20-security-205 by the freeze date :-) >> >> I would like to make the rc0 candidate next Friday, so I propose to >> declare 205.1 code freeze at noon, PST, Friday 11 Nov. If this is a >> problem for anyone, please let me know. >> >> Thank you, and best regards, >> --Matt (Release Manager) >> >> >> > > -- Todd Lipcon Software Engineer, Cloudera
