Author: mattf
Date: Thu Sep 29 00:18:54 2011
New Revision: 1177119
URL: http://svn.apache.org/viewvc?rev=1177119&view=rev
Log:
Preparing for release 0.20.205.0 (rc1)
Modified:
hadoop/common/branches/branch-0.20-security-205/CHANGES.txt
hadoop/common/branches/branch-0.20-security-205/src/docs/releasenotes.html
Modified: hadoop/common/branches/branch-0.20-security-205/CHANGES.txt
URL:
http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.20-security-205/CHANGES.txt?rev=1177119&r1=1177118&r2=1177119&view=diff
==============================================================================
--- hadoop/common/branches/branch-0.20-security-205/CHANGES.txt (original)
+++ hadoop/common/branches/branch-0.20-security-205/CHANGES.txt Thu Sep 29
00:18:54 2011
@@ -1,6 +1,6 @@
Hadoop Change Log
-Release 0.20.205.0 - 2011.09.27
+Release 0.20.205.0 - 2011.09.28
NEW FEATURES
Modified:
hadoop/common/branches/branch-0.20-security-205/src/docs/releasenotes.html
URL:
http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.20-security-205/src/docs/releasenotes.html?rev=1177119&r1=1177118&r2=1177119&view=diff
==============================================================================
--- hadoop/common/branches/branch-0.20-security-205/src/docs/releasenotes.html
(original)
+++ hadoop/common/branches/branch-0.20-security-205/src/docs/releasenotes.html
Thu Sep 29 00:18:54 2011
@@ -17,6 +17,7 @@
<h2>Changes since Hadoop 0.20.204.0</h2>
<ul>
+
<li> <a
href="https://issues.apache.org/jira/browse/HADOOP-6722";>HADOOP-6722</a>.
Major bug reported by tlipcon and fixed by tlipcon (util)<br>
<b>NetUtils.connect should check that it hasn't connected a socket
to itself</b><br>
@@ -67,6 +68,11 @@
<b>RPC client should deal with the IP address changes</b><br>
<blockquote>The current RPC client implementation and the client-side
callers assume that the hostname-address mappings of servers never change. The
resolved address is stored in an immutable InetSocketAddress object
above/outside RPC, and the reconnect logic in the RPC Connection implementation
also trusts the resolved address that was passed down.<br><br>If the NN suffers
a failure that requires migration, it may be started on a different node with a
different IP address. In this case, even if the name-addre...</blockquote></li>
+<li> <a
href="https://issues.apache.org/jira/browse/HADOOP-7510";>HADOOP-7510</a>.
+ Major improvement reported by daryn and fixed by daryn (security)<br>
+ <b>Tokens should use original hostname provided instead of ip</b><br>
+ <blockquote>Tokens currently store the ip:port of the remote server.
This precludes tokens from being used after a host's ip is changed.
Tokens should store the hostname used to make the RPC connection. This will
enable new processes to use their existing tokens.</blockquote></li>
+
<li> <a
href="https://issues.apache.org/jira/browse/HADOOP-7539";>HADOOP-7539</a>.
Major bug reported by johnvijoe and fixed by johnvijoe <br>
<b>merge hadoop archive goodness from trunk to .20</b><br>
@@ -187,6 +193,26 @@
<b>log4j.properties is missing properties for security audit and hdfs
audit should be changed to info</b><br>
<blockquote>log4j.properties defines the security audit and hdfs audit
files but is missing properties for security audit which causes security audit
logs to not be present and also updates the hdfs audit to log at a WARN level.
hdfs-audit logs should be at the INFO level so admin's/users can track
when the namespace got the appropriate change.</blockquote></li>
+<li> <a
href="https://issues.apache.org/jira/browse/HADOOP-7683";>HADOOP-7683</a>.
+ Minor bug reported by arpitgupta and fixed by arpitgupta <br>
+ <b>hdfs-site.xml template has properties that are not used in 20</b><br>
+ <blockquote>properties dfs.namenode.http-address and
dfs.namenode.https-address should be removed</blockquote></li>
+
+<li> <a
href="https://issues.apache.org/jira/browse/HADOOP-7684";>HADOOP-7684</a>.
+ Major bug reported by eyang and fixed by eyang (scripts)<br>
+ <b>jobhistory server and secondarynamenode should have init.d
script</b><br>
+ <blockquote>The current set of init.d scripts can start/stop process
for:<br><br>namenode<br>datanode<br>jobtracker<br>tasktracker<br><br>It is
missing init.d scripts
for:<br><br>secondarynamenode<br>jobhistory</blockquote></li>
+
+<li> <a
href="https://issues.apache.org/jira/browse/HADOOP-7685";>HADOOP-7685</a>.
+ Major bug reported by devaraj.k and fixed by devaraj.k (scripts)<br>
+ <b>Issues with
hadoop-common-project\hadoop-common\src\main\packages\hadoop-setup-conf.sh file
</b><br>
+
<blockquote>hadoop-common-project\hadoop-common\src\main\packages\hadoop-setup-conf.sh
has following issues<br>1. check_permission does not work as expected if there
are two folders with $NAME as part of their name inside $PARENT<br>e.g.
/home/hadoop/conf, /home/hadoop/someconf, <br>The result of `ls -ln $PARENT |
grep -w $NAME| awk '{print $3}'` is non zero..it is 0 0 and hence the
following if check becomes true.<br>{code:xml}<br>if [ "$OWNER" !=
"0" ]; then<br>RESULT=1<br>break<br>fi <br>{code}<br><br>2. Spelling
mistake<br>{code:xml}<br>H...</blockquote></li>
+
+<li> <a
href="https://issues.apache.org/jira/browse/HADOOP-7691";>HADOOP-7691</a>.
+ Major bug reported by gkesavan and fixed by eyang <br>
+ <b>hadoop deb pkg should take a diff group id</b><br>
+ <blockquote>ubuntu - 11.04 is using group id 114 for gdm.<br>hadoop deb
pkg should pickup a different groupid.</blockquote></li>
+
<li> <a href="https://issues.apache.org/jira/browse/HDFS-142";>HDFS-142</a>.
Blocker bug reported by rangadi and fixed by dhruba <br>
<b>In 0.20, move blocks being written into a blocksBeingWritten
directory</b><br>
@@ -395,7 +421,7 @@
<li> <a href="https://issues.apache.org/jira/browse/HDFS-2318";>HDFS-2318</a>.
Major sub-task reported by szetszwo and fixed by szetszwo <br>
<b>Provide authentication to webhdfs using SPNEGO</b><br>
- <blockquote></blockquote></li>
+ <blockquote> Added two new
conf properties dfs.web.authentication.kerberos.principal and
dfs.web.authentication.kerberos.keytab for the SPNEGO servlet filter.<br><br>
<br></blockquote></li>
<li> <a href="https://issues.apache.org/jira/browse/HDFS-2320";>HDFS-2320</a>.
Major bug reported by sureshms and fixed by sureshms (data-node, hdfs
client, name-node)<br>
@@ -425,7 +451,7 @@
<li> <a href="https://issues.apache.org/jira/browse/HDFS-2338";>HDFS-2338</a>.
Major sub-task reported by jnp and fixed by jnp <br>
<b>Configuration option to enable/disable webhdfs.</b><br>
- <blockquote>We should add a configuration option to enable/disable
webhdfs.</blockquote></li>
+ <blockquote> Added a conf
property dfs.webhdfs.enabled for enabling/disabling webhdfs.<br><br>
<br></blockquote></li>
<li> <a href="https://issues.apache.org/jira/browse/HDFS-2340";>HDFS-2340</a>.
Major sub-task reported by szetszwo and fixed by szetszwo <br>
@@ -450,13 +476,23 @@
<li> <a href="https://issues.apache.org/jira/browse/HDFS-2361";>HDFS-2361</a>.
Critical bug reported by rajsaha and fixed by jnp (name-node)<br>
<b>hftp is broken</b><br>
- <blockquote>Distcp with hftp is failing.<br><br><br>$hadoop distcp
hftp://<NNhostname>:50070/user/hadoopqa/1316814737/newtemp
1316814737/as<br>11/09/23 21:52:33 INFO tools.DistCp:
srcPaths=[hftp://<NNhostname>:50070/user/hadoopqa/1316814737/newtemp]<br>11/09/23
21:52:33 INFO tools.DistCp: destPath=1316814737/as<br>Retrieving token from:
https://<NN IP>:50470/getDelegationToken<br>Retrieving token from:
https://<NN IP>:50470/getDelegationToken?renewer=mapred<br>11/09/23
21:52:34 INFO security.TokenCache: Got dt for
hftp://<NNh...</blockquote></li>
+ <blockquote>Distcp with hftp is failing.<br><br>{noformat}<br>$hadoop
distcp hftp://<NNhostname>:50070/user/hadoopqa/1316814737/newtemp
1316814737/as<br>11/09/23 21:52:33 INFO tools.DistCp:
srcPaths=[hftp://<NNhostname>:50070/user/hadoopqa/1316814737/newtemp]<br>11/09/23
21:52:33 INFO tools.DistCp: destPath=1316814737/as<br>Retrieving token from:
https://<NN IP>:50470/getDelegationToken<br>Retrieving token from:
https://<NN IP>:50470/getDelegationToken?renewer=mapred<br>11/09/23
21:52:34 INFO security.TokenCache: Got dt for h...</blockquote></li>
<li> <a href="https://issues.apache.org/jira/browse/HDFS-2366";>HDFS-2366</a>.
Major bug reported by arpitgupta and fixed by szetszwo <br>
<b>webhdfs throws a npe when ugi is null from getDelegationToken</b><br>
<blockquote></blockquote></li>
+<li> <a href="https://issues.apache.org/jira/browse/HDFS-2368";>HDFS-2368</a>.
+ Major bug reported by arpitgupta and fixed by szetszwo <br>
+ <b>defaults created for web keytab and principal, these properties should
not have defaults</b><br>
+ <blockquote>the following defaults are set in
hdfs-defaults.xml<br><br><property><br>
<name>dfs.web.authentication.kerberos.principal</name><br>
<value>HTTP/${dfs.web.hostname}@${kerberos.realm}</value><br>
<description><br> The HTTP Kerberos principal used by Hadoop-Auth in
the HTTP endpoint.<br><br> The HTTP Kerberos principal MUST start with
'HTTP/' per Kerberos<br> HTTP SPENGO specification.<br>
</description><br></property><br><br><property><br>
<name>dfs.web.authentication.kerberos.keytab</name><br>
<value>${user.home}/dfs.web....</blockquote></li>
+
+<li> <a href="https://issues.apache.org/jira/browse/HDFS-2373";>HDFS-2373</a>.
+ Major bug reported by arpitgupta and fixed by arpitgupta <br>
+ <b>Commands using webhdfs and hftp print unnecessary debug information on
the console with security enabled</b><br>
+ <blockquote>run an hdfs command using either hftp or webhdfs and it
prints the following line to the console (system out)<br><br>Retrieving token
from: https://NN_HOST:50470/getDelegationToken<br><br><br>Probably in the code
where we get the delegation token. This should be removed as people using the
dfs commands to get a handle to the content such as dfs -cat will now get an
extra line that is not part of the actual content. This should either be only
in the log or not logged at all.</blockquote></li>
+
<li> <a href="https://issues.apache.org/jira/browse/HDFS-2375";>HDFS-2375</a>.
Blocker bug reported by sureshms and fixed by sureshms (hdfs client)<br>
<b>TestFileAppend4 fails in 0.20.205 branch</b><br>
@@ -557,6 +593,16 @@
<b>TestSleepJob fails </b><br>
<blockquote>TestSleepJob fails, it was intended to be used in other tests
for MAPREDUCE-2981.</blockquote></li>
+<li> <a
href="https://issues.apache.org/jira/browse/MAPREDUCE-3081";>MAPREDUCE-3081</a>.
+ Major bug reported by vitthal_gogate and fixed by (contrib/vaidya)<br>
+ <b>Change the name format for hadoop core and vaidya jar to be
hadoop-{core/vaidya}-{version}.jar in vaidya.sh</b><br>
+ <blockquote>
contrib/vaidya/bin/vaidya.sh script fixed to use appropriate jars and classpath
<br><br> <br></blockquote></li>
+
+<li> <a
href="https://issues.apache.org/jira/browse/MAPREDUCE-3112";>MAPREDUCE-3112</a>.
+ Major bug reported by eyang and fixed by eyang (contrib/streaming)<br>
+ <b>Calling hadoop cli inside mapreduce job leads to errors</b><br>
+ <blockquote> Removed inheritance of certain server
environment variables (HADOOP_OPTS and HADOOP_ROOT_LOGGER) in task attempt
process.
<br/><br><br><br></blockquote></li>
+
</ul>
