Author: suresh
Date: Sat May 25 04:26:58 2013
New Revision: 1486288
URL: http://svn.apache.org/r1486288
Log:
Update hadoop-common CHANGES.txt after merging HADOOP-8562
Modified:
hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
Modified: hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
URL:
http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt?rev=1486288&r1=1486287&r2=1486288&view=diff
==============================================================================
--- hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
(original)
+++ hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt Sat May
25 04:26:58 2013
@@ -18,10 +18,6 @@ Trunk (Unreleased)
HADOOP-8470. Add NetworkTopologyWithNodeGroup, a 4-layer implementation
of NetworkTopology. (Junping Du via szetszwo)
- HADOOP-8562. Enhancements to support Hadoop on Windows Server and Windows
- Azure environments. (See breakdown of tasks below for subtasks and
- contributors)
-
IMPROVEMENTS
HADOOP-8017. Configure hadoop-main pom to get rid of M2E plugin execution
@@ -140,15 +136,11 @@ Trunk (Unreleased)
HADOOP-9093. Move all the Exception in PathExceptions to o.a.h.fs package.
(suresh)
- HADOOP-9140 Cleanup rpc PB protos (sanjay Radia)
-
HADOOP-9162. Add utility to check native library availability.
(Binglin Chang via suresh)
HADOOP-9277. Improve javadoc for FileContext. (Andrew Wang via suresh)
- HADOOP-9218 Document the Rpc-wrappers used internally (sanjay Radia)
-
HADOOP-9258 Add stricter tests to FileSystemContractTestBase (stevel)
HADOOP-9486. Promoted Windows and Shell related utils from YARN to Hadoop
@@ -348,9 +340,6 @@ Trunk (Unreleased)
HADOOP-9397. Incremental dist tar build fails (Chris Nauroth via jlowe)
- HADOOP-9405. TestGridmixSummary#testExecutionSummarizer is broken. (Andrew
- Wang via atm)
-
HADOOP-9431 TestSecurityUtil#testLocalHostNameForNullOrWild on systems
where hostname
contains capital letters (Chris Nauroth via sanjay)
@@ -363,10 +352,6 @@ Trunk (Unreleased)
HADOOP-9433 TestLocalFileSystem#testHasFileDescriptor leaks file handle
(Chris Nauroth via sanjay)
- HADOOP-9488. FileUtil#createJarWithClassPath only substitutes environment
- variables from current process environment/does not support overriding
- when launching new process (Chris Nauroth via bikas)
-
HADOOP-9481. Broken conditional logic with HADOOP_SNAPPY_LIBRARY. (Vadim
Bondarev via atm)
@@ -381,173 +366,6 @@ Trunk (Unreleased)
HADOOP-9190. packaging docs is broken. (Andy Isaacson via atm)
- BREAKDOWN OF HADOOP-8562 SUBTASKS AND RELATED JIRAS
-
- HADOOP-8924. Hadoop Common creating package-info.java must not depend on
- sh. (Chris Nauroth via suresh)
-
- HADOOP-8945. Merge winutils from branch-1-win to branch-trunk-win.
- (Bikas Saha, Chuan Liu, Giridharan Kesavan, Ivan Mitic, and Steve Maine
- ported by Chris Nauroth via suresh)
-
- HADOOP-8946. winutils: compile codebase during Maven build on
- branch-trunk-win. (Chris Nauroth via suresh)
-
- HADOOP-8947. Merge FileUtil and Shell changes from branch-1-win to
- branch-trunk-win to enable initial test pass. (Raja Aluri, Davio Lao,
- Sumadhur Reddy Bolli, Ahmed El Baz, Kanna Karanam, Chuan Liu,
- Ivan Mitic, Chris Nauroth, and Bikas Saha via suresh)
-
- HADOOP-8954. "stat" executable not found on Windows. (Bikas Saha, Ivan
Mitic
- ported by Chris Narouth via suresh)
-
- HADOOP-8959. TestUserGroupInformation fails on Windows due to "id"
executable
- not found. (Bikas Saha, Ivan Mitic, ported by Chris Narouth via suresh)
-
- HADOOP-8955. "chmod" executable not found on Windows.
- (Chris Nauroth via suresh)
-
- HADOOP-8960. TestMetricsServlet fails on Windows. (Ivan Mitic via suresh)
-
- HADOOP-8961. GenericOptionsParser URI parsing failure on Windows.
- (Ivan Mitic via suresh)
-
- HADOOP-8949. Remove FileUtil.CygPathCommand dead code. (Chris Nauroth via
- suresh)
-
- HADOOP-8956. FileSystem.primitiveMkdir failures on Windows cause multiple
- test suites to fail. (Chris Nauroth via suresh)
-
- HADOOP-8978. TestTrash fails on Windows. (Chris Nauroth via suresh)
-
- HADOOP-8979. TestHttpServer fails on Windows. (Chris Nauroth via suresh)
-
- HADOOP-8953. Shell PathData parsing failures on Windows. (Arpit Agarwal via
- suresh)
-
- HADOOP-8975. TestFileContextResolveAfs fails on Windows. (Chris Nauroth via
- suresh)
-
- HADOOP-8977. Multiple FsShell test failures on Windows. (Chris Nauroth via
- suresh)
-
- HADOOP-9005. Merge hadoop cmd line scripts from branch-1-win. (David Lao,
- Bikas Saha, Lauren Yang, Chuan Liu, Thejas M Nair and Ivan Mitic via
suresh)
-
- HADOOP-9008. Building hadoop tarball fails on Windows. (Chris Nauroth via
- suresh)
-
- HADOOP-9011. saveVersion.py does not include branch in version annotation.
- (Chris Nauroth via suresh)
-
- HADOOP-9110. winutils ls off-by-one error indexing MONTHS array can cause
- access violation. (Chris Nauroth via suresh)
-
- HADOOP-9056. Build native library on Windows. (Chuan Liu, Arpit Agarwal via
- suresh)
-
- HADOOP-9144. Fix findbugs warnings. (Chris Nauroth via suresh)
-
- HADOOP-9081. Add TestWinUtils. (Chuan Liu, Ivan Mitic, Chris Nauroth,
- and Bikas Saha via suresh)
-
- HADOOP-9146. Fix sticky bit regression on branch-trunk-win.
- (Chris Nauroth via suresh)
-
- HADOOP-9266. Fix javac, findbugs, and release audit warnings on
- branch-trunk-win. (Chris Nauroth via suresh)
-
- HADOOP-9270. Remove a stale java comment from FileUtil. (Chris Nauroth via
- szetszwo)
-
- HADOOP-9271. Revert Python build scripts from branch-trunk-win.
- (Chris Nauroth via suresh)
-
- HADOOP-9313. Remove spurious mkdir from hadoop-config.cmd.
- (Ivan Mitic via suresh)
-
- HADOOP-9309. Test failures on Windows due to UnsatisfiedLinkError
- in NativeCodeLoader#buildSupportsSnappy. (Arpit Agarwal via suresh)
-
- HADOOP-9347. Add instructions to BUILDING.txt describing how to
- build on Windows. (Chris Nauroth via suresh)
-
- HADOOP-9348. Address TODO in winutils to add more command line usage
- and examples. (Chris Nauroth via suresh)
-
- HADOOP-9354. Windows native project files missing license headers.
- (Chris Nauroth via suresh)
-
- HADOOP-9356. Remove remaining references to cygwin/cygpath from scripts.
- (Chris Nauroth via suresh)
-
- HADOOP-9232. JniBasedUnixGroupsMappingWithFallback fails on Windows
- with UnsatisfiedLinkError. (Ivan Mitic via suresh)
-
- HADOOP-9368. Add timeouts to new tests in branch-trunk-win.
- (Arpit Agarwal via suresh)
-
- HADOOP-9373. Merge CHANGES.branch-trunk-win.txt to CHANGES.txt.
- (suresh)
-
- HADOOP-9372. Fix bad timeout annotations on tests.
- (Arpit Agarwal via suresh)
-
- HADOOP-9376. TestProxyUserFromEnv fails on a Windows domain joined machine.
- (Ivan Mitic via suresh)
-
- HADOOP-9365. TestHAZKUtil fails on Windows. (Ivan Mitic via suresh)
-
- HADOOP-9364. PathData#expandAsGlob does not return correct results for
- absolute paths on Windows. (Ivan Mitic via suresh)
-
- HADOOP-8973. DiskChecker cannot reliably detect an inaccessible disk on
- Windows with NTFS ACLs. (Chris Nauroth via suresh)
-
- HADOOP-9388. TestFsShellCopy fails on Windows. (Ivan Mitic via suresh)
-
- HADOOP-9387. Fix DF so that it won't execute a shell command on Windows
- to compute the file system/mount point. (Ivan Mitic via szetszwo)
-
- HADOOP-9353. Activate native-win maven profile by default on Windows.
- (Arpit Agarwal via szetszwo)
-
- HADOOP-9437. TestNativeIO#testRenameTo fails on Windows due to assumption
- that POSIX errno is embedded in NativeIOException. (Chris Nauroth via
- suresh)
-
- HADOOP-9443. Port winutils static code analysis change to trunk.
- (Chuan Liu via suresh)
-
- HADOOP-9290. Some tests cannot load native library on windows.
- (Chris Nauroth via suresh)
-
- HADOOP-9500. TestUserGroupInformation#testGetServerSideGroups fails on
- Windows due to failure to find winutils.exe. (Chris Nauroth via suresh)
-
- HADOOP-9490. LocalFileSystem#reportChecksumFailure not closing the
- checksum file handle before rename. (Ivan Mitic via suresh)
-
- HADOOP-9524. Fix ShellCommandFencer to work on Windows.
- (Arpit Agarwal via suresh)
-
- HADOOP-9413. Add common utils for File#setReadable/Writable/Executable &
- File#canRead/Write/Execute that work cross-platform. (Ivan Mitic via
suresh)
-
- HADOOP-9532. HADOOP_CLIENT_OPTS is appended twice by Windows cmd scripts.
- (Chris Nauroth via suresh)
-
- HADOOP-9043. Disallow in winutils creating symlinks with forwards slashes.
- (Chris Nauroth and Arpit Agarwal via suresh)
-
- HADOOP-9483. winutils support for readlink command.
- (Arpit Agarwal via suresh)
-
- HADOOP-9556. disable HA tests on Windows that fail due to ZooKeeper client
- connection management bug. (Chris Nauroth via suresh)
-
- HADOOP-9553. TestAuthenticationToken fails on Windows.
- (Arpit Agarwal via suresh)
Release 2.0.5-beta - UNRELEASED
@@ -565,18 +383,22 @@ Release 2.0.5-beta - UNRELEASED
HADOOP-9425 Add error codes to rpc-response (sanjay Radia)
- HADOOP-9194. RPC Support for QoS. (Junping Du via llu)
+ HADOOP-9194. RPC support for QoS. (Junping Du via llu)
NEW FEATURES
HADOOP-9283. Add support for running the Hadoop client on AIX. (atm)
- HADOOP-8415. Add getDouble() and setDouble() in
+ HADOOP-8415. Add getDouble() and setDouble() in
org.apache.hadoop.conf.Configuration (Jan van der Lugt via harsh)
HADOOP-9338. FsShell Copy Commands Should Optionally Preserve File
Attributes. (Nick White via atm)
+ HADOOP-8562. Enhancements to support Hadoop on Windows Server and Windows
+ Azure environments. (See breakdown of tasks below for subtasks and
+ contributors)
+
IMPROVEMENTS
HADOOP-9253. Capture ulimit info in the logs at service start time.
@@ -621,6 +443,10 @@ Release 2.0.5-beta - UNRELEASED
HADOOP-9560. metrics2#JvmMetrics should have max memory size of JVM.
(Tsuyoshi Ozawa via suresh)
+ HADOOP-9140 Cleanup rpc PB protos (sanjay Radia)
+
+ HADOOP-9218 Document the Rpc-wrappers used internally (sanjay Radia)
+
OPTIMIZATIONS
HADOOP-9150. Avoid unnecessary DNS resolution attempts for logical URIs
@@ -681,8 +507,8 @@ Release 2.0.5-beta - UNRELEASED
HADOOP-9407. commons-daemon 1.0.3 dependency has bad group id causing
build issues. (Sangjin Lee via suresh)
- HADOOP-9299. kerberos name resolution is kicking in even when kerberos
- is not configured (daryn)
+ HADOOP-9405. TestGridmixSummary#testExecutionSummarizer is broken. (Andrew
+ Wang via atm)
HADOOP-9430. TestSSLFactory fails on IBM JVM. (Amir Sanjar via suresh)
@@ -713,7 +539,7 @@ Release 2.0.5-beta - UNRELEASED
HADOOP-9549. WebHdfsFileSystem hangs on close(). (daryn via kihwal)
- HADOOP-9485. No default value in the code for
+ HADOOP-9485. No default value in the code for
hadoop.rpc.socket.factory.class.default. (Colin Patrick McCabe via atm)
HADOOP-9459. ActiveStandbyElector can join election even before
@@ -733,6 +559,178 @@ Release 2.0.5-beta - UNRELEASED
(which in turn throws SIGABRT) causing client crashes. (Colin Patrick
McCabe via atm)
+ BREAKDOWN OF HADOOP-8562 SUBTASKS AND RELATED JIRAS
+
+ HADOOP-8924. Hadoop Common creating package-info.java must not depend on
+ sh. (Chris Nauroth via suresh)
+
+ HADOOP-8945. Merge winutils from branch-1-win to branch-trunk-win.
+ (Bikas Saha, Chuan Liu, Giridharan Kesavan, Ivan Mitic, and Steve Maine
+ ported by Chris Nauroth via suresh)
+
+ HADOOP-8946. winutils: compile codebase during Maven build on
+ branch-trunk-win. (Chris Nauroth via suresh)
+
+ HADOOP-8947. Merge FileUtil and Shell changes from branch-1-win to
+ branch-trunk-win to enable initial test pass. (Raja Aluri, Davio Lao,
+ Sumadhur Reddy Bolli, Ahmed El Baz, Kanna Karanam, Chuan Liu,
+ Ivan Mitic, Chris Nauroth, and Bikas Saha via suresh)
+
+ HADOOP-8954. "stat" executable not found on Windows. (Bikas Saha, Ivan
Mitic
+ ported by Chris Narouth via suresh)
+
+ HADOOP-8959. TestUserGroupInformation fails on Windows due to "id"
executable
+ not found. (Bikas Saha, Ivan Mitic, ported by Chris Narouth via suresh)
+
+ HADOOP-8955. "chmod" executable not found on Windows.
+ (Chris Nauroth via suresh)
+
+ HADOOP-8960. TestMetricsServlet fails on Windows. (Ivan Mitic via suresh)
+
+ HADOOP-8961. GenericOptionsParser URI parsing failure on Windows.
+ (Ivan Mitic via suresh)
+
+ HADOOP-8949. Remove FileUtil.CygPathCommand dead code. (Chris Nauroth via
+ suresh)
+
+ HADOOP-8956. FileSystem.primitiveMkdir failures on Windows cause multiple
+ test suites to fail. (Chris Nauroth via suresh)
+
+ HADOOP-8978. TestTrash fails on Windows. (Chris Nauroth via suresh)
+
+ HADOOP-8979. TestHttpServer fails on Windows. (Chris Nauroth via suresh)
+
+ HADOOP-8953. Shell PathData parsing failures on Windows. (Arpit Agarwal via
+ suresh)
+
+ HADOOP-8975. TestFileContextResolveAfs fails on Windows. (Chris Nauroth via
+ suresh)
+
+ HADOOP-8977. Multiple FsShell test failures on Windows. (Chris Nauroth via
+ suresh)
+
+ HADOOP-9005. Merge hadoop cmd line scripts from branch-1-win. (David Lao,
+ Bikas Saha, Lauren Yang, Chuan Liu, Thejas M Nair and Ivan Mitic via
suresh)
+
+ HADOOP-9008. Building hadoop tarball fails on Windows. (Chris Nauroth via
+ suresh)
+
+ HADOOP-9011. saveVersion.py does not include branch in version annotation.
+ (Chris Nauroth via suresh)
+
+ HADOOP-9110. winutils ls off-by-one error indexing MONTHS array can cause
+ access violation. (Chris Nauroth via suresh)
+
+ HADOOP-9056. Build native library on Windows. (Chuan Liu, Arpit Agarwal via
+ suresh)
+
+ HADOOP-9144. Fix findbugs warnings. (Chris Nauroth via suresh)
+
+ HADOOP-9081. Add TestWinUtils. (Chuan Liu, Ivan Mitic, Chris Nauroth,
+ and Bikas Saha via suresh)
+
+ HADOOP-9146. Fix sticky bit regression on branch-trunk-win.
+ (Chris Nauroth via suresh)
+
+ HADOOP-9266. Fix javac, findbugs, and release audit warnings on
+ branch-trunk-win. (Chris Nauroth via suresh)
+
+ HADOOP-9270. Remove a stale java comment from FileUtil. (Chris Nauroth via
+ szetszwo)
+
+ HADOOP-9271. Revert Python build scripts from branch-trunk-win.
+ (Chris Nauroth via suresh)
+
+ HADOOP-9313. Remove spurious mkdir from hadoop-config.cmd.
+ (Ivan Mitic via suresh)
+
+ HADOOP-9309. Test failures on Windows due to UnsatisfiedLinkError
+ in NativeCodeLoader#buildSupportsSnappy. (Arpit Agarwal via suresh)
+
+ HADOOP-9347. Add instructions to BUILDING.txt describing how to
+ build on Windows. (Chris Nauroth via suresh)
+
+ HADOOP-9348. Address TODO in winutils to add more command line usage
+ and examples. (Chris Nauroth via suresh)
+
+ HADOOP-9354. Windows native project files missing license headers.
+ (Chris Nauroth via suresh)
+
+ HADOOP-9356. Remove remaining references to cygwin/cygpath from scripts.
+ (Chris Nauroth via suresh)
+
+ HADOOP-9232. JniBasedUnixGroupsMappingWithFallback fails on Windows
+ with UnsatisfiedLinkError. (Ivan Mitic via suresh)
+
+ HADOOP-9368. Add timeouts to new tests in branch-trunk-win.
+ (Arpit Agarwal via suresh)
+
+ HADOOP-9373. Merge CHANGES.branch-trunk-win.txt to CHANGES.txt.
+ (suresh)
+
+ HADOOP-9372. Fix bad timeout annotations on tests.
+ (Arpit Agarwal via suresh)
+
+ HADOOP-9376. TestProxyUserFromEnv fails on a Windows domain joined machine.
+ (Ivan Mitic via suresh)
+
+ HADOOP-9365. TestHAZKUtil fails on Windows. (Ivan Mitic via suresh)
+
+ HADOOP-9364. PathData#expandAsGlob does not return correct results for
+ absolute paths on Windows. (Ivan Mitic via suresh)
+
+ HADOOP-8973. DiskChecker cannot reliably detect an inaccessible disk on
+ Windows with NTFS ACLs. (Chris Nauroth via suresh)
+
+ HADOOP-9388. TestFsShellCopy fails on Windows. (Ivan Mitic via suresh)
+
+ HADOOP-9387. Fix DF so that it won't execute a shell command on Windows
+ to compute the file system/mount point. (Ivan Mitic via szetszwo)
+
+ HADOOP-9353. Activate native-win maven profile by default on Windows.
+ (Arpit Agarwal via szetszwo)
+
+ HADOOP-9437. TestNativeIO#testRenameTo fails on Windows due to assumption
+ that POSIX errno is embedded in NativeIOException. (Chris Nauroth via
+ suresh)
+
+ HADOOP-9443. Port winutils static code analysis change to trunk.
+ (Chuan Liu via suresh)
+
+ HADOOP-9290. Some tests cannot load native library on windows.
+ (Chris Nauroth via suresh)
+
+ HADOOP-9500. TestUserGroupInformation#testGetServerSideGroups fails on
+ Windows due to failure to find winutils.exe. (Chris Nauroth via suresh)
+
+ HADOOP-9490. LocalFileSystem#reportChecksumFailure not closing the
+ checksum file handle before rename. (Ivan Mitic via suresh)
+
+ HADOOP-9524. Fix ShellCommandFencer to work on Windows.
+ (Arpit Agarwal via suresh)
+
+ HADOOP-9413. Add common utils for File#setReadable/Writable/Executable &
+ File#canRead/Write/Execute that work cross-platform. (Ivan Mitic via
suresh)
+
+ HADOOP-9532. HADOOP_CLIENT_OPTS is appended twice by Windows cmd scripts.
+ (Chris Nauroth via suresh)
+
+ HADOOP-9043. Disallow in winutils creating symlinks with forwards slashes.
+ (Chris Nauroth and Arpit Agarwal via suresh)
+
+ HADOOP-9483. winutils support for readlink command.
+ (Arpit Agarwal via suresh)
+
+ HADOOP-9488. FileUtil#createJarWithClassPath only substitutes environment
+ variables from current process environment/does not support overriding
+ when launching new process (Chris Nauroth via bikas)
+
+ HADOOP-9556. disable HA tests on Windows that fail due to ZooKeeper client
+ connection management bug. (Chris Nauroth via suresh)
+
+ HADOOP-9553. TestAuthenticationToken fails on Windows.
+ (Arpit Agarwal via suresh)
+
Release 2.0.4-alpha - 2013-04-25
INCOMPATIBLE CHANGES
@@ -753,6 +751,9 @@ Release 2.0.4-alpha - 2013-04-25
HADOOP-9301. hadoop client servlet/jsp/jetty/tomcat JARs creating
conflicts in Oozie & HttpFS. (tucu)
+ HADOOP-9299. kerberos name resolution is kicking in even when kerberos
+ is not configured (daryn)
+
HADOOP-9408. misleading description for net.topology.table.file.name
property in core-default.xml. (rajeshbabu via suresh)