See http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/609/changes
Changes:
[rangadi] HADOOP-4006. Clean up FSConstants and move some of the constants to
better places. (Sanjay Radia via rangadi)
[nigel] Preparing for 0.20.0 development
[nigel] Preparing for release 0.19.0
[zshao] HADOOP-4205. Reverted to 697291 because of an erroneous commit of this
file.
[zshao] HADOOP 4205. Fixed compilation problems.
[zshao] HADOOP-4205. hive: metastore and ql to use the refactored SerDe library.
[cdouglas] HADOOP-3019. Missed a line
[acmurthy] HADOOP-3924. Adding the missed TestJobKillAndFail.java.
[dhruba] HADOOP-4090. The hive scripts pick up hadoop from HADOOP_HOME
and then the path. (Raghotham Murthy via dhruba)
[acmurthy] HADOOP-3924. Added a 'KILLED' job status. Contributed by Subramaniam
Krishnan.
[dhruba] HADOOP-4120. Hive interactive shell records the time taken by a
query. (Raghotham Murthy via dhruba)
[rangadi] HADOOP-3938. Disk space quotas for HDFS. This is similar to namespace
quotas in 0.18. (rangadi)
[omalley] HADOOP-3019. A new library to support total order partitions.
(cdouglas via omalley)
[szetszwo] HADOOP-4227. Remove the deprecated class
org.apache.hadoop.fs.ShellCommand. (szetszwo)
[omalley] HADOOP-4181. Add .svn to .gitignore.
[hairong] HADOOP-4062. IPC client does not need to be synchronized on the
output stream when a connection is closed. Contributed by Hairong Kuang.
[rangadi] HADOOP-3592. Fix a couple of possible file leaks in FileUtil (Bill de
hOra via rangadi)
[dhruba] HADOOP-4077. Setting access and modification time for a file
requires write permissions on the file. (dhruba)
[hairong] HADOOP-2816. Cluster summary at name node web has confusing report
for space utilization. Contributed by Suresh Srinivas.
[acmurthy] HADOOP-2165. Augmented JobHistory to include the URIs to the tasks'
userlogs. Contributed by Vinod Kumar Vavilapalli.
[acmurthy] HADOOP-4124. Added a command-line switch to allow users to set job
priorities, also allow it to be manipulated via the web-ui. Contributed by
Hemanth Yamijala.
[cdouglas] HADOOP-3975. Change test-patch script to report working the dir
modifications preventing the suite from being run. Contributed by Ramya R.
[acmurthy] HADOOP-2536. Implement a JDBC based database input and output
formats to allow Map-Reduce applications to work with databases. Contributed by
Fredrik Hedberg and Enis Soztutar.
[nigel] Reverted HADOOP-3924 since it broke the eclipse-plugin compile. merge
-r 697068:697067
------------------------------------------
[...truncated 251599 lines...]
[junit] 2008-09-20 13:21:32,719 INFO datanode.DataNode
(BlockReceiver.java:run(971)) - PacketResponder 1 for block
blk_-7357771567426804400_1001 terminating
[junit] 2008-09-20 13:21:32,720 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 4 on 59257,
ugi=null
[junit] 2008-09-20 13:21:32,720 INFO hdfs.StateChange
(FSNamesystem.java:addStoredBlock(2881)) - BLOCK* NameSystem.addStoredBlock:
blockMap updated: 127.0.0.1:59261 is added to blk_-7357771567426804400_1001
size 100
[junit] 2008-09-20 13:21:32,720 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 3 on 59257,
ugi=null
[junit] 2008-09-20 13:21:32,722 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 4 on 59257,
ugi=null
[junit] 2008-09-20 13:21:32,723 INFO DataNode.clienttrace
(BlockReceiver.java:run(907)) - src: /127.0.0.1:59270, dest: /127.0.0.1:59267,
bytes: 100, op: HDFS_WRITE, cliID: DFSClient_-80402410, srvID:
DS-1926660167-140.211.11.106-59267-1221916892443, blockid:
blk_-7357771567426804400_1001
[junit] 2008-09-20 13:21:32,724 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 2 on 59257,
ugi=null
[junit] 2008-09-20 13:21:32,724 INFO datanode.DataNode
(BlockReceiver.java:run(971)) - PacketResponder 2 for block
blk_-7357771567426804400_1001 terminating
[junit] 2008-09-20 13:21:32,724 INFO hdfs.StateChange
(FSNamesystem.java:addStoredBlock(2881)) - BLOCK* NameSystem.addStoredBlock:
blockMap updated: 127.0.0.1:59267 is added to blk_-7357771567426804400_1001
size 100
[junit] 2008-09-20 13:21:32,725 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 2 on 59257,
ugi=null
[junit] 2008-09-20 13:21:32,727 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 1 on 59257,
ugi=hudson,hudson
[junit] 2008-09-20 13:21:32,764 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 1 on 59257,
ugi=null
[junit] 2008-09-20 13:21:32,765 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 0 on 59257,
ugi=hudson,hudson
[junit] 2008-09-20 13:21:32,765 DEBUG security.UserGroupInformation
(PermissionChecker.java:<init>(40)) - ugi=hudson,hudson
[junit] 2008-09-20 13:21:32,781 INFO FSNamesystem.audit
(FSNamesystem.java:logAuditEvent(108)) - ugi=hudson,hudson ip=/127.0.0.1
cmd=setPermission src=/data/file1 dst=null
perm=hudson:supergroup:rw-------
[junit] 2008-09-20 13:21:32,782 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 0 on 59257,
ugi=null
[junit] 2008-09-20 13:21:32,785 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 9 on 59257,
ugi=hudson,hudson
[junit] 2008-09-20 13:21:32,786 DEBUG security.UserGroupInformation
(PermissionChecker.java:<init>(40)) - ugi=hudson,hudson
[junit] 2008-09-20 13:21:32,788 INFO FSNamesystem.audit
(FSNamesystem.java:logAuditEvent(108)) - ugi=hudson,hudson ip=/127.0.0.1
cmd=open src=/data/file1 dst=null perm=null
[junit] 2008-09-20 13:21:32,788 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 9 on 59257,
ugi=null
[junit] 2008-09-20 13:21:32,797 INFO DataNode.clienttrace
(BlockSender.java:sendBlock(396)) - src: /127.0.0.1:59261, dest:
/127.0.0.1:59273, bytes: 104, op: HDFS_READ, cliID: DFSClient_-80402410, srvID:
DS-787030575-140.211.11.106-59261-1221916890856, blockid:
blk_-7357771567426804400_1001
[junit] 2008-09-20 13:21:32,800 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 8 on 59257,
ugi=user2046093375,group1,group2
[junit] 2008-09-20 13:21:32,801 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 8 on 59257,
ugi=null
[junit] 2008-09-20 13:21:32,804 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 7 on 59257,
ugi=user2046093375,group1,group2
[junit] 2008-09-20 13:21:32,804 DEBUG security.UserGroupInformation
(PermissionChecker.java:<init>(40)) - ugi=user2046093375,group1,group2
[junit] 2008-09-20 13:21:32,805 DEBUG security.UserGroupInformation
(PermissionChecker.java:checkPermission(88)) - ACCESS CHECK: [EMAIL PROTECTED],
doCheckOwner=false, ancestorAccess=null, parentAccess=null, access=null,
subAccess=null
[junit] 2008-09-20 13:21:32,806 INFO FSNamesystem.audit
(FSNamesystem.java:logAuditEvent(108)) - ugi=user2046093375,group1,group2
ip=/127.0.0.1 cmd=mkdirs src=/data/child1 dst=null
perm=hudson:supergroup:rwxr-xr-x
[junit] 2008-09-20 13:21:32,806 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 7 on 59257,
ugi=null
[junit] 2008-09-20 13:21:32,807 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 6 on 59257,
ugi=user2046093375,group1,group2
[junit] 2008-09-20 13:21:32,808 DEBUG security.UserGroupInformation
(PermissionChecker.java:<init>(40)) - ugi=user2046093375,group1,group2
[junit] 2008-09-20 13:21:32,808 DEBUG security.UserGroupInformation
(PermissionChecker.java:checkPermission(88)) - ACCESS CHECK: [EMAIL PROTECTED],
doCheckOwner=false, ancestorAccess=null, parentAccess=null, access=null,
subAccess=null
[junit] 2008-09-20 13:21:32,808 DEBUG security.UserGroupInformation
(PermissionChecker.java:<init>(40)) - ugi=user2046093375,group1,group2
[junit] 2008-09-20 13:21:32,809 DEBUG security.UserGroupInformation
(PermissionChecker.java:checkPermission(88)) - ACCESS CHECK: [EMAIL PROTECTED],
doCheckOwner=false, ancestorAccess=WRITE, parentAccess=null, access=null,
subAccess=null
[junit] 2008-09-20 13:21:32,809 INFO ipc.Server (Server.java:run(890)) -
IPC Server handler 6 on 59257, call mkdirs(/data/child2, rwxr-xr-x) from
127.0.0.1:59274: error: org.apache.hadoop.fs.permission.AccessControlException:
Permission denied: user=user2046093375, access=WRITE,
inode="data":hudson:supergroup:rwxr-xr-x
[junit] org.apache.hadoop.fs.permission.AccessControlException: Permission
denied: user=user2046093375, access=WRITE,
inode="data":hudson:supergroup:rwxr-xr-x
[junit] at
org.apache.hadoop.hdfs.server.namenode.PermissionChecker.check(PermissionChecker.java:175)
[junit] at
org.apache.hadoop.hdfs.server.namenode.PermissionChecker.check(PermissionChecker.java:156)
[junit] at
org.apache.hadoop.hdfs.server.namenode.PermissionChecker.checkPermission(PermissionChecker.java:104)
[junit] at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:4329)
[junit] at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkAncestorAccess(FSNamesystem.java:4299)
[junit] at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirsInternal(FSNamesystem.java:1732)
[junit] at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:1701)
[junit] at
org.apache.hadoop.hdfs.server.namenode.NameNode.mkdirs(NameNode.java:471)
[junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit] at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit] at java.lang.reflect.Method.invoke(Method.java:597)
[junit] at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:452)
[junit] at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888)
[junit] 2008-09-20 13:21:32,810 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 6 on 59257,
ugi=null
[junit] 2008-09-20 13:21:32,812 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 5 on 59257,
ugi=user2046093375,group1,group2
[junit] 2008-09-20 13:21:32,812 DEBUG security.UserGroupInformation
(PermissionChecker.java:<init>(40)) - ugi=user2046093375,group1,group2
[junit] 2008-09-20 13:21:32,813 DEBUG security.UserGroupInformation
(PermissionChecker.java:checkPermission(88)) - ACCESS CHECK: [EMAIL PROTECTED],
doCheckOwner=false, ancestorAccess=WRITE, parentAccess=null, access=null,
subAccess=null
[junit] 2008-09-20 13:21:32,813 INFO ipc.Server (Server.java:run(890)) -
IPC Server handler 5 on 59257, call create(/data/file2, rwxr-xr-x,
DFSClient_-270090176, true, 3, 67108864) from 127.0.0.1:59274: error:
org.apache.hadoop.fs.permission.AccessControlException: Permission denied:
user=user2046093375, access=WRITE, inode="data":hudson:supergroup:rwxr-xr-x
[junit] org.apache.hadoop.fs.permission.AccessControlException: Permission
denied: user=user2046093375, access=WRITE,
inode="data":hudson:supergroup:rwxr-xr-x
[junit] at
org.apache.hadoop.hdfs.server.namenode.PermissionChecker.check(PermissionChecker.java:175)
[junit] at
org.apache.hadoop.hdfs.server.namenode.PermissionChecker.check(PermissionChecker.java:156)
[junit] at
org.apache.hadoop.hdfs.server.namenode.PermissionChecker.checkPermission(PermissionChecker.java:104)
[junit] at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:4329)
[junit] at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkAncestorAccess(FSNamesystem.java:4299)
[junit] at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFileInternal(FSNamesystem.java:1030)
[junit] at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFile(FSNamesystem.java:991)
[junit] at
org.apache.hadoop.hdfs.server.namenode.NameNode.create(NameNode.java:301)
[junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit] at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit] at java.lang.reflect.Method.invoke(Method.java:597)
[junit] at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:452)
[junit] at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888)
[junit] 2008-09-20 13:21:32,814 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 5 on 59257,
ugi=null
[junit] 2008-09-20 13:21:32,816 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 3 on 59257,
ugi=user2046093375,group1,group2
[junit] 2008-09-20 13:21:32,816 DEBUG security.UserGroupInformation
(PermissionChecker.java:<init>(40)) - ugi=user2046093375,group1,group2
[junit] 2008-09-20 13:21:32,817 DEBUG security.UserGroupInformation
(PermissionChecker.java:checkPermission(88)) - ACCESS CHECK: [EMAIL PROTECTED],
doCheckOwner=false, ancestorAccess=null, parentAccess=null, access=READ,
subAccess=null
[junit] 2008-09-20 13:21:32,817 INFO ipc.Server (Server.java:run(890)) -
IPC Server handler 3 on 59257, call getBlockLocations(/data/file1, 0,
671088640) from 127.0.0.1:59274: error:
org.apache.hadoop.fs.permission.AccessControlException: Permission denied:
user=user2046093375, access=READ, inode="file1":hudson:supergroup:rw-------
[junit] org.apache.hadoop.fs.permission.AccessControlException: Permission
denied: user=user2046093375, access=READ,
inode="file1":hudson:supergroup:rw-------
[junit] at
org.apache.hadoop.hdfs.server.namenode.PermissionChecker.check(PermissionChecker.java:175)
[junit] at
org.apache.hadoop.hdfs.server.namenode.PermissionChecker.checkPermission(PermissionChecker.java:110)
[junit] at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:4329)
[junit] at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPathAccess(FSNamesystem.java:4289)
[junit] at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:744)
[junit] at
org.apache.hadoop.hdfs.server.namenode.NameNode.getBlockLocations(NameNode.java:272)
[junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit] at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit] at java.lang.reflect.Method.invoke(Method.java:597)
[junit] at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:452)
[junit] at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888)
[junit] 2008-09-20 13:21:32,818 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 3 on 59257,
ugi=null
[junit] 2008-09-20 13:21:32,819 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 4 on 59257,
ugi=hudson,hudson
[junit] 2008-09-20 13:21:32,820 DEBUG security.UserGroupInformation
(PermissionChecker.java:<init>(40)) - ugi=hudson,hudson
[junit] 2008-09-20 13:21:32,849 INFO FSNamesystem.audit
(FSNamesystem.java:logAuditEvent(108)) - ugi=hudson,hudson ip=/127.0.0.1
cmd=setPermission src=/data dst=null
perm=hudson:supergroup:rwxr-xr-x
[junit] 2008-09-20 13:21:32,850 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 4 on 59257,
ugi=null
[junit] 2008-09-20 13:21:32,850 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 2 on 59257,
ugi=hudson,hudson
[junit] 2008-09-20 13:21:32,851 DEBUG security.UserGroupInformation
(PermissionChecker.java:<init>(40)) - ugi=hudson,hudson
[junit] 2008-09-20 13:21:32,866 INFO FSNamesystem.audit
(FSNamesystem.java:logAuditEvent(108)) - ugi=hudson,hudson ip=/127.0.0.1
cmd=setPermission src=/data/child1 dst=null
perm=hudson:supergroup:rwxrwxrwx
[junit] 2008-09-20 13:21:32,867 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 2 on 59257,
ugi=null
[junit] 2008-09-20 13:21:32,868 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 1 on 59257,
ugi=hudson,hudson
[junit] 2008-09-20 13:21:32,868 DEBUG security.UserGroupInformation
(PermissionChecker.java:<init>(40)) - ugi=hudson,hudson
[junit] 2008-09-20 13:21:32,884 INFO FSNamesystem.audit
(FSNamesystem.java:logAuditEvent(108)) - ugi=hudson,hudson ip=/127.0.0.1
cmd=setPermission src=/ dst=null perm=hudson:supergroup:rwxrwxrwx
[junit] 2008-09-20 13:21:32,884 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 1 on 59257,
ugi=null
[junit] 2008-09-20 13:21:32,885 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 0 on 59257,
ugi=user2046093375,group1,group2
[junit] 2008-09-20 13:21:32,885 DEBUG security.UserGroupInformation
(PermissionChecker.java:<init>(40)) - ugi=user2046093375,group1,group2
[junit] 2008-09-20 13:21:32,886 DEBUG security.UserGroupInformation
(PermissionChecker.java:checkPermission(88)) - ACCESS CHECK: [EMAIL PROTECTED],
doCheckOwner=false, ancestorAccess=null, parentAccess=null, access=null,
subAccess=null
[junit] 2008-09-20 13:21:32,886 DEBUG security.UserGroupInformation
(PermissionChecker.java:<init>(40)) - ugi=user2046093375,group1,group2
[junit] 2008-09-20 13:21:32,886 DEBUG security.UserGroupInformation
(PermissionChecker.java:checkPermission(88)) - ACCESS CHECK: [EMAIL PROTECTED],
doCheckOwner=false, ancestorAccess=WRITE, parentAccess=null, access=null,
subAccess=null
[junit] 2008-09-20 13:21:32,934 INFO FSNamesystem.audit
(FSNamesystem.java:logAuditEvent(108)) - ugi=user2046093375,group1,group2
ip=/127.0.0.1 cmd=mkdirs src=/foo/bar dst=null
perm=user2046093375:supergroup:rwxr-xr-x
[junit] 2008-09-20 13:21:32,934 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 0 on 59257,
ugi=null
[junit] 2008-09-20 13:21:32,935 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 9 on 59257,
ugi=user2046093375,group1,group2
[junit] 2008-09-20 13:21:32,936 DEBUG security.UserGroupInformation
(PermissionChecker.java:<init>(40)) - ugi=user2046093375,group1,group2
[junit] 2008-09-20 13:21:32,936 DEBUG security.UserGroupInformation
(PermissionChecker.java:checkPermission(88)) - ACCESS CHECK: [EMAIL PROTECTED],
doCheckOwner=false, ancestorAccess=null, parentAccess=WRITE, access=null,
subAccess=null
[junit] 2008-09-20 13:21:32,937 DEBUG security.UserGroupInformation
(PermissionChecker.java:<init>(40)) - ugi=user2046093375,group1,group2
[junit] 2008-09-20 13:21:32,937 DEBUG security.UserGroupInformation
(PermissionChecker.java:checkPermission(88)) - ACCESS CHECK: [EMAIL PROTECTED],
doCheckOwner=false, ancestorAccess=WRITE, parentAccess=null, access=null,
subAccess=null
[junit] 2008-09-20 13:21:32,967 INFO FSNamesystem.audit
(FSNamesystem.java:logAuditEvent(108)) - ugi=user2046093375,group1,group2
ip=/127.0.0.1 cmd=rename src=/foo/bar dst=/data/child1
perm=hudson:supergroup:rwxrwxrwx
[junit] 2008-09-20 13:21:32,968 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 9 on 59257,
ugi=null
[junit] Shutting down the Mini HDFS Cluster
[junit] Shutting down DataNode 2
[junit] 2008-09-20 13:21:32,970 INFO http.SocketListener
(SocketListener.java:stop(212)) - Stopped SocketListener on 127.0.0.1:59268
[junit] 2008-09-20 13:21:33,170 INFO util.Container
(Container.java:stop(156)) - Stopped HttpContext[/static,/static]
[junit] 2008-09-20 13:21:33,239 INFO util.Container
(Container.java:stop(156)) - Stopped HttpContext[/logs,/logs]
[junit] 2008-09-20 13:21:33,239 INFO util.Container
(Container.java:stop(156)) - Stopped [EMAIL PROTECTED]
[junit] 2008-09-20 13:21:33,318 INFO util.Container
(Container.java:stop(156)) - Stopped WebApplicationContext[/,/]
[junit] 2008-09-20 13:21:33,318 INFO util.Container
(Container.java:stop(156)) - Stopped [EMAIL PROTECTED]
[junit] 2008-09-20 13:21:33,319 INFO ipc.Server (Server.java:stop(992)) -
Stopping server on 59269
[junit] 2008-09-20 13:21:33,319 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 0 on 59269: exiting
[junit] 2008-09-20 13:21:33,320 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 1 on 59269: exiting
[junit] 2008-09-20 13:21:33,321 INFO datanode.DataNode
(DataNode.java:shutdown(574)) - Waiting for threadgroup to exit, active threads
is 1
[junit] 2008-09-20 13:21:33,321 INFO ipc.Server (Server.java:run(502)) -
Stopping IPC Server Responder
[junit] 2008-09-20 13:21:33,319 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 2 on 59269: exiting
[junit] 2008-09-20 13:21:33,319 INFO ipc.Server (Server.java:run(330)) -
Stopping IPC Server listener on 59269
[junit] 2008-09-20 13:21:33,646 INFO datanode.DataBlockScanner
(DataBlockScanner.java:run(599)) - Exiting DataBlockScanner thread.
[junit] 2008-09-20 13:21:33,926 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 8 on 59257,
ugi=null
[junit] 2008-09-20 13:21:33,926 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 8 on 59257,
ugi=null
[junit] 2008-09-20 13:21:34,326 INFO datanode.DataNode
(DataNode.java:shutdown(574)) - Waiting for threadgroup to exit, active threads
is 0
[junit] 2008-09-20 13:21:34,326 INFO datanode.DataNode
(DataNode.java:run(1130)) - DatanodeRegistration(127.0.0.1:59267,
storageID=DS-1926660167-140.211.11.106-59267-1221916892443, infoPort=59268,
ipcPort=59269):Finishing DataNode in:
FSDataset{dirpath='/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/test/data/dfs/data/data5/current,/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/test/data/dfs/data/data6/current'}
[junit] 2008-09-20 13:21:34,326 INFO ipc.Server (Server.java:stop(992)) -
Stopping server on 59269
[junit] 2008-09-20 13:21:34,327 INFO datanode.DataNode
(DataNode.java:shutdown(574)) - Waiting for threadgroup to exit, active threads
is 0
[junit] Shutting down DataNode 1
[junit] 2008-09-20 13:21:34,329 INFO http.SocketListener
(SocketListener.java:stop(212)) - Stopped SocketListener on 127.0.0.1:59265
[junit] 2008-09-20 13:21:34,398 INFO util.Container
(Container.java:stop(156)) - Stopped HttpContext[/static,/static]
[junit] 2008-09-20 13:21:34,467 INFO util.Container
(Container.java:stop(156)) - Stopped HttpContext[/logs,/logs]
[junit] 2008-09-20 13:21:34,467 INFO util.Container
(Container.java:stop(156)) - Stopped [EMAIL PROTECTED]
[junit] 2008-09-20 13:21:34,538 INFO util.Container
(Container.java:stop(156)) - Stopped WebApplicationContext[/,/]
[junit] 2008-09-20 13:21:34,538 INFO util.Container
(Container.java:stop(156)) - Stopped [EMAIL PROTECTED]
[junit] 2008-09-20 13:21:34,538 INFO ipc.Server (Server.java:stop(992)) -
Stopping server on 59266
[junit] 2008-09-20 13:21:34,539 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 7 on 59257,
ugi=null
[junit] 2008-09-20 13:21:34,539 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 2 on 59266: exiting
[junit] 2008-09-20 13:21:34,539 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 0 on 59266: exiting
[junit] 2008-09-20 13:21:34,539 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 7 on 59257,
ugi=null
[junit] 2008-09-20 13:21:34,540 INFO datanode.DataNode
(DataNode.java:shutdown(574)) - Waiting for threadgroup to exit, active threads
is 1
[junit] 2008-09-20 13:21:34,541 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 1 on 59266: exiting
[junit] 2008-09-20 13:21:34,541 INFO ipc.Server (Server.java:run(502)) -
Stopping IPC Server Responder
[junit] 2008-09-20 13:21:34,616 INFO datanode.DataBlockScanner
(DataBlockScanner.java:run(599)) - Exiting DataBlockScanner thread.
[junit] 2008-09-20 13:21:35,546 INFO datanode.DataNode
(DataNode.java:shutdown(574)) - Waiting for threadgroup to exit, active threads
is 0
[junit] 2008-09-20 13:21:35,546 INFO datanode.DataNode
(DataNode.java:run(1130)) - DatanodeRegistration(127.0.0.1:59264,
storageID=DS-1335379609-140.211.11.106-59264-1221916891445, infoPort=59265,
ipcPort=59266):Finishing DataNode in:
FSDataset{dirpath='/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/test/data/dfs/data/data3/current,/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/test/data/dfs/data/data4/current'}
[junit] 2008-09-20 13:21:35,546 INFO ipc.Server (Server.java:stop(992)) -
Stopping server on 59266
[junit] 2008-09-20 13:21:35,547 INFO datanode.DataNode
(DataNode.java:shutdown(574)) - Waiting for threadgroup to exit, active threads
is 0
[junit] Shutting down DataNode 0
[junit] 2008-09-20 13:21:35,548 INFO util.ThreadedServer
(ThreadedServer.java:run(656)) - Stopping Acceptor
ServerSocket[addr=localhost/127.0.0.1,port=0,localport=59262]
[junit] 2008-09-20 13:21:35,549 INFO http.SocketListener
(SocketListener.java:stop(212)) - Stopped SocketListener on 127.0.0.1:59262
[junit] 2008-09-20 13:21:35,618 INFO util.Container
(Container.java:stop(156)) - Stopped HttpContext[/static,/static]
[junit] 2008-09-20 13:21:35,682 INFO util.Container
(Container.java:stop(156)) - Stopped HttpContext[/logs,/logs]
[junit] 2008-09-20 13:21:35,682 INFO util.Container
(Container.java:stop(156)) - Stopped [EMAIL PROTECTED]
[junit] 2008-09-20 13:21:35,749 INFO util.Container
(Container.java:stop(156)) - Stopped WebApplicationContext[/,/]
[junit] 2008-09-20 13:21:35,749 INFO util.Container
(Container.java:stop(156)) - Stopped [EMAIL PROTECTED]
[junit] 2008-09-20 13:21:35,750 INFO ipc.Server (Server.java:stop(992)) -
Stopping server on 59263
[junit] 2008-09-20 13:21:35,750 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 0 on 59263: exiting
[junit] 2008-09-20 13:21:35,750 INFO ipc.Server (Server.java:run(330)) -
Stopping IPC Server listener on 59263
[junit] 2008-09-20 13:21:35,751 WARN datanode.DataNode
(DataXceiverServer.java:run(90)) - DatanodeRegistration(127.0.0.1:59261,
storageID=DS-787030575-140.211.11.106-59261-1221916890856, infoPort=59262,
ipcPort=59263):DataXceiveServer: java.nio.channels.AsynchronousCloseException
[junit] at
java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:185)
[junit] at
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:152)
[junit] at
sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:84)
[junit] at
org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:85)
[junit] at java.lang.Thread.run(Thread.java:619)
[junit]
[junit] 2008-09-20 13:21:35,751 INFO datanode.DataNode
(DataNode.java:shutdown(574)) - Waiting for threadgroup to exit, active threads
is 1
[junit] 2008-09-20 13:21:35,752 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 1 on 59263: exiting
[junit] 2008-09-20 13:21:35,752 INFO ipc.Server (Server.java:run(502)) -
Stopping IPC Server Responder
[junit] 2008-09-20 13:21:35,752 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 2 on 59263: exiting
[junit] 2008-09-20 13:21:36,196 INFO datanode.DataBlockScanner
(DataBlockScanner.java:run(599)) - Exiting DataBlockScanner thread.
[junit] 2008-09-20 13:21:36,756 INFO datanode.DataNode
(DataNode.java:shutdown(574)) - Waiting for threadgroup to exit, active threads
is 0
[junit] 2008-09-20 13:21:36,756 INFO datanode.DataNode
(DataNode.java:run(1130)) - DatanodeRegistration(127.0.0.1:59261,
storageID=DS-787030575-140.211.11.106-59261-1221916890856, infoPort=59262,
ipcPort=59263):Finishing DataNode in:
FSDataset{dirpath='/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/test/data/dfs/data/data1/current,/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/test/data/dfs/data/data2/current'}
[junit] 2008-09-20 13:21:36,757 INFO ipc.Server (Server.java:stop(992)) -
Stopping server on 59263
[junit] 2008-09-20 13:21:36,757 INFO datanode.DataNode
(DataNode.java:shutdown(574)) - Waiting for threadgroup to exit, active threads
is 0
[junit] 2008-09-20 13:21:36,758 INFO http.SocketListener
(SocketListener.java:stop(212)) - Stopped SocketListener on 127.0.0.1:59258
[junit] 2008-09-20 13:21:36,822 INFO util.Container
(Container.java:stop(156)) - Stopped HttpContext[/static,/static]
[junit] 2008-09-20 13:21:36,888 INFO util.Container
(Container.java:stop(156)) - Stopped HttpContext[/logs,/logs]
[junit] 2008-09-20 13:21:36,889 INFO util.Container
(Container.java:stop(156)) - Stopped [EMAIL PROTECTED]
[junit] 2008-09-20 13:21:36,950 INFO util.Container
(Container.java:stop(156)) - Stopped WebApplicationContext[/,/]
[junit] 2008-09-20 13:21:36,951 INFO util.Container
(Container.java:stop(156)) - Stopped [EMAIL PROTECTED]
[junit] 2008-09-20 13:21:36,951 WARN namenode.FSNamesystem
(FSNamesystem.java:run(2271)) - ReplicationMonitor thread received
InterruptedException.java.lang.InterruptedException: sleep interrupted
[junit] 2008-09-20 13:21:36,951 INFO namenode.FSNamesystem
(FSEditLog.java:printStatistics(959)) - Number of transactions: 12 Total time
for transactions(ms): 2 Number of syncs: 9 SyncTimes(ms): 153 85
[junit] 2008-09-20 13:21:37,000 INFO ipc.Server (Server.java:stop(992)) -
Stopping server on 59257
[junit] 2008-09-20 13:21:37,001 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 3 on 59257: exiting
[junit] 2008-09-20 13:21:37,001 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 6 on 59257: exiting
[junit] 2008-09-20 13:21:37,002 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 0 on 59257: exiting
[junit] 2008-09-20 13:21:37,002 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 1 on 59257: exiting
[junit] 2008-09-20 13:21:37,003 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 2 on 59257: exiting
[junit] 2008-09-20 13:21:37,002 INFO ipc.Server (Server.java:run(330)) -
Stopping IPC Server listener on 59257
[junit] 2008-09-20 13:21:37,005 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 8 on 59257: exiting
[junit] 2008-09-20 13:21:37,004 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 9 on 59257: exiting
[junit] 2008-09-20 13:21:37,004 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 7 on 59257: exiting
[junit] 2008-09-20 13:21:37,004 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 5 on 59257: exiting
[junit] 2008-09-20 13:21:37,003 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 4 on 59257: exiting
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 13.885 sec
[junit] Running org.apache.hadoop.security.TestUnixUserGroupInformation
[junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.417 sec
[junit] Running org.apache.hadoop.util.TestGenericsUtil
[junit] 2008-09-20 13:21:38,403 WARN util.GenericOptionsParser
(GenericOptionsParser.java:parseGeneralOptions(348)) - options parsing failed:
Missing argument for option:jt
[junit] usage: general options are:
[junit] -archives <paths> comma separated archives to be
unarchived
[junit] on the compute machines.
[junit] -conf <configuration file> specify an application configuration
file
[junit] -D <property=value> use value for given property
[junit] -files <paths> comma separated files to be copied
to the
[junit] map reduce cluster
[junit] -fs <local|namenode:port> specify a namenode
[junit] -jt <local|jobtracker:port> specify a job tracker
[junit] -libjars <paths> comma separated jar files to include
in the
[junit] classpath.
[junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 0.184 sec
[junit] Running org.apache.hadoop.util.TestIndexedSort
[junit] sortRandom seed:
-324995284491724884(org.apache.hadoop.util.QuickSort)
[junit] testSorted seed:
5162691180813237525(org.apache.hadoop.util.QuickSort)
[junit] testAllEqual setting min/max at
147/40(org.apache.hadoop.util.QuickSort)
[junit] sortWritable seed:
1926832272379234422(org.apache.hadoop.util.QuickSort)
[junit] QuickSort degen cmp/swp:
23252/3713(org.apache.hadoop.util.QuickSort)
[junit] sortRandom seed:
-6388555961047791958(org.apache.hadoop.util.HeapSort)
[junit] testSorted seed:
5221113769607664700(org.apache.hadoop.util.HeapSort)
[junit] testAllEqual setting min/max at
283/95(org.apache.hadoop.util.HeapSort)
[junit] sortWritable seed:
5841441678014910709(org.apache.hadoop.util.HeapSort)
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 1.551 sec
[junit] Running org.apache.hadoop.util.TestProcfsBasedProcessTree
[junit] 2008-09-20 13:21:40,863 INFO mapred.ProcfsBasedProcessTree
(ProcfsBasedProcessTree.java:isAvailable(76)) -
ProcfsBasedProcfsBasedProcessTree currently is supported only on Linux and
Windows
[junit] ProcfsBasedProcessTree is not available on this system. Not testing
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.054 sec
[junit] Running org.apache.hadoop.util.TestReflectionUtils
[junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.684 sec
[junit] Running org.apache.hadoop.util.TestShell
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.242 sec
[junit] Running org.apache.hadoop.util.TestStringUtils
[junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.083 sec
BUILD FAILED
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build.xml:661:
Tests failed!
Total time: 123 minutes 23 seconds
Recording fingerprints
Publishing Javadoc
Recording test results
