See http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/638/changes
Changes: [cdouglas] HADOOP-4464. Separate out TestFileCreationClient from TestFileCreation. Contributed by Tsz Wo (Nicholas), SZE. [cdouglas] HADOOP-4424. Change menu layout for Hadoop documentation. Contributed by Boris Shkolnik. [dhruba] HADOOP-4399. Make fuse-dfs multi-thread access safe. (Pete Wyckoff via dhruba) [hairong] HADOOP-4430. Namenode Web UI capacity report is inconsistent with Balancer. Contributed by Suresh Srinivas. [omalley] HADOOP-4321. Include documentation for the capacity scheduler. (Hemanth Yamijala via omalley) [johan] HADOOP-4238. If scheduling information isn't available print NA instead of empty output. (Sreekanth Ramakrishnan via johan) [ddas] HADOOP-4457. Fixes an input split logging problem introduced by HADOOP-3245. Contributed by Amareshwari Sriramadasu. [dhruba] HADOOP-4399. Make fuse-dfs multi-thread access safe. (Pete Wyckoff via dhruba) [dhruba] HADOOP-4399. Make fuse-dfs multi-thread access safe. (Pete Wyckoff via dhruba) ------------------------------------------ [...truncated 255116 lines...] [junit] 2008-10-20 22:15:11,038 INFO datanode.DataNode (DataXceiver.java:writeBlock(227)) - Receiving block blk_89993147198074002_1001 src: /127.0.0.1:39478 dest: /127.0.0.1:39475 [junit] 2008-10-20 22:15:11,041 INFO datanode.DataNode (DataXceiver.java:writeBlock(227)) - Receiving block blk_89993147198074002_1001 src: /127.0.0.1:39479 dest: /127.0.0.1:39469 [junit] 2008-10-20 22:15:11,042 INFO datanode.DataNode (DataXceiver.java:writeBlock(227)) - Receiving block blk_89993147198074002_1001 src: /127.0.0.1:39480 dest: /127.0.0.1:39472 [junit] 2008-10-20 22:15:11,047 INFO DataNode.clienttrace (BlockReceiver.java:lastDataNodeRun(784)) - src: /127.0.0.1:39480, dest: /127.0.0.1:39472, bytes: 100, op: HDFS_WRITE, cliID: DFSClient_1113127989, srvID: DS-1556293714-140.211.11.106-39472-1224540910186, blockid: blk_89993147198074002_1001 [junit] 2008-10-20 22:15:11,048 DEBUG security.UserGroupInformation (UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 9 on 39465, ugi=null [junit] 2008-10-20 22:15:11,048 INFO datanode.DataNode (BlockReceiver.java:lastDataNodeRun(808)) - PacketResponder 0 for block blk_89993147198074002_1001 terminating [junit] 2008-10-20 22:15:11,050 DEBUG security.UserGroupInformation (UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 6 on 39465, ugi=null [junit] 2008-10-20 22:15:11,050 INFO DataNode.clienttrace (BlockReceiver.java:run(907)) - src: /127.0.0.1:39479, dest: /127.0.0.1:39469, bytes: 100, op: HDFS_WRITE, cliID: DFSClient_1113127989, srvID: DS-1815513393-140.211.11.106-39469-1224540909386, blockid: blk_89993147198074002_1001 [junit] 2008-10-20 22:15:11,049 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(2890)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:39472 is added to blk_89993147198074002_1001 size 100 [junit] 2008-10-20 22:15:11,052 INFO datanode.DataNode (BlockReceiver.java:run(971)) - PacketResponder 1 for block blk_89993147198074002_1001 terminating [junit] 2008-10-20 22:15:11,053 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(2890)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:39469 is added to blk_89993147198074002_1001 size 100 [junit] 2008-10-20 22:15:11,053 DEBUG security.UserGroupInformation (UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 9 on 39465, ugi=null [junit] 2008-10-20 22:15:11,054 DEBUG security.UserGroupInformation (UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 6 on 39465, ugi=null [junit] 2008-10-20 22:15:11,055 INFO DataNode.clienttrace (BlockReceiver.java:run(907)) - src: /127.0.0.1:39478, dest: /127.0.0.1:39475, bytes: 100, op: HDFS_WRITE, cliID: DFSClient_1113127989, srvID: DS-1840184229-140.211.11.106-39475-1224540910806, blockid: blk_89993147198074002_1001 [junit] 2008-10-20 22:15:11,055 INFO datanode.DataNode (BlockReceiver.java:run(971)) - PacketResponder 2 for block blk_89993147198074002_1001 terminating [junit] 2008-10-20 22:15:11,057 DEBUG security.UserGroupInformation (UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 7 on 39465, ugi=hudson,hudson [junit] 2008-10-20 22:15:11,057 DEBUG security.UserGroupInformation (UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 2 on 39465, ugi=null [junit] 2008-10-20 22:15:11,059 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(2890)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:39475 is added to blk_89993147198074002_1001 size 100 [junit] 2008-10-20 22:15:11,059 DEBUG security.UserGroupInformation (UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 2 on 39465, ugi=null [junit] 2008-10-20 22:15:11,075 DEBUG security.UserGroupInformation (UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 7 on 39465, ugi=null [junit] 2008-10-20 22:15:11,076 DEBUG security.UserGroupInformation (UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 0 on 39465, ugi=hudson,hudson [junit] 2008-10-20 22:15:11,076 DEBUG security.UserGroupInformation (PermissionChecker.java:<init>(41)) - ugi=hudson,hudson [junit] 2008-10-20 22:15:11,145 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(109)) - ugi=hudson,hudson ip=/127.0.0.1 cmd=setPermission src=/data/file1 dst=null perm=hudson:supergroup:rw------- [junit] 2008-10-20 22:15:11,145 DEBUG security.UserGroupInformation (UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 0 on 39465, ugi=null [junit] 2008-10-20 22:15:11,150 DEBUG security.UserGroupInformation (UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 3 on 39465, ugi=hudson,hudson [junit] 2008-10-20 22:15:11,151 DEBUG security.UserGroupInformation (PermissionChecker.java:<init>(41)) - ugi=hudson,hudson [junit] 2008-10-20 22:15:11,153 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(109)) - ugi=hudson,hudson ip=/127.0.0.1 cmd=open src=/data/file1 dst=null perm=null [junit] 2008-10-20 22:15:11,153 DEBUG security.UserGroupInformation (UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 3 on 39465, ugi=null [junit] 2008-10-20 22:15:11,165 INFO DataNode.clienttrace (BlockSender.java:sendBlock(398)) - src: /127.0.0.1:39472, dest: /127.0.0.1:39481, bytes: 104, op: HDFS_READ, cliID: DFSClient_1113127989, srvID: DS-1556293714-140.211.11.106-39472-1224540910186, blockid: blk_89993147198074002_1001 [junit] 2008-10-20 22:15:11,179 DEBUG security.UserGroupInformation (UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 4 on 39465, ugi=user-1758078905,group1,group2 [junit] 2008-10-20 22:15:11,179 DEBUG security.UserGroupInformation (UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 4 on 39465, ugi=null [junit] 2008-10-20 22:15:11,182 DEBUG security.UserGroupInformation (UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 5 on 39465, ugi=user-1758078905,group1,group2 [junit] 2008-10-20 22:15:11,182 DEBUG security.UserGroupInformation (PermissionChecker.java:<init>(41)) - ugi=user-1758078905,group1,group2 [junit] 2008-10-20 22:15:11,183 DEBUG security.UserGroupInformation (PermissionChecker.java:checkPermission(89)) - ACCESS CHECK: [EMAIL PROTECTED], doCheckOwner=false, ancestorAccess=null, parentAccess=null, access=null, subAccess=null [junit] 2008-10-20 22:15:11,184 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(109)) - ugi=user-1758078905,group1,group2 ip=/127.0.0.1 cmd=mkdirs src=/data/child1 dst=null perm=hudson:supergroup:rwxr-xr-x [junit] 2008-10-20 22:15:11,186 DEBUG security.UserGroupInformation (UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 5 on 39465, ugi=null [junit] 2008-10-20 22:15:11,188 DEBUG security.UserGroupInformation (UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 8 on 39465, ugi=user-1758078905,group1,group2 [junit] 2008-10-20 22:15:11,188 DEBUG security.UserGroupInformation (PermissionChecker.java:<init>(41)) - ugi=user-1758078905,group1,group2 [junit] 2008-10-20 22:15:11,189 DEBUG security.UserGroupInformation (PermissionChecker.java:checkPermission(89)) - ACCESS CHECK: [EMAIL PROTECTED], doCheckOwner=false, ancestorAccess=null, parentAccess=null, access=null, subAccess=null [junit] 2008-10-20 22:15:11,189 DEBUG security.UserGroupInformation (PermissionChecker.java:<init>(41)) - ugi=user-1758078905,group1,group2 [junit] 2008-10-20 22:15:11,190 DEBUG security.UserGroupInformation (PermissionChecker.java:checkPermission(89)) - ACCESS CHECK: [EMAIL PROTECTED], doCheckOwner=false, ancestorAccess=WRITE, parentAccess=null, access=null, subAccess=null [junit] 2008-10-20 22:15:11,190 INFO ipc.Server (Server.java:run(890)) - IPC Server handler 8 on 39465, call mkdirs(/data/child2, rwxr-xr-x) from 127.0.0.1:39482: error: org.apache.hadoop.security.AccessControlException: Permission denied: user=user-1758078905, access=WRITE, inode="data":hudson:supergroup:rwxr-xr-x [junit] org.apache.hadoop.security.AccessControlException: Permission denied: user=user-1758078905, access=WRITE, inode="data":hudson:supergroup:rwxr-xr-x [junit] at org.apache.hadoop.hdfs.server.namenode.PermissionChecker.check(PermissionChecker.java:176) [junit] at org.apache.hadoop.hdfs.server.namenode.PermissionChecker.check(PermissionChecker.java:157) [junit] at org.apache.hadoop.hdfs.server.namenode.PermissionChecker.checkPermission(PermissionChecker.java:105) [junit] at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:4357) [junit] at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkAncestorAccess(FSNamesystem.java:4327) [junit] at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirsInternal(FSNamesystem.java:1744) [junit] at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:1713) [junit] at org.apache.hadoop.hdfs.server.namenode.NameNode.mkdirs(NameNode.java:471) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) [junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) [junit] at java.lang.reflect.Method.invoke(Method.java:597) [junit] at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:452) [junit] at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888) [junit] 2008-10-20 22:15:11,191 DEBUG security.UserGroupInformation (UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 8 on 39465, ugi=null [junit] 2008-10-20 22:15:11,195 DEBUG security.UserGroupInformation (UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 1 on 39465, ugi=user-1758078905,group1,group2 [junit] 2008-10-20 22:15:11,195 DEBUG security.UserGroupInformation (PermissionChecker.java:<init>(41)) - ugi=user-1758078905,group1,group2 [junit] 2008-10-20 22:15:11,196 DEBUG security.UserGroupInformation (PermissionChecker.java:checkPermission(89)) - ACCESS CHECK: [EMAIL PROTECTED], doCheckOwner=false, ancestorAccess=WRITE, parentAccess=null, access=null, subAccess=null [junit] 2008-10-20 22:15:11,196 INFO ipc.Server (Server.java:run(890)) - IPC Server handler 1 on 39465, call create(/data/file2, rwxr-xr-x, DFSClient_1321736162, true, 3, 67108864) from 127.0.0.1:39482: error: org.apache.hadoop.security.AccessControlException: Permission denied: user=user-1758078905, access=WRITE, inode="data":hudson:supergroup:rwxr-xr-x [junit] org.apache.hadoop.security.AccessControlException: Permission denied: user=user-1758078905, access=WRITE, inode="data":hudson:supergroup:rwxr-xr-x [junit] at org.apache.hadoop.hdfs.server.namenode.PermissionChecker.check(PermissionChecker.java:176) [junit] at org.apache.hadoop.hdfs.server.namenode.PermissionChecker.check(PermissionChecker.java:157) [junit] at org.apache.hadoop.hdfs.server.namenode.PermissionChecker.checkPermission(PermissionChecker.java:105) [junit] at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:4357) [junit] at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkAncestorAccess(FSNamesystem.java:4327) [junit] at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFileInternal(FSNamesystem.java:1034) [junit] at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFile(FSNamesystem.java:995) [junit] at org.apache.hadoop.hdfs.server.namenode.NameNode.create(NameNode.java:301) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) [junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) [junit] at java.lang.reflect.Method.invoke(Method.java:597) [junit] at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:452) [junit] at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888) [junit] 2008-10-20 22:15:11,198 DEBUG security.UserGroupInformation (UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 1 on 39465, ugi=null [junit] 2008-10-20 22:15:11,210 DEBUG security.UserGroupInformation (UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 9 on 39465, ugi=user-1758078905,group1,group2 [junit] 2008-10-20 22:15:11,211 DEBUG security.UserGroupInformation (PermissionChecker.java:<init>(41)) - ugi=user-1758078905,group1,group2 [junit] 2008-10-20 22:15:11,211 DEBUG security.UserGroupInformation (PermissionChecker.java:checkPermission(89)) - ACCESS CHECK: [EMAIL PROTECTED], doCheckOwner=false, ancestorAccess=null, parentAccess=null, access=READ, subAccess=null [junit] 2008-10-20 22:15:11,212 INFO ipc.Server (Server.java:run(890)) - IPC Server handler 9 on 39465, call getBlockLocations(/data/file1, 0, 671088640) from 127.0.0.1:39482: error: org.apache.hadoop.security.AccessControlException: Permission denied: user=user-1758078905, access=READ, inode="file1":hudson:supergroup:rw------- [junit] org.apache.hadoop.security.AccessControlException: Permission denied: user=user-1758078905, access=READ, inode="file1":hudson:supergroup:rw------- [junit] at org.apache.hadoop.hdfs.server.namenode.PermissionChecker.check(PermissionChecker.java:176) [junit] at org.apache.hadoop.hdfs.server.namenode.PermissionChecker.checkPermission(PermissionChecker.java:111) [junit] at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:4357) [junit] at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPathAccess(FSNamesystem.java:4317) [junit] at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:745) [junit] at org.apache.hadoop.hdfs.server.namenode.NameNode.getBlockLocations(NameNode.java:272) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) [junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) [junit] at java.lang.reflect.Method.invoke(Method.java:597) [junit] at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:452) [junit] at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888) [junit] 2008-10-20 22:15:11,212 DEBUG security.UserGroupInformation (UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 9 on 39465, ugi=null [junit] 2008-10-20 22:15:11,214 DEBUG security.UserGroupInformation (UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 6 on 39465, ugi=hudson,hudson [junit] 2008-10-20 22:15:11,215 DEBUG security.UserGroupInformation (PermissionChecker.java:<init>(41)) - ugi=hudson,hudson [junit] 2008-10-20 22:15:11,597 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(109)) - ugi=hudson,hudson ip=/127.0.0.1 cmd=setPermission src=/data dst=null perm=hudson:supergroup:rwxr-xr-x [junit] 2008-10-20 22:15:11,599 DEBUG security.UserGroupInformation (UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 6 on 39465, ugi=null [junit] 2008-10-20 22:15:11,600 DEBUG security.UserGroupInformation (UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 2 on 39465, ugi=hudson,hudson [junit] 2008-10-20 22:15:11,600 DEBUG security.UserGroupInformation (PermissionChecker.java:<init>(41)) - ugi=hudson,hudson [junit] 2008-10-20 22:15:11,648 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(109)) - ugi=hudson,hudson ip=/127.0.0.1 cmd=setPermission src=/data/child1 dst=null perm=hudson:supergroup:rwxrwxrwx [junit] 2008-10-20 22:15:11,648 DEBUG security.UserGroupInformation (UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 2 on 39465, ugi=null [junit] 2008-10-20 22:15:11,649 DEBUG security.UserGroupInformation (UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 7 on 39465, ugi=hudson,hudson [junit] 2008-10-20 22:15:11,650 DEBUG security.UserGroupInformation (PermissionChecker.java:<init>(41)) - ugi=hudson,hudson [junit] 2008-10-20 22:15:11,679 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(109)) - ugi=hudson,hudson ip=/127.0.0.1 cmd=setPermission src=/ dst=null perm=hudson:supergroup:rwxrwxrwx [junit] 2008-10-20 22:15:11,679 DEBUG security.UserGroupInformation (UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 7 on 39465, ugi=null [junit] 2008-10-20 22:15:11,680 DEBUG security.UserGroupInformation (UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 0 on 39465, ugi=user-1758078905,group1,group2 [junit] 2008-10-20 22:15:11,680 DEBUG security.UserGroupInformation (PermissionChecker.java:<init>(41)) - ugi=user-1758078905,group1,group2 [junit] 2008-10-20 22:15:11,681 DEBUG security.UserGroupInformation (PermissionChecker.java:checkPermission(89)) - ACCESS CHECK: [EMAIL PROTECTED], doCheckOwner=false, ancestorAccess=null, parentAccess=null, access=null, subAccess=null [junit] 2008-10-20 22:15:11,681 DEBUG security.UserGroupInformation (PermissionChecker.java:<init>(41)) - ugi=user-1758078905,group1,group2 [junit] 2008-10-20 22:15:11,681 DEBUG security.UserGroupInformation (PermissionChecker.java:checkPermission(89)) - ACCESS CHECK: [EMAIL PROTECTED], doCheckOwner=false, ancestorAccess=WRITE, parentAccess=null, access=null, subAccess=null [junit] 2008-10-20 22:15:11,706 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(109)) - ugi=user-1758078905,group1,group2 ip=/127.0.0.1 cmd=mkdirs src=/foo/bar dst=null perm=user-1758078905:supergroup:rwxr-xr-x [junit] 2008-10-20 22:15:11,707 DEBUG security.UserGroupInformation (UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 0 on 39465, ugi=null [junit] 2008-10-20 22:15:11,707 DEBUG security.UserGroupInformation (UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 3 on 39465, ugi=user-1758078905,group1,group2 [junit] 2008-10-20 22:15:11,708 DEBUG security.UserGroupInformation (PermissionChecker.java:<init>(41)) - ugi=user-1758078905,group1,group2 [junit] 2008-10-20 22:15:11,709 DEBUG security.UserGroupInformation (PermissionChecker.java:checkPermission(89)) - ACCESS CHECK: [EMAIL PROTECTED], doCheckOwner=false, ancestorAccess=null, parentAccess=WRITE, access=null, subAccess=null [junit] 2008-10-20 22:15:11,709 DEBUG security.UserGroupInformation (PermissionChecker.java:<init>(41)) - ugi=user-1758078905,group1,group2 [junit] 2008-10-20 22:15:11,709 DEBUG security.UserGroupInformation (PermissionChecker.java:checkPermission(89)) - ACCESS CHECK: [EMAIL PROTECTED], doCheckOwner=false, ancestorAccess=WRITE, parentAccess=null, access=null, subAccess=null [junit] 2008-10-20 22:15:11,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(109)) - ugi=user-1758078905,group1,group2 ip=/127.0.0.1 cmd=rename src=/foo/bar dst=/data/child1 perm=hudson:supergroup:rwxrwxrwx [junit] 2008-10-20 22:15:11,742 DEBUG security.UserGroupInformation (UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 3 on 39465, ugi=null [junit] Shutting down the Mini HDFS Cluster [junit] Shutting down DataNode 2 [junit] 2008-10-20 22:15:11,745 INFO http.SocketListener (SocketListener.java:stop(212)) - Stopped SocketListener on 127.0.0.1:39476 [junit] 2008-10-20 22:15:11,954 INFO util.Container (Container.java:stop(156)) - Stopped HttpContext[/static,/static] [junit] 2008-10-20 22:15:12,025 INFO util.Container (Container.java:stop(156)) - Stopped HttpContext[/logs,/logs] [junit] 2008-10-20 22:15:12,026 INFO util.Container (Container.java:stop(156)) - Stopped [EMAIL PROTECTED] [junit] 2008-10-20 22:15:12,109 INFO util.Container (Container.java:stop(156)) - Stopped WebApplicationContext[/,/] [junit] 2008-10-20 22:15:12,109 INFO util.Container (Container.java:stop(156)) - Stopped [EMAIL PROTECTED] [junit] 2008-10-20 22:15:12,110 INFO ipc.Server (Server.java:stop(992)) - Stopping server on 39477 [junit] 2008-10-20 22:15:12,110 INFO ipc.Server (Server.java:run(920)) - IPC Server handler 0 on 39477: exiting [junit] 2008-10-20 22:15:12,110 INFO ipc.Server (Server.java:run(920)) - IPC Server handler 1 on 39477: exiting [junit] 2008-10-20 22:15:12,111 INFO ipc.Server (Server.java:run(330)) - Stopping IPC Server listener on 39477 [junit] 2008-10-20 22:15:12,111 INFO ipc.Server (Server.java:run(920)) - IPC Server handler 2 on 39477: exiting [junit] 2008-10-20 22:15:12,113 INFO ipc.Server (Server.java:run(502)) - Stopping IPC Server Responder [junit] 2008-10-20 22:15:12,113 INFO datanode.DataNode (DataNode.java:shutdown(562)) - Waiting for threadgroup to exit, active threads is 1 [junit] 2008-10-20 22:15:12,114 INFO datanode.DataBlockScanner (DataBlockScanner.java:run(599)) - Exiting DataBlockScanner thread. [junit] 2008-10-20 22:15:12,114 INFO datanode.DataNode (DataNode.java:run(1118)) - DatanodeRegistration(127.0.0.1:39475, storageID=DS-1840184229-140.211.11.106-39475-1224540910806, infoPort=39476, ipcPort=39477):Finishing DataNode in: FSDataset{dirpath='/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/test/data/dfs/data/data5/current,/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/test/data/dfs/data/data6/current'} [junit] 2008-10-20 22:15:12,115 INFO ipc.Server (Server.java:stop(992)) - Stopping server on 39477 [junit] 2008-10-20 22:15:12,115 INFO datanode.DataNode (DataNode.java:shutdown(562)) - Waiting for threadgroup to exit, active threads is 0 [junit] Shutting down DataNode 1 [junit] 2008-10-20 22:15:12,116 INFO http.SocketListener (SocketListener.java:stop(212)) - Stopped SocketListener on 127.0.0.1:39473 [junit] 2008-10-20 22:15:12,188 INFO util.Container (Container.java:stop(156)) - Stopped HttpContext[/static,/static] [junit] 2008-10-20 22:15:12,257 INFO util.Container (Container.java:stop(156)) - Stopped HttpContext[/logs,/logs] [junit] 2008-10-20 22:15:12,257 INFO util.Container (Container.java:stop(156)) - Stopped [EMAIL PROTECTED] [junit] 2008-10-20 22:15:12,326 INFO util.Container (Container.java:stop(156)) - Stopped WebApplicationContext[/,/] [junit] 2008-10-20 22:15:12,327 INFO util.Container (Container.java:stop(156)) - Stopped [EMAIL PROTECTED] [junit] 2008-10-20 22:15:12,327 INFO ipc.Server (Server.java:stop(992)) - Stopping server on 39474 [junit] 2008-10-20 22:15:12,327 INFO ipc.Server (Server.java:run(920)) - IPC Server handler 0 on 39474: exiting [junit] 2008-10-20 22:15:12,327 INFO ipc.Server (Server.java:run(920)) - IPC Server handler 1 on 39474: exiting [junit] 2008-10-20 22:15:12,328 INFO ipc.Server (Server.java:run(920)) - IPC Server handler 2 on 39474: exiting [junit] 2008-10-20 22:15:12,328 INFO ipc.Server (Server.java:run(330)) - Stopping IPC Server listener on 39474 [junit] 2008-10-20 22:15:12,329 INFO datanode.DataNode (DataNode.java:shutdown(562)) - Waiting for threadgroup to exit, active threads is 1 [junit] 2008-10-20 22:15:12,330 INFO datanode.DataBlockScanner (DataBlockScanner.java:run(599)) - Exiting DataBlockScanner thread. [junit] 2008-10-20 22:15:12,330 INFO datanode.DataNode (DataNode.java:run(1118)) - DatanodeRegistration(127.0.0.1:39472, storageID=DS-1556293714-140.211.11.106-39472-1224540910186, infoPort=39473, ipcPort=39474):Finishing DataNode in: FSDataset{dirpath='/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/test/data/dfs/data/data3/current,/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/test/data/dfs/data/data4/current'} [junit] 2008-10-20 22:15:12,331 INFO ipc.Server (Server.java:stop(992)) - Stopping server on 39474 [junit] 2008-10-20 22:15:12,331 INFO datanode.DataNode (DataNode.java:shutdown(562)) - Waiting for threadgroup to exit, active threads is 0 [junit] Shutting down DataNode 0 [junit] 2008-10-20 22:15:12,333 INFO http.SocketListener (SocketListener.java:stop(212)) - Stopped SocketListener on 127.0.0.1:39470 [junit] 2008-10-20 22:15:12,404 INFO util.Container (Container.java:stop(156)) - Stopped HttpContext[/static,/static] [junit] 2008-10-20 22:15:12,470 INFO util.Container (Container.java:stop(156)) - Stopped HttpContext[/logs,/logs] [junit] 2008-10-20 22:15:12,470 INFO util.Container (Container.java:stop(156)) - Stopped [EMAIL PROTECTED] [junit] 2008-10-20 22:15:12,538 INFO util.Container (Container.java:stop(156)) - Stopped WebApplicationContext[/,/] [junit] 2008-10-20 22:15:12,538 INFO util.Container (Container.java:stop(156)) - Stopped [EMAIL PROTECTED] [junit] 2008-10-20 22:15:12,538 INFO ipc.Server (Server.java:stop(992)) - Stopping server on 39471 [junit] 2008-10-20 22:15:12,539 INFO ipc.Server (Server.java:run(920)) - IPC Server handler 0 on 39471: exiting [junit] 2008-10-20 22:15:12,539 INFO ipc.Server (Server.java:run(920)) - IPC Server handler 1 on 39471: exiting [junit] 2008-10-20 22:15:12,540 INFO ipc.Server (Server.java:run(920)) - IPC Server handler 2 on 39471: exiting [junit] 2008-10-20 22:15:12,540 INFO ipc.Server (Server.java:run(330)) - Stopping IPC Server listener on 39471 [junit] 2008-10-20 22:15:12,541 WARN datanode.DataNode (DataXceiverServer.java:run(134)) - DatanodeRegistration(127.0.0.1:39469, storageID=DS-1815513393-140.211.11.106-39469-1224540909386, infoPort=39470, ipcPort=39471):DataXceiveServer: java.nio.channels.AsynchronousCloseException [junit] at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:185) [junit] at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:152) [junit] at sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:84) [junit] at org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:129) [junit] at java.lang.Thread.run(Thread.java:619) [junit] [junit] 2008-10-20 22:15:12,542 INFO datanode.DataNode (DataNode.java:shutdown(562)) - Waiting for threadgroup to exit, active threads is 1 [junit] 2008-10-20 22:15:12,542 INFO datanode.DataBlockScanner (DataBlockScanner.java:run(599)) - Exiting DataBlockScanner thread. [junit] 2008-10-20 22:15:12,543 INFO datanode.DataNode (DataNode.java:run(1118)) - DatanodeRegistration(127.0.0.1:39469, storageID=DS-1815513393-140.211.11.106-39469-1224540909386, infoPort=39470, ipcPort=39471):Finishing DataNode in: FSDataset{dirpath='/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/test/data/dfs/data/data1/current,/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/test/data/dfs/data/data2/current'} [junit] 2008-10-20 22:15:12,543 INFO ipc.Server (Server.java:stop(992)) - Stopping server on 39471 [junit] 2008-10-20 22:15:12,544 INFO datanode.DataNode (DataNode.java:shutdown(562)) - Waiting for threadgroup to exit, active threads is 0 [junit] 2008-10-20 22:15:12,545 INFO http.SocketListener (SocketListener.java:stop(212)) - Stopped SocketListener on 127.0.0.1:39466 [junit] 2008-10-20 22:15:12,610 INFO util.Container (Container.java:stop(156)) - Stopped HttpContext[/static,/static] [junit] 2008-10-20 22:15:12,674 INFO util.Container (Container.java:stop(156)) - Stopped HttpContext[/logs,/logs] [junit] 2008-10-20 22:15:12,674 INFO util.Container (Container.java:stop(156)) - Stopped [EMAIL PROTECTED] [junit] 2008-10-20 22:15:12,736 INFO util.Container (Container.java:stop(156)) - Stopped WebApplicationContext[/,/] [junit] 2008-10-20 22:15:12,736 INFO util.Container (Container.java:stop(156)) - Stopped [EMAIL PROTECTED] [junit] 2008-10-20 22:15:12,736 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(965)) - Number of transactions: 12 Total time for transactions(ms): 0 Number of syncs: 9 SyncTimes(ms): 448 186 [junit] 2008-10-20 22:15:12,737 WARN namenode.FSNamesystem (FSNamesystem.java:run(2280)) - ReplicationMonitor thread received InterruptedException.java.lang.InterruptedException: sleep interrupted [junit] 2008-10-20 22:15:12,769 INFO ipc.Server (Server.java:stop(992)) - Stopping server on 39465 [junit] 2008-10-20 22:15:12,770 INFO ipc.Server (Server.java:run(920)) - IPC Server handler 0 on 39465: exiting [junit] 2008-10-20 22:15:12,770 INFO ipc.Server (Server.java:run(330)) - Stopping IPC Server listener on 39465 [junit] 2008-10-20 22:15:12,771 INFO ipc.Server (Server.java:run(920)) - IPC Server handler 9 on 39465: exiting [junit] 2008-10-20 22:15:12,771 INFO ipc.Server (Server.java:run(920)) - IPC Server handler 7 on 39465: exiting [junit] 2008-10-20 22:15:12,771 INFO ipc.Server (Server.java:run(920)) - IPC Server handler 3 on 39465: exiting [junit] 2008-10-20 22:15:12,771 INFO ipc.Server (Server.java:run(920)) - IPC Server handler 2 on 39465: exiting [junit] 2008-10-20 22:15:12,771 INFO ipc.Server (Server.java:run(920)) - IPC Server handler 1 on 39465: exiting [junit] 2008-10-20 22:15:12,771 INFO ipc.Server (Server.java:run(920)) - IPC Server handler 8 on 39465: exiting [junit] 2008-10-20 22:15:12,771 INFO ipc.Server (Server.java:run(920)) - IPC Server handler 5 on 39465: exiting [junit] 2008-10-20 22:15:12,771 INFO ipc.Server (Server.java:run(920)) - IPC Server handler 6 on 39465: exiting [junit] 2008-10-20 22:15:12,770 INFO ipc.Server (Server.java:run(920)) - IPC Server handler 4 on 39465: exiting [junit] 2008-10-20 22:15:12,773 INFO ipc.Server (Server.java:run(502)) - Stopping IPC Server Responder [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 11.685 sec [junit] Running org.apache.hadoop.security.TestUnixUserGroupInformation [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.397 sec [junit] Running org.apache.hadoop.util.TestGenericsUtil [junit] 2008-10-20 22:15:14,217 WARN util.GenericOptionsParser (GenericOptionsParser.java:parseGeneralOptions(348)) - options parsing failed: Missing argument for option:jt [junit] usage: general options are: [junit] -archives <paths> comma separated archives to be unarchived [junit] on the compute machines. [junit] -conf <configuration file> specify an application configuration file [junit] -D <property=value> use value for given property [junit] -files <paths> comma separated files to be copied to the [junit] map reduce cluster [junit] -fs <local|namenode:port> specify a namenode [junit] -jt <local|jobtracker:port> specify a job tracker [junit] -libjars <paths> comma separated jar files to include in the [junit] classpath. [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 0.187 sec [junit] Running org.apache.hadoop.util.TestIndexedSort [junit] sortRandom seed: -2039651456857250409(org.apache.hadoop.util.QuickSort) [junit] testSorted seed: 369743503660768429(org.apache.hadoop.util.QuickSort) [junit] testAllEqual setting min/max at 495/47(org.apache.hadoop.util.QuickSort) [junit] sortWritable seed: 7204071983675936389(org.apache.hadoop.util.QuickSort) [junit] QuickSort degen cmp/swp: 23252/3713(org.apache.hadoop.util.QuickSort) [junit] sortRandom seed: 3804381038414684427(org.apache.hadoop.util.HeapSort) [junit] testSorted seed: -3003553492794349698(org.apache.hadoop.util.HeapSort) [junit] testAllEqual setting min/max at 40/206(org.apache.hadoop.util.HeapSort) [junit] sortWritable seed: -2966072645898052295(org.apache.hadoop.util.HeapSort) [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 1.432 sec [junit] Running org.apache.hadoop.util.TestProcfsBasedProcessTree [junit] 2008-10-20 22:15:16,629 INFO mapred.ProcfsBasedProcessTree (ProcfsBasedProcessTree.java:isAvailable(76)) - ProcfsBasedProcessTree currently is supported only on Linux. [junit] ProcfsBasedProcessTree is not available on this system. Not testing [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.054 sec [junit] Running org.apache.hadoop.util.TestReflectionUtils [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.675 sec [junit] Running org.apache.hadoop.util.TestShell [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.235 sec [junit] Running org.apache.hadoop.util.TestStringUtils [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.073 sec BUILD FAILED /zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build.xml:666: Tests failed! Total time: 129 minutes 12 seconds Recording fingerprints Publishing Javadoc Recording test results