See http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/629/changes
Changes:
[ddas] HADOOP-4288. Fixes a NPE problem in CapacityScheduler. Contributed by
Amar Kamat.
[dhruba] HADOOP-4018. The number of tasks for a single job cannot exceed a
pre-configured maximum value. (dhruba)
------------------------------------------
[...truncated 236681 lines...]
[junit] 2008-10-10 15:41:57,970 INFO DataNode.clienttrace
(BlockReceiver.java:run(907)) - src: /127.0.0.1:49965, dest: /127.0.0.1:49955,
bytes: 100, op: HDFS_WRITE, cliID: DFSClient_330873645, srvID:
DS-694933253-140.211.11.106-49955-1223653316359, blockid:
blk_5009266154553082156_1001
[junit] 2008-10-10 15:41:57,970 INFO datanode.DataNode
(BlockReceiver.java:run(971)) - PacketResponder 1 for block
blk_5009266154553082156_1001 terminating
[junit] 2008-10-10 15:41:57,971 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 9 on 49951,
ugi=null
[junit] 2008-10-10 15:41:57,972 INFO hdfs.StateChange
(FSNamesystem.java:addStoredBlock(2881)) - BLOCK* NameSystem.addStoredBlock:
blockMap updated: 127.0.0.1:49955 is added to blk_5009266154553082156_1001 size
100
[junit] 2008-10-10 15:41:57,972 INFO DataNode.clienttrace
(BlockReceiver.java:run(907)) - src: /127.0.0.1:49964, dest: /127.0.0.1:49958,
bytes: 100, op: HDFS_WRITE, cliID: DFSClient_330873645, srvID:
DS-1933457745-140.211.11.106-49958-1223653317130, blockid:
blk_5009266154553082156_1001
[junit] 2008-10-10 15:41:57,973 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 9 on 49951,
ugi=null
[junit] 2008-10-10 15:41:57,974 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 9 on 49951,
ugi=null
[junit] 2008-10-10 15:41:57,975 INFO hdfs.StateChange
(FSNamesystem.java:addStoredBlock(2881)) - BLOCK* NameSystem.addStoredBlock:
blockMap updated: 127.0.0.1:49958 is added to blk_5009266154553082156_1001 size
100
[junit] 2008-10-10 15:41:57,975 INFO datanode.DataNode
(BlockReceiver.java:run(971)) - PacketResponder 2 for block
blk_5009266154553082156_1001 terminating
[junit] 2008-10-10 15:41:57,975 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 9 on 49951,
ugi=null
[junit] 2008-10-10 15:41:57,978 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 4 on 49951,
ugi=hudson,hudson
[junit] 2008-10-10 15:41:58,000 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 4 on 49951,
ugi=null
[junit] 2008-10-10 15:41:58,001 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 3 on 49951,
ugi=hudson,hudson
[junit] 2008-10-10 15:41:58,001 DEBUG security.UserGroupInformation
(PermissionChecker.java:<init>(40)) - ugi=hudson,hudson
[junit] 2008-10-10 15:41:58,018 INFO FSNamesystem.audit
(FSNamesystem.java:logAuditEvent(108)) - ugi=hudson,hudson ip=/127.0.0.1
cmd=setPermission src=/data/file1 dst=null
perm=hudson:supergroup:rw-------
[junit] 2008-10-10 15:41:58,019 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 3 on 49951,
ugi=null
[junit] 2008-10-10 15:41:58,022 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 1 on 49951,
ugi=hudson,hudson
[junit] 2008-10-10 15:41:58,023 DEBUG security.UserGroupInformation
(PermissionChecker.java:<init>(40)) - ugi=hudson,hudson
[junit] 2008-10-10 15:41:58,025 INFO FSNamesystem.audit
(FSNamesystem.java:logAuditEvent(108)) - ugi=hudson,hudson ip=/127.0.0.1
cmd=open src=/data/file1 dst=null perm=null
[junit] 2008-10-10 15:41:58,025 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 1 on 49951,
ugi=null
[junit] 2008-10-10 15:41:58,033 INFO DataNode.clienttrace
(BlockSender.java:sendBlock(398)) - src: /127.0.0.1:49958, dest:
/127.0.0.1:49967, bytes: 104, op: HDFS_READ, cliID: DFSClient_330873645, srvID:
DS-1933457745-140.211.11.106-49958-1223653317130, blockid:
blk_5009266154553082156_1001
[junit] 2008-10-10 15:41:58,035 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 6 on 49951,
ugi=user1064471074,group1,group2
[junit] 2008-10-10 15:41:58,035 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 6 on 49951,
ugi=null
[junit] 2008-10-10 15:41:58,042 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 7 on 49951,
ugi=user1064471074,group1,group2
[junit] 2008-10-10 15:41:58,044 DEBUG security.UserGroupInformation
(PermissionChecker.java:<init>(40)) - ugi=user1064471074,group1,group2
[junit] 2008-10-10 15:41:58,044 DEBUG security.UserGroupInformation
(PermissionChecker.java:checkPermission(88)) - ACCESS CHECK: [EMAIL PROTECTED],
doCheckOwner=false, ancestorAccess=null, parentAccess=null, access=null,
subAccess=null
[junit] 2008-10-10 15:41:58,045 INFO FSNamesystem.audit
(FSNamesystem.java:logAuditEvent(108)) - ugi=user1064471074,group1,group2
ip=/127.0.0.1 cmd=mkdirs src=/data/child1 dst=null
perm=hudson:supergroup:rwxr-xr-x
[junit] 2008-10-10 15:41:58,046 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 7 on 49951,
ugi=null
[junit] 2008-10-10 15:41:58,047 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 0 on 49951,
ugi=user1064471074,group1,group2
[junit] 2008-10-10 15:41:58,047 DEBUG security.UserGroupInformation
(PermissionChecker.java:<init>(40)) - ugi=user1064471074,group1,group2
[junit] 2008-10-10 15:41:58,048 DEBUG security.UserGroupInformation
(PermissionChecker.java:checkPermission(88)) - ACCESS CHECK: [EMAIL PROTECTED],
doCheckOwner=false, ancestorAccess=null, parentAccess=null, access=null,
subAccess=null
[junit] 2008-10-10 15:41:58,048 DEBUG security.UserGroupInformation
(PermissionChecker.java:<init>(40)) - ugi=user1064471074,group1,group2
[junit] 2008-10-10 15:41:58,049 DEBUG security.UserGroupInformation
(PermissionChecker.java:checkPermission(88)) - ACCESS CHECK: [EMAIL PROTECTED],
doCheckOwner=false, ancestorAccess=WRITE, parentAccess=null, access=null,
subAccess=null
[junit] 2008-10-10 15:41:58,049 INFO ipc.Server (Server.java:run(890)) -
IPC Server handler 0 on 49951, call mkdirs(/data/child2, rwxr-xr-x) from
127.0.0.1:49968: error: org.apache.hadoop.fs.permission.AccessControlException:
Permission denied: user=user1064471074, access=WRITE,
inode="data":hudson:supergroup:rwxr-xr-x
[junit] org.apache.hadoop.fs.permission.AccessControlException: Permission
denied: user=user1064471074, access=WRITE,
inode="data":hudson:supergroup:rwxr-xr-x
[junit] at
org.apache.hadoop.hdfs.server.namenode.PermissionChecker.check(PermissionChecker.java:175)
[junit] at
org.apache.hadoop.hdfs.server.namenode.PermissionChecker.check(PermissionChecker.java:156)
[junit] at
org.apache.hadoop.hdfs.server.namenode.PermissionChecker.checkPermission(PermissionChecker.java:104)
[junit] at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:4329)
[junit] at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkAncestorAccess(FSNamesystem.java:4299)
[junit] at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirsInternal(FSNamesystem.java:1732)
[junit] at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:1701)
[junit] at
org.apache.hadoop.hdfs.server.namenode.NameNode.mkdirs(NameNode.java:471)
[junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit] at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit] at java.lang.reflect.Method.invoke(Method.java:597)
[junit] at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:452)
[junit] at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888)
[junit] 2008-10-10 15:41:58,050 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 0 on 49951,
ugi=null
[junit] 2008-10-10 15:41:58,052 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 8 on 49951,
ugi=user1064471074,group1,group2
[junit] 2008-10-10 15:41:58,052 DEBUG security.UserGroupInformation
(PermissionChecker.java:<init>(40)) - ugi=user1064471074,group1,group2
[junit] 2008-10-10 15:41:58,053 DEBUG security.UserGroupInformation
(PermissionChecker.java:checkPermission(88)) - ACCESS CHECK: [EMAIL PROTECTED],
doCheckOwner=false, ancestorAccess=WRITE, parentAccess=null, access=null,
subAccess=null
[junit] 2008-10-10 15:41:58,053 INFO ipc.Server (Server.java:run(890)) -
IPC Server handler 8 on 49951, call create(/data/file2, rwxr-xr-x,
DFSClient_-154929498, true, 3, 67108864) from 127.0.0.1:49968: error:
org.apache.hadoop.fs.permission.AccessControlException: Permission denied:
user=user1064471074, access=WRITE, inode="data":hudson:supergroup:rwxr-xr-x
[junit] org.apache.hadoop.fs.permission.AccessControlException: Permission
denied: user=user1064471074, access=WRITE,
inode="data":hudson:supergroup:rwxr-xr-x
[junit] at
org.apache.hadoop.hdfs.server.namenode.PermissionChecker.check(PermissionChecker.java:175)
[junit] at
org.apache.hadoop.hdfs.server.namenode.PermissionChecker.check(PermissionChecker.java:156)
[junit] at
org.apache.hadoop.hdfs.server.namenode.PermissionChecker.checkPermission(PermissionChecker.java:104)
[junit] at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:4329)
[junit] at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkAncestorAccess(FSNamesystem.java:4299)
[junit] at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFileInternal(FSNamesystem.java:1030)
[junit] at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFile(FSNamesystem.java:991)
[junit] at
org.apache.hadoop.hdfs.server.namenode.NameNode.create(NameNode.java:301)
[junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit] at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit] at java.lang.reflect.Method.invoke(Method.java:597)
[junit] at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:452)
[junit] at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888)
[junit] 2008-10-10 15:41:58,055 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 8 on 49951,
ugi=null
[junit] 2008-10-10 15:41:58,056 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 5 on 49951,
ugi=user1064471074,group1,group2
[junit] 2008-10-10 15:41:58,056 DEBUG security.UserGroupInformation
(PermissionChecker.java:<init>(40)) - ugi=user1064471074,group1,group2
[junit] 2008-10-10 15:41:58,057 DEBUG security.UserGroupInformation
(PermissionChecker.java:checkPermission(88)) - ACCESS CHECK: [EMAIL PROTECTED],
doCheckOwner=false, ancestorAccess=null, parentAccess=null, access=READ,
subAccess=null
[junit] 2008-10-10 15:41:58,057 INFO ipc.Server (Server.java:run(890)) -
IPC Server handler 5 on 49951, call getBlockLocations(/data/file1, 0,
671088640) from 127.0.0.1:49968: error:
org.apache.hadoop.fs.permission.AccessControlException: Permission denied:
user=user1064471074, access=READ, inode="file1":hudson:supergroup:rw-------
[junit] org.apache.hadoop.fs.permission.AccessControlException: Permission
denied: user=user1064471074, access=READ,
inode="file1":hudson:supergroup:rw-------
[junit] at
org.apache.hadoop.hdfs.server.namenode.PermissionChecker.check(PermissionChecker.java:175)
[junit] at
org.apache.hadoop.hdfs.server.namenode.PermissionChecker.checkPermission(PermissionChecker.java:110)
[junit] at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:4329)
[junit] at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPathAccess(FSNamesystem.java:4289)
[junit] at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:744)
[junit] at
org.apache.hadoop.hdfs.server.namenode.NameNode.getBlockLocations(NameNode.java:272)
[junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit] at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit] at java.lang.reflect.Method.invoke(Method.java:597)
[junit] at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:452)
[junit] at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888)
[junit] 2008-10-10 15:41:58,058 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 5 on 49951,
ugi=null
[junit] 2008-10-10 15:41:58,060 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 2 on 49951,
ugi=hudson,hudson
[junit] 2008-10-10 15:41:58,060 DEBUG security.UserGroupInformation
(PermissionChecker.java:<init>(40)) - ugi=hudson,hudson
[junit] 2008-10-10 15:41:58,081 INFO FSNamesystem.audit
(FSNamesystem.java:logAuditEvent(108)) - ugi=hudson,hudson ip=/127.0.0.1
cmd=setPermission src=/data dst=null
perm=hudson:supergroup:rwxr-xr-x
[junit] 2008-10-10 15:41:58,082 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 2 on 49951,
ugi=null
[junit] 2008-10-10 15:41:58,083 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 9 on 49951,
ugi=hudson,hudson
[junit] 2008-10-10 15:41:58,084 DEBUG security.UserGroupInformation
(PermissionChecker.java:<init>(40)) - ugi=hudson,hudson
[junit] 2008-10-10 15:41:58,105 INFO FSNamesystem.audit
(FSNamesystem.java:logAuditEvent(108)) - ugi=hudson,hudson ip=/127.0.0.1
cmd=setPermission src=/data/child1 dst=null
perm=hudson:supergroup:rwxrwxrwx
[junit] 2008-10-10 15:41:58,106 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 9 on 49951,
ugi=null
[junit] 2008-10-10 15:41:58,107 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 4 on 49951,
ugi=hudson,hudson
[junit] 2008-10-10 15:41:58,107 DEBUG security.UserGroupInformation
(PermissionChecker.java:<init>(40)) - ugi=hudson,hudson
[junit] 2008-10-10 15:41:58,128 INFO FSNamesystem.audit
(FSNamesystem.java:logAuditEvent(108)) - ugi=hudson,hudson ip=/127.0.0.1
cmd=setPermission src=/ dst=null perm=hudson:supergroup:rwxrwxrwx
[junit] 2008-10-10 15:41:58,128 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 4 on 49951,
ugi=null
[junit] 2008-10-10 15:41:58,129 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 3 on 49951,
ugi=user1064471074,group1,group2
[junit] 2008-10-10 15:41:58,130 DEBUG security.UserGroupInformation
(PermissionChecker.java:<init>(40)) - ugi=user1064471074,group1,group2
[junit] 2008-10-10 15:41:58,130 DEBUG security.UserGroupInformation
(PermissionChecker.java:checkPermission(88)) - ACCESS CHECK: [EMAIL PROTECTED],
doCheckOwner=false, ancestorAccess=null, parentAccess=null, access=null,
subAccess=null
[junit] 2008-10-10 15:41:58,130 DEBUG security.UserGroupInformation
(PermissionChecker.java:<init>(40)) - ugi=user1064471074,group1,group2
[junit] 2008-10-10 15:41:58,131 DEBUG security.UserGroupInformation
(PermissionChecker.java:checkPermission(88)) - ACCESS CHECK: [EMAIL PROTECTED],
doCheckOwner=false, ancestorAccess=WRITE, parentAccess=null, access=null,
subAccess=null
[junit] 2008-10-10 15:41:58,158 INFO FSNamesystem.audit
(FSNamesystem.java:logAuditEvent(108)) - ugi=user1064471074,group1,group2
ip=/127.0.0.1 cmd=mkdirs src=/foo/bar dst=null
perm=user1064471074:supergroup:rwxr-xr-x
[junit] 2008-10-10 15:41:58,158 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 3 on 49951,
ugi=null
[junit] 2008-10-10 15:41:58,159 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 1 on 49951,
ugi=user1064471074,group1,group2
[junit] 2008-10-10 15:41:58,160 DEBUG security.UserGroupInformation
(PermissionChecker.java:<init>(40)) - ugi=user1064471074,group1,group2
[junit] 2008-10-10 15:41:58,160 DEBUG security.UserGroupInformation
(PermissionChecker.java:checkPermission(88)) - ACCESS CHECK: [EMAIL PROTECTED],
doCheckOwner=false, ancestorAccess=null, parentAccess=WRITE, access=null,
subAccess=null
[junit] 2008-10-10 15:41:58,161 DEBUG security.UserGroupInformation
(PermissionChecker.java:<init>(40)) - ugi=user1064471074,group1,group2
[junit] 2008-10-10 15:41:58,161 DEBUG security.UserGroupInformation
(PermissionChecker.java:checkPermission(88)) - ACCESS CHECK: [EMAIL PROTECTED],
doCheckOwner=false, ancestorAccess=WRITE, parentAccess=null, access=null,
subAccess=null
[junit] 2008-10-10 15:41:58,185 INFO FSNamesystem.audit
(FSNamesystem.java:logAuditEvent(108)) - ugi=user1064471074,group1,group2
ip=/127.0.0.1 cmd=rename src=/foo/bar dst=/data/child1
perm=hudson:supergroup:rwxrwxrwx
[junit] 2008-10-10 15:41:58,186 DEBUG security.UserGroupInformation
(UserGroupInformation.java:setCurrentUGI(46)) - IPC Server handler 1 on 49951,
ugi=null
[junit] Shutting down the Mini HDFS Cluster
[junit] Shutting down DataNode 2
[junit] 2008-10-10 15:41:58,188 INFO http.SocketListener
(SocketListener.java:stop(212)) - Stopped SocketListener on 127.0.0.1:49962
[junit] 2008-10-10 15:41:58,396 INFO util.Container
(Container.java:stop(156)) - Stopped HttpContext[/static,/static]
[junit] 2008-10-10 15:41:58,465 INFO util.Container
(Container.java:stop(156)) - Stopped HttpContext[/logs,/logs]
[junit] 2008-10-10 15:41:58,465 INFO util.Container
(Container.java:stop(156)) - Stopped [EMAIL PROTECTED]
[junit] 2008-10-10 15:41:58,544 INFO util.Container
(Container.java:stop(156)) - Stopped WebApplicationContext[/,/]
[junit] 2008-10-10 15:41:58,544 INFO util.Container
(Container.java:stop(156)) - Stopped [EMAIL PROTECTED]
[junit] 2008-10-10 15:41:58,549 INFO ipc.Server (Server.java:stop(992)) -
Stopping server on 49963
[junit] 2008-10-10 15:41:58,549 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 0 on 49963: exiting
[junit] 2008-10-10 15:41:58,550 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 1 on 49963: exiting
[junit] 2008-10-10 15:41:58,550 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 2 on 49963: exiting
[junit] 2008-10-10 15:41:58,550 INFO ipc.Server (Server.java:run(330)) -
Stopping IPC Server listener on 49963
[junit] 2008-10-10 15:41:58,552 WARN datanode.DataNode
(DataXceiverServer.java:run(134)) - DatanodeRegistration(127.0.0.1:49961,
storageID=DS-865286393-140.211.11.106-49961-1223653317771, infoPort=49962,
ipcPort=49963):DataXceiveServer: java.nio.channels.AsynchronousCloseException
[junit] at
java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:185)
[junit] at
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:152)
[junit] at
sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:84)
[junit] at
org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:129)
[junit] at java.lang.Thread.run(Thread.java:619)
[junit]
[junit] 2008-10-10 15:41:58,553 INFO datanode.DataNode
(DataNode.java:shutdown(562)) - Waiting for threadgroup to exit, active threads
is 0
[junit] 2008-10-10 15:41:58,553 INFO datanode.DataBlockScanner
(DataBlockScanner.java:run(599)) - Exiting DataBlockScanner thread.
[junit] 2008-10-10 15:41:58,554 INFO datanode.DataNode
(DataNode.java:run(1118)) - DatanodeRegistration(127.0.0.1:49961,
storageID=DS-865286393-140.211.11.106-49961-1223653317771, infoPort=49962,
ipcPort=49963):Finishing DataNode in:
FSDataset{dirpath='/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/test/data/dfs/data/data5/current,/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/test/data/dfs/data/data6/current'}
[junit] 2008-10-10 15:41:58,554 INFO ipc.Server (Server.java:stop(992)) -
Stopping server on 49963
[junit] 2008-10-10 15:41:58,555 INFO datanode.DataNode
(DataNode.java:shutdown(562)) - Waiting for threadgroup to exit, active threads
is 0
[junit] Shutting down DataNode 1
[junit] 2008-10-10 15:41:58,556 INFO util.ThreadedServer
(ThreadedServer.java:run(656)) - Stopping Acceptor
ServerSocket[addr=localhost/127.0.0.1,port=0,localport=49959]
[junit] 2008-10-10 15:41:58,557 INFO http.SocketListener
(SocketListener.java:stop(212)) - Stopped SocketListener on 127.0.0.1:49959
[junit] 2008-10-10 15:41:58,626 INFO util.Container
(Container.java:stop(156)) - Stopped HttpContext[/static,/static]
[junit] 2008-10-10 15:41:58,694 INFO util.Container
(Container.java:stop(156)) - Stopped HttpContext[/logs,/logs]
[junit] 2008-10-10 15:41:58,695 INFO util.Container
(Container.java:stop(156)) - Stopped [EMAIL PROTECTED]
[junit] 2008-10-10 15:41:58,761 INFO util.Container
(Container.java:stop(156)) - Stopped WebApplicationContext[/,/]
[junit] 2008-10-10 15:41:58,761 INFO util.Container
(Container.java:stop(156)) - Stopped [EMAIL PROTECTED]
[junit] 2008-10-10 15:41:58,762 INFO ipc.Server (Server.java:stop(992)) -
Stopping server on 49960
[junit] 2008-10-10 15:41:58,762 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 0 on 49960: exiting
[junit] 2008-10-10 15:41:58,763 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 1 on 49960: exiting
[junit] 2008-10-10 15:41:58,763 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 2 on 49960: exiting
[junit] 2008-10-10 15:41:58,764 INFO ipc.Server (Server.java:run(330)) -
Stopping IPC Server listener on 49960
[junit] 2008-10-10 15:41:58,765 WARN datanode.DataNode
(DataXceiverServer.java:run(134)) - DatanodeRegistration(127.0.0.1:49958,
storageID=DS-1933457745-140.211.11.106-49958-1223653317130, infoPort=49959,
ipcPort=49960):DataXceiveServer: java.nio.channels.AsynchronousCloseException
[junit] at
java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:185)
[junit] at
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:152)
[junit] at
sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:84)
[junit] at
org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:129)
[junit] at java.lang.Thread.run(Thread.java:619)
[junit]
[junit] 2008-10-10 15:41:58,766 INFO datanode.DataNode
(DataNode.java:shutdown(562)) - Waiting for threadgroup to exit, active threads
is 1
[junit] 2008-10-10 15:41:58,767 INFO datanode.DataBlockScanner
(DataBlockScanner.java:run(599)) - Exiting DataBlockScanner thread.
[junit] 2008-10-10 15:41:58,767 INFO datanode.DataNode
(DataNode.java:run(1118)) - DatanodeRegistration(127.0.0.1:49958,
storageID=DS-1933457745-140.211.11.106-49958-1223653317130, infoPort=49959,
ipcPort=49960):Finishing DataNode in:
FSDataset{dirpath='/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/test/data/dfs/data/data3/current,/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/test/data/dfs/data/data4/current'}
[junit] 2008-10-10 15:41:58,767 INFO ipc.Server (Server.java:stop(992)) -
Stopping server on 49960
[junit] 2008-10-10 15:41:58,768 INFO datanode.DataNode
(DataNode.java:shutdown(562)) - Waiting for threadgroup to exit, active threads
is 0
[junit] Shutting down DataNode 0
[junit] 2008-10-10 15:41:58,769 INFO http.SocketListener
(SocketListener.java:stop(212)) - Stopped SocketListener on 127.0.0.1:49956
[junit] 2008-10-10 15:41:58,839 INFO util.Container
(Container.java:stop(156)) - Stopped HttpContext[/static,/static]
[junit] 2008-10-10 15:41:58,903 INFO util.Container
(Container.java:stop(156)) - Stopped HttpContext[/logs,/logs]
[junit] 2008-10-10 15:41:58,903 INFO util.Container
(Container.java:stop(156)) - Stopped [EMAIL PROTECTED]
[junit] 2008-10-10 15:41:58,970 INFO util.Container
(Container.java:stop(156)) - Stopped WebApplicationContext[/,/]
[junit] 2008-10-10 15:41:58,970 INFO util.Container
(Container.java:stop(156)) - Stopped [EMAIL PROTECTED]
[junit] 2008-10-10 15:41:58,971 INFO ipc.Server (Server.java:stop(992)) -
Stopping server on 49957
[junit] 2008-10-10 15:41:58,971 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 0 on 49957: exiting
[junit] 2008-10-10 15:41:58,971 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 1 on 49957: exiting
[junit] 2008-10-10 15:41:58,972 INFO ipc.Server (Server.java:run(330)) -
Stopping IPC Server listener on 49957
[junit] 2008-10-10 15:41:58,972 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 2 on 49957: exiting
[junit] 2008-10-10 15:41:58,972 INFO ipc.Server (Server.java:run(502)) -
Stopping IPC Server Responder
[junit] 2008-10-10 15:41:58,973 INFO datanode.DataNode
(DataNode.java:shutdown(562)) - Waiting for threadgroup to exit, active threads
is 1
[junit] 2008-10-10 15:41:58,974 INFO datanode.DataBlockScanner
(DataBlockScanner.java:run(599)) - Exiting DataBlockScanner thread.
[junit] 2008-10-10 15:41:58,974 INFO datanode.DataNode
(DataNode.java:run(1118)) - DatanodeRegistration(127.0.0.1:49955,
storageID=DS-694933253-140.211.11.106-49955-1223653316359, infoPort=49956,
ipcPort=49957):Finishing DataNode in:
FSDataset{dirpath='/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/test/data/dfs/data/data1/current,/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build/test/data/dfs/data/data2/current'}
[junit] 2008-10-10 15:41:58,974 INFO ipc.Server (Server.java:stop(992)) -
Stopping server on 49957
[junit] 2008-10-10 15:41:58,975 INFO datanode.DataNode
(DataNode.java:shutdown(562)) - Waiting for threadgroup to exit, active threads
is 0
[junit] 2008-10-10 15:41:58,976 INFO http.SocketListener
(SocketListener.java:stop(212)) - Stopped SocketListener on 127.0.0.1:49952
[junit] 2008-10-10 15:41:59,039 INFO util.Container
(Container.java:stop(156)) - Stopped HttpContext[/static,/static]
[junit] 2008-10-10 15:41:59,105 INFO util.Container
(Container.java:stop(156)) - Stopped HttpContext[/logs,/logs]
[junit] 2008-10-10 15:41:59,105 INFO util.Container
(Container.java:stop(156)) - Stopped [EMAIL PROTECTED]
[junit] 2008-10-10 15:41:59,167 INFO util.Container
(Container.java:stop(156)) - Stopped WebApplicationContext[/,/]
[junit] 2008-10-10 15:41:59,167 INFO util.Container
(Container.java:stop(156)) - Stopped [EMAIL PROTECTED]
[junit] 2008-10-10 15:41:59,167 INFO namenode.FSNamesystem
(FSEditLog.java:printStatistics(959)) - Number of transactions: 12 Total time
for transactions(ms): 2 Number of syncs: 9 SyncTimes(ms): 88 92
[junit] 2008-10-10 15:41:59,168 WARN namenode.FSNamesystem
(FSNamesystem.java:run(2271)) - ReplicationMonitor thread received
InterruptedException.java.lang.InterruptedException: sleep interrupted
[junit] 2008-10-10 15:41:59,190 INFO ipc.Server (Server.java:stop(992)) -
Stopping server on 49951
[junit] 2008-10-10 15:41:59,190 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 3 on 49951: exiting
[junit] 2008-10-10 15:41:59,191 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 6 on 49951: exiting
[junit] 2008-10-10 15:41:59,191 INFO ipc.Server (Server.java:run(330)) -
Stopping IPC Server listener on 49951
[junit] 2008-10-10 15:41:59,191 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 0 on 49951: exiting
[junit] 2008-10-10 15:41:59,191 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 2 on 49951: exiting
[junit] 2008-10-10 15:41:59,191 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 1 on 49951: exiting
[junit] 2008-10-10 15:41:59,193 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 9 on 49951: exiting
[junit] 2008-10-10 15:41:59,192 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 8 on 49951: exiting
[junit] 2008-10-10 15:41:59,192 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 7 on 49951: exiting
[junit] 2008-10-10 15:41:59,192 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 5 on 49951: exiting
[junit] 2008-10-10 15:41:59,191 INFO ipc.Server (Server.java:run(920)) -
IPC Server handler 4 on 49951: exiting
[junit] 2008-10-10 15:41:59,194 INFO ipc.Server (Server.java:run(502)) -
Stopping IPC Server Responder
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 13.302 sec
[junit] Running org.apache.hadoop.security.TestUnixUserGroupInformation
[junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.375 sec
[junit] Running org.apache.hadoop.util.TestGenericsUtil
[junit] 2008-10-10 15:42:00,702 WARN util.GenericOptionsParser
(GenericOptionsParser.java:parseGeneralOptions(348)) - options parsing failed:
Missing argument for option:jt
[junit] usage: general options are:
[junit] -archives <paths> comma separated archives to be
unarchived
[junit] on the compute machines.
[junit] -conf <configuration file> specify an application configuration
file
[junit] -D <property=value> use value for given property
[junit] -files <paths> comma separated files to be copied
to the
[junit] map reduce cluster
[junit] -fs <local|namenode:port> specify a namenode
[junit] -jt <local|jobtracker:port> specify a job tracker
[junit] -libjars <paths> comma separated jar files to include
in the
[junit] classpath.
[junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 0.183 sec
[junit] Running org.apache.hadoop.util.TestIndexedSort
[junit] sortRandom seed:
8264914348522483333(org.apache.hadoop.util.QuickSort)
[junit] testSorted seed:
-4059700146167338654(org.apache.hadoop.util.QuickSort)
[junit] testAllEqual setting min/max at
285/66(org.apache.hadoop.util.QuickSort)
[junit] sortWritable seed:
-3171317456526063242(org.apache.hadoop.util.QuickSort)
[junit] QuickSort degen cmp/swp:
23252/3713(org.apache.hadoop.util.QuickSort)
[junit] sortRandom seed:
-4332090743575632349(org.apache.hadoop.util.HeapSort)
[junit] testSorted seed:
5620139733230605802(org.apache.hadoop.util.HeapSort)
[junit] testAllEqual setting min/max at
371/25(org.apache.hadoop.util.HeapSort)
[junit] sortWritable seed:
2091165302683699037(org.apache.hadoop.util.HeapSort)
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 1.298 sec
[junit] Running org.apache.hadoop.util.TestProcfsBasedProcessTree
[junit] 2008-10-10 15:42:02,912 INFO mapred.ProcfsBasedProcessTree
(ProcfsBasedProcessTree.java:isAvailable(76)) - ProcfsBasedProcessTree
currently is supported only on Linux.
[junit] ProcfsBasedProcessTree is not available on this system. Not testing
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.054 sec
[junit] Running org.apache.hadoop.util.TestReflectionUtils
[junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.703 sec
[junit] Running org.apache.hadoop.util.TestShell
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.23 sec
[junit] Running org.apache.hadoop.util.TestStringUtils
[junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.066 sec
BUILD FAILED
/zonestorage/hudson/home/hudson/hudson/jobs/Hadoop-trunk/workspace/trunk/build.xml:662:
Tests failed!
Total time: 127 minutes 12 seconds
Recording fingerprints
Publishing Javadoc
Recording test results