See <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/191/changes>
Changes:
[kihwal] HDFS-8131. Implement a space balanced block placement policy.
Contributed by Liu Shaohui.
[xgong] YARN-3601. Fix UT TestRMFailover.testRMWebAppRedirect. Contributed by
Weiwei Yang
[raviprak] YARN-3302. TestDockerContainerExecutor should run automatically if
it can detect docker in the usual place (Ravindra Kumar Naik via raviprak)
[cmccabe] HADOOP-11970. Replace uses of ThreadLocal<Random> with JDK7
ThreadLocalRandom (Sean Busbey via Colin P. McCabe)
[kihwal] HDFS-8404. Pending block replication can get stuck using older
genstamp. Contributed by Nathan Roberts.
[junping_du] Moving MAPREDUCE-6361 to 2.7.1 CHANGES.txt
[Arun Suresh] HADOOP-11973. Ensure ZkDelegationTokenSecretManager namespace
znodes get created with ACLs. (Gregory Chanan via asuresh)
[cnauroth] HADOOP-11963. Metrics documentation for FSNamesystem misspells
PendingDataNodeMessageCount. Contributed by Anu Engineer.
[jianhe] YARN-2821. Fixed a problem that DistributedShell AM may hang if
restarted. Contributed by Varun Vasudev
[aw] HADOOP-12000. cannot use --java-home in test-patch (aw)
[wangda] YARN-3565. NodeHeartbeatRequest/RegisterNodeManagerRequest should use
NodeLabel object instead of String. (Naganarasimha G R via wangda)
[wangda] YARN-3583. Support of NodeLabel object instead of plain String in
YarnClient side. (Sunil G via wangda)
[ozawa] YARN-3677. Fix findbugs warnings in yarn-server-resourcemanager.
Contributed by Vinod Kumar Vavilapalli.
[wheat9] HADOOP-11995. Make jetty version configurable from the maven command
line. Contributed by Sriharsha Devineni.
[aajisaka] HADOOP-11698. Remove DistCpV1 and Logalyzer. Contributed by Brahma
Reddy Battula.
------------------------------------------
[...truncated 8401 lines...]
[exec] 2015-05-20 14:54:01,909 INFO datanode.DataNode
(BlockPoolManager.java:refreshNamenodes(149)) - Refresh request received for
nameservices: null
[exec] 2015-05-20 14:54:01,911 INFO datanode.DataNode
(BlockPoolManager.java:doRefreshNamenodes(194)) - Starting BPOfferServices for
nameservices: <default>
[exec] 2015-05-20 14:54:01,921 INFO datanode.DataNode
(BPServiceActor.java:run(791)) - Block pool <registering> (Datanode Uuid
unassigned) service to localhost/127.0.0.1:44516 starting to offer service
[exec] 2015-05-20 14:54:01,929 INFO ipc.Server (Server.java:run(852)) -
IPC Server Responder: starting
[exec] 2015-05-20 14:54:01,929 INFO ipc.Server (Server.java:run(692)) -
IPC Server listener on 56237: starting
[exec] 2015-05-20 14:54:02,183 INFO common.Storage
(Storage.java:tryLock(715)) - Lock on
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/in_use.lock>
acquired by nodename [email protected]
[exec] 2015-05-20 14:54:02,184 INFO common.Storage
(DataStorage.java:loadStorageDirectory(272)) - Storage directory
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1>
is not formatted for BP-1718295274-67.195.81.149-1432133639955
[exec] 2015-05-20 14:54:02,184 INFO common.Storage
(DataStorage.java:loadStorageDirectory(274)) - Formatting ...
[exec] 2015-05-20 14:54:02,204 INFO common.Storage
(BlockPoolSliceStorage.java:recoverTransitionRead(241)) - Analyzing storage
directories for bpid BP-1718295274-67.195.81.149-1432133639955
[exec] 2015-05-20 14:54:02,204 INFO common.Storage
(Storage.java:lock(675)) - Locking is disabled for
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current/BP-1718295274-67.195.81.149-1432133639955>
[exec] 2015-05-20 14:54:02,204 INFO common.Storage
(BlockPoolSliceStorage.java:loadStorageDirectory(158)) - Block pool storage
directory
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current/BP-1718295274-67.195.81.149-1432133639955>
is not formatted for BP-1718295274-67.195.81.149-1432133639955
[exec] 2015-05-20 14:54:02,204 INFO common.Storage
(BlockPoolSliceStorage.java:loadStorageDirectory(160)) - Formatting ...
[exec] 2015-05-20 14:54:02,204 INFO common.Storage
(BlockPoolSliceStorage.java:format(267)) - Formatting block pool
BP-1718295274-67.195.81.149-1432133639955 directory
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current/BP-1718295274-67.195.81.149-1432133639955/current>
[exec] 2015-05-20 14:54:02,206 INFO common.Storage
(Storage.java:tryLock(715)) - Lock on
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/in_use.lock>
acquired by nodename [email protected]
[exec] 2015-05-20 14:54:02,207 INFO common.Storage
(DataStorage.java:loadStorageDirectory(272)) - Storage directory
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2>
is not formatted for BP-1718295274-67.195.81.149-1432133639955
[exec] 2015-05-20 14:54:02,207 INFO common.Storage
(DataStorage.java:loadStorageDirectory(274)) - Formatting ...
[exec] 2015-05-20 14:54:02,223 INFO common.Storage
(BlockPoolSliceStorage.java:recoverTransitionRead(241)) - Analyzing storage
directories for bpid BP-1718295274-67.195.81.149-1432133639955
[exec] 2015-05-20 14:54:02,223 INFO common.Storage
(Storage.java:lock(675)) - Locking is disabled for
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current/BP-1718295274-67.195.81.149-1432133639955>
[exec] 2015-05-20 14:54:02,224 INFO common.Storage
(BlockPoolSliceStorage.java:loadStorageDirectory(158)) - Block pool storage
directory
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current/BP-1718295274-67.195.81.149-1432133639955>
is not formatted for BP-1718295274-67.195.81.149-1432133639955
[exec] 2015-05-20 14:54:02,224 INFO common.Storage
(BlockPoolSliceStorage.java:loadStorageDirectory(160)) - Formatting ...
[exec] 2015-05-20 14:54:02,224 INFO common.Storage
(BlockPoolSliceStorage.java:format(267)) - Formatting block pool
BP-1718295274-67.195.81.149-1432133639955 directory
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current/BP-1718295274-67.195.81.149-1432133639955/current>
[exec] 2015-05-20 14:54:02,225 INFO datanode.DataNode
(DataNode.java:initStorage(1405)) - Setting up storage:
nsid=8655174;bpid=BP-1718295274-67.195.81.149-1432133639955;lv=-56;nsInfo=lv=-63;cid=testClusterID;nsid=8655174;c=0;bpid=BP-1718295274-67.195.81.149-1432133639955;dnuuid=null
[exec] 2015-05-20 14:54:02,227 INFO datanode.DataNode
(DataNode.java:checkDatanodeUuid(1234)) - Generated and persisted new Datanode
UUID 3946e6b1-482b-4bae-9c70-4df44fa6e173
[exec] 2015-05-20 14:54:02,248 INFO impl.FsDatasetImpl
(FsVolumeList.java:addVolume(305)) - Added new volume:
DS-a7872c5a-683a-4769-8bff-4c1682e8ec25
[exec] 2015-05-20 14:54:02,248 INFO impl.FsDatasetImpl
(FsDatasetImpl.java:addVolume(403)) - Added volume -
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current,>
StorageType: DISK
[exec] 2015-05-20 14:54:02,248 INFO impl.FsDatasetImpl
(FsVolumeList.java:addVolume(305)) - Added new volume:
DS-bb4ebb37-a7af-44a5-aa75-d9e9c3943f23
[exec] 2015-05-20 14:54:02,248 INFO impl.FsDatasetImpl
(FsDatasetImpl.java:addVolume(403)) - Added volume -
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current,>
StorageType: DISK
[exec] 2015-05-20 14:54:02,251 INFO impl.FsDatasetImpl
(FsDatasetImpl.java:registerMBean(2079)) - Registered FSDatasetState MBean
[exec] 2015-05-20 14:54:02,258 INFO datanode.DirectoryScanner
(DirectoryScanner.java:start(333)) - Periodic Directory Tree Verification scan
starting at 1432150855258 with interval 21600000
[exec] 2015-05-20 14:54:02,258 INFO impl.FsDatasetImpl
(FsDatasetImpl.java:addBlockPool(2535)) - Adding block pool
BP-1718295274-67.195.81.149-1432133639955
[exec] 2015-05-20 14:54:02,259 INFO impl.FsDatasetImpl
(FsVolumeList.java:run(404)) - Scanning block pool
BP-1718295274-67.195.81.149-1432133639955 on volume
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current...>
[exec] 2015-05-20 14:54:02,259 INFO impl.FsDatasetImpl
(FsVolumeList.java:run(404)) - Scanning block pool
BP-1718295274-67.195.81.149-1432133639955 on volume
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current...>
[exec] 2015-05-20 14:54:02,270 INFO impl.FsDatasetImpl
(FsVolumeList.java:run(409)) - Time taken to scan block pool
BP-1718295274-67.195.81.149-1432133639955 on
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current>:
11ms
[exec] 2015-05-20 14:54:02,270 INFO impl.FsDatasetImpl
(FsVolumeList.java:run(409)) - Time taken to scan block pool
BP-1718295274-67.195.81.149-1432133639955 on
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current>:
11ms
[exec] 2015-05-20 14:54:02,270 INFO impl.FsDatasetImpl
(FsVolumeList.java:addBlockPool(435)) - Total time to scan all replicas for
block pool BP-1718295274-67.195.81.149-1432133639955: 11ms
[exec] 2015-05-20 14:54:02,271 INFO impl.FsDatasetImpl
(FsVolumeList.java:run(190)) - Adding replicas to map for block pool
BP-1718295274-67.195.81.149-1432133639955 on volume
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current...>
[exec] 2015-05-20 14:54:02,271 INFO impl.FsDatasetImpl
(FsVolumeList.java:run(190)) - Adding replicas to map for block pool
BP-1718295274-67.195.81.149-1432133639955 on volume
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current...>
[exec] 2015-05-20 14:54:02,271 INFO impl.BlockPoolSlice
(BlockPoolSlice.java:readReplicasFromCache(688)) - Replica Cache file:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current/BP-1718295274-67.195.81.149-1432133639955/current/replicas>
doesn't exist
[exec] 2015-05-20 14:54:02,271 INFO impl.BlockPoolSlice
(BlockPoolSlice.java:readReplicasFromCache(688)) - Replica Cache file:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current/BP-1718295274-67.195.81.149-1432133639955/current/replicas>
doesn't exist
[exec] 2015-05-20 14:54:02,271 INFO impl.FsDatasetImpl
(FsVolumeList.java:run(195)) - Time to add replicas to map for block pool
BP-1718295274-67.195.81.149-1432133639955 on volume
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current>:
0ms
[exec] 2015-05-20 14:54:02,271 INFO impl.FsDatasetImpl
(FsVolumeList.java:run(195)) - Time to add replicas to map for block pool
BP-1718295274-67.195.81.149-1432133639955 on volume
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current>:
0ms
[exec] 2015-05-20 14:54:02,272 INFO impl.FsDatasetImpl
(FsVolumeList.java:getAllVolumesMap(221)) - Total time to add all replicas to
map: 2ms
[exec] 2015-05-20 14:54:02,273 INFO datanode.DataNode
(BPServiceActor.java:register(746)) - Block pool
BP-1718295274-67.195.81.149-1432133639955 (Datanode Uuid
3946e6b1-482b-4bae-9c70-4df44fa6e173) service to localhost/127.0.0.1:44516
beginning handshake with NN
[exec] 2015-05-20 14:54:02,282 INFO hdfs.StateChange
(DatanodeManager.java:registerDatanode(884)) - BLOCK* registerDatanode: from
DatanodeRegistration(127.0.0.1:48741,
datanodeUuid=3946e6b1-482b-4bae-9c70-4df44fa6e173, infoPort=49566,
infoSecurePort=0, ipcPort=56237,
storageInfo=lv=-56;cid=testClusterID;nsid=8655174;c=0) storage
3946e6b1-482b-4bae-9c70-4df44fa6e173
[exec] 2015-05-20 14:54:02,283 INFO blockmanagement.DatanodeDescriptor
(DatanodeDescriptor.java:updateHeartbeatState(448)) - Number of failed storage
changes from 0 to 0
[exec] 2015-05-20 14:54:02,284 INFO net.NetworkTopology
(NetworkTopology.java:add(418)) - Adding a new node:
/default-rack/127.0.0.1:48741
[exec] 2015-05-20 14:54:02,290 INFO datanode.DataNode
(BPServiceActor.java:register(764)) - Block pool Block pool
BP-1718295274-67.195.81.149-1432133639955 (Datanode Uuid
3946e6b1-482b-4bae-9c70-4df44fa6e173) service to localhost/127.0.0.1:44516
successfully registered with NN
[exec] 2015-05-20 14:54:02,291 INFO datanode.DataNode
(BPServiceActor.java:offerService(625)) - For namenode
localhost/127.0.0.1:44516 using BLOCKREPORT_INTERVAL of 21600000msec
CACHEREPORT_INTERVAL of 10000msec Initial delay: 0msec; heartBeatInterval=3000
[exec] 2015-05-20 14:54:02,306 INFO blockmanagement.DatanodeDescriptor
(DatanodeDescriptor.java:updateHeartbeatState(448)) - Number of failed storage
changes from 0 to 0
[exec] 2015-05-20 14:54:02,306 INFO blockmanagement.DatanodeDescriptor
(DatanodeDescriptor.java:updateStorage(859)) - Adding new storage ID
DS-a7872c5a-683a-4769-8bff-4c1682e8ec25 for DN 127.0.0.1:48741
[exec] 2015-05-20 14:54:02,308 INFO blockmanagement.DatanodeDescriptor
(DatanodeDescriptor.java:updateStorage(859)) - Adding new storage ID
DS-bb4ebb37-a7af-44a5-aa75-d9e9c3943f23 for DN 127.0.0.1:48741
[exec] 2015-05-20 14:54:02,319 INFO hdfs.MiniDFSCluster
(MiniDFSCluster.java:waitActive(2299)) - Cluster is active
[exec] 2015-05-20 14:54:02,321 INFO datanode.DataNode
(BPOfferService.java:updateActorStatesFromHeartbeat(511)) - Namenode Block pool
BP-1718295274-67.195.81.149-1432133639955 (Datanode Uuid
3946e6b1-482b-4bae-9c70-4df44fa6e173) service to localhost/127.0.0.1:44516
trying to claim ACTIVE state with txid=1
[exec] 2015-05-20 14:54:02,322 INFO datanode.DataNode
(BPOfferService.java:updateActorStatesFromHeartbeat(523)) - Acknowledging
ACTIVE Namenode Block pool BP-1718295274-67.195.81.149-1432133639955 (Datanode
Uuid 3946e6b1-482b-4bae-9c70-4df44fa6e173) service to localhost/127.0.0.1:44516
[exec] 2015-05-20 14:54:02,325 INFO hdfs.MiniDFSCluster
(MiniDFSCluster.java:shutdown(1728)) - Shutting down the Mini HDFS Cluster
[exec] 2015-05-20 14:54:02,325 INFO hdfs.MiniDFSCluster
(MiniDFSCluster.java:shutdownDataNodes(1773)) - Shutting down DataNode 0
[exec] 2015-05-20 14:54:02,325 WARN datanode.DirectoryScanner
(DirectoryScanner.java:shutdown(379)) - DirectoryScanner: shutdown has been
called
[exec] 2015-05-20 14:54:02,325 INFO datanode.DataNode
(DataXceiverServer.java:closeAllPeers(263)) - Closing all peers.
[exec] 2015-05-20 14:54:02,327 INFO mortbay.log (Slf4jLog.java:info(67))
- Stopped SelectChannelConnector@localhost:0
[exec] 2015-05-20 14:54:02,336 INFO blockmanagement.BlockManager
(BlockManager.java:processReport(1823)) - Processing first storage report for
DS-bb4ebb37-a7af-44a5-aa75-d9e9c3943f23 from datanode
3946e6b1-482b-4bae-9c70-4df44fa6e173
[exec] 2015-05-20 14:54:02,336 INFO BlockStateChange
(BlockManager.java:processReport(1872)) - BLOCK* processReport: from storage
DS-bb4ebb37-a7af-44a5-aa75-d9e9c3943f23 node
DatanodeRegistration(127.0.0.1:48741,
datanodeUuid=3946e6b1-482b-4bae-9c70-4df44fa6e173, infoPort=49566,
infoSecurePort=0, ipcPort=56237,
storageInfo=lv=-56;cid=testClusterID;nsid=8655174;c=0), blocks: 0,
hasStaleStorage: true, processing time: 0 msecs
[exec] 2015-05-20 14:54:02,336 INFO blockmanagement.BlockManager
(BlockManager.java:processReport(1823)) - Processing first storage report for
DS-a7872c5a-683a-4769-8bff-4c1682e8ec25 from datanode
3946e6b1-482b-4bae-9c70-4df44fa6e173
[exec] 2015-05-20 14:54:02,337 INFO BlockStateChange
(BlockManager.java:processReport(1872)) - BLOCK* processReport: from storage
DS-a7872c5a-683a-4769-8bff-4c1682e8ec25 node
DatanodeRegistration(127.0.0.1:48741,
datanodeUuid=3946e6b1-482b-4bae-9c70-4df44fa6e173, infoPort=49566,
infoSecurePort=0, ipcPort=56237,
storageInfo=lv=-56;cid=testClusterID;nsid=8655174;c=0), blocks: 0,
hasStaleStorage: false, processing time: 1 msecs
[exec] 2015-05-20 14:54:02,352 INFO datanode.DataNode
(BPServiceActor.java:blockReport(490)) - Successfully sent block report
0xd47f015b080316a, containing 2 storage report(s), of which we sent 2. The
reports had 0 total blocks and used 1 RPC(s). This took 4 msec to generate and
26 msecs for RPC and NN processing. Got back one command: FinalizeCommand/5.
[exec] 2015-05-20 14:54:02,352 INFO datanode.DataNode
(BPOfferService.java:processCommandFromActive(693)) - Got finalize command for
block pool BP-1718295274-67.195.81.149-1432133639955
[exec] 2015-05-20 14:54:02,438 INFO ipc.Server (Server.java:stop(2569)) -
Stopping server on 56237
[exec] 2015-05-20 14:54:02,438 INFO ipc.Server (Server.java:run(724)) -
Stopping IPC Server listener on 56237
[exec] 2015-05-20 14:54:02,438 INFO ipc.Server (Server.java:run(857)) -
Stopping IPC Server Responder
[exec] 2015-05-20 14:54:02,438 WARN datanode.DataNode
(BPServiceActor.java:offerService(701)) - BPOfferService for Block pool
BP-1718295274-67.195.81.149-1432133639955 (Datanode Uuid
3946e6b1-482b-4bae-9c70-4df44fa6e173) service to localhost/127.0.0.1:44516
interrupted
[exec] 2015-05-20 14:54:02,439 WARN datanode.DataNode
(BPServiceActor.java:run(831)) - Ending block pool service for: Block pool
BP-1718295274-67.195.81.149-1432133639955 (Datanode Uuid
3946e6b1-482b-4bae-9c70-4df44fa6e173) service to localhost/127.0.0.1:44516
[exec] 2015-05-20 14:54:02,540 INFO datanode.DataNode
(BlockPoolManager.java:remove(102)) - Removed Block pool
BP-1718295274-67.195.81.149-1432133639955 (Datanode Uuid
3946e6b1-482b-4bae-9c70-4df44fa6e173)
[exec] 2015-05-20 14:54:02,540 INFO impl.FsDatasetImpl
(FsDatasetImpl.java:shutdownBlockPool(2545)) - Removing block pool
BP-1718295274-67.195.81.149-1432133639955
[exec] 2015-05-20 14:54:02,541 INFO impl.FsDatasetAsyncDiskService
(FsDatasetAsyncDiskService.java:shutdown(183)) - Shutting down all async disk
service threads
[exec] 2015-05-20 14:54:02,542 INFO impl.FsDatasetAsyncDiskService
(FsDatasetAsyncDiskService.java:shutdown(191)) - All async disk service threads
have been shut down
[exec] 2015-05-20 14:54:02,542 INFO impl.RamDiskAsyncLazyPersistService
(RamDiskAsyncLazyPersistService.java:shutdown(165)) - Shutting down all async
lazy persist service threads
[exec] 2015-05-20 14:54:02,542 INFO impl.RamDiskAsyncLazyPersistService
(RamDiskAsyncLazyPersistService.java:shutdown(172)) - All async lazy persist
service threads have been shut down
[exec] 2015-05-20 14:54:02,547 INFO datanode.DataNode
(DataNode.java:shutdown(1821)) - Shutdown complete.
[exec] 2015-05-20 14:54:02,547 INFO namenode.FSNamesystem
(FSNamesystem.java:stopActiveServices(1221)) - Stopping services started for
active state
[exec] 2015-05-20 14:54:02,548 INFO namenode.FSNamesystem
(FSNamesystem.java:run(4405)) - LazyPersistFileScrubber was interrupted, exiting
[exec] 2015-05-20 14:54:02,548 INFO namenode.FSEditLog
(FSEditLog.java:endCurrentLogSegment(1291)) - Ending log segment 1
[exec] 2015-05-20 14:54:02,549 INFO namenode.FSEditLog
(FSEditLog.java:printStatistics(698)) - Number of transactions: 2 Total time
for transactions(ms): 0 Number of transactions batched in Syncs: 0 Number of
syncs: 3 SyncTimes(ms): 3 1
[exec] 2015-05-20 14:54:02,549 INFO namenode.FSNamesystem
(FSNamesystem.java:run(4325)) - NameNodeEditLogRoller was interrupted, exiting
[exec] 2015-05-20 14:54:02,550 INFO namenode.FileJournalManager
(FileJournalManager.java:finalizeLogSegment(134)) - Finalizing edits file
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/name1/current/edits_inprogress_0000000000000000001>
->
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/name1/current/edits_0000000000000000001-0000000000000000002>
[exec] 2015-05-20 14:54:02,552 INFO namenode.FileJournalManager
(FileJournalManager.java:finalizeLogSegment(134)) - Finalizing edits file
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/name2/current/edits_inprogress_0000000000000000001>
->
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/name2/current/edits_0000000000000000001-0000000000000000002>
[exec] 2015-05-20 14:54:02,553 INFO ipc.Server (Server.java:stop(2569)) -
Stopping server on 44516
[exec] 2015-05-20 14:54:02,554 INFO ipc.Server (Server.java:run(724)) -
Stopping IPC Server listener on 44516
[exec] 2015-05-20 14:54:02,555 INFO ipc.Server (Server.java:run(857)) -
Stopping IPC Server Responder
[exec] 2015-05-20 14:54:02,555 INFO blockmanagement.BlockManager
(BlockManager.java:run(3693)) - Stopping ReplicationMonitor.
[exec] 2015-05-20 14:54:02,583 INFO namenode.FSNamesystem
(FSNamesystem.java:stopActiveServices(1221)) - Stopping services started for
active state
[exec] 2015-05-20 14:54:02,584 INFO namenode.FSNamesystem
(FSNamesystem.java:stopStandbyServices(1311)) - Stopping services started for
standby state
[exec] 2015-05-20 14:54:02,585 INFO mortbay.log (Slf4jLog.java:info(67))
- Stopped SelectChannelConnector@localhost:0
[exec] 2015-05-20 14:54:02,686 INFO impl.MetricsSystemImpl
(MetricsSystemImpl.java:stop(211)) - Stopping DataNode metrics system...
[exec] 2015-05-20 14:54:02,687 INFO impl.MetricsSystemImpl
(MetricsSystemImpl.java:stop(217)) - DataNode metrics system stopped.
[exec] 2015-05-20 14:54:02,687 INFO impl.MetricsSystemImpl
(MetricsSystemImpl.java:shutdown(601)) - DataNode metrics system shutdown
complete.
[echo] Finished test_native_mini_dfs
[INFO] Executed tasks
[INFO]
[INFO] --- maven-jar-plugin:2.5:jar (prepare-jar) @ hadoop-hdfs ---
[INFO] Building jar:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/hadoop-hdfs-3.0.0-SNAPSHOT.jar>
[INFO]
[INFO] --- maven-jar-plugin:2.5:test-jar (prepare-test-jar) @ hadoop-hdfs ---
[INFO] Building jar:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/hadoop-hdfs-3.0.0-SNAPSHOT-tests.jar>
[INFO]
[INFO] >>> maven-source-plugin:2.3:jar (default) @ hadoop-hdfs >>>
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- hadoop-maven-plugins:3.0.0-SNAPSHOT:protoc (compile-protoc) @
hadoop-hdfs ---
[INFO]
[INFO] <<< maven-source-plugin:2.3:jar (default) @ hadoop-hdfs <<<
[INFO]
[INFO] --- maven-source-plugin:2.3:jar (default) @ hadoop-hdfs ---
[INFO] Building jar:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/hadoop-hdfs-3.0.0-SNAPSHOT-sources.jar>
[INFO]
[INFO] >>> maven-source-plugin:2.3:test-jar (default) @ hadoop-hdfs >>>
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- hadoop-maven-plugins:3.0.0-SNAPSHOT:protoc (compile-protoc) @
hadoop-hdfs ---
[INFO]
[INFO] <<< maven-source-plugin:2.3:test-jar (default) @ hadoop-hdfs <<<
[INFO]
[INFO] --- maven-source-plugin:2.3:test-jar (default) @ hadoop-hdfs ---
[INFO] Building jar:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/hadoop-hdfs-3.0.0-SNAPSHOT-test-sources.jar>
[INFO]
[INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default) @ hadoop-hdfs ---
[INFO] Fork Value is true
[java] Warnings generated: 1
[INFO] Done FindBugs Analysis....
[INFO]
[INFO] --- maven-dependency-plugin:2.2:copy (site) @ hadoop-hdfs ---
[INFO] Configured Artifact: jdiff:jdiff:1.0.9:jar
[INFO] Configured Artifact:
org.apache.hadoop:hadoop-annotations:3.0.0-SNAPSHOT:jar
[INFO] Configured Artifact: xerces:xercesImpl:2.11.0:jar
[INFO] Copying jdiff-1.0.9.jar to
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/jdiff.jar>
[INFO] Copying hadoop-annotations-3.0.0-SNAPSHOT.jar to
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/hadoop-annotations.jar>
[INFO] Copying xercesImpl-2.11.0.jar to
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/xerces.jar>
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (site) @ hadoop-hdfs ---
[INFO] Executing tasks
main:
[mkdir] Created dir:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/docs-src>
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Apache Hadoop HttpFS
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Apache Hadoop HDFS BookKeeper Journal
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Apache Hadoop HDFS-NFS
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Apache Hadoop HDFS Project 3.0.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-hdfs-project
---
[INFO] Deleting
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/target>
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs-project
---
[INFO] Executing tasks
main:
[mkdir] Created dir:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/target/test-dir>
[INFO] Executed tasks
[INFO]
[INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @
hadoop-hdfs-project ---
[INFO]
[INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @
hadoop-hdfs-project ---
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @
hadoop-hdfs-project ---
[INFO]
[INFO] --- maven-site-plugin:3.4:attach-descriptor (attach-descriptor) @
hadoop-hdfs-project ---
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @
hadoop-hdfs-project ---
[INFO] Not executing Javadoc as the project is not a Java classpath-capable
package
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (depcheck) @ hadoop-hdfs-project
---
[INFO]
[INFO] --- maven-checkstyle-plugin:2.15:checkstyle (default-cli) @
hadoop-hdfs-project ---
[INFO]
[INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default-cli) @
hadoop-hdfs-project ---
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop HDFS Client ......................... SUCCESS [ 48.488 s]
[INFO] Apache Hadoop HDFS ................................ FAILURE [ 02:51 h]
[INFO] Apache Hadoop HttpFS .............................. SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................ SKIPPED
[INFO] Apache Hadoop HDFS Project ........................ SUCCESS [ 0.046 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:52 h
[INFO] Finished at: 2015-05-20T14:56:08+00:00
[INFO] Final Memory: 54M/177M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-antrun-plugin:1.7:run (site) on project
hadoop-hdfs: An Ant BuildException has occured:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/src/main/docs>
does not exist.
[ERROR] around Ant part ...<copy
todir="<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/docs-src";>...>
@ 5:127 in
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/antrun/build-main.xml>
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-hdfs
Build step 'Execute shell' marked build as failure
Archiving artifacts
Sending artifact delta relative to Hadoop-Hdfs-trunk-Java8 #175
Archived 1 artifacts
Archive block size is 32768
Received 0 blocks and 797913 bytes
Compression is 0.0%
Took 33 sec
Recording test results
Updating HADOOP-11698
Updating HADOOP-11973
Updating YARN-3583
Updating YARN-3601
Updating HADOOP-11995
Updating HADOOP-12000
Updating HADOOP-11970
Updating YARN-3565
Updating YARN-2821
Updating MAPREDUCE-6361
Updating HDFS-8404
Updating YARN-3302
Updating HDFS-8131
Updating YARN-3677
Updating HADOOP-11963
