Okay we have just two problems now: 12/06/15 23:59:28 WARN bsp.BSPMaster: Could not clear zookeeper nodes. > java.lang.IllegalArgumentException: Path must start with / character > at org.apache.zookeeper.common.PathUtils.validatePath(PathUtils.java:51) > at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:788) > at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:837) > at org.apache.hama.bsp.BSPMaster.clearZKNodes(BSPMaster.java:514) > at org.apache.hama.bsp.JobInProgress.initTasks(JobInProgress.java:246)
It seems that I have introduced it now, will fix it soon. However the testcase in graph module is still failing, but the one in core module is running perfectly well. > 12/06/16 00:01:13 ERROR bsp.SimpleTaskScheduler: Error submitting job > java.util.concurrent.ExecutionException: java.lang.NullPointerException > at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222) > at java.util.concurrent.FutureTask.get(FutureTask.java:83) > at > org.apache.hama.bsp.SimpleTaskScheduler$JobProcessor.schedule(SimpleTaskScheduler.java:179) > at > org.apache.hama.bsp.SimpleTaskScheduler$JobProcessor.run(SimpleTaskScheduler.java:157) > Caused by: java.lang.NullPointerException > at > org.apache.hama.bsp.TaskInProgress.getTaskToRun(TaskInProgress.java:151) > at > org.apache.hama.bsp.JobInProgress.obtainNewTask(JobInProgress.java:275) > at > org.apache.hama.bsp.SimpleTaskScheduler$TaskWorker.call(SimpleTaskScheduler.java:233) I'm going to add a nullcheck and debug output if we reach that, so we can check the configuration of that hudson and plan our next steps. 2012/6/16 Apache Jenkins Server <[email protected]> > See <https://builds.apache.org/job/Hama-Nightly/583/changes> > > Changes: > > [tjungblut] honor the skipTests flag > > [tjungblut] [HAMA-550]: Implementation of Bipartite Matching > > [tjungblut] making testcases more robust against state and parallelism > > [tjungblut] fixing syncing > > [edwardyoon] Remove double whitespaces. > > [edwardyoon] Add fail() method again. It was test. > > ------------------------------------------ > [...truncated 5238 lines...] > 12/06/16 00:01:12 INFO bsp.GroomServer: groom start > > 12/06/16 00:01:12 INFO zookeeper.ZooKeeper: Initiating client connection, > connectString=localhost:21810 sessionTimeout=1200000 > watcher=org.apache.hama.bsp.GroomServer@5c7734 > > 12/06/16 00:01:12 INFO zookeeper.ClientCnxn: Opening socket connection to > server localhost/0:0:0:0:0:0:0:1:21810 > > 12/06/16 00:01:12 INFO server.NIOServerCnxn: Accepted socket connection > from /0:0:0:0:0:0:0:1:43710 > > 12/06/16 00:01:12 INFO zookeeper.ClientCnxn: Socket connection established > to localhost/0:0:0:0:0:0:0:1:21810, initiating session > > 12/06/16 00:01:12 INFO server.NIOServerCnxn: Client attempting to > establish new session at /0:0:0:0:0:0:0:1:43710 > > 12/06/16 00:01:12 INFO bsp.GroomServer: /tmp/hama-test > > 12/06/16 00:01:12 INFO ipc.Server: Starting SocketReader > > 12/06/16 00:01:12 INFO ipc.Server: IPC Server Responder: starting > > 12/06/16 00:01:12 INFO server.NIOServerCnxn: Established session > 0x137f297e9f00001 with negotiated timeout 40000 for client > /0:0:0:0:0:0:0:1:43710 > > 12/06/16 00:01:12 INFO zookeeper.ClientCnxn: Session establishment > complete on server localhost/0:0:0:0:0:0:0:1:21810, sessionid = > 0x137f297e9f00001, negotiated timeout = 40000 > > 12/06/16 00:01:12 INFO bsp.GroomServer: Worker rpc server --> > vesta.apache.org:58614 > > 12/06/16 00:01:12 INFO ipc.Server: IPC Server handler 0 on 58614: starting > > 12/06/16 00:01:12 INFO ipc.Server: IPC Server listener on 58614: starting > > 12/06/16 00:01:12 INFO bsp.GroomServer: starting webserver: > vesta.apache.org > > 12/06/16 00:01:12 INFO http.HttpServer: Port returned by > webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening > the listener on 40015 > > 12/06/16 00:01:12 INFO http.HttpServer: listener.getLocalPort() returned > 40015 webServer.getConnectors()[0].getLocalPort() returned 40015 > > 12/06/16 00:01:12 INFO http.HttpServer: Jetty bound to port 40015 > > 12/06/16 00:01:12 INFO mortbay.log: jetty-6.1.14 > > 12/06/16 00:01:12 INFO mortbay.log: Extract jar:< > https://builds.apache.org/job/Hama-Nightly/ws/trunk/core/target/hama-core-0.5.0-SNAPSHOT.jar!/webapp/groomserver/> > to /tmp/Jetty_vesta_apache_org_40015_groomserver____.ql73sy/webapp > > 12/06/16 00:01:12 INFO mortbay.log: Started > [email protected]:40015 > > 12/06/16 00:01:12 INFO ipc.Server: Starting SocketReader > > 12/06/16 00:01:12 INFO ipc.Server: IPC Server Responder: starting > > 12/06/16 00:01:12 INFO ipc.Server: IPC Server listener on 57964: starting > > 12/06/16 00:01:12 INFO ipc.Server: IPC Server handler 0 on 57964: starting > > 12/06/16 00:01:12 INFO ipc.Server: IPC Server handler 1 on 57964: starting > > 12/06/16 00:01:12 INFO ipc.Server: IPC Server handler 4 on 57964: starting > > 12/06/16 00:01:12 INFO ipc.Server: IPC Server handler 5 on 57964: starting > > 12/06/16 00:01:12 INFO ipc.Server: IPC Server handler 3 on 57964: starting > > 12/06/16 00:01:12 INFO ipc.Server: IPC Server handler 2 on 57964: starting > > 12/06/16 00:01:12 INFO ipc.Server: IPC Server handler 6 on 57964: starting > > 12/06/16 00:01:12 INFO ipc.Server: IPC Server handler 8 on 57964: starting > > 12/06/16 00:01:12 INFO ipc.Server: IPC Server handler 9 on 57964: starting > > 12/06/16 00:01:12 INFO bsp.GroomServer: GroomServer up at: localhost/ > 127.0.0.1:57964 > > 12/06/16 00:01:12 INFO bsp.GroomServer: Starting groom: > vesta.apache.org:58614 > > 12/06/16 00:01:12 INFO ipc.Server: IPC Server handler 7 on 57964: starting > > 12/06/16 00:01:12 INFO bsp.BSPMaster: groomd_vesta.apache.org_58614 is > added. > > 12/06/16 00:01:13 INFO bsp.TestBSPMasterGroomServer: Client finishes > execution job. > > 12/06/16 00:01:13 INFO bsp.FileInputFormat: Total input paths to process : > 1 > > 12/06/16 00:01:13 INFO bsp.FileInputFormat: Total # of splits: 2 > > 12/06/16 00:01:13 WARN bsp.BSPJobClient: No job jar file set. User > classes may not be found. See BSPJob#setJar(String) or check Your jar file. > > 12/06/16 00:01:13 INFO bsp.JobInProgress: num BSPTasks: 2 > > 12/06/16 00:01:13 WARN bsp.BSPMaster: Could not clear zookeeper nodes. > java.lang.IllegalArgumentException: Path must start with / character > at > org.apache.zookeeper.common.PathUtils.validatePath(PathUtils.java:51) > at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:788) > at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:837) > at org.apache.hama.bsp.BSPMaster.clearZKNodes(BSPMaster.java:514) > at > org.apache.hama.bsp.JobInProgress.initTasks(JobInProgress.java:246) > at org.apache.hama.bsp.QueueManager.initJob(QueueManager.java:45) > at > org.apache.hama.bsp.SimpleTaskScheduler$JobListener.jobAdded(SimpleTaskScheduler.java:116) > at org.apache.hama.bsp.BSPMaster.addJob(BSPMaster.java:794) > at org.apache.hama.bsp.BSPMaster.submitJob(BSPMaster.java:655) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:563) > at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1388) > at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1384) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:396) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1083) > at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1382) > > 12/06/16 00:01:13 INFO bsp.JobInProgress: Job is initialized. > > 12/06/16 00:01:13 ERROR bsp.SimpleTaskScheduler: Error submitting job > java.util.concurrent.ExecutionException: java.lang.NullPointerException > at > java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222) > at java.util.concurrent.FutureTask.get(FutureTask.java:83) > at > org.apache.hama.bsp.SimpleTaskScheduler$JobProcessor.schedule(SimpleTaskScheduler.java:179) > at > org.apache.hama.bsp.SimpleTaskScheduler$JobProcessor.run(SimpleTaskScheduler.java:157) > Caused by: java.lang.NullPointerException > at > org.apache.hama.bsp.TaskInProgress.getTaskToRun(TaskInProgress.java:151) > at > org.apache.hama.bsp.JobInProgress.obtainNewTask(JobInProgress.java:275) > at > org.apache.hama.bsp.SimpleTaskScheduler$TaskWorker.call(SimpleTaskScheduler.java:233) > at > org.apache.hama.bsp.SimpleTaskScheduler$TaskWorker.call(SimpleTaskScheduler.java:202) > at > java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:662) > > 12/06/16 00:01:13 INFO bsp.BSPJobClient: Running job: job_201206160001_0001 > > 12/06/16 00:01:13 ERROR bsp.SimpleTaskScheduler: Scheduling of job > Pagerank could not be done successfully. Killing it! > > 12/06/16 00:01:13 INFO bsp.BSPJobClient: Job failed. > > 12/06/16 00:01:13 INFO server.PrepRequestProcessor: Processed session > termination for sessionid: 0x137f297e9f00000 > > 12/06/16 00:01:13 INFO zookeeper.ZooKeeper: Session: 0x137f297e9f00000 > closed > > 12/06/16 00:01:13 INFO zookeeper.ClientCnxn: EventThread shut down > > 12/06/16 00:01:13 INFO ipc.Server: Stopping server on 40000 > > 12/06/16 00:01:13 INFO ipc.Server: Stopping IPC Server listener on 40000 > > 12/06/16 00:01:13 INFO metrics.RpcInstrumentation: shut down > > 12/06/16 00:01:13 INFO bsp.BSPMaster: Stopped RPC Master server. > > 12/06/16 00:01:13 INFO ipc.Server: Stopping IPC Server Responder > > 12/06/16 00:01:13 INFO server.NIOServerCnxn: Closed socket connection for > client /0:0:0:0:0:0:0:1:43452 which had sessionid 0x137f297e9f00000 > > 12/06/16 00:01:13 INFO ipc.Server: IPC Server handler 0 on 40000: exiting > > 12/06/16 00:01:13 INFO server.PrepRequestProcessor: Processed session > termination for sessionid: 0x137f297e9f00001 > > 12/06/16 00:01:13 INFO zookeeper.ZooKeeper: Session: 0x137f297e9f00001 > closed > > 12/06/16 00:01:13 INFO server.NIOServerCnxn: Closed socket connection for > client /0:0:0:0:0:0:0:1:43710 which had sessionid 0x137f297e9f00001 > > 12/06/16 00:01:13 INFO zookeeper.ClientCnxn: EventThread shut down > > 12/06/16 00:01:13 INFO ipc.Server: Stopping server on 58614 > > 12/06/16 00:01:13 INFO ipc.Server: IPC Server handler 0 on 58614: exiting > > 12/06/16 00:01:13 INFO metrics.RpcInstrumentation: shut down > > 12/06/16 00:01:13 INFO ipc.Server: Stopping IPC Server listener on 58614 > > 12/06/16 00:01:13 INFO ipc.Server: Stopping server on 57964 > > 12/06/16 00:01:13 INFO ipc.Server: Stopping IPC Server Responder > > 12/06/16 00:01:13 INFO ipc.Server: IPC Server handler 1 on 57964: exiting > > 12/06/16 00:01:13 INFO ipc.Server: IPC Server handler 0 on 57964: exiting > > 12/06/16 00:01:13 INFO ipc.Server: IPC Server handler 2 on 57964: exiting > > 12/06/16 00:01:13 INFO ipc.Server: IPC Server handler 3 on 57964: exiting > > 12/06/16 00:01:13 INFO ipc.Server: IPC Server handler 4 on 57964: exiting > > 12/06/16 00:01:13 INFO ipc.Server: IPC Server handler 5 on 57964: exiting > > 12/06/16 00:01:13 INFO ipc.Server: IPC Server handler 7 on 57964: exiting > > 12/06/16 00:01:13 INFO ipc.Server: IPC Server handler 6 on 57964: exiting > > 12/06/16 00:01:13 INFO ipc.Server: IPC Server handler 8 on 57964: exiting > > 12/06/16 00:01:13 INFO ipc.Server: IPC Server handler 9 on 57964: exiting > > 12/06/16 00:01:13 INFO ipc.Server: Stopping IPC Server listener on 57964 > > 12/06/16 00:01:13 INFO metrics.RpcInstrumentation: shut down > > 12/06/16 00:01:13 INFO ipc.Server: Stopping IPC Server Responder > > 12/06/16 00:01:13 INFO server.NIOServerCnxn: NIOServerCnxn factory exited > run method > > 12/06/16 00:01:13 INFO server.PrepRequestProcessor: PrepRequestProcessor > exited loop! > > 12/06/16 00:01:13 INFO server.SyncRequestProcessor: SyncRequestProcessor > exited! > > 12/06/16 00:01:13 INFO server.FinalRequestProcessor: shutdown of request > processor complete > > Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.025 sec > <<< FAILURE! > > Results : > > Failed tests: > testSubmitJob(org.apache.hama.graph.TestSubmitGraphJob) > > Tests run: 1, Failures: 1, Errors: 0, Skipped: 0 > > [INFO] > ------------------------------------------------------------------------ > [INFO] Reactor Summary: > [INFO] > [INFO] Apache Hama parent POM ............................ SUCCESS > [14.276s] > [INFO] core .............................................. SUCCESS > [2:06.833s] > [INFO] graph ............................................. FAILURE [7.637s] > [INFO] examples .......................................... SKIPPED > [INFO] yarn .............................................. SKIPPED > [INFO] machine learning .................................. SKIPPED > [INFO] hama-dist ......................................... SKIPPED > [INFO] > ------------------------------------------------------------------------ > [INFO] BUILD FAILURE > [INFO] > ------------------------------------------------------------------------ > [INFO] Total time: 2:34.943s > [INFO] Finished at: Sat Jun 16 00:01:13 UTC 2012 > [INFO] Final Memory: 40M/156M > [INFO] > ------------------------------------------------------------------------ > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-surefire-plugin:2.6:test (default-test) on > project hama-graph: There are test failures. > [ERROR] > [ERROR] Please refer to < > https://builds.apache.org/job/Hama-Nightly/ws/trunk/graph/target/surefire-reports> > for the individual test results. > [ERROR] -> [Help 1] > [ERROR] > [ERROR] To see the full stack trace of the errors, re-run Maven with the > -e switch. > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > [ERROR] > [ERROR] For more information about the errors and possible solutions, > please read the following articles: > [ERROR] [Help 1] > http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException > [ERROR] > [ERROR] After correcting the problems, you can resume the build with the > command > [ERROR] mvn <goals> -rf :hama-graph > Build step 'Invoke top-level Maven targets' marked build as failure > Archiving artifacts > Recording test results > Updating HAMA-550 > -- Thomas Jungblut Berlin <[email protected]>
