[
https://issues.apache.org/jira/browse/TINKERPOP-1557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15676819#comment-15676819
]
ASF GitHub Bot commented on TINKERPOP-1557:
-------------------------------------------
Github user robertdale commented on the issue:
https://github.com/apache/tinkerpop/pull/498
There's probably over an hour that can be gained in giraph that's spent in
waiting for everything to shutdown in each test run (about 6s each). Looks like
it's zookeper. But I don't really know anything about giraph, zookeeper,
hadoop. If someone has a better idea, here's the shutdown sequence:
```
[INFO] org.apache.giraph.comm.netty.NettyClient - stop: Halting netty client
[INFO] org.apache.giraph.comm.netty.NettyClient$2 - stop: reached wait
threshold, 1 connections closed, releasing resources now.
[INFO] org.apache.giraph.worker.BspServiceWorker - processEvent: Job state
changed, checking to see if it needs to restart
[INFO] org.apache.giraph.master.BspServiceMaster - setJobState:
{"_applicationAttemptKey":-1,"_stateKey":"FINISHED","_superstepKey":-1}
[INFO] org.apache.giraph.bsp.BspService - getJobState: Job state already
exists (/_hadoopBsp/job_local2106675051_0003/_masterJobState)
[INFO] org.apache.giraph.master.BspServiceMaster - cleanup: Notifying
master its okay to cleanup with
/_hadoopBsp/job_local2106675051_0003/_cleanedUpDir/0_master
[INFO] org.apache.giraph.master.BspServiceMaster - cleanUpZooKeeper: Node
/_hadoopBsp/job_local2106675051_0003/_cleanedUpDir already exists, no need to
create.
[INFO] org.apache.giraph.master.BspServiceMaster - cleanUpZooKeeper: Got 1
of 2 desired children from /_hadoopBsp/job_local2106675051_0003/_cleanedUpDir
[INFO] org.apache.giraph.master.BspServiceMaster - cleanedUpZooKeeper:
Waiting for the children of /_hadoopBsp/job_local2106675051_0003/_cleanedUpDir
to change since only got 1 nodes.
[INFO] org.apache.giraph.comm.netty.NettyClient - stop: Netty client halted
[INFO] org.apache.giraph.utils.LoggerUtils - saveVertices: Starting to save
6 vertices using 1 threads
[INFO] org.apache.giraph.utils.LoggerUtils - saveVertices: Done saving
vertices.
[WARN] org.apache.giraph.worker.BspServiceWorker - saveEdges:
giraph.edgeOutputFormatClass => null [EdgeOutputFormat] (class)
Make sure that the EdgeOutputFormat is not required.
[INFO] org.apache.giraph.bsp.BspService - process: cleanedUpChildrenChanged
signaled
[INFO] org.apache.giraph.worker.BspServiceWorker - cleanup: Notifying
master its okay to cleanup with
/_hadoopBsp/job_local2106675051_0003/_cleanedUpDir/0_worker
[INFO] org.apache.giraph.master.BspServiceMaster - cleanUpZooKeeper: Got 2
of 2 desired children from /_hadoopBsp/job_local2106675051_0003/_cleanedUpDir
[INFO] org.apache.giraph.master.BspServiceMaster - cleanup: Removed HDFS
checkpoint directory (_bsp/_checkpoints//job_local2106675051_0003) with return
= false since the job HadoopGremlin(Giraph):
org.apache.tinkerpop.gremlin.process.computer.GraphComputerTest$VertexProgramK@68c9bafc
succeeded
[INFO] org.apache.giraph.comm.netty.NettyClient - stop: Halting netty client
[INFO] org.apache.giraph.comm.netty.NettyClient$2 - stop: reached wait
threshold, 1 connections closed, releasing resources now.
[INFO] org.apache.zookeeper.ZooKeeper - Session: 0x15873a7d0540001 closed
[INFO] org.apache.zookeeper.ClientCnxn$EventThread - EventThread shut down
[INFO] org.apache.giraph.comm.netty.NettyServer - stop: Halting netty server
[INFO] org.apache.giraph.comm.netty.NettyServer - stop: Start releasing
resources
[INFO]
org.apache.giraph.job.HaltApplicationUtils$DefaultHaltInstructionsWriter -
writeHaltInstructions: To halt after next superstep execute:
'bin/halt-application --zkServer bccc11278890:22181 --zkNode
/_hadoopBsp/job_local2106675051_0003/_haltComputation'
[INFO] org.apache.giraph.comm.netty.NettyClient - stop: Netty client halted
[INFO] org.apache.giraph.comm.netty.NettyServer - stop: Netty server halted
[INFO] org.apache.giraph.comm.netty.NettyServer - stop: Halting netty server
[INFO] org.apache.giraph.comm.netty.NettyServer - stop: Start releasing
resources
[INFO] org.apache.giraph.comm.netty.NettyServer - stop: Netty server halted
[INFO] org.apache.giraph.bsp.BspService - process:
masterElectionChildrenChanged signaled
[INFO] org.apache.zookeeper.ClientCnxn$EventThread - EventThread shut down
[INFO] org.apache.zookeeper.ZooKeeper - Session: 0x15873a7d0540000 closed
[INFO] org.apache.giraph.master.MasterThread - setup: Took 0.006 seconds.
[INFO] org.apache.giraph.master.MasterThread - input superstep: Took 0.163
seconds.
[INFO] org.apache.giraph.master.MasterThread - superstep 0: Took 0.034
seconds.
[INFO] org.apache.giraph.master.MasterThread - shutdown: Took 6.632 seconds.
[INFO] org.apache.giraph.master.MasterThread - total: Took 6.836 seconds.
```
> Improve docker build time with this one weird trick!
> ----------------------------------------------------
>
> Key: TINKERPOP-1557
> URL: https://issues.apache.org/jira/browse/TINKERPOP-1557
> Project: TinkerPop
> Issue Type: Improvement
> Components: build-release
> Affects Versions: 3.2.3
> Reporter: Robert Dale
> Assignee: Robert Dale
> Priority: Minor
> Labels: docker
> Fix For: 3.1.6
>
>
> Reduce integration test time of giraph and neo4j
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
