Hi all,
I am trying to use by LDBC benchmark using neo4j driver here:
https://github.com/ldbc-dev/ldbc_snb_workload_interactive_neo4j. Yet
currently I'm having some problem understanding it. The way I run LDBC is
using client.java from com.ldbc.java, with command:
-db com.ldbc.snb.interactive.neo4j.Neo4jDb
-w
com.ldbc.driver.workloads.ldbc.snb.interactive.LdbcSnbInteractiveWorkload
-oc 10
-tc 1
-tu MILLISECONDS
-nm BENCHMARK_NAME
-rd results_dir
-P
/home/jer/gdb_benchmarks/ldbc_socialnet_bm_neo4j/ldbc_driver/workloads/ldbc/socnet/interactive/ldbc_socnet_interactive.properties
-p
"parameters_dir|/home/jer/gdb_benchmarks/ldbc_snb_datagen/substitution_parameters/"
-p "neo4j.path|graph.db/"
-p "neo4j.dbtype|embedded-api-steps"
-p
"neo4j.config|/home/jer/gdb_benchmarks/ldbc_socialnet_bm_neo4j/data-import/src/main/resources/neo4j_run_dev.properties"
To have a concrete understanding of server workload, I place breakpoints in
the neo4j kernel package, specifically in
org.neo4j.kernel.impl.nioneo.store.PersistenceWindowPool.
I know that any query requesting for node/relationship/property will
trigger this class. However, the running of the benchmark seems to execute
this class only on database initialization/ clean up stage. Since database
have been started by the benchmark, it doesn't make sense to me that no
workload is done. Is it because that the benchmark starts another server
process in the background? If this is the case, is there anyway to debug
that background process? The other problem is in the result on the console,
only LdbcQuery13 and 8 are seen, and no output from these two queries are
seen. Do you have any suggestions in understand the ldbc workload or
correct by current problem? Thanks a lot!
The Result printed on my console is as follows:
INFO com.ldbc.driver.Client Loaded Workload:
com.ldbc.driver.workloads.ldbc.snb.interactive.LdbcSnbInteractiveWorkload
INFO com.ldbc.snb.interactive.neo4j.Neo4jDb *** Neo4j Properties ***
INFO com.ldbc.snb.interactive.neo4j.Neo4jDb database type =
embedded-api-steps
INFO com.ldbc.snb.interactive.neo4j.Neo4jDb url = UNKNOWN
INFO com.ldbc.snb.interactive.neo4j.Neo4jDb db path =
/home/jer/gdb_benchmarks/ldbc_socialnet_bm_neo4j/ldbc_driver/graph.db
INFO com.ldbc.snb.interactive.neo4j.Neo4jDb config path =
/home/jer/gdb_benchmarks/ldbc_socialnet_bm_neo4j/data-import/src/main/resources/neo4j_run_dev.properties
INFO com.ldbc.snb.interactive.neo4j.Neo4jDb ************************
INFO com.ldbc.snb.interactive.neo4j.Neo4jDb Connecting to database:
graph.db/
INFO com.ldbc.snb.interactive.neo4j.Neo4jDb API type: Traversal Framework
- STEPS
Physical mem: 12009MB, Heap size: 2670MB
16:41:59.558 [main] WARN o.neo4j.kernel.EmbeddedGraphDatabase - You are
using an unsupported Java runtime. Please use Oracle(R) Java(TM) Runtime
Environment 7.
INFO com.ldbc.snb.interactive.neo4j.Neo4jDb Initialization complete
INFO com.ldbc.driver.Client Loaded DB:
com.ldbc.snb.interactive.neo4j.Neo4jDb
INFO com.ldbc.driver.Client Retrieving operation stream for workload:
LdbcSnbInteractiveWorkload
INFO com.ldbc.driver.Client Instantiating WorkloadRunner
INFO com.ldbc.driver.Client Instantiated WorkloadRunner - Operation Count
= 10
INFO com.ldbc.driver.Client Initializing driver
INFO com.ldbc.driver.Client Waiting for all driver processes to complete
initialization
INFO com.ldbc.driver.Client Initialization complete
INFO com.ldbc.driver.Client Driver Configuration
INFO com.ldbc.driver.Client Workload Start Time: 16:42:09.098
Parameters:
Name: BENCHMARK_NAME
DB: com.ldbc.snb.interactive.neo4j.Neo4jDb
Workload:
com.ldbc.driver.workloads.ldbc.snb.interactive.LdbcSnbInteractiveWorkload
Operation Count: 10
Worker Threads: 1
Status Display Interval: 00:02.000 (m:s.ms)
Time Unit: MILLISECONDS
Results Directory:
/home/jer/gdb_benchmarks/ldbc_socialnet_bm_neo4j/ldbc_driver/results_dir
Time Compression Ratio: 1.0
Execution Window Size: 1000 (ms) / 00:01.000 (m:s.ms)
Peer IDs: []
Tolerated Execution Delay: 1800000 (ms) / 30:00.000 (m:s.ms)
Validation Creation Params: null
Database Validation File: null
Validate Workload: false
Calculate Workload Statistics: false
Spinner Sleep Duration: 0 (ms) / 00:00.000 (m:s.ms)
Print Help: false
User-defined parameters:
LdbcQuery10_enable = true
LdbcQuery10_interleave = 27
LdbcQuery11_enable = true
LdbcQuery11_interleave = 18
LdbcQuery12_enable = true
LdbcQuery12_interleave = 34
LdbcQuery13_enable = true
LdbcQuery13_interleave = 1
LdbcQuery14_enable = true
LdbcQuery14_interleave = 66
LdbcQuery1_enable = true
LdbcQuery1_interleave = 30
LdbcQuery2_enable = true
LdbcQuery2_interleave = 12
LdbcQuery3_enable = true
LdbcQuery3_interleave = 72
LdbcQuery4_enable = true
LdbcQuery4_interleave = 27
LdbcQuery5_enable = true
LdbcQuery5_interleave = 42
LdbcQuery6_enable = true
LdbcQuery6_interleave = 18
LdbcQuery7_enable = true
LdbcQuery7_interleave = 13
LdbcQuery8_enable = true
LdbcQuery8_interleave = 1
LdbcQuery9_enable = true
LdbcQuery9_interleave = 40
LdbcUpdate1AddPerson_enable = false
LdbcUpdate2AddPostLike_enable = false
LdbcUpdate3AddCommentLike_enable = false
LdbcUpdate4AddForum_enable = false
LdbcUpdate5AddForumMembership_enable = false
LdbcUpdate6AddPost_enable = false
LdbcUpdate7AddComment_enable = false
LdbcUpdate8AddFriendship_enable = false
neo4j.config =
/home/jer/gdb_benchmarks/ldbc_socialnet_bm_neo4j/data-import/src/main/resources/neo4j_run_dev.properties
neo4j.dbtype = embedded-api-steps
neo4j.path = graph.db/
parameters_dir =
/home/jer/gdb_benchmarks/ldbc_snb_datagen/substitution_parameters/
resultfile = test_ldbc_socnet_interactive_results.json
INFO com.ldbc.driver.runtime.WorkloadStatusThread Runtime [00:00.000
(m:s.ms)], Operations [0], Since Last Measurement [00:00.000 (m:s.ms)],
Throughput (op/sec) [0.00], GCT: 19:47:16.854
INFO com.ldbc.driver.runtime.WorkloadStatusThread Runtime [00:00.000
(m:s.ms)], Operations [0], Since Last Measurement [00:00.000 (m:s.ms)],
Throughput (op/sec) [0.00], GCT: 19:47:16.854
INFO com.ldbc.driver.runtime.WorkloadStatusThread Runtime [00:00.000
(m:s.ms)], Operations [0], Since Last Measurement [00:00.000 (m:s.ms)],
Throughput (op/sec) [0.00], GCT: 19:47:16.854
INFO com.ldbc.driver.runtime.WorkloadStatusThread Runtime [00:00.000
(m:s.ms)], Operations [0], Since Last Measurement [00:00.000 (m:s.ms)],
Throughput (op/sec) [0.00], GCT: 19:47:16.854
INFO com.ldbc.driver.runtime.WorkloadStatusThread Runtime [00:00.000
(m:s.ms)], Operations [0], Since Last Measurement [00:00.000 (m:s.ms)],
Throughput (op/sec) [0.00], GCT: 19:47:16.854
INFO com.ldbc.driver.Client Cleaning up Workload...
INFO com.ldbc.driver.Client Complete
INFO com.ldbc.driver.Client Cleaning up DB...
INFO com.ldbc.driver.Client Complete
INFO com.ldbc.driver.Client Shutting down completion time service...
INFO com.ldbc.driver.Client Shutting down metrics collection service...
INFO com.ldbc.driver.Client Runtime: 00:00.007 (m:s.ms)
INFO com.ldbc.driver.Client Exporting workload metrics...
Runtime
com.ldbc.driver.workloads.ldbc.snb.interactive.LdbcQuery13
Units: MILLISECONDS
Count: 5
Min: 0
Max: 1
Mean: 0.4
50th Percentile: 0
90th Percentile: 1
95th Percentile: 1
99th Percentile: 1
com.ldbc.driver.workloads.ldbc.snb.interactive.LdbcQuery8
Units: MILLISECONDS
Count: 5
Min: 0
Max: 5
Mean: 1.0
50th Percentile: 0
90th Percentile: 5
95th Percentile: 5
99th Percentile: 5
Start Time Delay
com.ldbc.driver.workloads.ldbc.snb.interactive.LdbcQuery13
Units: MILLISECONDS
Count: 5
Min: 3
Max: 5
Mean: 4.2
50th Percentile: 4
90th Percentile: 5
95th Percentile: 5
99th Percentile: 5
com.ldbc.driver.workloads.ldbc.snb.interactive.LdbcQuery8
Units: MILLISECONDS
Count: 5
Min: 0
Max: 5
Mean: 3.2
50th Percentile: 4
90th Percentile: 5
95th Percentile: 5
99th Percentile: 5
Result
com.ldbc.driver.workloads.ldbc.snb.interactive.LdbcQuery13
Units: MILLISECONDS
Count: 5
Values:
0: 5
com.ldbc.driver.workloads.ldbc.snb.interactive.LdbcQuery8
Units: MILLISECONDS
Count: 5
Values:
0: 5
--
You received this message because you are subscribed to the Google Groups
"Neo4j" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
For more options, visit https://groups.google.com/d/optout.