Hello. Looking for ideas and if anyone else has come across this...
I have a bulk load (same as the previous OOME question) which auto commits after 25k quads have been added then begins a new write transaction. All of the commits average 2 seconds but one takes 42 seconds. ~500K quads are added with ~500MB on disk storage. I've changed the underlying storage from HHD to SSD, to USB MS and I still get the same symptoms. Different files give different stalls, some have multiple stalls, typically around 40 seconds but some are 2 minutes. iotop is not showing anything "odd" and the GC isn't stressing. I can repeat this with a new TDB and a 25M quad TDB. Is the TDB having to copy write new "blocks" to balance it's storage at some point? Whilst it will stall at some point the point is not always the same. Jena 3.1, Ubuntu 16.04, 8 cores 16GB RAM, JVM Xmx 4GB G1GC. Log below shows consistent ~2 second commits bar one. TIA Dick. INFO 2016-08-08T10:03:13.284Z DXFDatasetBulkload apply#10 Loading into graph [urn:iungo:dxf/graph/4ff155f4-c958-4660-8ee6-8487aba738b9] METHOD_INIT 2016-08-08T10:03:13.285Z AutocommitDatasetGraphShim apply#11 org.iungo.result.Result apply(java.util.function.Supplier) TIME_STARTED 2016-08-08T10:03:14.656Z AutocommitDatasetGraphShim add#9 [Commit [1] [25000]] [2016-08-08T10:03:14.655Z] TIME_STOPPED 2016-08-08T10:03:17.013Z AutocommitDatasetGraphShim add#9 [Commit [1] [25000]] [2016-08-08T10:03:17.013Z]/[PT2.358S] TIME_STARTED 2016-08-08T10:03:17.264Z AutocommitDatasetGraphShim add#9 [Write [1]] [2016-08-08T10:03:17.263Z] TIME_STOPPED 2016-08-08T10:03:17.266Z AutocommitDatasetGraphShim add#9 [Write [1]] [2016-08-08T10:03:17.266Z]/[PT0.003S] TIME_STARTED 2016-08-08T10:03:18.242Z AutocommitDatasetGraphShim add#9 [Commit [2] [50000]] [2016-08-08T10:03:18.242Z] TIME_STOPPED 2016-08-08T10:03:20.421Z AutocommitDatasetGraphShim add#9 [Commit [2] [50000]] [2016-08-08T10:03:20.421Z]/[PT2.179S] TIME_STARTED 2016-08-08T10:03:20.671Z AutocommitDatasetGraphShim add#9 [Write [2]] [2016-08-08T10:03:20.671Z] TIME_STOPPED 2016-08-08T10:03:20.674Z AutocommitDatasetGraphShim add#9 [Write [2]] [2016-08-08T10:03:20.673Z]/[PT0.002S] TIME_STARTED 2016-08-08T10:03:21.403Z AutocommitDatasetGraphShim add#9 [Commit [3] [75000]] [2016-08-08T10:03:21.403Z] TIME_STOPPED 2016-08-08T10:03:23.567Z AutocommitDatasetGraphShim add#9 [Commit [3] [75000]] [2016-08-08T10:03:23.567Z]/[PT2.164S] TIME_STARTED 2016-08-08T10:03:23.817Z AutocommitDatasetGraphShim add#9 [Write [3]] [2016-08-08T10:03:23.817Z] TIME_STOPPED 2016-08-08T10:03:23.818Z AutocommitDatasetGraphShim add#9 [Write [3]] [2016-08-08T10:03:23.818Z]/[PT0.001S] TIME_STARTED 2016-08-08T10:03:24.442Z AutocommitDatasetGraphShim add#9 [Commit [4] [100000]] [2016-08-08T10:03:24.442Z] TIME_STOPPED 2016-08-08T10:03:26.871Z AutocommitDatasetGraphShim add#9 [Commit [4] [100000]] [2016-08-08T10:03:26.871Z]/[PT2.429S] TIME_STARTED 2016-08-08T10:03:27.121Z AutocommitDatasetGraphShim add#9 [Write [4]] [2016-08-08T10:03:27.121Z] TIME_STOPPED 2016-08-08T10:03:27.122Z AutocommitDatasetGraphShim add#9 [Write [4]] [2016-08-08T10:03:27.122Z]/[PT0.001S] TIME_STARTED 2016-08-08T10:03:27.835Z AutocommitDatasetGraphShim add#9 [Commit [5] [125000]] [2016-08-08T10:03:27.835Z] TIME_STOPPED 2016-08-08T10:03:30.262Z AutocommitDatasetGraphShim add#9 [Commit [5] [125000]] [2016-08-08T10:03:30.262Z]/[PT2.427S] TIME_STARTED 2016-08-08T10:03:30.513Z AutocommitDatasetGraphShim add#9 [Write [5]] [2016-08-08T10:03:30.512Z] TIME_STOPPED 2016-08-08T10:03:30.515Z AutocommitDatasetGraphShim add#9 [Write [5]] [2016-08-08T10:03:30.514Z]/[PT0.002S] TIME_STARTED 2016-08-08T10:03:31.198Z AutocommitDatasetGraphShim add#9 [Commit [6] [150000]] [2016-08-08T10:03:31.198Z] TIME_STOPPED 2016-08-08T10:03:33.508Z AutocommitDatasetGraphShim add#9 [Commit [6] [150000]] [2016-08-08T10:03:33.508Z]/[PT2.31S] TIME_STARTED 2016-08-08T10:03:33.758Z AutocommitDatasetGraphShim add#9 [Write [6]] [2016-08-08T10:03:33.758Z] TIME_STOPPED 2016-08-08T10:03:33.760Z AutocommitDatasetGraphShim add#9 [Write [6]] [2016-08-08T10:03:33.760Z]/[PT0.002S] TIME_STARTED 2016-08-08T10:03:34.504Z AutocommitDatasetGraphShim add#9 [Commit [7] [175000]] [2016-08-08T10:03:34.504Z] TIME_STOPPED 2016-08-08T10:03:37.044Z AutocommitDatasetGraphShim add#9 [Commit [7] [175000]] [2016-08-08T10:03:37.044Z]/[PT2.54S] TIME_STARTED 2016-08-08T10:03:37.294Z AutocommitDatasetGraphShim add#9 [Write [7]] [2016-08-08T10:03:37.294Z] TIME_STOPPED 2016-08-08T10:03:37.296Z AutocommitDatasetGraphShim add#9 [Write [7]] [2016-08-08T10:03:37.296Z]/[PT0.002S] TIME_STARTED 2016-08-08T10:03:38.009Z AutocommitDatasetGraphShim add#9 [Commit [8] [200000]] [2016-08-08T10:03:38.009Z] TIME_STOPPED 2016-08-08T10:03:40.120Z AutocommitDatasetGraphShim add#9 [Commit [8] [200000]] [2016-08-08T10:03:40.120Z]/[PT2.111S] TIME_STARTED 2016-08-08T10:03:40.371Z AutocommitDatasetGraphShim add#9 [Write [8]] [2016-08-08T10:03:40.370Z] TIME_STOPPED 2016-08-08T10:03:40.372Z AutocommitDatasetGraphShim add#9 [Write [8]] [2016-08-08T10:03:40.372Z]/[PT0.002S] TIME_STARTED 2016-08-08T10:03:41.061Z AutocommitDatasetGraphShim add#9 [Commit [9] [225000]] [2016-08-08T10:03:41.061Z] TIME_STOPPED 2016-08-08T10:03:43.308Z AutocommitDatasetGraphShim add#9 [Commit [9] [225000]] [2016-08-08T10:03:43.308Z]/[PT2.247S] TIME_STARTED 2016-08-08T10:03:43.558Z AutocommitDatasetGraphShim add#9 [Write [9]] [2016-08-08T10:03:43.558Z] TIME_STOPPED 2016-08-08T10:03:43.559Z AutocommitDatasetGraphShim add#9 [Write [9]] [2016-08-08T10:03:43.559Z]/[PT0.001S] TIME_STARTED 2016-08-08T10:03:44.159Z AutocommitDatasetGraphShim add#9 [Commit [10] [250000]] [2016-08-08T10:03:44.159Z] TIME_STOPPED 2016-08-08T10:03:46.402Z AutocommitDatasetGraphShim add#9 [Commit [10] [250000]] [2016-08-08T10:03:46.402Z]/[PT2.243S] TIME_STARTED 2016-08-08T10:03:46.652Z AutocommitDatasetGraphShim add#9 [Write [10]] [2016-08-08T10:03:46.652Z] TIME_STOPPED 2016-08-08T10:03:46.653Z AutocommitDatasetGraphShim add#9 [Write [10]] [2016-08-08T10:03:46.653Z]/[PT0.001S] TIME_STARTED 2016-08-08T10:03:47.367Z AutocommitDatasetGraphShim add#9 [Commit [11] [275000]] [2016-08-08T10:03:47.367Z] TIME_STOPPED 2016-08-08T10:04:30.335Z AutocommitDatasetGraphShim add#9 [Commit [11] [275000]] [2016-08-08T10:04:30.335Z]/[PT42.968S] TIME_STARTED 2016-08-08T10:04:30.586Z AutocommitDatasetGraphShim add#9 [Write [11]] [2016-08-08T10:04:30.586Z] TIME_STOPPED 2016-08-08T10:04:30.587Z AutocommitDatasetGraphShim add#9 [Write [11]] [2016-08-08T10:04:30.587Z]/[PT0.001S] TIME_STARTED 2016-08-08T10:04:31.178Z AutocommitDatasetGraphShim add#9 [Commit [12] [300000]] [2016-08-08T10:04:31.178Z] TIME_STOPPED 2016-08-08T10:04:33.631Z AutocommitDatasetGraphShim add#9 [Commit [12] [300000]] [2016-08-08T10:04:33.631Z]/[PT2.453S] TIME_STARTED 2016-08-08T10:04:33.881Z AutocommitDatasetGraphShim add#9 [Write [12]] [2016-08-08T10:04:33.881Z] TIME_STOPPED 2016-08-08T10:04:33.882Z AutocommitDatasetGraphShim add#9 [Write [12]] [2016-08-08T10:04:33.882Z]/[PT0.001S] TIME_STARTED 2016-08-08T10:04:34.530Z AutocommitDatasetGraphShim add#9 [Commit [13] [325000]] [2016-08-08T10:04:34.530Z] TIME_STOPPED 2016-08-08T10:04:37.125Z AutocommitDatasetGraphShim add#9 [Commit [13] [325000]] [2016-08-08T10:04:37.124Z]/[PT2.594S] TIME_STARTED 2016-08-08T10:04:37.375Z AutocommitDatasetGraphShim add#9 [Write [13]] [2016-08-08T10:04:37.375Z] TIME_STOPPED 2016-08-08T10:04:37.376Z AutocommitDatasetGraphShim add#9 [Write [13]] [2016-08-08T10:04:37.376Z]/[PT0.001S] TIME_STARTED 2016-08-08T10:04:38.016Z AutocommitDatasetGraphShim add#9 [Commit [14] [350000]] [2016-08-08T10:04:38.016Z] TIME_STOPPED 2016-08-08T10:04:40.566Z AutocommitDatasetGraphShim add#9 [Commit [14] [350000]] [2016-08-08T10:04:40.566Z]/[PT2.55S] TIME_STARTED 2016-08-08T10:04:40.816Z AutocommitDatasetGraphShim add#9 [Write [14]] [2016-08-08T10:04:40.816Z] TIME_STOPPED 2016-08-08T10:04:40.817Z AutocommitDatasetGraphShim add#9 [Write [14]] [2016-08-08T10:04:40.817Z]/[PT0.001S] TIME_STARTED 2016-08-08T10:04:41.462Z AutocommitDatasetGraphShim add#9 [Commit [15] [375000]] [2016-08-08T10:04:41.461Z] TIME_STOPPED 2016-08-08T10:04:43.974Z AutocommitDatasetGraphShim add#9 [Commit [15] [375000]] [2016-08-08T10:04:43.974Z]/[PT2.513S] TIME_STARTED 2016-08-08T10:04:44.224Z AutocommitDatasetGraphShim add#9 [Write [15]] [2016-08-08T10:04:44.224Z] TIME_STOPPED 2016-08-08T10:04:44.225Z AutocommitDatasetGraphShim add#9 [Write [15]] [2016-08-08T10:04:44.225Z]/[PT0.001S] TIME_STARTED 2016-08-08T10:04:44.901Z AutocommitDatasetGraphShim add#9 [Commit [16] [400000]] [2016-08-08T10:04:44.901Z] TIME_STOPPED 2016-08-08T10:04:47.042Z AutocommitDatasetGraphShim add#9 [Commit [16] [400000]] [2016-08-08T10:04:47.042Z]/[PT2.141S] TIME_STARTED 2016-08-08T10:04:47.292Z AutocommitDatasetGraphShim add#9 [Write [16]] [2016-08-08T10:04:47.292Z] TIME_STOPPED 2016-08-08T10:04:47.293Z AutocommitDatasetGraphShim add#9 [Write [16]] [2016-08-08T10:04:47.293Z]/[PT0.001S] TIME_STARTED 2016-08-08T10:04:47.873Z AutocommitDatasetGraphShim add#9 [Commit [17] [425000]] [2016-08-08T10:04:47.873Z] TIME_STOPPED 2016-08-08T10:04:49.921Z AutocommitDatasetGraphShim add#9 [Commit [17] [425000]] [2016-08-08T10:04:49.921Z]/[PT2.048S] TIME_STARTED 2016-08-08T10:04:50.171Z AutocommitDatasetGraphShim add#9 [Write [17]] [2016-08-08T10:04:50.171Z] TIME_STOPPED 2016-08-08T10:04:50.172Z AutocommitDatasetGraphShim add#9 [Write [17]] [2016-08-08T10:04:50.172Z]/[PT0.001S] TIME_STARTED 2016-08-08T10:04:50.865Z AutocommitDatasetGraphShim add#9 [Commit [18] [450000]] [2016-08-08T10:04:50.865Z] TIME_STOPPED 2016-08-08T10:04:53.713Z AutocommitDatasetGraphShim add#9 [Commit [18] [450000]] [2016-08-08T10:04:53.713Z]/[PT2.848S] TIME_STARTED 2016-08-08T10:04:53.964Z AutocommitDatasetGraphShim add#9 [Write [18]] [2016-08-08T10:04:53.963Z] TIME_STOPPED 2016-08-08T10:04:53.965Z AutocommitDatasetGraphShim add#9 [Write [18]] [2016-08-08T10:04:53.965Z]/[PT0.002S] TIME_STARTED 2016-08-08T10:04:54.629Z AutocommitDatasetGraphShim add#9 [Commit [19] [475000]] [2016-08-08T10:04:54.628Z] TIME_STOPPED 2016-08-08T10:04:57.341Z AutocommitDatasetGraphShim add#9 [Commit [19] [475000]] [2016-08-08T10:04:57.341Z]/[PT2.713S] TIME_STARTED 2016-08-08T10:04:57.591Z AutocommitDatasetGraphShim add#9 [Write [19]] [2016-08-08T10:04:57.591Z] TIME_STOPPED 2016-08-08T10:04:57.592Z AutocommitDatasetGraphShim add#9 [Write [19]] [2016-08-08T10:04:57.592Z]/[PT0.001S] TIME_STARTED 2016-08-08T10:04:58.339Z AutocommitDatasetGraphShim add#9 [Commit [20] [500000]] [2016-08-08T10:04:58.339Z] TIME_STOPPED 2016-08-08T10:05:01.459Z AutocommitDatasetGraphShim add#9 [Commit [20] [500000]] [2016-08-08T10:05:01.459Z]/[PT3.12S] TIME_STARTED 2016-08-08T10:05:01.709Z AutocommitDatasetGraphShim add#9 [Write [20]] [2016-08-08T10:05:01.709Z] TIME_STOPPED 2016-08-08T10:05:01.710Z AutocommitDatasetGraphShim add#9 [Write [20]] [2016-08-08T10:05:01.710Z]/[PT0.001S] DEBUG 2016-08-08T10:05:04.216Z RootLogger Thread-24 take() METHOD_RETURN 2016-08-08T10:05:04.216Z AutocommitDatasetGraphShim apply#11 Return Timer [Complete [2016-08-08T10:03:13.285Z]/[2016-08-08T10:05:04.216Z]/[PT1M50.931S]] Value [org.iungo.result.Result] *Dick Murray* Technology Specialist *Business Collaborator Limited* 9th Floor, Reading Bridge House, George Street, Reading, RG1 8LS, United Kingdom T 0044 7884 111729 *|* E [email protected] <[email protected]> *|* Twitter @BusCollaborator <https://twitter.com/BusCollaborator> *|* http://www.groupbc.com
