DomGarguilo commented on PR #267:
URL: https://github.com/apache/accumulo-testing/pull/267#issuecomment-1858569419
Here is what the test output looks like currently:
```
2023-12-15T17:23:41,394 [testing.continuous.ManySplits] INFO : Properties
being used to create tables for this test: {table.split.threshold=1G}
2023-12-15T17:23:41,395 [testing.continuous.ManySplits] INFO : Creating
initial table: manysplits.table1
2023-12-15T17:23:41,754 [testing.continuous.CreateTable] INFO : Created
Accumulo table manysplits.table1 with 1 tablets
2023-12-15T17:23:41,755 [testing.continuous.ManySplits] INFO : Ingesting
10000000 entries into first table, manysplits.table1.
2023-12-15T17:23:41,763 [testing.continuous.ContinuousIngest] INFO : Ingest
instance ID: fbd7ecff-2dda-49da-bda0-d2169f2870c5 current time: 1702679021763ms
2023-12-15T17:23:41,763 [testing.continuous.ContinuousIngest] INFO : A flush
will occur after every 1000000 entries written
2023-12-15T17:23:41,820 [testing.continuous.ContinuousIngest] INFO : Total
entries to be written: 10000000
2023-12-15T17:23:41,822 [testing.continuous.ContinuousIngest] INFO : DELETES
will occur with a probability of 0.00
2023-12-15T17:23:46,600 [testing.continuous.ContinuousIngest] INFO : FLUSH -
duration: 1148ms, since last flush: 4780ms, total written: 1000000, total
deleted: 0
2023-12-15T17:23:51,798 [testing.continuous.ContinuousIngest] INFO : FLUSH -
duration: 444ms, since last flush: 5198ms, total written: 2000000, total
deleted: 0
2023-12-15T17:23:58,619 [testing.continuous.ContinuousIngest] INFO : FLUSH -
duration: 500ms, since last flush: 6821ms, total written: 3000000, total
deleted: 0
2023-12-15T17:24:04,419 [testing.continuous.ContinuousIngest] INFO : FLUSH -
duration: 412ms, since last flush: 5800ms, total written: 4000000, total
deleted: 0
2023-12-15T17:24:10,281 [testing.continuous.ContinuousIngest] INFO : FLUSH -
duration: 520ms, since last flush: 5862ms, total written: 5000000, total
deleted: 0
2023-12-15T17:24:18,411 [testing.continuous.ContinuousIngest] INFO : FLUSH -
duration: 1000ms, since last flush: 8130ms, total written: 6000000, total
deleted: 0
2023-12-15T17:24:23,261 [testing.continuous.ContinuousIngest] INFO : FLUSH -
duration: 485ms, since last flush: 4850ms, total written: 7000000, total
deleted: 0
2023-12-15T17:24:28,543 [testing.continuous.ContinuousIngest] INFO : FLUSH -
duration: 389ms, since last flush: 5282ms, total written: 8000000, total
deleted: 0
2023-12-15T17:24:34,605 [testing.continuous.ContinuousIngest] INFO : FLUSH -
duration: 362ms, since last flush: 6062ms, total written: 9000000, total
deleted: 0
2023-12-15T17:24:40,499 [testing.continuous.ContinuousIngest] INFO : FLUSH -
duration: 558ms, since last flush: 5894ms, total written: 10000000, total
deleted: 0
2023-12-15T17:24:40,545 [testing.continuous.ManySplits] INFO : Creating 2
more tables by cloning the first
2023-12-15T17:24:48,539 [testing.continuous.ManySplits] INFO : Changing
split threshold on all tables from 1G to 102M
2023-12-15T17:24:48,580 [testing.continuous.ManySplits] INFO : Waiting for
each tablet to have a sum file size <= 102M
2023-12-15T17:24:50,605 [testing.continuous.ManySplits] INFO : 1 tablets
have file sizes not yet <= 102M on table manysplits.table2. Diff of avg
offending file(s): 194M
2023-12-15T17:24:50,605 [testing.continuous.ManySplits] INFO : 1 tablets
have file sizes not yet <= 102M on table manysplits.table1. Diff of avg
offending file(s): 197M
2023-12-15T17:24:50,605 [testing.continuous.ManySplits] INFO : 1 tablets
have file sizes not yet <= 102M on table manysplits.table3. Diff of avg
offending file(s): 194M
....
2023-12-15T17:25:35,736 [testing.continuous.ManySplits] INFO : 1 tablets
have file sizes not yet <= 102M on table manysplits.table2. Diff of avg
offending file(s): 52M
2023-12-15T17:25:35,736 [testing.continuous.ManySplits] INFO : 1 tablets
have file sizes not yet <= 102M on table manysplits.table1. Diff of avg
offending file(s): 52M
2023-12-15T17:25:35,736 [testing.continuous.ManySplits] INFO : 1 tablets
have file sizes not yet <= 102M on table manysplits.table3. Diff of avg
offending file(s): 52M
2023-12-15T17:25:36,740 [testing.continuous.ManySplits] INFO : Time taken
for all tables to reach expected total file size (102M): 48 seconds (48199ms)
2023-12-15T17:25:36,742 [testing.continuous.ManySplits] INFO : Changing
split threshold on all tables from 102M to 10M
2023-12-15T17:25:36,751 [testing.continuous.ManySplits] INFO : Waiting for
each tablet to have a sum file size <= 10M
2023-12-15T17:25:38,758 [testing.continuous.ManySplits] INFO : 3 tablets
have file sizes not yet <= 10M on table manysplits.table1. Diff of avg
offending file(s): 67M
2023-12-15T17:25:38,758 [testing.continuous.ManySplits] INFO : 3 tablets
have file sizes not yet <= 10M on table manysplits.table2. Diff of avg
offending file(s): 67M
2023-12-15T17:25:38,758 [testing.continuous.ManySplits] INFO : 3 tablets
have file sizes not yet <= 10M on table manysplits.table3. Diff of avg
offending file(s): 67M
....
2023-12-15T17:27:30,030 [testing.continuous.ManySplits] INFO : 1 tablets
have file sizes not yet <= 10M on table manysplits.table2. Diff of avg
offending file(s): 9M
2023-12-15T17:27:33,037 [testing.continuous.ManySplits] INFO : 1 tablets
have file sizes not yet <= 10M on table manysplits.table2. Diff of avg
offending file(s): 9M
2023-12-15T17:27:36,044 [testing.continuous.ManySplits] INFO : 1 tablets
have file sizes not yet <= 10M on table manysplits.table2. Diff of avg
offending file(s): 9M
2023-12-15T17:27:37,049 [testing.continuous.ManySplits] INFO : Time taken
for all tables to reach expected total file size (10M): 120 seconds (120304ms)
2023-12-15T17:27:37,052 [testing.continuous.ManySplits] INFO : Changing
split threshold on all tables from 10M to 1M
2023-12-15T17:27:37,094 [testing.continuous.ManySplits] INFO : Waiting for
each tablet to have a sum file size <= 1M
2023-12-15T17:27:39,102 [testing.continuous.ManySplits] INFO : 7 tablets
have file sizes not yet <= 1M on table manysplits.table3. Diff of avg offending
file(s): 8M
2023-12-15T17:27:39,102 [testing.continuous.ManySplits] INFO : 4 tablets
have file sizes not yet <= 1M on table manysplits.table1. Diff of avg offending
file(s): 8M
2023-12-15T17:27:39,102 [testing.continuous.ManySplits] INFO : 7 tablets
have file sizes not yet <= 1M on table manysplits.table2. Diff of avg offending
file(s): 8M
....
2023-12-15T17:29:48,569 [testing.continuous.ManySplits] INFO : 3 tablets
have file sizes not yet <= 1M on table manysplits.table3. Diff of avg offending
file(s): 187K
2023-12-15T17:29:51,582 [testing.continuous.ManySplits] INFO : 8 tablets
have file sizes not yet <= 1M on table manysplits.table2. Diff of avg offending
file(s): 189K
2023-12-15T17:29:54,614 [testing.continuous.ManySplits] INFO : Time taken
for all tables to reach expected total file size (1M): 137 seconds (137549ms)
2023-12-15T17:29:54,615 [testing.continuous.ManySplits] INFO : Test
completed successfully.
2023-12-15T17:29:54,616 [testing.continuous.ManySplits] INFO : Test results:
Total test rounds: 3
Table count: 3
Test round 0:
TABLE_SPLIT_THRESHOLD 1G -> 102M
Splits count: 0 -> 9
Splits per second: 0.19
Test round 1:
TABLE_SPLIT_THRESHOLD 102M -> 10M
Splits count: 9 -> 93
Splits per second: 0.70
Test round 2:
TABLE_SPLIT_THRESHOLD 10M -> 1M
Splits count: 93 -> 1533
Splits per second: 10.51
2023-12-15T17:29:54,616 [testing.continuous.ManySplits] INFO : Deleting
tables
2023-12-15T17:30:02,545 [testing.continuous.ManySplits] INFO : Deleting
namespace
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
