Re: Extremely Small Segments

2021-02-12 Thread Shawn Heisey
On 2/12/2021 4:30 AM, yasoobhaider wrote: Note: Nothing out of the ordinary in logs. Only /update request logs. Can you share your logs? The best option would be to include everything in the logs directory. Hopefully you have not altered the default logging config, which sets the detail to

Re: Extremely Small Segments

2021-02-12 Thread Alessandro Benedetti
at the throughput of our earlier > master-slave setup, but soon the machines ran into full blown Garbage > Collection. This throughput was not a lot though. We index the whole > collection overnight, so roughly ~250k documents in 6 hours. That's roughly > 12rps. > > So now I'm do

Extremely Small Segments

2021-02-12 Thread samuel...@grupoinditex.mail.onmicrosoft.com


Extremely Small Segments

2021-02-12 Thread yasoobhaider
I'm indexing at 1 document/2seconds, so every minute ~30 documents. Observations: 1. I'm noticing extremely small segments in the segments UI. Example: Segment _1h4: #docs: 5 #dels: 0 size: 1,586,878 bytes age: 2021-02-12T11:05:33.050Z source: flush Why is lucene creating such small segments? I

Extremely small segments

2021-02-12 Thread samuel...@grupoinditex.mail.onmicrosoft.com


Extremely small segments

2021-02-12 Thread Yasoob Haider
I'm indexing at 1 document/2seconds, so every minute ~30 documents. Observations: 1. I'm noticing extremely small segments in the segments UI. Example: Segment _1h4: #docs: 5 #dels: 0 size: 1,586,878 bytes age: 2021-02-12T11:05:33.050Z source: flush Why is lucene creating such small segments? I