dweiss opened a new issue, #16644:
URL: https://github.com/apache/lucene/issues/16644

   ### Description
   
   The changes made in #16418 affect the file handle count significantly. Our 
handle-limiting guard caught this here:
   
   https://ci-builds.apache.org/job/Lucene/job/Lucene-Check-main/16971/
   
   Local repro on main: 
   ```
   gradlew :lucene:core:test --tests 
"org.apache.lucene.index.TestMixedDocValuesUpdates.testStressMultiThreading" 
-Ptests.asserts=false -Ptests.file.encoding=UTF-8 -Ptests.gui=true 
-Ptests.haltonfailure=false -Ptests.jvmargs= -Ptests.jvms=4 
-Ptests.multiplier=2 -Ptests.seed=E3F5824CCA864C24 -Ptests.vectorsize=512
   ```
   
   Claude's analysis:
   
   > The open-handle count of a reader now scales as segments times updated 
fields times (1 + overlays) times 2. With the default of 16 overlays, an index 
with 50 segments and 10 hot doc-values fields could hold on the order of 17,000 
descriptors instead of 1,000. I think this is worth raising with Jim on the PR 
or a new issue rather than just bumping the test limit.
   
   I wonder if this is something that should be fixed in the patch/core rather 
than just by bumping this test's `HandleLimitFS.MaxOpenHandles`. I bet this 
will affect people if it's true.
   
   @jimczi ?
   
   ### Version and environment details
   
   _No response_


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to