Hi all, we're building vector indexes and we'd like to achieve large segments. There's `IndexWriterConfig.setRAMPerThreadHardLimitMB` that defaults to 1945 and can be set to up to 2048 MB. I've commented out the precondition in the method and set the limit to 16384 and I have successfully built 6GB segment (didn't try more).
The larger segment is twice as fast to query (than equivalent smaller segments), though it takes longer to build. My question is into what issues might I run if I keep it above 2048? Its javadoc says that there's internal 32-bit memory addressing - where? Viliam
