[
https://issues.apache.org/jira/browse/LUCENE-8267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16448788#comment-16448788
]
Robert Muir commented on LUCENE-8267:
-------------------------------------
{quote}
Thanks for the suggestion to use MMapDirectory.preload, I didn't know about it,
but that appears to only help warmup, not sustained performance; right?
{quote}
loading stuff into heap memory gives no higher guarantee than doing it this way
under pressure, it still depends on vm parameters.
{quote}
I get the maintenance aspect but we need community input on such decisions to
ascertain real-world use.
{quote}
That is not how it works: this is open source. These memory/direct formats
cause excessive maintenance hassle with the tests. I saw Alan and Dawid
fighting with them and it seemed clear to me its not worth the trouble. We
should remove them: the cost is too high.
Someone can always pull in the source code themselves for their esoteric
use-case: but unless we have *maintainers* coming up then they need to go: this
doesn't come down to a vote by users.
If you want to make it hard for us to clean up tech debt like this, by -1s and
so on, thats your choice. But it is also my choice to make it hard to add
things.
Trust me, I will make it equally hard to add code as it is to remove code. It
is the only way to make things sustainable.
> Remove memory codecs from the codebase
> --------------------------------------
>
> Key: LUCENE-8267
> URL: https://issues.apache.org/jira/browse/LUCENE-8267
> Project: Lucene - Core
> Issue Type: Task
> Reporter: Dawid Weiss
> Priority: Major
>
> Memory codecs (MemoryPostings*, MemoryDocValues*) are part of random
> selection of codecs for tests and cause occasional OOMs when a test with huge
> data is selected. We don't use those memory codecs anywhere outside of tests,
> it has been suggested to just remove them to avoid maintenance costs and OOMs
> in tests. [1]
> [1] https://apache.markmail.org/thread/mj53os2ekyldsoy3
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
