[
https://issues.apache.org/jira/browse/LUCENE-8671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankit Jain updated LUCENE-8671:
-------------------------------
Description:
While LUCENE-8635, adds support for loading FST offheap using mmap, users do
not have the flexibility to specify fields for which FST needs to be offheap.
This allows users to tune heap usage as per their workload.
Ideal way will be to add an attribute to FieldInfo, where we have
put/getAttribute. Then FieldReader can inspect the FieldInfo and pass the
appropriate On/OffHeapStore when creating its FST. It can support special
keywords like ALL/NONE.
was:
in real case,we use lucene index many documents. But some machine have not much
memory.,once documents reach up to tens of billion,lucene can not start because
of no enough memory. Most of the memry cost is FST;s .tip content.
So I want to pull my change on lucene core to make load FST's .tip into memory
become configurable!
What do you think?
Summary: Add setting for moving FST offheap/onheap (was: Adding
setting for moving FST offheap/onheap)
> Add setting for moving FST offheap/onheap
> -----------------------------------------
>
> Key: LUCENE-8671
> URL: https://issues.apache.org/jira/browse/LUCENE-8671
> Project: Lucene - Core
> Issue Type: New Feature
> Components: core/FSTs, core/store
> Reporter: Ankit Jain
> Priority: Minor
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> While LUCENE-8635, adds support for loading FST offheap using mmap, users do
> not have the flexibility to specify fields for which FST needs to be
> offheap. This allows users to tune heap usage as per their workload.
> Ideal way will be to add an attribute to FieldInfo, where we have
> put/getAttribute. Then FieldReader can inspect the FieldInfo and pass the
> appropriate On/OffHeapStore when creating its FST. It can support special
> keywords like ALL/NONE.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
