[
https://issues.apache.org/jira/browse/LUCENE-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16744419#comment-16744419
]
Ankit Jain commented on LUCENE-8635:
Thanks [~sokolov] for updating patch and doing another run. As
[
https://issues.apache.org/jira/browse/LUCENE-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16743577#comment-16743577
]
Ankit Jain commented on LUCENE-8635:
Rally tests use underlying elasticsearch cluster which use
[
https://issues.apache.org/jira/browse/LUCENE-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749180#comment-16749180
]
Ankit Jain edited comment on LUCENE-8635 at 1/22/19 9:40 PM:
-
bq.
[
https://issues.apache.org/jira/browse/LUCENE-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749180#comment-16749180
]
Ankit Jain commented on LUCENE-8635:
bq. {quote}Technically we could make things work for existing
[
https://issues.apache.org/jira/browse/LUCENE-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749180#comment-16749180
]
Ankit Jain edited comment on LUCENE-8635 at 1/22/19 9:41 PM:
-
[
https://issues.apache.org/jira/browse/LUCENE-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750316#comment-16750316
]
Ankit Jain edited comment on LUCENE-8635 at 1/23/19 6:47 PM:
-
{quote}Ankit
[
https://issues.apache.org/jira/browse/LUCENE-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750316#comment-16750316
]
Ankit Jain commented on LUCENE-8635:
{quote}Ankit Jain unfortunately RandomAccessInput doesn't offer
Ankit Jain created LUCENE-8635:
--
Summary: Lazy loading Lucene FST offheap using mmap
Key: LUCENE-8635
URL: https://issues.apache.org/jira/browse/LUCENE-8635
Project: Lucene - Core
Issue Type:
[
https://issues.apache.org/jira/browse/LUCENE-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740855#comment-16740855
]
Ankit Jain commented on LUCENE-8635:
I ran the test suite and couple of tests seem to fail. Though,
[
https://issues.apache.org/jira/browse/LUCENE-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740855#comment-16740855
]
Ankit Jain edited comment on LUCENE-8635 at 1/12/19 12:07 AM:
--
The excel
[
https://issues.apache.org/jira/browse/LUCENE-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740855#comment-16740855
]
Ankit Jain edited comment on LUCENE-8635 at 1/12/19 12:08 AM:
--
The excel
[
https://issues.apache.org/jira/browse/LUCENE-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740855#comment-16740855
]
Ankit Jain edited comment on LUCENE-8635 at 1/12/19 4:58 AM:
-
The excel
[
https://issues.apache.org/jira/browse/LUCENE-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740997#comment-16740997
]
Ankit Jain commented on LUCENE-8635:
Thanks for the tip Erick. I ran the failing tests individually
[
https://issues.apache.org/jira/browse/LUCENE-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753595#comment-16753595
]
Ankit Jain commented on LUCENE-8635:
I also independently tried performance run after removing the
[
https://issues.apache.org/jira/browse/LUCENE-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankit Jain updated LUCENE-8635:
---
Attachment: optional_offheap_ra.patch
> Lazy loading Lucene FST offheap using mmap
>
[
https://issues.apache.org/jira/browse/LUCENE-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753595#comment-16753595
]
Ankit Jain edited comment on LUCENE-8635 at 1/27/19 9:23 PM:
-
I also
[
https://issues.apache.org/jira/browse/LUCENE-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753609#comment-16753609
]
Ankit Jain edited comment on LUCENE-8635 at 1/27/19 10:14 PM:
--
Results for
[
https://issues.apache.org/jira/browse/LUCENE-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753609#comment-16753609
]
Ankit Jain commented on LUCENE-8635:
Results for bigger data sets:
{code| title=wikimedium10m, java
[
https://issues.apache.org/jira/browse/LUCENE-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753595#comment-16753595
]
Ankit Jain edited comment on LUCENE-8635 at 1/27/19 9:26 PM:
-
I also
[
https://issues.apache.org/jira/browse/LUCENE-8671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16786133#comment-16786133
]
Ankit Jain commented on LUCENE-8671:
bq. We can then pass it down to the relevant parts and make it
[
https://issues.apache.org/jira/browse/LUCENE-8671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775680#comment-16775680
]
Ankit Jain commented on LUCENE-8671:
bq. Ankit Jain We could maybe add a setter on
[
https://issues.apache.org/jira/browse/LUCENE-8671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16788340#comment-16788340
]
Ankit Jain commented on LUCENE-8671:
[~simonw] [~mikemccand] I have created PR -
[
https://issues.apache.org/jira/browse/LUCENE-8671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16788340#comment-16788340
]
Ankit Jain edited comment on LUCENE-8671 at 3/10/19 1:01 AM:
-
[~simonw]
[
https://issues.apache.org/jira/browse/LUCENE-8671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762028#comment-16762028
]
Ankit Jain commented on LUCENE-8671:
I have added [^offheap_settings.patch] that allows user to pass
[
https://issues.apache.org/jira/browse/LUCENE-8671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankit Jain updated LUCENE-8671:
---
Attachment: offheap_settings.patch
> Add setting for moving FST offheap/onheap
>
[
https://issues.apache.org/jira/browse/LUCENE-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764370#comment-16764370
]
Ankit Jain commented on LUCENE-8635:
I added print statements while running the benchmarks, and the
[
https://issues.apache.org/jira/browse/LUCENE-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764370#comment-16764370
]
Ankit Jain edited comment on LUCENE-8635 at 2/10/19 9:51 AM:
-
I added print
[
https://issues.apache.org/jira/browse/LUCENE-8671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16772641#comment-16772641
]
Ankit Jain commented on LUCENE-8671:
[~mikemccand] Also, I'm wondering if we need per field setting
[
https://issues.apache.org/jira/browse/LUCENE-8671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankit Jain updated LUCENE-8671:
---
Attachment: offheap_generic_settings.patch
> Add setting for moving FST offheap/onheap
>
[
https://issues.apache.org/jira/browse/LUCENE-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764051#comment-16764051
]
Ankit Jain commented on LUCENE-8635:
{quote}Ankit Jain that's strange yeah – this patch was supposed
[
https://issues.apache.org/jira/browse/LUCENE-8671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764055#comment-16764055
]
Ankit Jain commented on LUCENE-8671:
Hi David,
Thanks for the feedback.
{quote}Modifying FieldInfo
[
https://issues.apache.org/jira/browse/LUCENE-8671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16772384#comment-16772384
]
Ankit Jain commented on LUCENE-8671:
bq. But can you use the existing attributes instead of adding a
[
https://issues.apache.org/jira/browse/LUCENE-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16755389#comment-16755389
]
Ankit Jain edited comment on LUCENE-8635 at 1/29/19 9:20 PM:
-
{quote}Given
[
https://issues.apache.org/jira/browse/LUCENE-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16755389#comment-16755389
]
Ankit Jain commented on LUCENE-8635:
{quote}Given that the performance hit is mostly on PK lookups,
[
https://issues.apache.org/jira/browse/LUCENE-8671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankit Jain updated LUCENE-8671:
---
Description:
While LUCENE-8635, adds support for loading FST offheap using mmap, users do
not have
Ankit Jain created LUCENE-8671:
--
Summary: Adding setting for moving FST offheap/onheap
Key: LUCENE-8671
URL: https://issues.apache.org/jira/browse/LUCENE-8671
Project: Lucene - Core
Issue Type:
[
https://issues.apache.org/jira/browse/LUCENE-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16756963#comment-16756963
]
Ankit Jain commented on LUCENE-8635:
Given that reversing the index during write to make it forward
[
https://issues.apache.org/jira/browse/LUCENE-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16760118#comment-16760118
]
Ankit Jain commented on LUCENE-8635:
I have created [pull
[
https://issues.apache.org/jira/browse/LUCENE-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16760118#comment-16760118
]
Ankit Jain edited comment on LUCENE-8635 at 2/4/19 7:35 PM:
I have created
[
https://issues.apache.org/jira/browse/LUCENE-8783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankit Jain updated LUCENE-8783:
---
Description:
Even though, [LUCENE-8635](https://issues.apache.org/jira/browse/LUCENE-8635)
and
[
https://issues.apache.org/jira/browse/LUCENE-8783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankit Jain updated LUCENE-8783:
---
Description:
Even though, LUCENE-8635 and LUCENE-8671 adds support to keep FST offheap for
default
[
https://issues.apache.org/jira/browse/LUCENE-8783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankit Jain updated LUCENE-8783:
---
Review Patch?: (was: Yes)
> Support FST lazy loading for non-default Codecs
>
[
https://issues.apache.org/jira/browse/LUCENE-8783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankit Jain updated LUCENE-8783:
---
Lucene Fields: New (was: New,Patch Available)
> Support FST lazy loading for non-default Codecs
>
Ankit Jain created LUCENE-8783:
--
Summary: Support FST lazy loading for non-default Codecs
Key: LUCENE-8783
URL: https://issues.apache.org/jira/browse/LUCENE-8783
Project: Lucene - Core
Issue
[
https://issues.apache.org/jira/browse/LUCENE-8783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankit Jain updated LUCENE-8783:
---
Environment: (was: I used below setup for es_rally tests:
single node i3.xlarge running ES 6.5
[
https://issues.apache.org/jira/browse/LUCENE-8783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankit Jain updated LUCENE-8783:
---
Description: Even though,
[LUCENE-8635](https://issues.apache.org/jira/browse/LUCENE-8635) and
[
https://issues.apache.org/jira/browse/LUCENE-8783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankit Jain updated LUCENE-8783:
---
Summary: Add FST Offheap for non-default Codecs (was: Support FST lazy
loading for non-default
[
https://issues.apache.org/jira/browse/LUCENE-8783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankit Jain updated LUCENE-8783:
---
Description:
Even though, [~LUCENE-8635] and [~LUCENE-8671]adds support to keep FST offheap
for
[
https://issues.apache.org/jira/browse/LUCENE-8783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankit Jain updated LUCENE-8783:
---
Description:
Even though, LUCENE-8635 and LUCENE-8671 adds support to keep FST offheap for
default
[
https://issues.apache.org/jira/browse/LUCENE-8783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankit Jain updated LUCENE-8783:
---
Description:
Even though, [^LUCENE-8635] and [^LUCENE-8671]adds support to keep FST offheap
for
50 matches
Mail list logo
