[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-11-18 Thread Adrien Grand (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234755#comment-17234755 ] Adrien Grand commented on LUCENE-9378: -- [~gworah] I'm pretty sure that the drop is due to this

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-11-17 Thread Michael McCandless (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17233885#comment-17233885 ] Michael McCandless commented on LUCENE-9378: {quote}Meanwhile, I'll open an issue to disable

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-11-17 Thread Gautam Worah (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17233826#comment-17233826 ] Gautam Worah commented on LUCENE-9378: -- Thanks for catching that regression so quickly Adrien! I

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-11-17 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17233445#comment-17233445 ] ASF subversion and git services commented on LUCENE-9378: - Commit

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-11-16 Thread Adrien Grand (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17232812#comment-17232812 ] Adrien Grand commented on LUCENE-9378: -- This introduced some slowdowns on the nightly benchmarks,

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-11-14 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17232045#comment-17232045 ] ASF subversion and git services commented on LUCENE-9378: - Commit

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-11-14 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17232044#comment-17232044 ] ASF subversion and git services commented on LUCENE-9378: - Commit

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-11-14 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17232043#comment-17232043 ] ASF subversion and git services commented on LUCENE-9378: - Commit

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-11-14 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17232042#comment-17232042 ] ASF subversion and git services commented on LUCENE-9378: - Commit

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-11-14 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17232040#comment-17232040 ] ASF subversion and git services commented on LUCENE-9378: - Commit

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-11-13 Thread Michael McCandless (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231472#comment-17231472 ] Michael McCandless commented on LUCENE-9378: Thanks [~jpountz]! > Configurable compression

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-11-12 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17230911#comment-17230911 ] ASF subversion and git services commented on LUCENE-9378: - Commit

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-11-12 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17230912#comment-17230912 ] ASF subversion and git services commented on LUCENE-9378: - Commit

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-11-12 Thread Nico Tonozzi (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17230801#comment-17230801 ] Nico Tonozzi commented on LUCENE-9378: -- Thank you for the help here folks, and especially

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-11-12 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17230701#comment-17230701 ] ASF subversion and git services commented on LUCENE-9378: - Commit

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-11-12 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17230700#comment-17230700 ] ASF subversion and git services commented on LUCENE-9378: - Commit

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-11-09 Thread Michael McCandless (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17228681#comment-17228681 ] Michael McCandless commented on LUCENE-9378: {quote}I'll be looking into it for 8.8. {quote}

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-11-09 Thread Adrien Grand (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17228665#comment-17228665 ] Adrien Grand commented on LUCENE-9378: -- I'll be looking into it for 8.8. > Configurable

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-11-09 Thread Michael McCandless (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17228642#comment-17228642 ] Michael McCandless commented on LUCENE-9378: {quote}IMO this is so definitely not a "Minor"

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-11-06 Thread Michael McCandless (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227469#comment-17227469 ] Michael McCandless commented on LUCENE-9378: {quote}I'm wondering if there is anything I

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-10-29 Thread Alex Klibisz (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223292#comment-17223292 ] Alex Klibisz commented on LUCENE-9378: -- Using the `Lucene70DocValuesFormat` gets me back to the pre

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-10-29 Thread Alex Klibisz (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223132#comment-17223132 ] Alex Klibisz commented on LUCENE-9378: -- > The workaround we were forced to set our codec to a

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-10-29 Thread Nico Tonozzi (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223016#comment-17223016 ] Nico Tonozzi commented on LUCENE-9378: -- [~alexklibisz] The workaround we were forced to set our

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-10-29 Thread Michael Gibney (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17222962#comment-17222962 ] Michael Gibney commented on LUCENE-9378: {quote}I prefer that BinaryDocValues be simple/fast as

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-10-29 Thread Alex Klibisz (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17222935#comment-17222935 ] Alex Klibisz commented on LUCENE-9378: -- Are there any suggested workarounds for this issue at the

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-09-18 Thread David Smiley (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17198646#comment-17198646 ] David Smiley commented on LUCENE-9378: -- Given that docValues (compared to "stored" values) is

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-09-18 Thread Michael McCandless (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17198570#comment-17198570 ] Michael McCandless commented on LUCENE-9378: {quote}I'm not sure what the path forward is.

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-09-18 Thread Adrien Grand (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17198432#comment-17198432 ] Adrien Grand commented on LUCENE-9378: -- I'm surprised it's slower since other cases that were about

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-09-15 Thread Julie Tibshirani (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196567#comment-17196567 ] Julie Tibshirani commented on LUCENE-9378: -- Adding another datapoint in case it’s helpful:

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-08-26 Thread Nico Tonozzi (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17185324#comment-17185324 ] Nico Tonozzi commented on LUCENE-9378: -- Oh, and to clarify, we are not sorting by this field, but

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-08-24 Thread Nico Tonozzi (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183431#comment-17183431 ] Nico Tonozzi commented on LUCENE-9378: -- The most expensive data to load is a serialized

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-08-24 Thread Adrien Grand (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183291#comment-17183291 ] Adrien Grand commented on LUCENE-9378: -- [~nicot] Can you give more details about what you're

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-08-20 Thread Nico Tonozzi (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181436#comment-17181436 ] Nico Tonozzi commented on LUCENE-9378: -- We have also noticed this problem at Twitter. The search

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-06-18 Thread Alex Klibisz (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140163#comment-17140163 ] Alex Klibisz commented on LUCENE-9378: -- [~jpountz] It's about 2x slower.  I re-ran a benchmark to

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-06-18 Thread Adrien Grand (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139977#comment-17139977 ] Adrien Grand commented on LUCENE-9378: -- [~alexklibisz] Thanks for the details, what is the order of

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-06-16 Thread Alex Klibisz (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17137925#comment-17137925 ] Alex Klibisz commented on LUCENE-9378: -- [~mgibney]  > quick clarification regarding "for every doc

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-06-16 Thread Michael Gibney (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17137820#comment-17137820 ] Michael Gibney commented on LUCENE-9378: [~alexklibisz], quick clarification regarding "for

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-06-16 Thread Alex Klibisz (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17136668#comment-17136668 ] Alex Klibisz commented on LUCENE-9378: -- [~jpountz] Sure, I'll explain below: My plugin is doing

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-06-16 Thread Adrien Grand (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17136454#comment-17136454 ] Adrien Grand commented on LUCENE-9378: -- [~alexklibisz] Can you give more details about what you are

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-06-12 Thread Alex Klibisz (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134629#comment-17134629 ] Alex Klibisz commented on LUCENE-9378: -- Hi, just as another datapoint: I'm using BinaryDocValues

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-05-26 Thread Michael Sokolov (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116719#comment-17116719 ] Michael Sokolov commented on LUCENE-9378: - Another use case I'd like to plan for is using

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-05-26 Thread Michael Sokolov (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116713#comment-17116713 ] Michael Sokolov commented on LUCENE-9378: - {quote}... disabled compression for short binary

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-05-26 Thread Adrien Grand (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116518#comment-17116518 ] Adrien Grand commented on LUCENE-9378: -- I profiled some of these sorting tasks to understand where

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-05-25 Thread Michael Sokolov (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116167#comment-17116167 ] Michael Sokolov commented on LUCENE-9378: - {quote}... binary doc values at Amazon, ie. are

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-05-25 Thread Adrien Grand (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115885#comment-17115885 ] Adrien Grand commented on LUCENE-9378: -- bq. Another factor that probably plays a role here is how

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-05-24 Thread Michael McCandless (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115553#comment-17115553 ] Michael McCandless commented on LUCENE-9378: {quote}As an alternative to API changes and

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-05-23 Thread Robert Muir (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114727#comment-17114727 ] Robert Muir commented on LUCENE-9378: - As an alternative to API changes and on/off stuff (which is

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-05-23 Thread Michael Sokolov (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114706#comment-17114706 ] Michael Sokolov commented on LUCENE-9378: - This is the output of the "normal" wikimediumall

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-05-22 Thread Adrien Grand (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114010#comment-17114010 ] Adrien Grand commented on LUCENE-9378: -- The code suggests that block decompression happens only

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-05-22 Thread Michael McCandless (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17113960#comment-17113960 ] Michael McCandless commented on LUCENE-9378: Thanks for running the luceneutil benchmarks

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-05-21 Thread Michael Sokolov (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17113535#comment-17113535 ] Michael Sokolov commented on LUCENE-9378: - Here are the index file sizes (after merging to a

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-05-21 Thread Adrien Grand (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17113506#comment-17113506 ] Adrien Grand commented on LUCENE-9378: -- If you still have the indices, I'd be curious to know what

[jira] [Commented] (LUCENE-9378) Configurable compression for BinaryDocValues

2020-05-21 Thread Michael Sokolov (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17113489#comment-17113489 ] Michael Sokolov commented on LUCENE-9378: - I updated luceneutil to enable sorting by a