Re: nested documents performance anomaly

2019-04-17 Thread Jeff Wartes
* For soft commits, set the commit interval as large as you can stand. -Jeff Wartes From: Dale Richardson Reply-To: "dev@lucene.apache.org" Date: Sunday, April 14, 2019 at 3:58 AM To: "dev@lucene.apache.org" Subject: Re: nested documents performance anomaly Hi Roi, My unde

[jira] [Commented] (SOLR-6312) CloudSolrServer doesn't honor updatesToLeaders constructor argument

2017-10-17 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-6312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16208362#comment-16208362 ] Jeff Wartes commented on SOLR-6312: --- As of 7.0.1, three years later, yes, I think i

[jira] [Commented] (SOLR-7269) ZK as truth for SolrCloud

2017-01-25 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15838581#comment-15838581 ] Jeff Wartes commented on SOLR-7269: --- Any life still here? I've always thoug

Re: How would you architect solr/lucene if you were starting from scratch for them to be 10X+ faster/efficient ?

2017-01-23 Thread Jeff Wartes
I’ve had some curiosity about this question too. For a while, I watched for a seastar-like library for the JVM, but https://github.com/bestwpw/windmill was the only one I came across, and it doesn’t seem to be going anywhere. Since one of the points of the JVM is to abstract away the platform,

[jira] [Commented] (SOLR-5170) Spatial multi-value distance sort via DocValues

2017-01-10 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816053#comment-15816053 ] Jeff Wartes commented on SOLR-5170: --- Well, yes, I'm interested. I've go

[jira] [Commented] (SOLR-5170) Spatial multi-value distance sort via DocValues

2017-01-09 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812871#comment-15812871 ] Jeff Wartes commented on SOLR-5170: --- It's coming up on two years, and I'

[jira] [Commented] (SOLR-4735) Improve Solr metrics reporting

2016-12-12 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-4735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15743325#comment-15743325 ] Jeff Wartes commented on SOLR-4735: --- Understood, and not all cores are part

[jira] [Commented] (SOLR-4735) Improve Solr metrics reporting

2016-12-12 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-4735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15743207#comment-15743207 ] Jeff Wartes commented on SOLR-4735: --- That's almost perfect. Can we repl

[jira] [Commented] (SOLR-4735) Improve Solr metrics reporting

2016-12-12 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-4735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15743201#comment-15743201 ] Jeff Wartes commented on SOLR-4735: --- Oh, one thing just occurred to me though. There

[jira] [Comment Edited] (SOLR-4735) Improve Solr metrics reporting

2016-12-12 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-4735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15742740#comment-15742740 ] Jeff Wartes edited comment on SOLR-4735 at 12/12/16 6:3

[jira] [Commented] (SOLR-4735) Improve Solr metrics reporting

2016-12-12 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-4735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15742740#comment-15742740 ] Jeff Wartes commented on SOLR-4735: --- I've fallen behind keeping up with you

[jira] [Commented] (SOLR-4735) Improve Solr metrics reporting

2016-12-02 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-4735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15716772#comment-15716772 ] Jeff Wartes commented on SOLR-4735: --- That seems pretty viable too. As I mentioned,

[jira] [Commented] (SOLR-4735) Improve Solr metrics reporting

2016-12-02 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-4735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15716247#comment-15716247 ] Jeff Wartes commented on SOLR-4735: --- Yeah, I get that. I like this line of tho

[jira] [Commented] (SOLR-4735) Improve Solr metrics reporting

2016-12-02 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-4735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15715880#comment-15715880 ] Jeff Wartes commented on SOLR-4735: --- `MetricRegistry` is really just a bunc

[jira] [Commented] (SOLR-4735) Improve Solr metrics reporting

2016-11-29 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-4735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15707000#comment-15707000 ] Jeff Wartes commented on SOLR-4735: --- Heh, I wondered whether something like that w

[jira] [Commented] (SOLR-4735) Improve Solr metrics reporting

2016-11-25 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-4735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15696479#comment-15696479 ] Jeff Wartes commented on SOLR-4735: --- I had a scheme for collapsable namesp

[jira] [Commented] (SOLR-4735) Improve Solr metrics reporting

2016-11-24 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-4735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15693874#comment-15693874 ] Jeff Wartes commented on SOLR-4735: --- >From what I see, SolrMetricManager only ne

[jira] [Commented] (SOLR-4735) Improve Solr metrics reporting

2016-11-23 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-4735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15690992#comment-15690992 ] Jeff Wartes commented on SOLR-4735: --- For what it's worth, this looks like rea

[jira] [Commented] (SOLR-8785) Use Metrics library for core metrics

2016-11-21 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15684725#comment-15684725 ] Jeff Wartes commented on SOLR-8785: --- Understood, I'm all for incremental chan

[jira] [Commented] (SOLR-8785) Use Metrics library for core metrics

2016-11-21 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15684165#comment-15684165 ] Jeff Wartes commented on SOLR-8785: --- I'm trying to remember now, but I think

Re: Collection API for performance monitoring?

2016-11-17 Thread Jeff Wartes
I’m a big fan of the codehale/dropwizard Metrics library, but if you’re really serious about your histograms, even Metrics’s histograms are vulnerable to the Coordinated Omission problem. I haven’t used it yet, but I’ve been itching to try out this: https://bitbucket.org/marshallpierce/hdrhist

[jira] [Commented] (SOLR-4735) Improve Solr metrics reporting

2016-11-01 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-4735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15626442#comment-15626442 ] Jeff Wartes commented on SOLR-4735: --- I have, and am, by instantiati

[jira] [Commented] (SOLR-8785) Use Metrics library for core metrics

2016-10-21 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595671#comment-15595671 ] Jeff Wartes commented on SOLR-8785: --- For the record, it looks like I wrote this p

[jira] [Commented] (SOLR-8785) Use Metrics library for core metrics

2016-10-21 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595482#comment-15595482 ] Jeff Wartes commented on SOLR-8785: --- Providing a way to reset is fine, but I'

[jira] [Updated] (SOLR-4449) Enable backup requests for the internal solr load balancer

2016-10-21 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-4449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Wartes updated SOLR-4449: -- Labels: patch patch-available (was: patch-available) > Enable backup requests for the internal s

[jira] [Updated] (SOLR-8785) Use Metrics library for core metrics

2016-10-21 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Wartes updated SOLR-8785: -- Labels: patch patch-available (was: patch-available) > Use Metrics library for core metr

[jira] [Updated] (SOLR-4449) Enable backup requests for the internal solr load balancer

2016-10-21 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-4449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Wartes updated SOLR-4449: -- Labels: patch-available (was: ) > Enable backup requests for the internal solr load balan

[jira] [Updated] (SOLR-8785) Use Metrics library for core metrics

2016-10-21 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Wartes updated SOLR-8785: -- Labels: patch-available (was: ) > Use Metrics library for core metr

Re: [DISCUSS] JIRA maintenance and response times

2016-10-05 Thread Jeff Wartes
t;> and if it is still silent some time later there may be an email to dev@ >>> calling out for committer attention for SOLR-. >>> >>> If we get ourselves a dashboard, it would be nice to have a column listing >>> issues that are explicitly await

Re: [DISCUSS] JIRA maintenance and response times

2016-10-04 Thread Jeff Wartes
I’m not a committer, but Solr is the first major open source project I’ve followed closely enough to get a feel for the actual community. The issues coming up in this thread have been rattling around in my head for at least the last year, and I’m absolutely thrilled to see this conversation. I n

Re: How hard would a "wipe all deletes" operation be?

2016-08-16 Thread Jeff Wartes
Looks to me like if you’re using TieredMergePolicy, forceMergeDeletesPctAllowed is simply a way of including a segment as a merge candidate that would not have otherwise been a candidate (due to being a different tier). Setting it to zero means never include a segment as a merge candidate due t

[jira] [Commented] (SOLR-6581) Efficient DocValues support and numeric collapse field implementations for Collapse and Expand

2016-07-25 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15392504#comment-15392504 ] Jeff Wartes commented on SOLR-6581: --- For what it's worth, I recall hav

[jira] [Commented] (SOLR-9335) Move solr stats collections to use LongAdder

2016-07-25 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15392297#comment-15392297 ] Jeff Wartes commented on SOLR-9335: --- fwiw, SOLR-8241 involves cache implementations

[jira] [Created] (SOLR-9133) UUID FieldType shouldn't be stored as a String

2016-05-19 Thread Jeff Wartes (JIRA)
Jeff Wartes created SOLR-9133: - Summary: UUID FieldType shouldn't be stored as a String Key: SOLR-9133 URL: https://issues.apache.org/jira/browse/SOLR-9133 Project: Solr Issue Type: Improv

[jira] [Commented] (SOLR-9125) CollapseQParserPlugin allocations are index based, not query based

2016-05-17 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15287339#comment-15287339 ] Jeff Wartes commented on SOLR-9125: --- Isn't there a chicken-and-egg situation t

[jira] [Commented] (SOLR-9125) CollapseQParserPlugin allocations are index based, not query based

2016-05-17 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-9125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15286940#comment-15286940 ] Jeff Wartes commented on SOLR-9125: --- I messed around a little bit, but I don'

[jira] [Created] (SOLR-9125) CollapseQParserPlugin allocations are index based, not query based

2016-05-17 Thread Jeff Wartes (JIRA)
Jeff Wartes created SOLR-9125: - Summary: CollapseQParserPlugin allocations are index based, not query based Key: SOLR-9125 URL: https://issues.apache.org/jira/browse/SOLR-9125 Project: Solr

[jira] [Commented] (SOLR-8697) Fix LeaderElector issues

2016-05-13 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-8697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15282958#comment-15282958 ] Jeff Wartes commented on SOLR-8697: --- Does this fix SOLR-6498? > Fix Leader

[jira] [Commented] (LUCENE-7258) Tune DocIdSetBuilder allocation rate

2016-05-02 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-7258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267176#comment-15267176 ] Jeff Wartes commented on LUCENE-7258: - Ok, yeah, that’s a reasonable thing to as

[jira] [Commented] (LUCENE-7258) Tune DocIdSetBuilder allocation rate

2016-05-01 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-7258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15265829#comment-15265829 ] Jeff Wartes commented on LUCENE-7258: - There are actually three threads goin

[jira] [Commented] (LUCENE-7258) Tune DocIdSetBuilder allocation rate

2016-04-29 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-7258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15264309#comment-15264309 ] Jeff Wartes commented on LUCENE-7258: - I'm not sure I understand how the d

[jira] [Commented] (LUCENE-7258) Tune DocIdSetBuilder allocation rate

2016-04-27 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-7258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15260960#comment-15260960 ] Jeff Wartes commented on LUCENE-7258: - I'd be interested in trying Ti

[jira] [Updated] (LUCENE-7258) Tune DocIdSetBuilder allocation rate

2016-04-27 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-7258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Wartes updated LUCENE-7258: Attachment: LUCENE-7258-Tune-memory-allocation-rate-for-Intersec.patch After 24 hours, I found I

[jira] [Commented] (LUCENE-7258) Tune DocIdSetBuilder allocation rate

2016-04-26 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-7258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15258929#comment-15258929 ] Jeff Wartes commented on LUCENE-7258: - Random aside: I did do one test run whe

[jira] [Updated] (LUCENE-7258) Tune DocIdSetBuilder allocation rate

2016-04-26 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-7258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Wartes updated LUCENE-7258: Attachment: allocation_plot.jpg Attaching the graph directly. > Tune DocIdSetBuilder allocat

[jira] [Commented] (LUCENE-7258) Tune DocIdSetBuilder allocation rate

2016-04-26 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-7258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15258848#comment-15258848 ] Jeff Wartes commented on LUCENE-7258: - I put this patch on a production node

[jira] [Updated] (LUCENE-7258) Tune DocIdSetBuilder allocation rate

2016-04-26 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-7258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Wartes updated LUCENE-7258: Attachment: LUCENE-7258-Tune-memory-allocation-rate-for-Intersec.patch This patch does the

[jira] [Commented] (LUCENE-7258) Tune DocIdSetBuilder allocation rate

2016-04-26 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-7258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15258834#comment-15258834 ] Jeff Wartes commented on LUCENE-7258: - The "eia" label repres

[jira] [Created] (LUCENE-7258) Tune Spatial RPT Intersects allocation rate

2016-04-26 Thread Jeff Wartes (JIRA)
Jeff Wartes created LUCENE-7258: --- Summary: Tune Spatial RPT Intersects allocation rate Key: LUCENE-7258 URL: https://issues.apache.org/jira/browse/LUCENE-7258 Project: Lucene - Core Issue Type

[jira] [Commented] (SOLR-8944) Improve geospatial garbage generation

2016-04-12 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-8944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15237853#comment-15237853 ] Jeff Wartes commented on SOLR-8944: --- Results from applying this patch were q

[jira] [Updated] (SOLR-8944) Improve geospatial garbage generation

2016-04-12 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-8944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Wartes updated SOLR-8944: -- Attachment: SOLR-8944-Use-DocIdSetBuilder-instead-of-FixedBitSet.patch [~dsmiley]'s suggestio

[jira] [Commented] (SOLR-8241) Evaluate W-TinyLfu cache

2016-04-11 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-8241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15235935#comment-15235935 ] Jeff Wartes commented on SOLR-8241: --- Since Solr requires Java 8 as of 6.0, it seems

[jira] [Commented] (SOLR-8922) DocSetCollector can allocate massive garbage on large indexes

2016-04-06 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15229260#comment-15229260 ] Jeff Wartes commented on SOLR-8922: --- I stumbled onto SJK recently, which provides

[jira] [Commented] (SOLR-8944) Improve geospatial garbage generation

2016-04-05 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-8944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15226948#comment-15226948 ] Jeff Wartes commented on SOLR-8944: --- I hadn't refreshed and didn't se

[jira] [Commented] (SOLR-8944) Improve geospatial garbage generation

2016-04-05 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-8944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15226709#comment-15226709 ] Jeff Wartes commented on SOLR-8944: --- It was an easy test, so I tried simply usi

[jira] [Created] (SOLR-8944) Improve geospatial garbage generation

2016-04-04 Thread Jeff Wartes (JIRA)
Jeff Wartes created SOLR-8944: - Summary: Improve geospatial garbage generation Key: SOLR-8944 URL: https://issues.apache.org/jira/browse/SOLR-8944 Project: Solr Issue Type: Improvement

[jira] [Commented] (SOLR-8922) DocSetCollector can allocate massive garbage on large indexes

2016-03-31 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15220342#comment-15220342 ] Jeff Wartes commented on SOLR-8922: --- Both of those appear to add capacity by declari

[jira] [Commented] (SOLR-8922) DocSetCollector can allocate massive garbage on large indexes

2016-03-31 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15220299#comment-15220299 ] Jeff Wartes commented on SOLR-8922: --- With some tweaking, I was able to get G1 paus

[jira] [Commented] (SOLR-8922) DocSetCollector can allocate massive garbage on large indexes

2016-03-31 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15220136#comment-15220136 ] Jeff Wartes commented on SOLR-8922: --- Ok, so after a little more than 12 hours on on

[jira] [Commented] (SOLR-8922) DocSetCollector can allocate massive garbage on large indexes

2016-03-31 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15220052#comment-15220052 ] Jeff Wartes commented on SOLR-8922: --- Incidentally, I had one or two other findings

[jira] [Commented] (SOLR-8922) DocSetCollector can allocate massive garbage on large indexes

2016-03-31 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15220045#comment-15220045 ] Jeff Wartes commented on SOLR-8922: --- Absolutely. Memory pools were my first tho

[jira] [Commented] (SOLR-8922) DocSetCollector can allocate massive garbage on large indexes

2016-03-30 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15219066#comment-15219066 ] Jeff Wartes commented on SOLR-8922: --- Not yet. The major risk area would be the

[jira] [Commented] (SOLR-8922) DocSetCollector can allocate massive garbage on large indexes

2016-03-30 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15218974#comment-15218974 ] Jeff Wartes commented on SOLR-8922: --- For my index, (86M-doc shards and a per-s

[jira] [Updated] (SOLR-8922) DocSetCollector can allocate massive garbage on large indexes

2016-03-30 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Wartes updated SOLR-8922: -- Attachment: SOLR-8922.patch This is essentially the same patch as in SOLR-5444, but applies cleanly

[jira] [Commented] (SOLR-8922) DocSetCollector can allocate massive garbage on large indexes

2016-03-30 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15218910#comment-15218910 ] Jeff Wartes commented on SOLR-8922: --- SOLR-5444 had a patch to help with this, (

[jira] [Created] (SOLR-8922) DocSetCollector can allocate massive garbage on large indexes

2016-03-30 Thread Jeff Wartes (JIRA)
Jeff Wartes created SOLR-8922: - Summary: DocSetCollector can allocate massive garbage on large indexes Key: SOLR-8922 URL: https://issues.apache.org/jira/browse/SOLR-8922 Project: Solr Issue

[jira] [Commented] (SOLR-7887) Upgrade Solr to use log4j2 -- log4j 1 now officially end of life

2016-03-25 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15212210#comment-15212210 ] Jeff Wartes commented on SOLR-7887: --- SOLR-7698 and SOLR-6377 both have attempt

[jira] [Created] (SOLR-8785) Use Metrics library for core metrics

2016-03-03 Thread Jeff Wartes (JIRA)
Jeff Wartes created SOLR-8785: - Summary: Use Metrics library for core metrics Key: SOLR-8785 URL: https://issues.apache.org/jira/browse/SOLR-8785 Project: Solr Issue Type: Improvement

[jira] [Commented] (SOLR-8725) Invalid name error with core names with hyphens

2016-02-26 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-8725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15169572#comment-15169572 ] Jeff Wartes commented on SOLR-8725: --- Well, I'm glad I haven't tried mov

[jira] [Closed] (SOLR-8531) ZK leader path changed in 5.4

2016-01-26 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-8531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Wartes closed SOLR-8531. - > ZK leader path changed in 5.4 > - > > Ke

[jira] [Resolved] (SOLR-8531) ZK leader path changed in 5.4

2016-01-26 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-8531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Wartes resolved SOLR-8531. --- Resolution: Fixed Fix Version/s: 5.4.1 > ZK leader path changed in

[jira] [Commented] (SOLR-8531) ZK leader path changed in 5.4

2016-01-26 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-8531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15117568#comment-15117568 ] Jeff Wartes commented on SOLR-8531: --- Looks like this was resolved in SOLR-8561

[jira] [Commented] (SOLR-8531) ZK leader path changed in 5.4

2016-01-10 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-8531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15091427#comment-15091427 ] Jeff Wartes commented on SOLR-8531: --- I just looked again, and 5.4 is indeed writing

[jira] [Commented] (SOLR-8531) ZK leader path changed in 5.4

2016-01-09 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-8531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090732#comment-15090732 ] Jeff Wartes commented on SOLR-8531: --- 1. A fully upgraded cluster behaves normall

[jira] [Commented] (SOLR-8531) ZK leader path changed in 5.4

2016-01-09 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-8531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090706#comment-15090706 ] Jeff Wartes commented on SOLR-8531: --- I was imagining a note https://lucene.apache

[jira] [Created] (SOLR-8531) ZK leader path changed in 5.4

2016-01-08 Thread Jeff Wartes (JIRA)
Jeff Wartes created SOLR-8531: - Summary: ZK leader path changed in 5.4 Key: SOLR-8531 URL: https://issues.apache.org/jira/browse/SOLR-8531 Project: Solr Issue Type: Bug Components

[jira] [Commented] (SOLR-4449) Enable backup requests for the internal solr load balancer

2015-12-11 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-4449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15053711#comment-15053711 ] Jeff Wartes commented on SOLR-4449: --- For what it's worth, if I were a solr com

[jira] [Commented] (SOLR-4449) Enable backup requests for the internal solr load balancer

2015-12-11 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-4449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15053665#comment-15053665 ] Jeff Wartes commented on SOLR-4449: --- I looked around a bit, and unless I'

[jira] [Created] (SOLR-8171) Facet query filterCache usage is psychic

2015-10-19 Thread Jeff Wartes (JIRA)
Jeff Wartes created SOLR-8171: - Summary: Facet query filterCache usage is psychic Key: SOLR-8171 URL: https://issues.apache.org/jira/browse/SOLR-8171 Project: Solr Issue Type: Bug

[jira] [Commented] (SOLR-4449) Enable backup requests for the internal solr load balancer

2015-10-08 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-4449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949141#comment-14949141 ] Jeff Wartes commented on SOLR-4449: --- Ah, great. Yeah, same thing. I knew it had

[jira] [Commented] (SOLR-4449) Enable backup requests for the internal solr load balancer

2015-10-07 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-4449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14947724#comment-14947724 ] Jeff Wartes commented on SOLR-4449: --- I've added performance tracking to this

[jira] [Commented] (SOLR-8059) NPE distributed DebugComponent

2015-09-28 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14933631#comment-14933631 ] Jeff Wartes commented on SOLR-8059: --- I've seen this too. I assumed it was r

[jira] [Commented] (SOLR-4449) Enable backup requests for the internal solr load balancer

2015-09-21 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-4449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14901555#comment-14901555 ] Jeff Wartes commented on SOLR-4449: --- I pulled this patch out into a freestanding jar

[jira] [Commented] (SOLR-7698) solr alternative logback contrib

2015-08-19 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14703723#comment-14703723 ] Jeff Wartes commented on SOLR-7698: --- Also see SOLR-6377 > solr alternative

[jira] [Updated] (SOLR-7493) Requests aren't distributed evenly if the collection isn't present locally

2015-04-30 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Wartes updated SOLR-7493: -- Labels: (was: pat) > Requests aren't distributed evenly if the collection isn't pr

[jira] [Updated] (SOLR-7493) Requests aren't distributed evenly if the collection isn't present locally

2015-04-30 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Wartes updated SOLR-7493: -- Labels: pat (was: ) > Requests aren't distributed evenly if the collection isn't pr

[jira] [Updated] (SOLR-7493) Requests aren't distributed evenly if the collection isn't present locally

2015-04-30 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-7493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Wartes updated SOLR-7493: -- Attachment: SOLR-7493.patch It looks like this happens because SolrDispatchFilter's getRemoteCo

[jira] [Created] (SOLR-7493) Requests aren't distributed evenly if the collection isn't present locally

2015-04-30 Thread Jeff Wartes (JIRA)
Jeff Wartes created SOLR-7493: - Summary: Requests aren't distributed evenly if the collection isn't present locally Key: SOLR-7493 URL: https://issues.apache.org/jira/browse/SOLR-7493 Pro

[jira] [Commented] (SOLR-5170) Spatial multi-value distance sort via DocValues

2015-04-23 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509521#comment-14509521 ] Jeff Wartes commented on SOLR-5170: --- I got tired of maintaining a custom solr b

[jira] [Updated] (SOLR-5170) Spatial multi-value distance sort via DocValues

2014-06-30 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Wartes updated SOLR-5170: -- Attachment: SOLR-5170_spatial_multi-value_sort_via_docvalues.patch Updated to work with Solr 4.9

[jira] [Created] (SOLR-5917) Allow dismax wildcard field specifications

2014-03-26 Thread Jeff Wartes (JIRA)
Jeff Wartes created SOLR-5917: - Summary: Allow dismax wildcard field specifications Key: SOLR-5917 URL: https://issues.apache.org/jira/browse/SOLR-5917 Project: Solr Issue Type: Improvement

[jira] [Updated] (SOLR-5170) Spatial multi-value distance sort via DocValues

2014-01-07 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Wartes updated SOLR-5170: -- Attachment: SOLR-5170_spatial_multi-value_sort_via_docvalues.patch.txt Adds recipDistance scoring, lat

[jira] [Commented] (SOLR-5170) Spatial multi-value distance sort via DocValues

2014-01-07 Thread Jeff Wartes (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13864738#comment-13864738 ] Jeff Wartes commented on SOLR-5170: --- I've been using this patch with some min