Re: [VOTE] Release Solr 9.6.0 RC1

2024-04-26 Thread Michael Gibney
I got a test failure that reproduces for me locally: gradlew :solr:modules:analytics:test --tests "org.apache.solr.analytics.legacy.facet.LegacyFieldFacetTest.timeAllowedTest" -Ptests.jvms=5 "-Ptests.jvmargs=-XX:TieredStopAtLevel=1 -XX:+UseParallelGC -XX:ActiveProcessorCount=1

Re: Welcome Jason Gerlowski as Solr's new PMC Chair

2024-04-18 Thread Michael Gibney
Thank you, David and Jason! Michael On Thu, Apr 18, 2024 at 2:58 PM Tomás Fernández Löbbe wrote: > > Thanks for all the work David! > > And thank you Jason for taking over. > > Tomas > > On Thu, Apr 18, 2024 at 2:36 PM Jan Høydahl wrote: > > > Thanks for your efforts David, and congrats Jason

Re: updateLog tlog directory config silently ignored (SOLR-16962)

2024-01-08 Thread Michael Gibney
practically not relevant). [1] https://issues.apache.org/jira/browse/SOLR-16962 [2] https://issues.apache.org/jira/browse/SOLR-6537 On Mon, Sep 11, 2023 at 12:36 PM Michael Gibney wrote: > > > useful to separate the location to use some fast local SSDs vs slower but > > larger stora

Re: updateLog tlog directory config silently ignored (SOLR-16962)

2023-09-11 Thread Michael Gibney
plica type. > In our configuration, the nomenclature is "update log" or "ulog". If we > add a new setting, let's at least be consistent and call the new proposed > dir "ulogDir". > > ~ David > > > On Mon, Sep 11, 2023 at 9:45 AM Michael Gibne

Re: updateLog tlog directory config silently ignored (SOLR-16962)

2023-09-11 Thread Michael Gibney
n Fri, Sep 8, 2023 at 4:59 PM Ilan Ginzburg wrote: > > Re backcompat issue: might be an option to fix that config but use a > different name for it then, so that any currently existing (and ignored) > config continues to be ignored. > > Ilan > > On Thu, Sep 7, 2023, 6:14 PM Mi

updateLog tlog directory config silently ignored (SOLR-16962)

2023-09-07 Thread Michael Gibney
I'd like to call some extra attention to SOLR-16962 [1]. I'm fairly certain that it's been years since it has actually worked to specify tlog dir in solrconfig.xml `` element. I've opened a PR that fixes this, but it involves making some decisions about edge-case handling, for which I'd appreciate

Re: Build: checkWorkingCopyClean -- is there value?

2023-09-06 Thread Michael Gibney
Something like this could work?: https://github.com/apache/solr/blob/eaaabbfa33456639613a7a6aecc37cd2d89e5dfa/gradle/globals.gradle#L168-L171 On Wed, Sep 6, 2023 at 5:26 PM David Smiley wrote: > > Is there a property or something used to detect that the build is being run > in a CI or CI-like

Re: Crave patch optimization

2023-08-31 Thread Michael Gibney
atching. > > But besides all this explanation, we're looking to improve the entire > patching process so that there's no need to repeatedly restart Github Actions. > One of the ways we're trying to get debug information is to get access to the > Action Runner so that we can

Re: [EXTERNAL] - Re: PR reviewed

2023-08-25 Thread Michael Gibney
This is likely related to the concerns recently raised in this thread: https://lists.apache.org/thread/ybmp5xz3c9549opqgktdb4cxlpmdmwy4 A short-term workaround is to rebase on upstream main, I think. Michael On Fri, Aug 25, 2023 at 1:00 PM Isabelle Giguere wrote: > > Hi again; > > My PR build

Crave patch optimization

2023-08-02 Thread Michael Gibney
Hi Uv: regarding https://lists.apache.org/thread/l8hgqwkm9vt8yhygoo2blw5j4n5gh121 Would it be possible for Crave, instead of using `git format-patch` / `git am`, to instead generate/apply a simple single diff/patch, via `git diff .. > file.patch` / `git apply file.patch`? This would address a

Re: Welcome Alex Deparvu as Solr committer

2023-08-02 Thread Michael Gibney
Welcome, Alex, and congrats! Michael On Wed, Aug 2, 2023 at 11:08 AM Alex Deparvu wrote: > > Thank you so much Anshum! > > I am honored to be invited and very excited to join the community as a > committer and hoping to contribute more. > > My past experience includes spending a good number of

Re: lucene-dev-repo-composite.gradle

2023-05-16 Thread Michael Gibney
`-Plucene.dev.path=[path]` in particular can be useful for iterative development of Lucene as used in the context of Solr, or as cross-checked through Solr tests. IIRC I've found that the versions.props/lock bypasses mavenLocal and always tries to re-download dependencies? Jar checksums might

Re: Welcome David Smiley as Solr's new PMC chair

2023-04-03 Thread Michael Gibney
Thank you, David and Houston! On Sat, Apr 1, 2023 at 4:11 PM Anshum Gupta wrote: > > Congratulations David and thanks a lot for your service, Houston! > > On Fri, Mar 31, 2023 at 10:34 PM Houston Putman wrote: > > > Hello, > > > > Solr has had quite a year, with a major release and many cool

Re: Welcome Marcus Eagan as Solr committer

2023-04-03 Thread Michael Gibney
Welcome, Marcus! On Mon, Apr 3, 2023 at 9:02 AM Jason Gerlowski wrote: > > Congrats and welcome! > > On Sun, Apr 2, 2023 at 3:28 PM Noble Paul wrote: > > > > Congrats Marcus > > > > Welcome > > > > On Mon, Apr 3, 2023, 4:00 AM Justin Sweeney > > wrote: > > > > > Congratulations Marcus! > > > >

Re: Limiting Jetty threads?

2023-03-29 Thread Michael Gibney
Mar 29, 2023 at 5:51 PM David Smiley wrote: > > Has anyone experimented with reducing the number of request/Jetty threads > in jetty.xml? The default is 10K. I'm concerned about the use of > ThreadLocals caching stuff, like maybe Lucene analysis chains (Analyzer > ReuseStrategy

Re: [VOTE] Release Solr 9.2.0 RC1

2023-03-22 Thread Michael Gibney
+1 SUCCESS! [0:55:42.691297] On Tue, Mar 21, 2023 at 11:25 AM Houston Putman wrote: > > Please vote for release candidate 1 for Solr 9.2.0 > > The artifacts can be downloaded from: > https://dist.apache.org/repos/dist/dev/solr/solr-9.2.0-RC1-rev-92c5515e2918c22513f7aa527d6c6db943150fea > > You

Re: Caffeine - ISE: Recursive update Re: [JENKINS] Solr-main-Linux (64bit/hotspot/jdk-16.0.2) - Build # 10777 - Unstable!

2023-03-16 Thread Michael Gibney
directly before SOLR-1). The user would be no worse off than they were pre-SOLR-1, and everything should "just work". That said, why would anyone actually _choose_ `async=false` ... but then that's where we already are, unless I'm missing something. On Wed, Mar 15, 2023 at 2:20 

Re: Caffeine - ISE: Recursive update Re: [JENKINS] Solr-main-Linux (64bit/hotspot/jdk-16.0.2) - Build # 10777 - Unstable!

2023-03-15 Thread Michael Gibney
I've been able to trigger this locally using `-Ptests.iters=20` (or whatever). Still not sure what the issue is, but here's the request that's triggering this for me: 2> 176445 INFO (TEST-TestFiltering.testRandomFiltering-seed#[8C523D43388C3411]) [] o.a.s.c.S.Request webapp=null path=null

Re: [DISCUSS] Rebrand the JSON Request/Facet APIs

2023-03-10 Thread Michael Gibney
I kind of like "Aggregation API" (or something similar). Facets/stats/analytics are all definitely "aggregations". As luck would have it, "aggregation" isn't yet used to mean something more specific in Solr (right?), so we wouldn't have the problem of "it used to mean X, but now it means Y". The

Re: Welcome Andy Webb as Solr committer

2023-03-07 Thread Michael Gibney
Welcome, and congrats! On Tue, Mar 7, 2023 at 6:19 AM Ilan Ginzburg wrote: > > Welcome Andy and congrats! > > On Tue, Mar 7, 2023 at 7:52 AM Mikhail Khludnev wrote: > > > Welcome, Andy! > > > > On Mon, Mar 6, 2023 at 10:54 PM Andy Webb wrote: > > > > > hi all, thank you for the invitation and

Re: Re: Low untunable default FastWriter output buffer - possible reason for slow single threaded data receiving from Solr on 1Gigabit+ networks while scroll, search etc

2023-02-27 Thread Michael Gibney
in Solr, but somewhere at the level of > transformation-data transfer by the "responce writers" (except javabin). I > don't know where to look for the problem further than the FastWriter output > buffer, but I hope the specialists will succeed. > > To the remark of Michae

Re: Re: Re: Low untunable default FastWriter output buffer - possible reason for slow single threaded data receiving from Solr on 1Gigabit+ networks while scroll, search etc

2023-02-26 Thread Michael Gibney
> I'm not sure there's a shortcut bypassing ordering results through heap To expand on this a bit: the behavior Mikhail describes changes as of solr 9.1 (https://issues.apache.org/jira/browse/SOLR-14765), which introduces exactly the proposed bypass. The extra overhead (pre-9.1) scales linear wrt

Re: Welcome Colvin Cowie as Solr committer

2023-02-14 Thread Michael Gibney
Welcome, Colvin! On Tue, Feb 14, 2023 at 8:53 AM Kevin Risden wrote: > > Welcome Colvin! > > Kevin Risden > > > On Tue, Feb 14, 2023 at 8:40 AM Justin Sweeney > wrote: > > > Welcome Colvin! > > > > On Tue, Feb 14, 2023 at 6:27 AM Alessandro Benedetti > > > > wrote: > > > > > Welcome on board

Re: Welcome Justin Sweeney as Solr committer

2023-02-10 Thread Michael Gibney
Welcome, Justin! On Fri, Feb 10, 2023 at 2:53 PM Gus Heck wrote: > > Welcome :) I'm also in the Boston area. Need to get some sort of meet up > going again in this area. > > On Fri, Feb 10, 2023 at 2:31 PM Justin Sweeney > wrote: > > > Hi everyone, > > > > Thank you Ishan for the announcement.

Re: NullPointerException when using facets in More Like This Query

2023-02-06 Thread Michael Gibney
setup step, which is relatively recent) On Mon, Feb 6, 2023 at 10:35 PM Michael Gibney wrote: > > I do suspect this is MLT-specific -- I'm not exactly sure how this is > _supposed_ to work (I'm unfamiliar with MLT), but something seems a > bit off between these two spots: > https://gi

Re: NullPointerException when using facets in More Like This Query

2023-02-06 Thread Michael Gibney
I do suspect this is MLT-specific -- I'm not exactly sure how this is _supposed_ to work (I'm unfamiliar with MLT), but something seems a bit off between these two spots:

[ANNOUNCE] Apache Solr 9.1.1 released

2023-01-25 Thread Michael Gibney
The Solr PMC is pleased to announce the release of Apache Solr 9.1.1. Solr is the popular, blazing fast, open source NoSQL search platform from the Apache Solr project. Its major features include powerful full-text search, hit highlighting, faceted search, dynamic clustering, database

Re: [VOTE] Release Solr 9.1.1 RC2

2023-01-24 Thread Michael Gibney
It's been >72h since the vote was initiated and the result is: +1 7 (6 binding) 0 0 -1 0 This vote has PASSED On Tue, Jan 24, 2023 at 1:11 PM Michael Gibney wrote: > > Thanks for the nudge! I was planning on followup steps this evening > (considering the vote passed!). Offic

Re: [VOTE] Release Solr 9.1.1 RC2

2023-01-24 Thread Michael Gibney
st if I find something (that > > wasn't related to my machine/env). > > > > +1 (binding) > > > > > > On Tue, Jan 17, 2023 at 6:20 PM Michael Gibney > > wrote: > > > > > Please vote for release candidate 2

Re: [VOTE] Release Solr 9.1.1 RC2

2023-01-19 Thread Michael Gibney
gt; Bence Szabó > > > On 2023. Jan 18., at 23:21, Michael Gibney > > wrote: > > > > Thanks for reporting, David! I have a possible fix?: > > https://issues.apache.org/jira/browse/SOLR-16628 > > > > > > On Wed, Jan 18, 2023 at 2:44 PM David Smiley wrote:

Re: [VOTE] Release Solr 9.1.1 RC2

2023-01-18 Thread Michael Gibney
hyaya < > ichattopadhy...@gmail.com> wrote: > > > +1 > > > > SUCCESS! [0:37:13.656686] > > > > > > On Wed, Jan 18, 2023 at 11:59 PM Kevin Risden > wrote: > > > > > > +1 SUCCESS! [0:29:29.944432] > > > > >

[VOTE] Release Solr 9.1.1 RC2

2023-01-17 Thread Michael Gibney
Please vote for release candidate 2 for Solr 9.1.1 The artifacts can be downloaded from: https://dist.apache.org/repos/dist/dev/solr/solr-9.1.1-RC2-rev-d998e63978abfedde3b75bab4ba6e1e78ddb5944 You can run the smoke tester directly with this command: python3 -u

Re: [VOTE] Release Solr 9.1.1 RC1

2023-01-17 Thread Michael Gibney
l#comment-17676890 > > > TLDR; queries (faceting) were failing with http status 503. > > > > > > At this point in time, we don't know much more due to inadequate > > > information from the logs. Please give us a couple of days to settle > > > this one way or t

[VOTE] Release Solr 9.1.1 RC1

2023-01-13 Thread Michael Gibney
Please vote for release candidate 1 for Solr 9.1.1 The artifacts can be downloaded from: https://dist.apache.org/repos/dist/dev/solr/solr-9.1.1-RC1-rev-cfd3eaede7054e08385df43d5ccd6462ee1b3539 You can run the smoke tester directly with this command: python3 -u

Re: Solr 9.1.1 bugfix release

2023-01-10 Thread Michael Gibney
gt; > > LinkedIn <https://linkedin.com/company/sease-ltd> | Twitter > > <https://twitter.com/seaseltd> | Youtube > > <https://www.youtube.com/channel/UCDx86ZKLYNpI3gzMercM7BQ> | Github > > <https://github.com/seaseltd> > > > > > > On F

Re: Solr 9.1.1 bugfix release

2023-01-06 Thread Michael Gibney
site: Sease.io <http://sease.io/> > LinkedIn <https://linkedin.com/company/sease-ltd> | Twitter > <https://twitter.com/seaseltd> | Youtube > <https://www.youtube.com/channel/UCDx86ZKLYNpI3gzMercM7BQ> | Github > <https://github.com/seaseltd> >

Re: Solr 9.1.1 bugfix release

2023-01-04 Thread Michael Gibney
Q> | Github > <https://github.com/seaseltd> > > > On Tue, 3 Jan 2023 at 17:18, Shawn Heisey wrote: > > > On 1/3/23 08:05, Michael Gibney wrote: > > > and possibly upgrade to Lucene 9.4 > > > https://issues.apache.org/jira/browse/SOLR-16442 > > >

Re: Solr 9.1.1 bugfix release

2023-01-03 Thread Michael Gibney
~ David Smiley > > > Apache Lucene/Solr Search Developer > > > http://www.linkedin.com/in/davidwsmiley > > > > > > > > > On Tue, Jan 3, 2023 at 10:05 AM Michael Gibney > > > wrote: > > > > > > > Wondering what folks think o

Re: Solr 9.1.1 bugfix release

2023-01-03 Thread Michael Gibney
Wondering what folks think of backporting some classloading deadlock-related fixes: https://issues.apache.org/jira/browse/SOLR-16165 and possibly upgrade to Lucene 9.4 https://issues.apache.org/jira/browse/SOLR-16442 particularly considering: https://github.com/apache/lucene/pull/11718 The main

Solr 9.1.1 bugfix release

2022-12-22 Thread Michael Gibney
I'd like to get the ball rolling on a 9.1.1 bugfix release, and volunteer to be release manager. There aren't very many bugfixes accumulated since 9.1.0 on `branch_9_1`, but SOLR-16585 in particular (NPE on MatchAllDocs pagination) should be fixed asap. I'm thinking to build a release candidate

Re: Welcome Michael Gibney to the Solr PMC

2022-12-21 Thread Michael Gibney
t; > I am pleased to announce that Michael Gibney has accepted the PMC's > > invitation to join. > > > > Congratulations and welcome, Michael! > > - > To unsubscribe, e-mail: dev-unsubscr

Re: Why does faceting add an entry to the filter cache for the q parameter?

2022-11-18 Thread Michael Gibney
Given that the filters being cached are useful across all these contexts, and that facet values are often subsequently applied as filters, I don't think it'd make sense to separate these two -- especially not without some way to have both aware of each other to avoid duplicating effort. It might

Re: Going to ApacheCon 2022

2022-09-09 Thread Michael Gibney
I'm planning to be there; also still working out travel plans. Michael On Fri, Sep 9, 2022 at 5:24 AM Alessandro Benedetti wrote: > > I plan to be at ApacheCon this year as well(presenting the latest works on > Apache Solr Neural Search)! > An Hack-day/ Committers' meet-up before or after or

Re: FacetFieldProcessorByArrayDV recomputes ords for each request?

2022-09-01 Thread Michael Gibney
Yes, as you've found, the ordmap is cached via SlowCompositeReaderWrapper. It's a bit opaque that that's (iiuc?) the main acceptable use of SlowCompositeReaderWrapper -- as a wrapper around OrdinalMaps. I'm pretty sure I remember looking into this, and the `si.mapping` in `findStartAndEndOrds `

Re: Cleaning up IntelliJ warnings in code base

2022-05-27 Thread Michael Gibney
I have a vague recollection of having seen intellij warnings that really _shouldn't_ be "fixed". Unfortunately I'm not sure I'll be able to recall exactly what, but I thought I'd mention it as a word of caution, and in case it spurs anyone else's curiosity. Splitting any such PRs up by warning

Re: [VOTE] Release Solr 9.0.0 RC5

2022-05-09 Thread Michael Gibney
+1 (non-binding) SUCCESS! [0:49:30.542503] I ran the smoketester, but did not do any manual testing. It may be worth noting: I struggled a bit to get the integration tests to run on Alpine Linux (with the BusyBox version of `ps`) -- solved by `apk add procps`. It's possible that this would not

Re: [RESULT] [VOTE] Release Solr 9.0.0 RC4

2022-05-03 Thread Michael Gibney
I'll be backporting SOLR-16176 shortly (today) to fix the distributed faceting issue Gus pointed out. Michael On Tue, May 3, 2022 at 10:26 AM Mike Drob wrote: > I created SOLR-16177 for > the license header issue. > > I am backporting

Re: [VOTE] Release Solr 9.0.0 RC4

2022-05-02 Thread Michael Gibney
Gus said most of what I have to say -- this affects an odd edge case: explicit positive overrequest _and_ method:enum _and_ limit:-1. This would be a pretty pathological combination; but even so, the consequence would be to turn an unlimited (limit:-1) request into a limited one (limit:n, n>=0) --

Re: [VOTE] Release Solr 9.0.0 RC4

2022-05-02 Thread Michael Gibney
Gus, re: the SKG failure: I was able to reproduce it, but haven't dug in enough to say exactly what's going on. (off-the-cuff response: this test is quite robust, and has uncovered edge-case issues before that are more about "distributed faceting" generally than about "SKG" per se). I'd be

Re: Can someone explain how -Ptest.seed works (Oh and DistributedQueryComponentCustomSortTest keeps failing!)?

2021-11-22 Thread Michael Gibney
Dawid, sorry for the incomplete information (and for hijacking the thread)! The "no runnable tests" error indeed isn't an issue for the gradle build. But for ant I just confirmed that on a clean checkout of `releases/lucene-solr/8.11.0`: `ant test -Dtests.class='org.apache.solr.search.facet.*'`

Re: Can someone explain how -Ptest.seed works (Oh and DistributedQueryComponentCustomSortTest keeps failing!)?

2021-11-22 Thread Michael Gibney
>LUCENE-9660. Perhaps it's worth porting over to Solr too. +1 to this, I had been wondering about that! The above explanation of the test suite error messages is great, and perhaps would be nice to have in "contributing" docs too. FWIW: the test-suite-level "no runnable tests" errors usually

Re: First class support for node roles

2021-11-03 Thread Michael Gibney
>I actually didn't realize that an empty Solr node would forward the top-level >request onward instead of just being the query controller itself? That >actually seems like a bug vs. a feature, IMO any node that receives >the top-level query should just be the coordinator, what stops it? +1 to

Re: Solr/Lucene joint development workflow?

2021-06-03 Thread Michael Gibney
a `gradlew --write-locks`), does the trick. If I were to take a crack at documenting this workflow, any ideas on the best place to do so? Michael On Wed, Jun 2, 2021 at 9:19 AM Michael Gibney wrote: > Thanks for digging into this! I can confirm that my > lucene-*-9.0.0-SNAPSHOT.ja

Re: Solr/Lucene joint development workflow?

2021-06-02 Thread Michael Gibney
oes not have > > > the META- > > > INF/services. I wonder how Solr works! > > > > > > It would be good to figure out what's going on and why the JAR files in > > > your > > > local repository do not have the required META-INF/services subfolde

Re: Solr/Lucene joint development workflow?

2021-06-01 Thread Michael Gibney
ository coordinates >> created by Jenkins (needs to be done in 2 files, see below). >> >> For more details how to update Lucene dependencies in Solr, run: >> $ gradlew :helpDeps >> >> Uwe >> >> - >> Uwe Schindler >> Achterdiek 19, D-283

Solr/Lucene joint development workflow?

2021-05-26 Thread Michael Gibney
I'm working on some features that involve changes to both Lucene and Solr. Post-TLP-split, I'm wondering whether anyone has recommended techniques to handle this kind of situation. Ideally one would work on Lucene changes, get them merged, and then proceed with Solr development; but realistically

Re: Thread-safety without volatile for an immutable array

2021-03-17 Thread Michael Gibney
a local and return > > > that > > > > one at end, you know that it's as you expect. > > > > > > > > You could also add a fence, so the order is preserved, I think for > that > > > > the following is fine (put it before the write inside t