Re: [JENKINS] Lucene-Solr-5.x-Linux (64bit/jdk1.7.0_80-ea-b05) - Build # 12125 - Still Failing!

2015-04-13 Thread david.w.smi...@gmail.com
Woops; sorry for the noise in the highlighter; I'll fix On Mon, Apr 13, 2015 at 4:51 PM Policeman Jenkins Server < jenk...@thetaphi.de> wrote: > Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Linux/12125/ > Java: 64bit/jdk1.7.0_80-ea-b05 -XX:-UseCompressedOops > -XX:+UseConcMarkSweepGC > >

Re: Examples in JIRA issues & CHANGES messages

2015-04-11 Thread david.w.smi...@gmail.com
Great advise; thanks Yonik. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Sat, Apr 11, 2015 at 2:51 PM, Yonik Seeley wrote: > Devs & contributors, please remember to be nice to other contributors > and describe what your patch

Re: [VOTE] 5.1.0 RC2

2015-04-11 Thread david.w.smi...@gmail.com
+1 SUCCESS! [0:49:30.419933] ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Thu, Apr 9, 2015 at 2:42 PM, Timothy Potter wrote: > Please vote for the second release candidate for Lucene/Solr 5.1.0 > > The artifacts can be downl

Re: CompressingTermVectors; per-field decompress?

2015-04-02 Thread david.w.smi...@gmail.com
not be) > with vectors would also enable better compression, maybe even > underneath LZ4, like stored fields got in 5.0 too. > > > On Thu, Apr 2, 2015 at 2:51 PM, david.w.smi...@gmail.com > wrote: > > I was looking at a JIRA issue someone posted pertaining to optimizing

CompressingTermVectors; per-field decompress?

2015-04-02 Thread david.w.smi...@gmail.com
I was looking at a JIRA issue someone posted pertaining to optimizing highlighting for when there are term vectors ( SOLR-5855 ). I dug into the details a bit and learned something unexpected: CompressingTermVectorsReader.get(docId) fully loads all term vectors for the document. The client/user

Re: [DISCUSS] Change Query API to make queries immutable in 6.0

2015-04-02 Thread david.w.smi...@gmail.com
On Thu, Apr 2, 2015 at 9:45 AM, Robert Muir wrote: > They are also only relevant when scores are needed: > so we can prevent nasty filter caching bugs as a step, by making > everything else immutable. > That’s a good point. +1 to your progress Adrien! ~ David Smiley Freelance Apache Lucene/Sol

Re: [DISCUSS] Change Query API to make queries immutable in 6.0

2015-04-02 Thread david.w.smi...@gmail.com
On Thu, Apr 2, 2015 at 3:40 AM, Adrien Grand wrote: > first make queries immutable up to the boost and then discuss > if/how/when we should go fully immutable with a new API to change > boosts? > The “if” part concerns me; I don’t mind it being a separate issue to make the changes more manageabl

Re: [DISCUSS] Change Query API to make queries immutable in 6.0

2015-04-01 Thread david.w.smi...@gmail.com
I’m +1 to going all the way (fully immutable) but the proposal stops short by skipping the boost. I agree with Terry’s comments — what a shame to make Queries “more immutable” but not really quite immutable. It kinda misses the point? Otherwise why bother? If this is about progress not perfecti

Re: SOLR-7240, java -jar start.jar, and 5.1

2015-04-01 Thread david.w.smi...@gmail.com
+1; more time is needed before start.jar can be deprecated/removed. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Wed, Apr 1, 2015 at 12:37 PM, Timothy Potter wrote: > As Gus points out in the ticket, the cloud-dev scripts are

Re: svn commit: r1664126 - in /lucene/dev/trunk/solr: core/src/java/org/apache/solr/core/ core/src/java/org/apache/solr/handler/ core/src/test-files/ core/src/test/org/apache/solr/core/ core/src/test/

2015-03-04 Thread david.w.smi...@gmail.com
I use that judgement too — sometimes I don’t bother if it’s internal and I never would for something trivial like a typo. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Wed, Mar 4, 2015 at 4:13 PM, Ramkumar R. Aiyengar < andyetit

Re: DocValues instead of stored values

2015-03-02 Thread david.w.smi...@gmail.com
On Mon, Mar 2, 2015 at 9:13 AM, Shalin Shekhar Mangar < shalinman...@gmail.com> wrote: > The problem with fetching from DocValue automatically is that it may cause > as many number of disk seeks as the number of doc value fields being > retrieved. True in the worst-case (cold disk cache). If yo

Re: DocValues instead of stored values

2015-03-02 Thread david.w.smi...@gmail.com
I have a patch to do this somewhat automatically here: https://issues.apache.org/jira/browse/SOLR-5478 I’m waiting on SOLR-6810 before revisiting the patch. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Mon, Mar 2, 2015 at 9:08

Re: Welcome Ramkumar Aiyengar as Lucene/Solr committer

2015-03-02 Thread david.w.smi...@gmail.com
Welcome Ram! ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Sun, Mar 1, 2015 at 11:39 PM, Shalin Shekhar Mangar < shalinman...@gmail.com> wrote: > I'm pleased to announce that Ramkumar Aiyengar has accepted the PMC's > invitatio

Re: [JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0_40-ea-b22) - Build # 11897 - Still Failing!

2015-02-28 Thread david.w.smi...@gmail.com
Ha! Randomized testing FTW! ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Sat, Feb 28, 2015 at 10:29 AM, Michael McCandless < luc...@mikemccandless.com> wrote: > I committed a fix .. this was a fun one: SimpleText had a bug wh

Re: Inconsistency in the suggester factories

2015-02-28 Thread david.w.smi...@gmail.com
On Sat, Feb 28, 2015 at 2:48 PM, Erick Erickson wrote: > I think this is worth a JIRA, anyone else got an opinion? And what > should we do here? Just use one or the other? Remove the one we decide > against? Allow both as synonyms? Deprecate one? > Standardize on one, the other becomes a depreca

Re: Welcome Varun Thacker as Lucene/Solr committer

2015-02-23 Thread david.w.smi...@gmail.com
Welcome Varun, and congratulations! ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Mon, Feb 23, 2015 at 9:51 AM, Grant Ingersoll wrote: > Hi All, > > Please join me in welcoming Varun Thacker as the latest committer on > Lucene

Re: [VOTE] 5.0.0 RC2

2015-02-13 Thread david.w.smi...@gmail.com
Anshum (and anyone else), How would you feel about getting https://issues.apache.org/jira/browse/LUCENE-6215 in, which is quite simply moving a particular class (new to 5.x) to the correct Java package. If this isn’t done… then I’m forced to consider marking it deprecated at it’s current wrong lo

Re: [JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0_31) - Build # 11780 - Failure!

2015-02-11 Thread david.w.smi...@gmail.com
It reproduces; I’m on it. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Wed, Feb 11, 2015 at 12:30 PM, Policeman Jenkins Server < jenk...@thetaphi.de> wrote: > Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/11780

Re: [VOTE] 5.0.0 RC2

2015-02-11 Thread david.w.smi...@gmail.com
JAVA_HOME to point to java 8 as well (that's what it > looks like since only jdk is listed in that output)? --test-java8 is meant > to take the java 8 home, but your regular JAVA_HOME should stay java 7. > > > > On Wed, Feb 11, 2015 at 6:13 AM, david.w.smi...@gmail.com < >

Re: [VOTE] 5.0.0 RC2

2015-02-11 Thread david.w.smi...@gmail.com
I found two problems, and I’m not sure what to make of them. First, perhaps the simplest. I ran it with Java 8 with this at the command-line (copied from Uwe’s email, inserting my environment variable): python3 -u dev-tools/scripts/smokeTestRelease.py --test-java8 $JAVA8_HOME http://people.apach

Re: Static Analysis Tooling

2015-02-05 Thread david.w.smi...@gmail.com
+1 to this idea. Note this is tracked as https://issues.apache.org/jira/browse/LUCENE-3973 ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Thu, Feb 5, 2015 at 12:43 PM, Mike Drob wrote: > Devs, > > I'd like to bring up static a

Re: Interesting resource for Unix shell script cleanup

2015-02-05 Thread david.w.smi...@gmail.com
Cool! ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Thu, Feb 5, 2015 at 10:25 AM, Steve Rowe wrote: > > On Feb 5, 2015, at 9:51 AM, Alexandre Rafalovitch > wrote: > > > > Hi, > > > > Just saw a link to http://www.shellcheck.n

Re: Give Solr its "own" port number

2015-02-04 Thread david.w.smi...@gmail.com
-0 Hoss’s points are my view as well. 8983 is already pretty well known amongst Solr users. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Wed, Feb 4, 2015 at 12:37 PM, Chris Hostetter wrote: > : Until 5.x Solr would start on

Re: StandardTokenizer, maxTokenLength behavior — likely bug

2015-01-26 Thread david.w.smi...@gmail.com
g/jira/browse/LUCENE-5400 > > On Mon, Jan 26, 2015 at 11:17 AM, david.w.smi...@gmail.com < > david.w.smi...@gmail.com> wrote: > >> On one of my other open-source projects (SolrTextTagger) I have a test >> that deliberately tests the effect of a very long token with the >&

StandardTokenizer, maxTokenLength behavior — likely bug

2015-01-26 Thread david.w.smi...@gmail.com
On one of my other open-source projects (SolrTextTagger) I have a test that deliberately tests the effect of a very long token with the StandardTokenizer, and that project is in turn tested against a wide matrix of Lucene/Solr versions. Before Lucene 4.9, if you had a token that exceeded maxTokenL

Re: Potential contribution: Geo 3d package

2015-01-22 Thread david.w.smi...@gmail.com
t does this > but which requires a FunctionQuery to be part of the search query. > > If you are in favor, I'll create a ticket and attach the library. > > Karl > > > On Thu, Jan 22, 2015 at 4:01 PM, david.w.smi...@gmail.com < > david.w.smi...@gmail.com> wro

Re: Potential contribution: Geo 3d package

2015-01-22 Thread david.w.smi...@gmail.com
ial; I can contribute that >> separately. >> >> Karl >> >> >> On Thu, Jan 22, 2015 at 3:27 PM, david.w.smi...@gmail.com < >> david.w.smi...@gmail.com> wrote: >> >>> Nice Karl! I’d love to learn more about this. Does the shapes here &g

Re: Potential contribution: Geo 3d package

2015-01-22 Thread david.w.smi...@gmail.com
Nice Karl! I’d love to learn more about this. Does the shapes here implement a Spatial4j Shape and thus would work with SpatialPrefixTree & friends for index & search? If not, what is the search side of the equation here? ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer h

Re: Lucene/Solr 5.0 release branch created

2015-01-14 Thread david.w.smi...@gmail.com
Anshum, are you going to create a 5.1 version in JIRA so we can appropriately assign issues? ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Wed, Jan 14, 2015 at 12:07 PM, Anshum Gupta wrote: > Thanks for setting it up. > > On W

Re: Lucene/Solr 5.0 release branch created

2015-01-14 Thread david.w.smi...@gmail.com
+1 to SOLR-6976 especially. I’m sad about SpanQueries not getting nuked yet :-( ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley

Re: how to highlight the whole search phrase only?

2015-01-12 Thread david.w.smi...@gmail.com
Hi Meena, Please use the “solr-user” list for user questions. This is the list for development of Lucene & Solr. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Mon, Jan 12, 2015 at 6:26 PM, meena.sri...@mathworks.com < meena.sri.

Re: Solr geospatial index?

2015-01-10 Thread david.w.smi...@gmail.com
Hello Matteo, Welcome. You are not bothering/me-us; you are asking in the right place. Jack’s right in terms of the field type dictating how it works. LatLonType, simply stores the latitude and longitude internally as separate floating point fields and it does efficient range queries over them f

Re: One other question

2015-01-03 Thread david.w.smi...@gmail.com
I’m puzzled… did you mean to send this to our dev list? The wording suggests it was in error. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Sat, Jan 3, 2015 at 1:47 PM, Erick Erickson wrote: > My son-in-law pointed me at a co

Re: Randomized testing talk (your favorite moment)

2015-01-02 Thread david.w.smi...@gmail.com
Some of the bugs it has helped me find that I am most appreciative of are in testing spatial code. One comes to mind when I developed the IsWithin predicate, and others in computing the bounding lat-lon box of a geodetic circle, and… and on and on… but the details are unimportant really and to tell

Re: [JENKINS] Lucene-Solr-5.x-MacOSX (64bit/jdk1.7.0) - Build # 1959 - Still Failing!

2014-12-19 Thread david.w.smi...@gmail.com
Ouch; thanks! ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Fri, Dec 19, 2014 at 10:29 AM, Michael McCandless < luc...@mikemccandless.com> wrote: > > I committed a fix. > > Mike McCandless > > http://blog.mikemccandless.com > >

Re: Determining NumericType for a field

2014-12-15 Thread david.w.smi...@gmail.com
> Down to practicalities, we need Lucene 4.8 as our DocValues are Disk > based and that support was removed in 4.9. I assume you’re referring to the “Disk” DV format/Codec? The standard format has the data on disk too, it’s just that there’s some “small” (relative to the disk data) lookup refere

Re: [VOTE] Release 4.10.3 RC1

2014-12-10 Thread david.w.smi...@gmail.com
On Wed, Dec 10, 2014 at 2:26 PM, Timothy Potter wrote: > Wow - that's a fast box Mike! > My thoughts exactly. +1 SUCCESS! [0:58:16.394370]

Re: Release 4.10.3

2014-12-10 Thread david.w.smi...@gmail.com
IMO there’s no such thing as having too many FSTs :-P ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Wed, Dec 10, 2014 at 6:08 AM, Michael McCandless < luc...@mikemccandless.com> wrote: > Hi Mark, > > If it's not too late, I'd

Re: "facet.mincount=0" returns facet values with 0 counts for "q=*" query

2014-12-09 Thread david.w.smi...@gmail.com
Abhishek, Please send such questions to the solr-user list, not the Lucene dev list. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Tue, Dec 9, 2014 at 9:52 AM, Abhishek Sharma wrote: > Hi, > > Can any one help me understand wh

Re: what is the rule for updating CHANGES.txt

2014-12-07 Thread david.w.smi...@gmail.com
Michael, I recall you’re working on building a test tool that sees changes and runs applicable tests? If that’s the case, why would it matter if CHANGES.txt gets updated? The vast majority of the time there is a reference to a JIRA issue from the commit message, and most JIRA issues that have cod

Re: Minimum test set for idempotent changes in schema.xml

2014-12-06 Thread david.w.smi...@gmail.com
> Can you explain once more your suggestion by maybe giving a specific > example? > > Thanks > > Michael > > Am 07.12.14 um 04:29 schrieb david.w.smi...@gmail.com: > > Hi Alex, > > > > There isn’t a way to say “just schema-related ones”. But, if you > s

Re: Minimum test set for idempotent changes in schema.xml

2014-12-06 Thread david.w.smi...@gmail.com
Hi Alex, There isn’t a way to say “just schema-related ones”. But, if you suspect the tests you want to run will have a string in the class name then you can run tests for classes matching a supplied regexp. For example: ant test -Dtestcase="*High*" And do that from within a specific module (

Re: Interesting blog on G1 GC improvemnts u25 - u60

2014-12-05 Thread david.w.smi...@gmail.com
Thanks for sharing; I’ll add that to my reading list. FWIW I don’t trust the G1 enough for production use. Some random Lucene/Solr build failures are blamed on it, even. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Fri, Dec 5

Re: solr client sdk's/libraries for native platforms

2014-12-04 Thread david.w.smi...@gmail.com
. Perhaps > >> somebody else can revisit it with a fresh eye now that I cleaned it up > >> a bit. > >> > >> Regards, > >> Alex. > >> Personal: http://www.outerthoughts.com/ and @arafalov > >> Solr resources and newsletter: http://www.solr-st

Re: [JENKINS] Lucene-Solr-Tests-5.x-Java7 - Build # 2267 - Failure

2014-12-04 Thread david.w.smi...@gmail.com
...@gmail.com < david.w.smi...@gmail.com> wrote: > I’ll dig. > > On Tue, Dec 2, 2014 at 11:57 AM, Apache Jenkins Server < > jenk...@builds.apache.org> wrote: > >> Build: https://builds.apache.org/job/Lucene-Solr-Tests-5.x-Java7/2267

Re: [JENKINS] Lucene-Solr-Tests-5.x-Java7 - Build # 2267 - Failure

2014-12-02 Thread david.w.smi...@gmail.com
I’ll dig. On Tue, Dec 2, 2014 at 11:57 AM, Apache Jenkins Server < jenk...@builds.apache.org> wrote: > Build: https://builds.apache.org/job/Lucene-Solr-Tests-5.x-Java7/2267/ > > 1 tests failed. > FAILED: org.apache.lucene.spatial.prefix.DateNRStrategyTest.testContains > {#9 seed=[801EEB0A7D92DF9

Re: solr client sdk's/libraries for native platforms

2014-12-01 Thread david.w.smi...@gmail.com
wrote: > > I think in the vein of a “do-it-tocracy”, getting the Wiki updated is a > perfectly good first step, and then if there is a better approach, > hopefully that occurs.… ;-) > > > > > > > >> On Dec 1, 2014, at 10:51 AM, Alexandre Rafalovitch > wrote:

Re: solr client sdk's/libraries for native platforms

2014-12-01 Thread david.w.smi...@gmail.com
I meant to reply earlier... On Mon, Nov 24, 2014 at 11:37 AM, Alexandre Rafalovitch wrote: > They are super-stale Yup but it’s a wiki so feel free to freshen it up. I’ll be doing that in a bit. It may also be helpful if these particular pages got more prominence/visibility by being linked fr

Re: svn commit: r1642294 - in /lucene/dev/trunk/lucene: ./ highlighter/src/java/org/apache/lucene/search/highlight/ highlighter/src/test/org/apache/lucene/search/highlight/ test-framework/src/java/org

2014-11-29 Thread david.w.smi...@gmail.com
Reposting my comment on JIRA: Ouch; so sorry I failed the build! In my checkout I have several pending issues related to highlighting, and apparently the Solr one, SOLR-6680 , is dependent. I should have monitored the dev list closely; I recall gett

Re: IntelliJ build

2014-11-26 Thread david.w.smi...@gmail.com
introduce > misalignments with the Ant build, and because unwanted transitive deps > could improperly influence the IntelliJ build. But if you feel strongly > about it, go ahead: -0. > > Thanks for working on it. > > Steve > > > On Nov 24, 2014, at 10:37 PM, david.w.smi...@gmail.co

Re: Where is the SVN repository only for Lucene project ?

2014-11-26 Thread david.w.smi...@gmail.com
GitHub offers SVN access: svn checkout https://github.com/apache/lucene-solr ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Wed, Nov 26, 2014 at 4:19 AM, Yosuke Yamatani < s151...@center.wakayama-u.ac.jp> wrote: > Dear sir/madam

IntelliJ build

2014-11-24 Thread david.w.smi...@gmail.com
On trunk I cleaned and re-created my IntelliJ based build (ant clean-idea, idea). IntelliJ didn’t get the memo about Java 8 so I changed that (locally). Then I found that the Solr velocity contrib couldn’t resolve a ResourceLoader class in analysis-common. So I simply checked the “export” checkb

Re: solr client sdk's/libraries for native platforms

2014-11-24 Thread david.w.smi...@gmail.com
FYI see https://wiki.apache.org/solr/IntegratingSolr for a list. This is a great use of the wiki. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Mon, Nov 24, 2014 at 10:35 AM, Alexandre Rafalovitch wrote: > Well, a start would

Re: [JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_40-ea-b09) - Build # 11586 - Failure!

2014-11-08 Thread david.w.smi...@gmail.com
Weird; I can’t reproduce this given the given Ant invocation given. I used JDK 1.8.0_20. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Sat, Nov 8, 2014 at 4:50 PM, Policeman Jenkins Server < jenk...@thetaphi.de> wrote: > Build

Re: Multi-valued fields and TokenStream

2014-11-06 Thread david.w.smi...@gmail.com
I think I like the other ideas better though. > > On Thu, Nov 6, 2014 at 3:13 PM, david.w.smi...@gmail.com > wrote: > > Are you suggesting that DefaultIndexingChain.PerField.invert(boolean > > firstValue) would, prior to calling reset(), call > > setPositionIncreme

Re: Multi-valued fields and TokenStream

2014-11-06 Thread david.w.smi...@gmail.com
ybe the position increment gap would be useful? If set to a value > larger than likely max position for any individual value, it could be used > to infer (non-)first-value-ness. > > > On Nov 5, 2014, at 1:03 PM, david.w.smi...@gmail.com wrote: > > > > Several times now,

Multi-valued fields and TokenStream

2014-11-05 Thread david.w.smi...@gmail.com
Several times now, I’ve had to come up with work-arounds for a TokenStream not knowing it’s processing the first value or a subsequent-value of a multi-valued field. Two of these times, the use-case was ensuring the first position of each value started at a multiple of 1000 (or some other configur

Re: An experience and some thoughts about solr/example -> solr/server

2014-11-04 Thread david.w.smi...@gmail.com
+1 Yeah, this would be huge. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Tue, Nov 4, 2014 at 2:30 AM, Jan Høydahl wrote: > Also a crucial part here is to add a Collection tab in Admin GUI, and a > more intelligent Cores tag,

Re: History question: contribution from Solr to Lucene

2014-11-02 Thread david.w.smi...@gmail.com
Alex, You should follow Yonik’s blog (Heliosearch), he has a post on this subject, more or less: http://heliosearch.org/lucene-solr-history/ ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Sun, Nov 2, 2014 at 8:36 PM, Alexandre Ra

Re: Change the name of the implicit router in SolrCloud?

2014-10-16 Thread david.w.smi...@gmail.com
Not if you don’t specify numShards, and then you can’t shard-split later. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Thu, Oct 16, 2014 at 11:18 AM, Yonik Seeley wrote: > On Thu, Oct 16, 2014 at 11:15 AM, david.w.

Re: Change the name of the implicit router in SolrCloud?

2014-10-16 Thread david.w.smi...@gmail.com
+1 for “manual”. Furthermore, I think specifying the router should become mandatory or default to the has based router. For back-compat, we can keep current behavior but output a warning about what choice was made. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://ww

Re: Solr: very slow custom Query/Weight/Scorer, "post filtering" vs sorting

2014-10-14 Thread david.w.smi...@gmail.com
On Mon, Oct 13, 2014 at 11:04 AM, Patrick Schemitz wrote: > This Query/Weight/Scorer construct is obviously very costly, so I don't > want it to leapfrog with the other - much faster - filters in the query > (especially when using a high threshold). > It’s leap-frogging with filters? That’s str

Re: Highlighters, accurate highlighting, and the PostingsHighlighter

2014-10-10 Thread david.w.smi...@gmail.com
ment > themselves”. > > Uwe > > - > Uwe Schindler > H.-H.-Meier-Allee 63, D-28213 Bremen > http://www.thetaphi.de > eMail: u...@thetaphi.de > > *From:* david.w.smi...@gmail.com [mailto:david.w.smi...@gmail.com > ] > *Sent:* Friday, October 10, 2014 4:46 PM > *To

Re: Highlighters, accurate highlighting, and the PostingsHighlighter

2014-10-10 Thread david.w.smi...@gmail.com
On Fri, Oct 10, 2014 at 7:13 AM, Robert Muir wrote: > On Fri, Oct 10, 2014 at 12:38 AM, david.w.smi...@gmail.com > wrote: > > The fastest > > highlighter we’ve got in Lucene is the PostingsHighlighter but it throws > out > > any positional nature in the query and can

Re: Highlighters, accurate highlighting, and the PostingsHighlighter

2014-10-10 Thread david.w.smi...@gmail.com
On Fri, Oct 10, 2014 at 6:39 AM, Michael McCandless < luc...@mikemccandless.com> wrote: > +1 for a "completely accurate" (each snippet shown matches the query) > and fast highlighter, but it's a real challenge because you need a > clean way to recursively iterate all positions for any (even > non-

Highlighters, accurate highlighting, and the PostingsHighlighter

2014-10-09 Thread david.w.smi...@gmail.com
I’m working on making highlighting both accurate and fast. By “accurate”, I mean the highlights need to accurately reflect a match given the query and various possible query types (to include SpanQueries and MultiTermQueries and obviously phrase queries and the usual suspects). The fastest highli

Re: how to do auto suggestion using apache lucene?

2014-10-01 Thread david.w.smi...@gmail.com
On Wed, Oct 1, 2014 at 9:19 AM, Alexandre Rafalovitch wrote: > https://github.com/arafalov/Solr-Javadoc/tree/master/SearchServer Pretty cool, Alex! ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley

Re: Lucene Benchmark

2014-09-24 Thread david.w.smi...@gmail.com
I use the benchmark module for spatial and I intend to for highlighting performance next month. On Wednesday, September 24, 2014, Mikhail Khludnev < mkhlud...@griddynamics.com> wrote: > Hi John, > > It's obvious > http://lucene.apache.org/core/4_8_0/benchmark/org/apache/lucene/benchmark/byTask/pa

Re: Welcome Gregory Chanan as Lucene/Solr committer

2014-09-20 Thread david.w.smi...@gmail.com
Welcome! On Friday, September 19, 2014, Steve Rowe wrote: > I'm pleased to announce that Gregory Chanan has accepted the PMC's > invitation to become a committer. > > Gregory, it's tradition that you introduce yourself with a brief bio. > > Mark Miller, the Lucene PMC chair, has already added yo

Re: [VOTE] Move trunk to Java 8

2014-09-15 Thread david.w.smi...@gmail.com
Ryan, I’m unclear on what makes a “procedural vote” as such. This seems to me to be about code modifications — in a big way as it’s a large change to the codebase. ~ David

Re: [VOTE] Move trunk to Java 8

2014-09-12 Thread david.w.smi...@gmail.com
Your arguments really resonate with me, Ryan… +1 to Java 8 (FWIW I’m using coding in Java 8 these days already) ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Fri, Sep 12, 2014 at 1:39 PM, Ryan Ernst wrote: > One that is on my

Re: VOTE: Solr Reference Guide for 4.10

2014-09-03 Thread david.w.smi...@gmail.com
+1, at least for the spatial part I looked at ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Wed, Sep 3, 2014 at 1:20 PM, Chris Hostetter wrote: > > +1 > > : > https://dist.apache.org/repos/dist/dev/lucene/solr/ref-guide/apach

Re: Issue with bin/solr script, collection1, and cloud mode

2014-08-28 Thread david.w.smi...@gmail.com
Ok. I wish the router was an explicit option, separate from declaring numShards. And furthermore, that it would never be “implicit” unless you expressly told it to be. People sometimes get this router because they forget numShards, thinking “1 is fine anyway”. — for now. ~ David Smiley Freelanc

Re: [JENKINS] Lucene-4x-Linux-Java7-64-test-only - Build # 29500 - Failure!

2014-08-23 Thread david.w.smi...@gmail.com
Rob, just curious, how did you deduce that? I’m guessing it didn’t reproduce and the logic in question seemed valid and wasn’t recently changed, leaving no sure cause except that G1GC isn’t as stable. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/

Re: [JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_11) - Build # 11036 - Still Failing!

2014-08-17 Thread david.w.smi...@gmail.com
I’ll look into it. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Sat, Aug 16, 2014 at 10:16 AM, Policeman Jenkins Server < jenk...@thetaphi.de> wrote: > Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/11036/ > Ja

Re: Can't assign jiras to myself

2014-08-06 Thread david.w.smi...@gmail.com
Tomás, I put you into the “Committers” role for Lucene & Solr in JIRA just now. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Wed, Aug 6, 2014 at 9:51 PM, Tomás Fernández Löbbe wrote: > May I be missing the "committer role" i

Re: Question for D. Smiley

2014-08-05 Thread david.w.smi...@gmail.com
Hi Erick, The field type for LatLonType mandates a subFieldSuffix or subFieldType attribute, and so I think there’s clearly a problem if you don’t provide a field type that’s going to match it. The default schema even has a comment on the dynamicField definition for *_coordinate that it’s needed.

Re: Welcome Tomás Fernández Löbbe as Lucene/Solr committer!

2014-07-31 Thread david.w.smi...@gmail.com
Welcome Tomas! Will you make it to Lucene/Solr Revolution in November? ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Thu, Jul 31, 2014 at 1:16 PM, Tomás Fernández Löbbe < tomasflo...@gmail.com> wrote: > Thanks everyone, I’m r

Re: Distributed spellcheck

2014-07-29 Thread david.w.smi...@gmail.com
Steve, File a bug. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Tue, Jul 29, 2014 at 9:14 AM, Steve Molloy wrote: > > Hi, > > I'm running into an issue with distributed spellcheck and was wondering if > anyone else faced thi

Re: [JENKINS] Lucene-Solr-SmokeRelease-trunk - Build # 184 - Still Failing

2014-07-18 Thread david.w.smi...@gmail.com
On Fri, Jul 18, 2014 at 10:18 AM, Timothy Potter wrote: > sheisty class LOL that error is funny. Tim, Take a look at the smoke tester like 268 or so. It already makes exceptions for certain Solr contrib modules, and apparently you need to augument it further. ~ David

Re: Hints on constructing/running Solr analyzer chains standalone

2014-07-12 Thread david.w.smi...@gmail.com
That sounds like a wonderful project, Alexandre — I’ve always wanted such a capability! I suggest approaching this very pragmatically based on minimizing the time to get something useful, which means leveraging as much as is available already — that means solr’s existing analysis UI screen. I sug

Re: Using a patch review tool for Lucene / Solr development.

2014-07-10 Thread david.w.smi...@gmail.com
On Wed, Jul 9, 2014 at 1:34 PM, Mark Miller wrote: > A few months ago, I filed INFRA JIRA issue to add the Lucene project to > review board (https://reviews.apache.org) and it was just resolved ( > https://issues.apache.org/jira/browse/INFRA-7630). > Awesome. > I’m not the biggest fan of revie

Re: [JENKINS] Lucene-Solr-trunk-Linux (32bit/ibm-j9-jdk7) - Build # 10760 - Still Failing!

2014-07-08 Thread david.w.smi...@gmail.com
I’m on it; this’ll get fixed momentarily. Some co-related JIRA issues; one got committed without the other. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Tue, Jul 8, 2014 at 2:54 PM, Policeman Jenkins Server < jenk...@thetaphi

Re: Single Field instance for both DocValues and indexed?

2014-07-03 Thread david.w.smi...@gmail.com
tc. supported more officially? Any way, I’ll go with this for now. FYI this very class is going to show up in spatial BBoxStrategy in a new patch soon. ~ David On Thu, Jul 3, 2014 at 12:48 PM, david.w.smi...@gmail.com wrote: > I was experimenting with having a user-provided/customized FieldTyp

Single Field instance for both DocValues and indexed?

2014-07-03 Thread david.w.smi...@gmail.com
I was experimenting with having a user-provided/customized FieldType for indexing code of (mostly) a set of numeric fields that are of a common type. The user/developer might want the type to both be indexed & have docValues, or perhaps just one. Or maybe stored hypothetically for the purposes of

Re: [JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 1682 - Still Failing!

2014-07-01 Thread david.w.smi...@gmail.com
On Tue, Jul 1, 2014 at 6:54 PM, Robert Muir wrote: > FieldCache is historically lenient, it allows all kinds of nonsense, > such as uninverting a multi-valued field as single-valued (e.g. leaves > gaps in ordinals and other bullshit that will cause this assertion to > fail). > > I can fix fieldcac

Re: [JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 1682 - Still Failing!

2014-07-01 Thread david.w.smi...@gmail.com
atial module is doing is wrong? > > On Tue, Jul 1, 2014 at 6:13 PM, david.w.smi...@gmail.com > wrote: > > Another case of: > > https://issues.apache.org/jira/browse/LUCENE-5713 > > (cause unknown) > > > > ~ David Smiley > > Freela

Re: [JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 1682 - Still Failing!

2014-07-01 Thread david.w.smi...@gmail.com
Another case of: https://issues.apache.org/jira/browse/LUCENE-5713 (cause unknown) ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Tue, Jul 1, 2014 at 6:08 PM, Policeman Jenkins Server < jenk...@thetaphi.de> wrote: > Build: http

Re: [VOTE] 4.9.0

2014-06-22 Thread david.w.smi...@gmail.com
at, Jun 21, 2014 at 3:16 PM, david.w.smi...@gmail.com > wrote: > > The smoke tester failed for me: > > > > lucene-solr_4x_svn$ python3.3 -u dev-tools/scripts/smokeTestRelease.py > > http://people.apache.org/~rmuir/staging_area/lucene_solr_4_9_0_r1604085/ > > 1604085 4.9.0

Re: [VOTE] 4.9.0

2014-06-21 Thread david.w.smi...@gmail.com
The smoke tester failed for me: *lucene-solr_4x_svn*$ python3.3 -u dev-tools/scripts/smokeTestRelease.py http://people.apache.org/~rmuir/staging_area/lucene_solr_4_9_0_r1604085/ 1604085 4.9.0 /Volumes/RamDisk/tmp JAVA7_HOME is /Library/Java/JavaVirtualMachines/jdk1.7.0_51.jdk/Contents/Home NOTE:

Re: [JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0_20-ea-b15) - Build # 10597 - Still Failing!

2014-06-18 Thread david.w.smi...@gmail.com
This is not a spatial bug; it’s another case of: https://issues.apache.org/jira/browse/LUCENE-5713 ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley

Re: facet.mincount in SolrCloud

2014-06-16 Thread david.w.smi...@gmail.com
That doesn’t make sense to me either, Toke. Have you tried changing it and running tests to see that they pass? ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Mon, Jun 16, 2014 at 8:39 AM, Toke Eskildsen wrote: > I am having

Re: [JENKINS] Lucene-Solr-trunk-Windows (32bit/jdk1.8.0_20-ea-b15) - Build # 4119 - Failure!

2014-06-15 Thread david.w.smi...@gmail.com
I’m on it. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Sun, Jun 15, 2014 at 10:30 PM, Policeman Jenkins Server < jenk...@thetaphi.de> wrote: > Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/4119/ > Java: 32b

Re: Adding Morphline support to DIH - worth the effort?

2014-06-11 Thread david.w.smi...@gmail.com
LOL I had the very same reaction Alexandre. Most of us don’t have all this big data software sitting around, even if it is free. Complexity. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Thu, Jun 12, 2014 at 12:44 AM, Alexand

Re: [JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_20-ea-b15) - Build # 10516 - Still Failing!

2014-06-09 Thread david.w.smi...@gmail.com
I’m on it. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Mon, Jun 9, 2014 at 10:36 AM, Policeman Jenkins Server < jenk...@thetaphi.de> wrote: > Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10516/ > Java: 64bit

Re: Adding Morphline support to DIH - worth the effort?

2014-06-08 Thread david.w.smi...@gmail.com
> One of the ideas over DIH discussed earlier is making it standalone. Yeah; my beef with the DIH is that it’s tied to Solr. But I’d rather see something other than the DIH outside Solr; it’s not worthy IMO. Why have something Solr specific even? A great pipeline shouldn’t tie itself to any end

Re: Extract values from custom function for ValueSource with multiple indexable fields

2014-06-08 Thread david.w.smi...@gmail.com
I suggest investigating this using a known example that does this, such as LatLonType and geodist(). LatLonType registers the field in a custom way too. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Sun, Jun 8, 2014 at 7:54 AM

Re: Trappy behavior with default search field

2014-06-05 Thread david.w.smi...@gmail.com
In my view, solrconfig.xml shouldn’t refer to any field by name out of the box, except for the /browse handler, and perhaps pre-filling the query form in the admin GUI. That’s it. A couple years ago at about the time I became a committer, I finally did something about a feature I am very opiniona

Re: [JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0_20-ea-b15) - Build # 10472 - Failure!

2014-06-04 Thread david.w.smi...@gmail.com
Thanks for fixing, Rob. ~ David On Wed, Jun 4, 2014 at 10:49 PM, Policeman Jenkins Server < jenk...@thetaphi.de> wrote: > Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10472/ > Java: 32bit/jdk1.8.0_20-ea-b15 -server -XX:+UseG1GC > > 1 tests failed. > FAILED: > > org.apache.luce

Re: [JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.7.0_60-ea-b15) - Build # 10394 - Still Failing!

2014-05-26 Thread david.w.smi...@gmail.com
I’ll dig. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Tue, May 27, 2014 at 12:04 AM, Policeman Jenkins Server < jenk...@thetaphi.de> wrote: > Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10394/ > Java: 64bit

<    1   2   3   >