Re: what to try next for replica that will not stay up.

2016-09-01 Thread John Bickerstaff
This may be too simplistic of course, but what if you totally wipe Solr off that machine, re-install it from scratch, bring it up and let it join the cluster, then add the replica? If it was me (since I have the luxury of VM's) I'd turn it off and build a new VM from the ground up, but I get that

Re: Mailing list subscriptions

2016-08-31 Thread John Bickerstaff
On that page, look for an "options" link. Choose "subscribe via email" and there will be some options to choose. At least that's all I've been able to find. It doesn't allow "only threads I've started" but it does allow a once-a-day summary and a few other choices... On Wed, Aug 31, 2016 at

Re: changing the /solr path, additional steps needed for 6.1

2016-08-29 Thread John Bickerstaff
Bless you Chris! And if you were local, I'd buy you a beer! This was a big help - I was trying to figure this one out. On Thu, Aug 25, 2016 at 1:27 PM, Chris Morley wrote: > This might help some people: > > To change the URL to server:port/ourspecialpath from

Re: Solr for Multi Tenant architecture

2016-08-27 Thread John Bickerstaff
In my own work, the risk to the business if every single client cannot access search is so great, we would never consider putting everything in one. You should certainly ask that question of the business stakeholders before you decide. For that reason, I might recommend that each of the multiple

Re: /select results different between 5.4 and 6.1

2016-08-19 Thread John Bickerstaff
Many thanks. On Fri, Aug 19, 2016 at 4:22 PM, Anshum Gupta <ans...@anshumgupta.net> wrote: > The default similarity changed from TF-IDF to BM25 in 6.0. > > On Fri, Aug 19, 2016 at 3:00 PM John Bickerstaff <j...@johnbickerstaff.com > > > wrote: > > > Bump

Re: /select results different between 5.4 and 6.1

2016-08-19 Thread John Bickerstaff
Bump! TL;DR Question: Are scores (and debug output) *expected* to be different between 5.4 and 6.1? On Thu, Aug 18, 2016 at 2:44 PM, John Bickerstaff <j...@johnbickerstaff.com> wrote: > Hi all, > > TL:DR - > Is it expected that the /select endpoint would produce different >

/select results different between 5.4 and 6.1

2016-08-18 Thread John Bickerstaff
Hi all, TL:DR - Is it expected that the /select endpoint would produce different scores/result order between versions 5.4 and 6.1? (I'm aware that it's certainly possible I've done something different to these environments, although at this point I can't see any difference in configs etc... and

Re: Want zero results from SOLR when there are no matches for "querystring"

2016-08-12 Thread John Bickerstaff
Thanks - I'll look at it... On Fri, Aug 12, 2016 at 1:21 PM, Erick Erickson <erickerick...@gmail.com> wrote: > Maybe rerankqparserplugin? > > On Aug 12, 2016 11:54, "John Bickerstaff" <j...@johnbickerstaff.com> > wrote: > > > @Hossman -- thanks ag

Re: Want zero results from SOLR when there are no matches for "querystring"

2016-08-12 Thread John Bickerstaff
this thread helps someone else... {!boost defType=synonym_edismax qf='title' synonyms='true' synonyms.originalBoost='2.5' synonyms.synonymBoost='1.1' bf='' bq='' v=$q} On Fri, Aug 12, 2016 at 12:09 PM, John Bickerstaff <j...@johnbickerstaff.com > wrote: > Thanks! I'll check it out. &

Re: Want zero results from SOLR when there are no matches for "querystring"

2016-08-12 Thread John Bickerstaff
passed to outer expressions and so on > https://cwiki.apache.org/confluence/display/solr/Streaming+Expressions > > HTH > Susheel > > On Fri, Aug 12, 2016 at 1:08 PM, John Bickerstaff < > j...@johnbickerstaff.com> > wrote: > > > Hossman - many thanks again for you

Re: Getting "collection already exists" when creating collection in admin UI

2016-08-12 Thread John Bickerstaff
I don't know if this helps, but I had trouble creating collections due to a number of issues and I think I got this error (I was using the command line, not the UI) As I recall, if it exists in Zookeeper, it will error out. It was a while ago, but I think the way I had to solve it was to go into

Re: Want zero results from SOLR when there are no matches for "querystring"

2016-08-12 Thread John Bickerstaff
ther query for further processing? Essentially, pass ONLY the results (including an empty set of results) to another query for processing? thanks... On Thu, Aug 11, 2016 at 6:19 PM, John Bickerstaff <j...@johnbickerstaff.com> wrote: > Thanks! > > To answer your questions

Re: Want zero results from SOLR when there are no matches for "querystring"

2016-08-11 Thread John Bickerstaff
Thanks! To answer your questions, while I digest the rest of that information... I'm using the hon-lucene-synonyms.5.0.4.jar from here: https://github.com/healthonnet/hon-lucene-synonyms The config looks like this - and IIRC, is simply a copy from the recommended cofig on the site mentioned

Want zero results from SOLR when there are no matches for "querystring"

2016-08-11 Thread John Bickerstaff
First let me say that this is very possibly the "x - y problem" so let me state up front what my ultimate need is -- then I'll ask about the thing I imagine might help... which, of course, is heavily biased in the direction of my experience coding Java and writing SQL... I have a piece of a

Re: How to re-index SOLR data

2016-08-10 Thread John Bickerstaff
ly a quite well-tested process, often used when you want to > > change "atomically", e.g. when you reindex the same data nightly but want > > all the new data available in its entirety only after it has been QA'd or > > such. > > > > Best, > > Erick > >

Re: How to re-index SOLR data

2016-08-09 Thread John Bickerstaff
hon script? The new data will be indexed > correctly with the new rules, but what about the old data? > > Our SOLR data is around 30GB with around 60 million documents. We use SOLR > cloud with 3 solr nodes and 3 zookeepers. > > On Tue, Aug 9, 2016 at 2:13 PM, John Bickerstaff <

Re: How to re-index SOLR data

2016-08-09 Thread John Bickerstaff
In case this helps... Assuming you have the resources to build a copy of your production environment and assuming you have the time, you don't need to take your production down - or even affect it's processing... What I've done (with admittedly smaller data sets) is build a separate environment

Re: Solr and Drupal

2016-08-09 Thread John Bickerstaff
Rose -- Further reading on the drupal site suggests to me that the latest Drupal (8?) comes with a generic "connector" that can be tied to any search engine and that the instructions on the page I sent may be superseded by the new connector... I'm not familiar with Drupal beyond simple

Re: Solr and Drupal

2016-08-09 Thread John Bickerstaff
This might be a good place to start... https://www.drupal.org/project/apachesolr On Tue, Aug 9, 2016 at 11:11 AM, Rose, John B wrote: > We are looking at Solr for a Drupal web site. We have never installed Solr. > > > From my readings it is not clear exactly what we need to

Re: NoNode error on -downconfig when node does exist?

2016-08-08 Thread John Bickerstaff
though, I'm sure, you wondered if it was necessary. Saved at least > three back-and-forths to get to the root of the problem (little pun > there)... > > Erick > > On Mon, Aug 8, 2016 at 3:11 PM, John Bickerstaff > <j...@johnbickerstaff.com> wrote: > > OMG! > &g

Re: NoNode error on -downconfig when node does exist?

2016-08-08 Thread John Bickerstaff
s you use /solr6_1/configs, but you have /solr6.1 in your > zk connection string chroot. > > Kevin Risden > > On Mon, Aug 8, 2016 at 4:44 PM, John Bickerstaff <j...@johnbickerstaff.com > > > wrote: > > > First, the caveat: I understand this is technically a zookeep

NoNode error on -downconfig when node does exist?

2016-08-08 Thread John Bickerstaff
First, the caveat: I understand this is technically a zookeeper error. It is an error that occurs when trying to deal with Solr however, so I'm hoping someone on the list may have some insight. Also, I'm getting the error via the zkcli.sh tool that comes with Solr... I have created a

Re: Problems using fieldType text_general in copyField

2016-08-05 Thread John Bickerstaff
afa...@gmail.com> wrote: > Just as a note, TYPO3 uses a lot of include files though I do not remember > which specific mechanism they rely on. > > Regards, > Alex > > On 5 Aug 2016 10:51 AM, "John Bickerstaff" <j...@johnbickerstaff.com> > wrote: >

Re: Problems using fieldType text_general in copyField

2016-08-04 Thread John Bickerstaff
Many thanks for your time! Yes, it does make sense. I'll give your recommendation a shot tomorrow and update the thread. On Aug 4, 2016 6:22 PM, "Chris Hostetter" wrote: TL;DR: use entity includes *WITH OUT TOP LEVEL WRAPPER ELEMENTS* like in this example...

Re: Problems using fieldType text_general in copyField

2016-08-04 Thread John Bickerstaff
you mentioned that the problem only happens when you use xinclude, but > you > : > havne't shown us hte details of your xinclude -- what exactly does your > : > schema.xml look like (with the xinclude call) and what exactly does the > : > file being included look like (entire contents) > : >

Re: Problems using fieldType text_general in copyField

2016-08-04 Thread John Bickerstaff
I get the same error with the Entity Includes - with or without the tag... I'm probably just going to make a section in schema.xml rather than worry about this. Includes are "nice to have" but not critical. On Thu, Aug 4, 2016 at 4:25 PM, John Bickerstaff <j...@johnbickersta

Re: Problems using fieldType text_general in copyField

2016-08-04 Thread John Bickerstaff
Found the Entity Includes - thanks. On Thu, Aug 4, 2016 at 4:22 PM, John Bickerstaff <j...@johnbickerstaff.com> wrote: > Thanks! > > The schema is a copy of the techproducts sample. > > Entire include here - and I take your point about the possibility of > malformation

Re: Problems using fieldType text_general in copyField

2016-08-04 Thread John Bickerstaff
y support "snippets" of malformed xml, and instead requires > some root tag -- i can't imagine what root tag you are using in the > included file that would play nicely with mixing/matching field > declarations. ... using xml entity includes may be a simpler/safer option) > &g

Re: Problems using fieldType text_general in copyField

2016-08-04 Thread John Bickerstaff
be created in the schema.xml file. That makes use of the include for custom things somewhat moot - at least in my situation. I'd love to be wrong by the way, but that's what my tests suggest right now... On Thu, Aug 4, 2016 at 1:37 PM, John Bickerstaff <j...@johnbickerstaff.com> wrote: > Summary:

Problems using fieldType text_general in copyField

2016-08-04 Thread John Bickerstaff
Summary: Using xinclude to include an xml file into schema.xml The following line generates an error: about a field being "not a glob and not matching an explicit field" even though I declare the field in the line just above. This seems to happen only for for fieldType text_general?

Re: how to specify a tailored schema.xml

2016-07-29 Thread John Bickerstaff
@ Immanuel -- Not sure if this is what you're asking for, but inside /opt/solr/bin is a post script that allows you to "post" the contents of a file to Solr.. ./post -help will get you the list of options. You could submit films.xml for indexing this way I believe. On Fri, Jul 29, 2016 at 9:57

Re: Solr 6 managed-schema & version control

2016-07-29 Thread John Bickerstaff
ould guess that you could do this by exposing an MBean. > Anyway that's how I interpreted Erick's reply. > > > On Wed, Jul 27, 2016 at 6:01 PM, John Bickerstaff < > j...@johnbickerstaff.com> > wrote: > > > Erick - the UI you mention -- something that exists or something t

Re: Solr 6 managed-schema & version control

2016-07-27 Thread John Bickerstaff
Erick - the UI you mention -- something that exists or something that has to be built? (I'm upgrading to version 6 as well and this question is one I'll have to deal with...) On Wed, Jul 27, 2016 at 5:31 PM, Rachid Bouacheria wrote: > Thank you very much Erick, I appreciate

Re: Can't load schema managed-schema: unknown field 'id'

2016-07-26 Thread John Bickerstaff
n only one of them) or, if someone has done a really good job, it's in source control somewhere... On Tue, Jul 26, 2016 at 2:17 PM, John Bickerstaff <j...@johnbickerstaff.com> wrote: > indexed="true" stored="true" required="true" multiValued="false"

Re: Can't load schema managed-schema: unknown field 'id'

2016-07-26 Thread John Bickerstaff
and further on in the file... < uniqueKey>id On Tue, Jul 26, 2016 at 2:17 PM, John Bickerstaff <j...@johnbickerstaff.com> wrote: > I don't see a managed schema file. As far as I understand it, id is set > as a "uniqueKey" in the schema.xml file... > &g

Re: Can't load schema managed-schema: unknown field 'id'

2016-07-26 Thread John Bickerstaff
I don't see a managed schema file. As far as I understand it, id is set as a "uniqueKey" in the schema.xml file... On Tue, Jul 26, 2016 at 2:11 PM, Michael Joyner wrote: > ok, I think I need to do a manual edit on the managed-schema file but I > get "NoNode" for

Re: Can't load schema managed-schema: unknown field 'id'

2016-07-26 Thread John Bickerstaff
@Michael - if you're on Linux and decide to take Alexandre's advice, I can possibly save you some time. I wrestled with getting the data in and out of zookeeper a while ago... sudo /opt/solr/server/scripts/cloud-scripts/zkcli.sh -cmd upconfig -confdir /home/john/conf/ -confname collectionName -z

Re: SolrCloud start up script

2016-06-23 Thread John Bickerstaff
t... Got the > way !!! > > Regards > > José-Marcio > > > On 06/23/2016 10:44 PM, John Bickerstaff wrote: > >> So, if you installed with the install script (warning: I used 5.4 but I >> think everything is the same) and add this setting in your solr.in.sh &

Re: [ANN] Relevant Search by Manning out! (Thanks Solr community!)

2016-06-23 Thread John Bickerstaff
I'll add my vote that reading the book will really expand your understanding of search and "Relevance". If you're working in the Search space, this book is really worth your time! On Thu, Jun 23, 2016 at 2:59 PM, MaryJo Sminkey wrote: > > For someone familiar with Solr,

Re: SolrCloud start up script

2016-06-23 Thread John Bickerstaff
se-marcio.mart...@mines-paristech.fr> wrote: > > Hi John, > > On 06/23/2016 10:18 PM, John Bickerstaff wrote: > >> Jose, >> >> There is a setting in the solr.in.sh script that should make Solr start >> in >> "cloud" mode... >>

Re: SolrCloud start up script

2016-06-23 Thread John Bickerstaff
Jose, There is a setting in the solr.in.sh script that should make Solr start in "cloud" mode... It's ZK_HOST That's where you list the IP addresses (or hostnames) of your zookeeper machines... Is this set? What version of Solr are you using? On Thu, Jun 23, 2016 at 2:13 PM, Jose-Marcio

Re: Solr Query Processing Detail

2016-06-23 Thread John Bickerstaff
uery, > multiply their score by the results of the bf > specified". > > Best, > Erick > > > On Wed, Jun 22, 2016 at 3:04 PM, John Bickerstaff > <j...@johnbickerstaff.com> wrote: > > Oh - gotcha... Thanks for taking the time to reply. My use of the &

Re: Solr Query Processing Detail

2016-06-22 Thread John Bickerstaff
he Rerank stuff. > > That said, if you do want to use the results of one query in another > you can just put the whole thing into an fq clause (perhaps with > {!cache=false}. At that point you'd get back the top N does > that made it through the fq clause in score order. > >

Re: Solr Query Processing Detail

2016-06-22 Thread John Bickerstaff
one query through another. > > Best, > Erick > On Jun 21, 2016 2:43 PM, "John Bickerstaff" <j...@johnbickerstaff.com> > wrote: > > > Hi all, > > > > I have a question about whether sub-queries in Solr requestHandlers go > >

Solr Query Processing Detail

2016-06-21 Thread John Bickerstaff
Hi all, I have a question about whether sub-queries in Solr requestHandlers go against the total index or against the results of the previous query. Here's a simple example: {!edismax qf=blah, blah} {!edismax qf=blah, blah} My question is: What does Query2 run

Re: [ANN] Relevant Search by Manning out! (Thanks Solr community!)

2016-06-21 Thread John Bickerstaff
Congrats! Now you can enjoy those huge royalty payments that I'm sure are coming in... Great book and it's been hugely helpful to me. --JohnB On Tue, Jun 21, 2016 at 12:12 PM, Doug Turnbull < dturnb...@opensourceconnections.com> wrote: > Not much more to add than my post here! This book

Re: Solr Cloud and Multi-word Synonyms :: synonym_edismax parser

2016-06-17 Thread John Bickerstaff
OK - Slapping forehead now... D'oh! 1.2 wrote: > Hi all - > > I've successfully run the hon-lucene-synonyms plugin from the Admin > console by adding the following to the Raw Query Parameters field... > > > =text=synonym_edismax=true=1.2=1.1 > > I got those from the Read Me on the github

Re: Solr Cloud and Multi-word Synonyms :: synonym_edismax parser

2016-06-17 Thread John Bickerstaff
Hi all - I've successfully run the hon-lucene-synonyms plugin from the Admin console by adding the following to the Raw Query Parameters field... =text=synonym_edismax=true=1.2=1.1 I got those from the Read Me on the github account. Now I'm trying to make this work via a requestHandler in

Re: Solr Cloud and Multi-word Synonyms :: synonym_edismax parser

2016-06-05 Thread John Bickerstaff
Yes, query parameters/modifications mentioned in the readme. Beyond those I don't have useful advice at this point On Jun 4, 2016 10:56 PM, "MaryJo Sminkey" <mjsmin...@gmail.com> wrote: > On Sat, Jun 4, 2016 at 11:47 PM, John Bickerstaff < > j...@johnbickerstaff.com>

Re: Solr Cloud and Multi-word Synonyms :: synonym_edismax parser

2016-06-04 Thread John Bickerstaff
MaryJo - I'm on vacation but can't resist... iirc there are some very useful query modifications suggested in the readme on the github for the plugin... can't access right now. You may know about them already, but if it's been a while since you looked, those may help... On Jun 3, 2016 12:28 PM,

Re: Solr Cloud and Multi-word Synonyms :: synonym_edismax parser

2016-06-01 Thread John Bickerstaff
a 8 and is the first release that made > it to maven central. It uses the namespace > com.github.healthonnet.search.SynonymExpandingExtendedDismaxQParserPlugin > > The features are the same for all versions. > > Hope this clears things up. > > -Joe > On Jun 1, 2016 8:11 PM

Re: Solr Cloud and Multi-word Synonyms :: synonym_edismax parser

2016-06-01 Thread John Bickerstaff
e esp > when I linked the latest 5.0.4 test config prior. > > You can get the older jars from the links off the readme.md. > On Jun 1, 2016 6:14 PM, "Shawn Heisey" <apa...@elyograg.org> wrote: > > On 6/1/2016 1:10 PM, John Bickerstaff wrote: > > @Joe: > > &g

Re: Solr Cloud and Multi-word Synonyms :: synonym_edismax parser

2016-06-01 Thread John Bickerstaff
ib - which, taking the default "for production" install script on Ubuntu resolved to /var/solr/data/lib Good luck! On Wed, Jun 1, 2016 at 12:49 PM, John Bickerstaff <j...@johnbickerstaff.com> wrote: > I tried this - it didn't fail. I don't know if it really star

Re: Solr Cloud and Multi-word Synonyms :: synonym_edismax parser

2016-06-01 Thread John Bickerstaff
at 12:42 PM, John Bickerstaff <j...@johnbickerstaff.com> wrote: > So - the instructions on using the Blob Store API say to use the > Denable.runtime.lib=true option when starting Solr. > > Thing is, I've installed per the "for production" instructions which gives > me

Re: Solr Cloud and Multi-word Synonyms :: synonym_edismax parser

2016-06-01 Thread John Bickerstaff
not be the greatest example) > > > On 5/31/16, 4:02 PM, "John Bickerstaff" <j...@johnbickerstaff.com> wrote: > > >Thanks Jeff, > > > >I believe I tried that, and it still refused to load.. But I'd sure love > >it to work since the other proces

Re: Solr Cloud and Multi-word Synonyms :: synonym_edismax parser

2016-06-01 Thread John Bickerstaff
start.jar in /opt/solr/server as long as I issue the "cloud mode" flag or does that no longer work in 5.x? Do I instead have to modify that start script in /etc/init.d ? On Wed, Jun 1, 2016 at 10:42 AM, John Bickerstaff <j...@johnbickerstaff.com> wrote: > Ahhh - gotcha. > > We

Re: Solr Cloud and Multi-word Synonyms :: synonym_edismax parser

2016-06-01 Thread John Bickerstaff
t; > On Wed, Jun 1, 2016 at 12:20 PM, John Bickerstaff < > j...@johnbickerstaff.com> > wrote: > > > Hi Mary Jo, > > > > I'll point you to Joe's earlier comment about needing to use the Blob > Store > > API... He put a link in his response. &g

Re: Solr Cloud and Multi-word Synonyms :: synonym_edismax parser

2016-06-01 Thread John Bickerstaff
LClassLoader.java:381) > > at java.lang.ClassLoader.loadClass(ClassLoader.java:424) > > at > java.net.FactoryURLClassLoader.loadClass(URLClassLoader.java:814) > > at java.lang.ClassLoader.loadClass(ClassLoader.java:357) > > at java.lang.Class.forNa

Re: Solr Cloud and Multi-word Synonyms :: synonym_edismax parser

2016-06-01 Thread John Bickerstaff
- I'm being lazy, I know. Thanks all! On Tue, May 31, 2016 at 11:35 PM, Shawn Heisey <apa...@elyograg.org> wrote: > On 5/31/2016 3:13 PM, John Bickerstaff wrote: > > The suggestion on the readme is that I can drop the > > hon_lucene_synonyms jar file into the

Re: Solr Cloud and Multi-word Synonyms :: synonym_edismax parser

2016-05-31 Thread John Bickerstaff
about the valuesourceyparser is a bit confusing) Thanks On Tue, May 31, 2016 at 5:02 PM, John Bickerstaff <j...@johnbickerstaff.com> wrote: > Thanks Jeff, > > I believe I tried that, and it still refused to load.. But I'd sure love > it to work since the other process i

Re: Solr Cloud and Multi-word Synonyms :: synonym_edismax parser

2016-05-31 Thread John Bickerstaff
t care about the classloader, I believe you can use whatever > dir you want, with the appropriate bit of solrconfig.xml to load it. > Something like: > > > > On 5/31/16, 2:13 PM, "John Bickerstaff" <j...@johnbickerstaff.com> wrote: > > >All -- &g

Re: Solr Cloud and Multi-word Synonyms :: synonym_edismax parser

2016-05-31 Thread John Bickerstaff
ry to update it soon. I've run > the plugin on Solr 5 and 6, solrcloud and standalone. For running in > SolrCloud make sure you follow > > https://cwiki.apache.org/confluence/display/solr/Adding+Custom+Plugins+in+SolrCloud+Mode > On May 31, 2016 5:13 PM, "John Bickerstaff" <j...

Re: Solr Cloud and Multi-word Synonyms :: synonym_edismax parser

2016-05-31 Thread John Bickerstaff
ince he really doesn't know Solr well > either. > > Mary Jo > > > > > On Mon, May 30, 2016 at 7:49 PM, John Bickerstaff < > j...@johnbickerstaff.com> > wrote: > > > Thanks for the comment Mary Jo... > > > > The error loading the class rings a

Re: Alternate Port Not Working for Solr 6.0.0

2016-05-31 Thread John Bickerstaff
This may be no help at all, but my first thought is to wonder if anything else is already running on port 80? That might explain the somewhat silent "fail"... Nicely said by the way - resisting the urge On Tue, May 31, 2016 at 2:02 PM, Teague James wrote: >

Re: Solr Cloud and Multi-word Synonyms :: synonym_edismax parser

2016-05-30 Thread John Bickerstaff
on Developer* > > *CF Webtools* > You Dream It... We Build It. <https://www.cfwebtools.com/> > 11204 Davenport Suite 100 > Omaha, Nebraska 68154 > O: 402.408.3733 x128 > E: maryjo.smin...@cfwebtools.com > Skype: maryjos.cfwebtools > > > On Mon, May 30, 2016 at 5:0

Re: Solr Cloud and Multi-word Synonyms :: synonym_edismax parser

2016-05-30 Thread John Bickerstaff
fic approach - could you validate whether my thought process is correct and / or if I'm missing something? Yes - I get that I can set it all up and try - but it's what I don't know I don't know that bothers me... On Fri, May 27, 2016 at 11:57 AM, John Bickerstaff <j...@johnbickerstaff.com > wrot

Re: Solr Cloud and Multi-word Synonyms :: synonym_edismax parser

2016-05-27 Thread John Bickerstaff
ser, and addressing > problems with how queries are constructed from Lucene’s “sausagized” token > stream. > > -- > Steve > www.lucidworks.com > > > On May 26, 2016, at 2:21 PM, John Bickerstaff <j...@johnbickerstaff.com> > wrote: > > > > Thanks Chris --

Re: import efficiencies

2016-05-26 Thread John Bickerstaff
usually seek out a specialist to help me make sure the query isn't wasteful. It frequently was and I learned a lot. On Thu, May 26, 2016 at 12:31 PM, John Bickerstaff <j...@johnbickerstaff.com > wrote: > It may or may not be helpful, but there's a similar class of problem that > i

Re: import efficiencies

2016-05-26 Thread John Bickerstaff
It may or may not be helpful, but there's a similar class of problem that is frequently solved either by stored procedures or by running the query on a time-frame and storing the results... Doesn't matter if the end-point for the data is Solr or somewhere else. The problem is long running

Re: Solr Cloud and Multi-word Synonyms :: synonym_edismax parser

2016-05-26 Thread John Bickerstaff
erison, I'd be glad to hear your experience. > > > > I haven't used it, but I am aware of one other project in this vein that > > you might be interested in looking at: > > https://github.com/LucidWorks/auto-phrase-tokenfilter > > > > > > On 5/26/1

Re: Solr Cloud and Multi-word Synonyms :: synonym_edismax parser

2016-05-26 Thread John Bickerstaff
fixing typo: http://wiki.apache.org/solr/QueryParser (search the page for synonym_edismax) On Thu, May 26, 2016 at 11:50 AM, John Bickerstaff <j...@johnbickerstaff.com > wrote: > Hey Jeff (or anyone interested in multi-word synonyms) here are some > potentially interesting links

Re: Solr Cloud and Multi-word Synonyms :: synonym_edismax parser

2016-05-26 Thread John Bickerstaff
project in this vein that > you might be interested in looking at: > https://github.com/LucidWorks/auto-phrase-tokenfilter > > > On 5/26/16, 9:29 AM, "John Bickerstaff" <j...@johnbickerstaff.com> wrote: > > >Ahh - for question #3 I may have spoken too soon.

Re: Solr Cloud and Multi-word Synonyms :: synonym_edismax parser

2016-05-26 Thread John Bickerstaff
of course... If anyone on the list has experience in this area... Thanks. On Thu, May 26, 2016 at 10:25 AM, John Bickerstaff <j...@johnbickerstaff.com > wrote: > Hi all, > > I'm creating a Solr Cloud that will index and search medical text. > Multi-word synonyms are a pretty impor

Solr Cloud and Multi-word Synonyms :: synonym_edismax parser

2016-05-26 Thread John Bickerstaff
Hi all, I'm creating a Solr Cloud that will index and search medical text. Multi-word synonyms are a pretty important factor. I find that there are some challenges around multi-word synonyms and I also found on the wiki that there is a recommended 3rd-party parser (synonym_edismax parser)

Re: API call for optimising a collection

2016-05-17 Thread John Bickerstaff
Having run the optimize from the admin UI on one of my three cores in a Solr Cloud collection, I find that when I got to try to run it on one of the other cores, it is already "optimized" I realize that's not the same thing as an API call, but thought it might help. On Tue, May 17, 2016 at 11:22

Re: [scottchu] How to specify multiple zk nodes using solr startcommand under Windows

2016-05-17 Thread John Bickerstaff
I think those zk server warning messages are expected. Until you have 3 running instances you don't have a "Quorum" and the Zookeeper instances complain. Once the third one comes up they are "happy" and don't complain any more. You'd get similar messages if one of the Zookeeper nodes ever went

Re: [scottchu] How to specify multiple zk nodes using solr start command under Windows

2016-05-17 Thread John Bickerstaff
it's roundabout, but this might work -- ask for the healthcheck status (from the solr box) and hit each zkNode separately. I'm on Linux so you'll have to translate to Windows... using the solr.cmd file I assume... ./solr healthcheck -z 192.168.56.5:2181/solr5_4 -c collectionName ./solr

Re: [scottchu] How to specify multiple zk nodes using solr start commandunder Windows

2016-05-17 Thread John Bickerstaff
In your original command, you listed the same port twice. That may have been at least part of the difficulty. It's probably fine to just use one zk node - as the zookeeper instances should be aware of each other. I also assume that if your solr.in.sh (or windows equavalent) has the properly

Re: Does anybody crawl to a database and then index from the database to Solr?

2016-05-13 Thread John Bickerstaff
I've been working on a less-complex thing along the same lines - taking all the data from our corporate database and pumping it into Kafka for long-term storage -- and the ability to "play back" all the Kafka messages any time we need to re-index. That simpler scenario has worked like a charm. I

Re: Is there an equivalent to an SQL "select distinct" in Solr

2016-05-13 Thread John Bickerstaff
I should clarify: http:/XXX.XXX.XX.XX:8983/solr/yourCoreName/select q=*%3A*=0=json=true=true=category "yourCoreName" will get built in for you if you use the Solr Admin UI for queries -- On Fri, May 13, 2016 at 9:36 AM, John Bickerstaff <j...@johnbickerstaff.com> wrote: > I

Re: Is there an equivalent to an SQL "select distinct" in Solr

2016-05-13 Thread John Bickerstaff
In case it's helpful for a quick and dirty peek at your facets, the following URL (in a browser or Curl) will get you basic facets for a field named "category" -- assuming you change the IP address / hostname to match yours. http:/XXX.XXX.XX.XX:8983/solr/statdx_shard1_replica3/select

Re: Atomicity of commits in Solr Cloud?

2016-05-12 Thread John Bickerstaff
I'm not a dev, but I would assume the following if I were concerned with speed and atomicity A. A commit WILL be reflected in all appropriate shards / replicas in a very short time. I believe Solr Cloud guarantees this, although the time frame will be dependent on "B" B. Network,

Re: changing web context and port for SolrCloud Zookeeper

2016-05-11 Thread John Bickerstaff
ing to see if anyone knows what is the cleanest way to move from a Tomcat/8080 install to a Jetty/8983 one. > > Thanks > >> On May 11, 2016, at 1:59 PM, John Bickerstaff <j...@johnbickerstaff.com> wrote: >> >> I may be answering the wrong question - but SolrCloud

Re: changing web context and port for SolrCloud Zookeeper

2016-05-11 Thread John Bickerstaff
inks > they are replicas. So I’m looking to see if anyone knows what is the > cleanest way to move from a Tomcat/8080 install to a Jetty/8983 one. > > Thanks > > > On May 11, 2016, at 1:59 PM, John Bickerstaff <j...@johnbickerstaff.com> > wrote: > > &g

Re: changing web context and port for SolrCloud Zookeeper

2016-05-11 Thread John Bickerstaff
g4j.properties" SOLR_LOGS_DIR="/var/solr/logs" SOLR_PORT="8983" On Wed, May 11, 2016 at 11:59 AM, John Bickerstaff <j...@johnbickerstaff.com > wrote: > I may be answering the wrong question - but SolrCloud goes in by default > on 8983, yes? Is yours currently on

Re: changing web context and port for SolrCloud Zookeeper

2016-05-11 Thread John Bickerstaff
I may be answering the wrong question - but SolrCloud goes in by default on 8983, yes? Is yours currently on 8080? I don't recall where, but I think I saw a config file setting for the port number (In Solr I mean) Am I on the right track or are you asking something other than how to get Solr on

Re: I need Consultation/Suggestion and I am even willing to pay fee for that

2016-05-05 Thread John Bickerstaff
g -- which is generally incompatible with a really great user experience... And, of course, I may have totally missed your meaning and you may have had something totally different in mind... On Thu, May 5, 2016 at 8:33 AM, John Bickerstaff <j...@johnbickerstaff.com> wrote: > I'll just briefl

Re: I need Consultation/Suggestion and I am even willing to pay fee for that

2016-05-05 Thread John Bickerstaff
I'll just briefly add some thoughts... #1 This can be done several ways - including keeping a totally separate document that contains ONLY the data you're willing to expose for free -- but what you want to accomplish is not clear enough to me for me to start making recommendations. I'll just say

Re: What does the "Max Doc" means in Admin interface?

2016-05-04 Thread John Bickerstaff
Max doc is the total amount of documents in the collection INCLUDING the ones that have been deleted but not actually removed. Don't worry, deleted docs are not used in search results. Yes, you can change the number by "optimizing" (see the button) but this does take time and bandwidth so use it

Re: [Installation] Solr log directory

2016-05-03 Thread John Bickerstaff
Hoss - I'm guessing this is all in the install script that gets created when you run that command (can't remember it) on the tar.gz file... In other words, Yunee can edit that file, find those variables (like SOLR_SERVICE) and change them from what they're set to by default to whatever he

Re: [Installation] Solr log directory

2016-05-03 Thread John Bickerstaff
I think you should be able to change $SOLR_HOME to any valid path. For example: /var/logs/solr_logs On Tue, May 3, 2016 at 4:02 PM, Yunee Lee wrote: > Hi, solr experts. > > I have a question for installing solr server. > Using ' install_solr_service.sh' with option -d ,

Re: solr.StrField or solr.StringField?

2016-05-03 Thread John Bickerstaff
g and such it is missing >> from the official Solr wiki's. >> >> Steve >> >> [1] https://wiki.apache.org/solr/SolrFacetingOverview, >> >> http://grokbase.com/t/lucene/solr-commits/06cw5038rk/solr-wiki-update-of-solrfacetingoverview-by-jjlarrea >> , >> >>

Re: solr.StrField or solr.StringField?

2016-05-03 Thread John Bickerstaff
ure if that's a typo, a real thing and such it is missing > from the official Solr wiki's. > > Steve > > [1] https://wiki.apache.org/solr/SolrFacetingOverview, > > http://grokbase.com/t/lucene/solr-commits/06cw5038rk/solr-wiki-update-of-solrfacetingoverview-by-jjlarrea >

Re: solr.StrField or solr.StringField?

2016-05-03 Thread John Bickerstaff
My default schema.xml does not have an entry for solr.StringField so I can't tell you what that one does. If you look for solr.StrField in the schema.xml file, you'll get some idea of how it's defined. The default setting is for it not to be analyzed. On Tue, May 3, 2016 at 10:16 AM, Steven

Re: Solr5.5:DocValues/CopyField does not work with Atomic updates

2016-04-21 Thread John Bickerstaff
Which field do you try to atomically update? A or B or some other? On Apr 21, 2016 8:29 PM, "Tirthankar Chatterjee" wrote: > Hi, > Here is the scenario for SOLR5.5: > > FieldA type= stored=true indexed=true > > FieldB type= stored=false indexed=true docValue=true >

Re: complete cluster shutdown

2016-04-21 Thread John Bickerstaff
I guess errors like "fsync-ing the write ahead log in SyncThread:5 took 7268ms which will adversely effect operation latency." and: "likely client has closed socket" make me wonder if something went wrong in terms of running out of disk space for logs (thus giving your OS no space for necessary

Re: Verifying - SOLR Cloud replaces load balancer?

2016-04-19 Thread John Bickerstaff
, Apr 19, 2016 at 7:59 AM, Shawn Heisey <apa...@elyograg.org> wrote: > On 4/18/2016 11:22 AM, John Bickerstaff wrote: > > So - my IT guy makes the case that we don't really need Zookeeper / Solr > > Cloud... > > > I'm biased in terms of using the most recen

Re: Verifying - SOLR Cloud replaces load balancer?

2016-04-19 Thread John Bickerstaff
atabases. If you're interested, ping me -- I'm happy to share what I've got... On Tue, Apr 19, 2016 at 2:08 AM, Charlie Hull <char...@flax.co.uk> wrote: > On 18/04/2016 18:22, John Bickerstaff wrote: > >> So - my IT guy makes the case that we don't really need Zookeeper / Solr >

Re: Verifying - SOLR Cloud replaces load balancer?

2016-04-18 Thread John Bickerstaff
ng > loads. The argument totally changes if you need low latency. It > doesn't sound like your situation is sensitive to any of these > though > > Best, > Erick > > On Apr 18, 2016 10:41 AM, "John Bickerstaff" <j...@johnbickerstaff.com> > wrote:

Re: Verifying - SOLR Cloud replaces load balancer?

2016-04-18 Thread John Bickerstaff
> collection name that doesn't conflict, and create the thing, and smoke test > with it. I know that standard practice is to bring up all new nodes, but > I don't see why this is needed. > > -Original Message- > From: John Bickerstaff [mailto:j...@johnbickerstaff.c

<    1   2   3   >