Re: SOLR 5.4.0?

2015-12-31 Thread Xavier Sanchez Loro
El 31/12/15 a las 8:07, Ere Maijala escribió: Well, for us SOLR-8418 is a major issue. I haven't encountered other issues, but that one was sort of a show-stopper. --Ere 31.12.2015, 7.27, William Bell kirjoitti: How is SOLR 5.4.0 ? I heard there was a quick 5.4.1 coming out? Any major

Re: Testing Solr configuration, schema, and other fields

2015-12-31 Thread Erik Hatcher
Dan - I’m a fan of the idea of using EmbeddedSolrServer for the type of thing you mention, but since you’re already using SolrCloud how about simply upconfig’ing the configuration from the Git repo, create a temporary collection using that configset and smoke test it before making it ready for

RE: Teiid with Solr - using any other engine except the SolrDefaultQueryEngine

2015-12-31 Thread Mark Horninger
Thanks for the response, Alex. I am trying to accomplish a Federated search of SQL Server and Solr. I guess I should have given more detail on this. The overall plan is to do the following: 1. SSIS ETL data from multiple sources into SQL Server 2. SSIS call to update Solr Indexing. 3. SQL

Re: Memory Usage increases by a lot during and after optimization .

2015-12-31 Thread Alexandre Rafalovitch
Wouldn't collection swapping be a better strategy in that case? Load and optimise in a separate server, then swap it in. On 30 Dec 2015 10:08 am, "Walter Underwood" wrote: > The only time that a force merge might be useful is when you reindex all > content every night or

RE: multi term analyzer error

2015-12-31 Thread Eyal Naamati
Hi Erick, Thanks for the detailed response! My use case is exactly as you described in your 'Eric*' example. Our index and query analyzers replace a dash "-" with an underscore "_". So when a user tries to search for something that has a dash in it, and the query has a wildcard (for example

Re: Using post.jr for indexing in Solr 5.4.0

2015-12-31 Thread Erik Hatcher
Looks like you don't have Solr "Cell" lib's pointed to properly in your solrconfig. Try /update/extract directly taking post.jar out if the equation to troubleshoot. What's your exact command line? Erik > On Dec 31, 2015, at 00:42, Zheng Lin Edwin Yeo wrote: >

shard lost - solr5.3

2015-12-31 Thread GOURAUD Emmanuel
Hi there, I have a collection that is composed of 8 shards with a replicationFactor of 2 i found 2 cores of the same shard in recoveryfailed status so i decided to restart both, after having doing that , i do not have any leader on that shard... and both cores are down is there a way to

Re: SOLR 5.4.0?

2015-12-31 Thread Erick Erickson
Ere: Can you help with testing the patch if it's important to you? Ramkumar is working on it... Best, Erick On Wed, Dec 30, 2015 at 11:07 PM, Ere Maijala wrote: > Well, for us SOLR-8418 is a major issue. I haven't encountered other issues, > but that one was sort of a

RE: Testing Solr configuration, schema, and other fields

2015-12-31 Thread Alexandre Rafalovitch
Well, I guess NIH stands for Not Invented Here. No idea what NLM is for. P.s. sorry, could not resist. I worked for orgs like that too :-( On 1 Jan 2016 12:03 am, "Davis, Daniel (NIH/NLM) [C]" wrote: > That's incredibly cool. Much easier than the chef/puppet scripts and

Re: Testing Solr configuration, schema, and other fields

2015-12-31 Thread Alexandre Rafalovitch
Makes sense. Answering the answer email in this thread, did you look at Solr Scale? Maybe it has the base infrastructure you need: https://github.com/LucidWorks/solr-scale-tk Regards, Alex. Newsletter and resources for Solr beginners and intermediates: http://www.solr-start.com/ On 31

RE: Testing Solr configuration, schema, and other fields

2015-12-31 Thread Davis, Daniel (NIH/NLM) [C]
That's incredibly cool. Much easier than the chef/puppet scripts and stuff I've seen.I'm certain to play with this and get under the hood; however, we locally don't have a permission to use AWS EC2 in this corner of NLM. There's some limited use of S3 and Glacier. Maybe we'll

Re: Teiid with Solr - using any other engine except the SolrDefaultQueryEngine

2015-12-31 Thread Erick Erickson
In addition, and depending on your time-frame, you may want to work with Solr 6.0 and the "ParallelSQL" option. NOTE: this is _very_ new. People are using it but it'll probably have some rough edges for a while, not to mention you're using an unreleased version of Solr. BTW, Solr 6.0 is also

Re: Testing Solr configuration, schema, and other fields

2015-12-31 Thread Erick Erickson
Hmmm, a couple of things: the bin/solr script could be used as a model in this scenario for how to automate a lot of this. I'm thinking you can skip all the argument parsing and that and just see how the SolrCLI jar file is used to spin up collections, upload configs and the like. In fact,

Re: Using post.jr for indexing in Solr 5.4.0

2015-12-31 Thread Zheng Lin Edwin Yeo
Yes, I tried using the latest post.jar, and I got the same error. I have shortlisted the problem down to the org.apache.solr.handler.extraction.ExtractingDocumentLoader, as I have modified my SolrContentHandler to remove things like \n, \t and \r from being indexed. for this, I have repackaged

Re: Teiid with Solr - using any other engine except the SolrDefaultQueryEngine

2015-12-31 Thread Alexandre Rafalovitch
Actually, this does not sound like a federated search. It sounds like you want to pre-filter possible records with SQL query before doing the rest of the search in Solr. The simple option would be to see if Solr alone can handle it and avoid the complicated integration.. But if not, a custom

RE: Testing Solr configuration, schema, and other fields

2015-12-31 Thread Davis, Daniel (NIH/NLM) [C]
> What is the next step you are stuck on? > > Regards, >Alex I'm not really stuck. My question has been about the best practices. I am trying to work against "not-invented-here" syndrome, "only-useful-here" syndrome, and "boil-the-ocean" syndrome.I have to make the solution work

Re: [More Like This] Query building

2015-12-31 Thread Alessandro Benedetti
https://issues.apache.org/jira/browse/LUCENE-6954 First draft patch available, I will check better the tests new year ! On 29 December 2015 at 13:43, Alessandro Benedetti wrote: > Sure, I will proceed tomorrow with the Jira and the simple patch + tests. > > In the

RE: Testing Solr configuration, schema, and other fields

2015-12-31 Thread Davis, Daniel (NIH/NLM) [C]
Heh National Library of Medicine (NLM) is all over the map in terms of "not-invented-here", being a large organization within a large organization. It's my personal tendency towards "not-invented-here" that concerns me. -Original Message- From: Alexandre Rafalovitch

Re: Teiid with Solr - using any other engine except the SolrDefaultQueryEngine

2015-12-31 Thread Erik Hatcher
Yeah, rather than go to all the complexity here, definitely see if providing a list of id’s to a Solr filter query (fq) works well for you. Many do this sort of thing, and with the “terms” query parser it’s tractable to provide fairly big lists of id’s to filter on… fq={!terms f=id}1,2,3,…,

RE: Testing Solr configuration, schema, and other fields

2015-12-31 Thread Davis, Daniel (NIH/NLM) [C]
Erik, that suggests an additional approach that seems to have "legs": * A webapp that acts as a sort of Cloud IDE for Solr configsets. It supports multiple projects and a single SolrCloud cluster. For each project, it upconfigs a git repository local to the webapp, and has the ability to

Re: Issue with if() statement

2015-12-31 Thread billnbell
Solr 5.3.1 Bill Bell Sent from mobile > On Dec 31, 2015, at 4:50 PM, William Bell wrote: > > We are getting weird results with if(exists(a),b,c). We are getting b+c!! > >

Re: Issue with if() statement

2015-12-31 Thread Jack Krupansky
You can't have spaces in a function query - the %20 will get expanded to a space (just as a "+" would.) And fq is "filter query" anyway, not "function query". Try: fq={!func}... Not sure what the solution to those embedded spaces is, but you probably need function queries there as well. --

Re: Solr - facet fields that contain other facet fields

2015-12-31 Thread Kevin Lopez
Hi Erick, I believe I have found a solution and I am putting plenty of detail for future reference. I have taken your previous advice and decided to add a field (cancerTerms) and add in the terms there. But I am not doing this outside of Solr. I am using the analysis chain and passing it through

Issue with if() statement

2015-12-31 Thread William Bell
We are getting weird results with if(exists(a),b,c). We are getting b+c!! http://localhost:8983/solr/providersearch/select?q=*:*=json=state:%22CO%22=state:%22NY%22=if(exists(query($state1)),{!lucene%20v=$state1},{!lucene%20v=$state}) I am getting NY and CO! I only want $state1, which is NY.

Re: Using post.jr for indexing in Solr 5.4.0

2015-12-31 Thread Zheng Lin Edwin Yeo
Hi, This is the latest error that I got even after I update all the class and dependency jars to the latest version. SimplePostTool: WARNING: Response: 5000 java.lang.NullPointerException at org.apache.tika.parser.AutoDetectParser.init(AutoDetectParser .java:77) at

Re: Memory Usage increases by a lot during and after optimization .

2015-12-31 Thread Zheng Lin Edwin Yeo
Hi Yonik, Yes, the plan is to do the optimizing at night after indexing, when there are lesser user who will use the system. But the problem I'm facing now is that during optimizing, the memory usage of the server hit the maximum of 64GB, and I believe the optimization could not be completed