Re: Score different for different documents containing same value

2018-03-26 Thread Erick Erickson
add debug=true to the query and you'll see exactly how the scores are calculated, that should give you a clue as to what's going on. In particular look at the parsed query and be sure that your query is parsed as you expect. It should be given you you specify the query, but as a sanity check. Is

Re: edit gc parameters in solr.in.sh or solr?

2018-03-26 Thread Shawn Heisey
On 3/26/2018 6:41 PM, Derek Poh wrote: On my installation, "solr.in.sh" is in solr-6.6.2/bin directory. It is recommended to place the file in /etc/default? Regarding the "solrfile", I was referring to the file "solr". Sorry for the typo. The file "solr" is not edited normally? I've

Re: Solr 4.9 - configs and collections

2018-03-26 Thread Shawn Heisey
On 3/26/2018 8:43 AM, Abhi Basu wrote: > Running on MS HDInsight and Solr 4.9.What is the BKM for creation, update, > delete of configurations and collections? I have no idea what a BKM is.  I will cover the update of configuration below. > I do the following: > > 1. First I create the zk

Re: Default Index config

2018-03-26 Thread Shawn Heisey
On 3/26/2018 10:45 AM, mganeshs wrote: > I haven't changed the solr config wrt index config, which means it's all > commented in the solrconfig.xml. > > It's something like what I pasted before. But I would like to know whats the > default value of each of this. Default value of *what* exactly? 

Re: Solr 7 or 6 - stability and performance

2018-03-26 Thread Greg Roodt
We've been running 7.2.1 at work for a while now and it's been running very well. We saw some performance improvements, but I would attribute most of that to the newer instance types we used in the upgrade. Didn't see any major performance regressions for our workload. A couple of things to think

Re: Why are cursor mark queries recommended over regular start, rows combination?

2018-03-26 Thread Webster Homer
Shawn, Thanks. It's been a while now, but we did find issues with both cursorMark AND start/rows. the effect was much more obvious with cursorMark. We were able to address this by switching to use TLOG replicas. These give consistent results. It's nice to know that the cursorMark problems were

Score different for different documents containing same value

2018-03-26 Thread bbarani
Hi, I was trying to query a field that has specific term in it and to my surprise the score was different for different documents even though the field I am searching for contained the same exact terms in all the documents. Any idea when this issue would come up? *Note:* All the documents

Re: Solr on HDInsight to write to Active Data Lake

2018-03-26 Thread Abhi Basu
Yes, I copied the jars to all nodes and restarted Solr service. 04212org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException:Error CREATEing SolrCore 'ems-collection-700_shard1_replica2': Unable to create core: ems-collection-700_shard1_replica2 Caused by: Class

Re: solrj question

2018-03-26 Thread Shawn Heisey
On 3/26/2018 11:19 AM, Webster Homer wrote: > You may say that the String in the constructor is "meant to be query > syntax", nothing in the Javadoc says anything about the expected syntax. > Since there is also a method to set the query, it seemed reasonable to > expect that it would take the

Re: solrj question

2018-03-26 Thread Webster Homer
You may say that the String in the constructor is "meant to be query syntax", nothing in the Javadoc says anything about the expected syntax. Since there is also a method to set the query, it seemed reasonable to expect that it would take the output of the toString method. (or some other

Default Index config

2018-03-26 Thread mganeshs
Hi, I haven't changed the solr config wrt index config, which means it's all commented in the solrconfig.xml. It's something like what I pasted before. But I would like to know whats the default value of each of this. Coz.. after loading to 6.5.1 and our document size also crossed 5GB in each

Re: querying vs. highlighting: complete freedom?

2018-03-26 Thread Erick Erickson
Arturas: Thanks for the "atta boy's", but I have to confess I poked a developer's list and the person (David Smiley) who, you know, like understands the highlighting code replied, and I passed it on ; I have great respect for the SO forum, but don't post to it since there's only so much time in

Re: Solr on HDInsight to write to Active Data Lake

2018-03-26 Thread Erick Erickson
Several things: 1> I often start with an absolute path, knowing the exact relative path from where Solr starts can be confusing. If you've pathed properly and the jar file is in the path, it'll be found. 2> Are you sure HdiAdlFileSystem is in one of the jars? 3> did you restart the JVM? Best,

Re: Solr 4.9 - configs and collections

2018-03-26 Thread Erick Erickson
Yes, use the same command to upload a config. Yes, you need to reload a collection. Lots of this functionality is in the newer bin/solr scripts, 4.9 is 3.5 years old. Best, Erick On Mon, Mar 26, 2018 at 7:43 AM, Abhi Basu <9000r...@gmail.com> wrote: > Running on MS HDInsight and Solr 4.9.What

Re: Solr 7 or 6 - stability and performance

2018-03-26 Thread Walter Underwood
If you are running 6.4.1, you will see a big speedup when going to a later version. The metrics code caused a serious performance problem. https://issues.apache.org/jira/browse/SOLR-10130 wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Mar 25,

Re: Phrase search with Solr 7.2

2018-03-26 Thread Steven White
Please ignore this. It was a user error. I was pointing to the wrong analyzer in my app's cfg file. Steve On Mon, Mar 26, 2018 at 10:17 AM, Steven White wrote: > Setting "sow=true" didn't make a difference. > > Here is what I'm using now: http://localhost:8983/ >

Re: edit gc parameters in solr.in.sh or solr?

2018-03-26 Thread Walter Underwood
We use the G1 collector in Java 8u131 and it works well. We are running 6.6.2. Our Solr instances do a LOT of allocation. We have long queries (25 terms average) and many unique queries. SOLR_HEAP=8g # Use G1 GC -- wunder 2017-01-23 # Settings from https://wiki.apache.org/solr/ShawnHeisey

Solr 4.9 - configs and collections

2018-03-26 Thread Abhi Basu
Running on MS HDInsight and Solr 4.9.What is the BKM for creation, update, delete of configurations and collections? I do the following: 1. First I create the zk config: sudo zkcli.sh -cmd upconfig -zkhost zknode :2181

Re: edit gc parameters in solr.in.sh or solr?

2018-03-26 Thread Shawn Heisey
On 3/26/2018 2:22 AM, Derek Poh wrote: From your experience, would like to know if It is advisable to change the gc parameters in solr.in.sh or solrfile? It is mentioned in the documentation to edit solr.in.sh but would like toknow which file you actually edit. You need a GC_TUNE variable in

Re: Phrase search with Solr 7.2

2018-03-26 Thread Steven White
Setting "sow=true" didn't make a difference. Here is what I'm using now: http://localhost:8983/solr/ccfts/select_test?q=%22record%20type%20session%22=json=true=true=true And here is the output: { "responseHeader":{ "status":0, "QTime":1, "params":{ "q":"\"record type

Re: Solr on HDInsight to write to Active Data Lake

2018-03-26 Thread Abhi Basu
Adding this to solrconfig.xml did not work. I put all the azure and hadoop jars in the ext folder. Caused by: Class org.apache.hadoop.fs.adl.HdiAdlFileSystem not found Thanks, Abhi On Fri, Mar 23, 2018 at 7:40 PM, Abhi Basu <9000r...@gmail.com> wrote: > I'll try it out. > > Thanks > > Abhi

Indexing multi level Nested JSON using curl

2018-03-26 Thread Zheng Lin Edwin Yeo
Hi, I'm trying to index the following JSON with 2 child level using the following curl command using cygwin: curl 'http://localhost:8983/solr/collection1/update/json/docs?split=/|/orgs' -H 'Content-type:application/json' -d ' { "id":"1", "name_s": "JoeSmith", "phone_s": 876876687,

edit gc parameters in solr.in.sh or solr?

2018-03-26 Thread Derek Poh
Hi From your experience, would like to know if It is advisable to change the gc parameters in solr.in.sh or solrfile? It is mentioned in the documentation to edit solr.in.sh but would like toknow which file you actually edit. I am using Solr 6.6.2at the moment. Regards, Derek

Re: querying vs. highlighting: complete freedom?

2018-03-26 Thread Arturas Mazeika
Hi Erick, Adding a field-qualify to the hl.q parameter solved the issue. My excitement is steaming over the roof! What a thorough answer: the explanation about the behavior of solr, how it tries to interpret what I mean when I supply a keyword without the field-qualifier. Very impressive. Would