unsubsribe
-Original Message- From: Sachin Aggarwal [mailto:different.sac...@gmail.com] Sent: Tuesday, July 10, 2012 6:08 AM To: solr-user@lucene.apache.org Subject: unique key is it possible not to index and but store the unique keyit will make index size small. i need the unique key to b stored so that i can read the returned result from the database. -- Thanks Regards Sachin Aggarwal 7760502772
RE: Can't find solr.xml
Try to add below below file, and set to any path you would like to use: /usr/local/tomcat/conf/Catalina/localhost/solr.xml Context path=/solr Environment name=solr/home type=java.lang.String value=/usr/local/tomcat/data/solr/dev/ override=true/ /Context Roxy -Original Message- From: Nabeel Sulieman [mailto:nabeel.sulie...@gmail.com] Sent: Monday, July 02, 2012 4:34 AM To: solr-user@lucene.apache.org Subject: Re: Can't find solr.xml Argh! (and hooray!) I started from scratch again, following the wiki instructions. I did only one thing differently; put my data directory in /opt instead of /home/dev. And now it works! I'm glad it's working now. I just wish I knew exactly what the difference is. The directory in /opt has exactly the same permissions as the one in /home/dev (chown -R tomcat solr). On Sun, Jul 1, 2012 at 10:08 PM, Michael Della Bitta michael.della.bi...@appinions.com wrote: Possibly an obvious thing you've already looked at, but does the user that Tomcat's running under have execute permissions on all the directories leading up to your solr directory? It might be being prevented from traversing the directory tree. Also I would verify there's no ACLs on anything in that directory tree. Those can get bizarre if you're like me and don't understand them. :) I'm assuming you're using a UNIX variant here... Michael Della Bitta Appinions, Inc. -- Where Influence Isn’t a Game. http://www.appinions.com On Sun, Jul 1, 2012 at 11:40 AM, Nabeel Sulieman nabeel.sulie...@gmail.com wrote: I tried going back to 3.5 and ran into the same problem, so it's definitely an issue on my server. It's just so bizarre; I can cat or vi /home/dev/solr/solr.xml with no problems, and I've even tried setting the permission to read/write for all, but tomcat still can't seem to find the file. Hmmm... I wonder if my tomcat user is running in some kind of jailed environment? I'll look into that next. Anyways, I'll retrace my steps and see if I come up with anything. -Original Message- From: Mark Miller [mailto:markrmil...@gmail.com] Sent: Sunday, July 01, 2012 5:27 PM To: solr-user@lucene.apache.org Subject: Re: Can't find solr.xml Can't think of anything that would cause this from 3.5 to 3.6. If you indeed have a solr home located at home/dev/solr/ and there is a conf dir under that, all I can imagine is that it's a permissions issue or something at the OS level. On Jun 30, 2012, at 2:28 PM, Nabeel Sulieman wrote: Hi, I really hate bothering this group with something that should be trivial, but I've been googling and experimenting to get this to work for the last week now. I had no trouble getting my simple configuration working on 3.5, but when I moved over to 3.6, I seem to have hit something strange. As I said I'm on the latest version of solr (3.6.0), and I'm using exactly the standard war file, with the solr/home section uncommented and set to my Solr directory. However, even though the path is correct, Solr/Tomcat don't seem to be able to find the solr.xml file, nor the solrconfig.xml file. Java version is 1.6.0_29-b11, tomcat 5.5.35, CentOS. What am I missing here? Thanks. Below is the error log. Jun 30, 2012 12:47:58 PM org.apache.solr.core.CoreContainer$Initializer initialize INFO: looking for solr.xml: /home/dev/solr/solr.xml Jun 30, 2012 12:47:58 PM org.apache.solr.core.CoreContainer$Initializer initialize INFO: no solr.xml file found - using default Jun 30, 2012 12:47:58 PM org.apache.solr.core.CoreContainer load INFO: Loading CoreContainer using Solr Home: '/home/dev/solr/' Jun 30, 2012 12:47:58 PM org.apache.solr.core.SolrResourceLoader init INFO: new SolrResourceLoader for directory: '/home/dev/solr/' Jun 30, 2012 12:47:58 PM org.apache.solr.core.CoreContainer create INFO: Creating SolrCore '' using instanceDir: /home/dev/solr/. Jun 30, 2012 12:47:58 PM org.apache.solr.core.SolrResourceLoader init INFO: new SolrResourceLoader for directory: '/home/dev/solr/./' Jun 30, 2012 12:47:58 PM org.apache.solr.common.SolrException log SEVERE: java.lang.RuntimeException: Can't find resource 'solrconfig.xml' in classpath or '/home/dev/solr/./conf/', cwd=/usr/local/jakarta/apache-tomcat-5.5.35/bin at org.apache.solr.core.SolrResourceLoader.openResource(SolrResourceLoade r.java :273) at org.apache.solr.core.SolrResourceLoader.openConfig(SolrResourceLoader. java:2 39) at org.apache.solr.core.Config.init(Config.java:141) at org.apache.solr.core.SolrConfig.init(SolrConfig.java:138) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:455) at
RE: elevate vs. select numFound results
I modified mysolrconfig.xml to: requestHandler name=/elevate class=solr.SearchHandler startup=lazy lst name=defaults str name=defTypedismax/str str name=echoParamsexplicit/str bool name=omitHeadertrue/bool float name=tie0.01/float str name=pfcontent^2.0/str int name=ps15/int !-- Abort any searches longer than 4 seconds -- !-- int name=timeAllowed4000/int -- str name=mm1/str str name=q.alt*:*/str /lst arr name=last-components strelevator/str /arr /requestHandler Then added enableElevation=true parameter to my elevate url. http://mydomain:8181/solr/elevate?q=dwayne+rock+johnsonwt=xmlsort=score+descfl=id,bundle_nameexclusive=truedebugQuery=onenableElevation=true This made my /elevate parsed query to match my /select query, and I got back same numFound. My parsedquery: str name=parsedquery +((DisjunctionMaxQuery((content:dwayn)~0.01) DisjunctionMaxQuery((content:rock)~0.01) DisjunctionMaxQuery((content:johnson)~0.01))~1) DisjunctionMaxQuery((content:dwayn rock johnson~15^2.0)~0.01) /str But it would be nice to make exclusive=true work, and get empty result set back when there is no matching elevation query. Is there any solrconfig settings to do so? -Original Message- From: Noordeen, Roxy [mailto:roxy.noord...@wwecorp.com] Sent: Friday, May 04, 2012 8:11 PM To: solr-user@lucene.apache.org Subject: RE: elevate vs. select numFound results My actual problem is with elevate not working with exclusive=true. I have a special pinned widget, that has to display only the nodes defined in my elevate.xml, kind of sponsored results. If I define game in my elevte.xml, and send exclusive=true I get only the elevated entries. http://my domain:8181/solr/elevate?q=gamewt=xmlsort=score+descfl=id,bundle_nameexclusive=true but when I pass a word not defined in my elevate.xml, and send exclusive=true, I almost get same results like /select query. http://my domain:8181/solr/elevate?q=gamenotdefinedwt=xmlsort=score+descfl=id,bundle_nameexclusive=true So I ended up in using both elevate and select, if numbers [numFound] MATCH in both the request, I assume the word does not exist in my elevate.xml, and I had to hide my pinned widget. But in few cases, my /elevate and /select are not returning same numFound. There are some differences in the numbers. Is there a way to force exclusive=true just to look at elevate.xml entries, and ignore the result from default search? answer to your questions: 1. There is no exclude=true parameter set in my elevate.xml 2. There is no exlusive=true set in url 3. My elevate entry in solrconfig.xml searchComponent name=elevator class=solr.QueryElevationComponent !-- pick a fieldType to analyze queries -- str name=queryFieldTypestring/str str name=config-fileelevate.xml/str !-- str name=refreshOnCommmittrue/str -- /searchComponent !-- a request handler utilizing the elevator component -- requestHandler name=/elevate class=solr.SearchHandler startup=lazy lst name=defaults str name=echoParamsexplicit/str /lst arr name=last-components strelevator/str /arr /requestHandler 4. I am not sure how to verify qf difference. I am using raw schema.xml and solrconfig.xml shipped with drupal solr module. I manage most of the solr configs via the drupal module, except at query time I query solr queries directly. -Original Message- From: Jack Krupansky [mailto:j...@basetechnology.com] Sent: Friday, May 04, 2012 5:44 PM To: solr-user@lucene.apache.org Subject: Re: elevate vs. select numFound results Some ways that fewer docs might be returned by query elevation: 1. The excude option: exclude=true in the xml file. 2. The exclusive request parameter: exclusive=true in the URL. (Certainly not your case.) 3. The exclusive request parameter default set to true in defaults for the /elevate request handler in solrconfig. 4. Some other query-related parameters (e.g., qf) are different between your /select and /elevate request handlers Try adding enableElevation=false to your URL for /elevate, which should show you whether query elevation itself is affecting the number of docs, or if it must be some other parameters that are different between the two request handlers. -- Jack Krupansky -Original Message- From: roxy.noord...@wwecorp.com Sent: Friday, May 04, 2012 3:21 PM To: solr-user@lucene.apache.org Subject: elevate vs. select numFound results I need help understanding the difference in the numFound number in the result when I execute two queries against my solr instance, one with the elevation and one without. I have a simple elevate.xml file created and working and am searching for terms that are not meant to be elevated. Elevate query example.com:8080/solr/elevate?q=dwayne+rock+johnsonwt=xmlsort=score+descrows=1 for this the numFound is 125 in the result element of the XML Select query example.com:8080/solr/select?q=dwayne+rock+johnsonwt=xmlsort=score+descrows=1 for this the numFound is 154 in the result element of the XML For many
Re: Solr 3.5 - Elevate.xml causing issues when placed under /data directory
Yes numfound is 0
I tried your way of defining solrdir, didn't work either.
Right now I placed my elevate.xml in conf dir, and wrote a script to reload
solr webapp. We will run the script once a day.
- Original Message -
From: Koji Sekiguchi [mailto:k...@r.email.ne.jp]
Sent: Wednesday, May 02, 2012 09:19 PM
To: solr-user@lucene.apache.org solr-user@lucene.apache.org
Subject: Re: Solr 3.5 - Elevate.xml causing issues when placed under /data
directory
(12/05/03 1:39), Noordeen, Roxy wrote:
Hello,
I just started using elevation for solr. I am on solr 3.5, running with
Drupal 7, Linux.
1. I updated my solrconfig.xml
from
dataDir${solr.data.dir:./solr/data}/dataDir
To
dataDir/usr/local/tomcat2/data/solr/dev_d7/data/dataDir
2. I placed my elevate.xml in my solr's data directory. Based on forum
answers, I thought placing elevate.xml under data directory would pick my
latest change.
I restarted tomcat.
3. When i placed my elevate.xml under conf directory, elevation was working
with url:
http://mysolr.www.com:8181/solr/elevate?q=gameswt=xmlsort=score+descfl=id,bundle_namehttp://p6solr1.cube6.wwe.com:8181/solr/elevate?q=gameswt=xmlfl=id,bundle_name
But when i moved to data directory, I am not seeing any results.
NOTE: I can see the catalina.out, printing solr reading the file from data
directory. I tried to give invalid entries; I noticed solr errors parsing
elevate.xml from data directory. I even tried to send some documents to
index, thought commit might help to read the elevate config file. But nothing
helped.
I don't understand why below url does not work anymore. There are no errors
in the log files.
http://mysolr.www.com:8181/solr/elevate?q=gameswt=xmlsort=score+descfl=id,bundle_namehttp://p6solr1.cube6.wwe.com:8181/solr/elevate?q=gameswt=xmlfl=id,bundle_name
Any help on this topic is appreciated.
Hi Noordeen,
What do you mean by I am not seeing any results.? Is it no docs in response
(numFound=0) ?
And have you tried the original ${solr.data.dir:./solr/data} for the dataDir?
Isn't it working for you too?
koji
--
Query Log Visualizer for Apache Solr
http://soleami.com/
RE: synonyms
Jack, I am also using synonyms at query side, but so far i am able to use only single words to work, multi words is not working for me. I didn't want to use synonyms during indexing, to avoid re indexing. Is there a way for solr to support multi words? Ex: John Cena, John, Cena Or Triple H, DX, tripleh, hhh. Thanks Roxy -Original Message- From: Jack Krupansky [mailto:j...@basetechnology.com] Sent: Wednesday, May 02, 2012 8:53 PM To: solr-user@lucene.apache.org Subject: Re: synonyms There are lots of different strategies for dealing with synonyms, depending on what exactly is most important and what exactly your are willing to tolerate. In your latest example, you seem to be using string fields, which is somewhat different form the text synonyms we talk about in Solr. You can certainly have multiple string fields, or even a multi-valued string field to store variations on selected categories of terms. That works well when you have a well-defined number of categories. So, you can have a user query go against a combination of normal text fields and these category string fields. If that is sufficient for your application, great. -- Jack Krupansky -Original Message- From: Carlos Andres Garcia Sent: Wednesday, May 02, 2012 6:57 PM To: solr-user@lucene.apache.org Subject: RE: synonyms Thanks for your answers, now I have another cuestions,if I develop the filter to replacement the current synonym filter,I understand that this procces would be in time of the indexing because in time of the query search there are a lot problems knows. if so, how can I do for create my index file. For example: I have two synonyms Nou cam, Cataluña for barcelona in the data base Opcion 1) In time of the indexing would create 2 records like this: doc fieldbarcelonafield fieldCamp Noufield ... doc and doc fieldbarcelonafield fieldCataluñafield ... doc Opcion 2) or only would create one record like this: doc fieldbarcelonafield fieldCamp Nou,Cataluñafield ... doc If it create the opcion 2 can looking for by Camp Nou y by Cataluña but when I looking for by barcelona the Solr return 2 records and that is one error because barcelona is only one IF it create the opcion 2 , I have searching wiht wildcards for example *Camp Nou* o *Cataluña* y the solr would return one records, the same case if searching by barcelona solr would return one recors that is good , but i want to know if is the better option or solr have another caracteristic betters that can resolve this topic of one better way.
RE: Solr 3.5 - Elevate.xml causing issues when placed under /data directory
Koji,
Using the way i have specified datadir, i was able to see solr reading my file.
It didnt have any issue reading, but it was not serving the results using
/elevate.
I looked at the ElevationComponent java code, i didn't see any issue with the
code either.
I need elevation to work with synonyms; right now i am not sure how to
implement synonyms with elevation. The code seems to maintain elevation data in
a map, and it does key matches.
Is there a way i can configure solrconfig.xml to use synonyms after elevate
results are returned?
Thanks
Roxy Noordeen
-Original Message-
From: Koji Sekiguchi [mailto:k...@r.email.ne.jp]
Sent: Wednesday, May 02, 2012 9:19 PM
To: solr-user@lucene.apache.org
Subject: Re: Solr 3.5 - Elevate.xml causing issues when placed under /data
directory
(12/05/03 1:39), Noordeen, Roxy wrote:
Hello,
I just started using elevation for solr. I am on solr 3.5, running with
Drupal 7, Linux.
1. I updated my solrconfig.xml
from
dataDir${solr.data.dir:./solr/data}/dataDir
To
dataDir/usr/local/tomcat2/data/solr/dev_d7/data/dataDir
2. I placed my elevate.xml in my solr's data directory. Based on forum
answers, I thought placing elevate.xml under data directory would pick my
latest change.
I restarted tomcat.
3. When i placed my elevate.xml under conf directory, elevation was working
with url:
http://mysolr.www.com:8181/solr/elevate?q=gameswt=xmlsort=score+descfl=id,bundle_namehttp://p6solr1.cube6.wwe.com:8181/solr/elevate?q=gameswt=xmlfl=id,bundle_name
But when i moved to data directory, I am not seeing any results.
NOTE: I can see the catalina.out, printing solr reading the file from data
directory. I tried to give invalid entries; I noticed solr errors parsing
elevate.xml from data directory. I even tried to send some documents to
index, thought commit might help to read the elevate config file. But nothing
helped.
I don't understand why below url does not work anymore. There are no errors
in the log files.
http://mysolr.www.com:8181/solr/elevate?q=gameswt=xmlsort=score+descfl=id,bundle_namehttp://p6solr1.cube6.wwe.com:8181/solr/elevate?q=gameswt=xmlfl=id,bundle_name
Any help on this topic is appreciated.
Hi Noordeen,
What do you mean by I am not seeing any results.? Is it no docs in response
(numFound=0) ?
And have you tried the original ${solr.data.dir:./solr/data} for the dataDir?
Isn't it working for you too?
koji
--
Query Log Visualizer for Apache Solr
http://soleami.com/
Solr 3.5 - Elevate.xml causing issues when placed under /data directory
Hello,
I just started using elevation for solr. I am on solr 3.5, running with Drupal
7, Linux.
1. I updated my solrconfig.xml
from
dataDir${solr.data.dir:./solr/data}/dataDir
To
dataDir/usr/local/tomcat2/data/solr/dev_d7/data/dataDir
2. I placed my elevate.xml in my solr's data directory. Based on forum answers,
I thought placing elevate.xml under data directory would pick my latest change.
I restarted tomcat.
3. When i placed my elevate.xml under conf directory, elevation was working
with url:
http://mysolr.www.com:8181/solr/elevate?q=gameswt=xmlsort=score+descfl=id,bundle_namehttp://p6solr1.cube6.wwe.com:8181/solr/elevate?q=gameswt=xmlfl=id,bundle_name
But when i moved to data directory, I am not seeing any results.
NOTE: I can see the catalina.out, printing solr reading the file from data
directory. I tried to give invalid entries; I noticed solr errors parsing
elevate.xml from data directory. I even tried to send some documents to index,
thought commit might help to read the elevate config file. But nothing helped.
I don't understand why below url does not work anymore. There are no errors in
the log files.
http://mysolr.www.com:8181/solr/elevate?q=gameswt=xmlsort=score+descfl=id,bundle_namehttp://p6solr1.cube6.wwe.com:8181/solr/elevate?q=gameswt=xmlfl=id,bundle_name
Any help on this topic is appreciated.
Thanks
RE: synonyms
Another solution is to write a script to read the database and create the synonyms.txt file, dump the file to solr and reload the core. This gives you the custom synonym solution. -Original Message- From: Jack Krupansky [mailto:j...@basetechnology.com] Sent: Wednesday, May 02, 2012 4:54 PM To: solr-user@lucene.apache.org Subject: Re: synonyms I'm not sure I completely follow, but are you simply saying that you want to have a synonym filter that reads the synonym table from a database rather than the current text file? If so, sure, you could develop a replacement for the current synonym filter which loads its table from a database, but you would have to develop that code yourself (or get some assistance doing it.) If that is not what you are trying to do, please explain in a little more detail. -- Jack Krupansky -Original Message- From: Carlos Andres Garcia Sent: Wednesday, May 02, 2012 4:31 PM To: solr-user@lucene.apache.org Subject: synonyms Hello everbody, I have a doubt with respect to synonyms in Solr, In our company we are lookink for one solution to resolve synonyms from database and not from one text file like SynonymFilterFactory do it. The idea is save all the synonyms in the database, indexing and they will be ready to one query, but we haven't found one solution from database. Another idea is create one plugin that extend to SynonymFilterFactory but I don't know if this is posible. I hope someone can help me. regards, Carlos Andrés García García
