maxWarmingSearchers
Hello all, I'm having this issue and I hope I get some help.. :) This following happens quite often ... even though searching and indexing are on a safe side... SolrException: HTTP code=503, reason=Error opening new searcher. exceeded limit of maxWarmingSearchers=4, try again later. I have increased the value of maxWarmingSearchers to 8 and I still experience the same problem This issue is happening to the master solr server changing maxWarmingSearchers to higher value would help overcoming this issue ? or I should consider some other points ? Another question is ? from your experience, do you think such error introduces server crash ? thanks for your time.. ak _ Get a bird’s eye view of the world with Multimap http://clk.atdmt.com/GBL/go/115454059/direct/01/
RE: maxWarmingSearchers
Hi ToddFeak, thanks for your response... solr version is 1.3. Roughly about every 4 minutes there are indexing/updaing of 4 to 10 documents that is from multiple clients to one master server... It is also worth mentioning that I have postCommit uncommented under solrconfig ... QueryCache and FilterCache settings are left as default thanks ak Subject: RE: maxWarmingSearchers Date: Mon, 1 Dec 2008 13:13:15 -0800 From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Probably going to need a bit more information. Such as: What version of Solr and a little info on doc count, index size, etc. How often are you sending updates to your Master? How often are you committing? What are your QueryCache and FilterCache settings for autowarm? Do you have queries set up for newSearcher and firstSearcher? To start looking for your problem, you usually get a pile up of searchers if you are committing too fast, and/or the warming of new searchers is taking an extraordinary long time. If is happening in a repeatable fashion, increasing the number of warming searchers probably won't fix the issue, just delay it. -ToddFeak -Original Message- From: dudes dudes [mailto:[EMAIL PROTECTED] Sent: Monday, December 01, 2008 12:13 PM To: solr-user@lucene.apache.org Subject: maxWarmingSearchers Hello all, I'm having this issue and I hope I get some help.. :) This following happens quite often ... even though searching and indexing are on a safe side... SolrException: HTTP code=503, reason=Error opening new searcher. exceeded limit of maxWarmingSearchers=4, try again later. I have increased the value of maxWarmingSearchers to 8 and I still experience the same problem This issue is happening to the master solr server changing maxWarmingSearchers to higher value would help overcoming this issue ? or I should consider some other points ? Another question is ? from your experience, do you think such error introduces server crash ? thanks for your time.. ak _ Get a bird's eye view of the world with Multimap http://clk.atdmt.com/GBL/go/115454059/direct/01/ _ Get Windows Live Messenger on your Mobile http://clk.atdmt.com/UKM/go/msnnkmgl001001ukm/direct/01/
RE: maxWarmingSearchers
Subject: RE: maxWarmingSearchers Date: Mon, 1 Dec 2008 13:35:53 -0800 From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Ok sounds reasonable. When you index/update those 4-10 documents, are you doing a single commit? OR are you doing a commit after each one? well, commits after each one.. How big is your index? How big are your documents? Ballpark figures are ok. more than couple of MBs one final piece of information: I only have 2 G of RAM on that machine( linux on VMware environment ) and increased the memory of tomcat to 1 G thanks -ToddFeak -Original Message- From: dudes dudes [mailto:[EMAIL PROTECTED] Sent: Monday, December 01, 2008 1:24 PM To: solr-user@lucene.apache.org Subject: RE: maxWarmingSearchers Hi ToddFeak, thanks for your response... solr version is 1.3. Roughly about every 4 minutes there are indexing/updaing of 4 to 10 documents that is from multiple clients to one master server... It is also worth mentioning that I have postCommit uncommented under solrconfig ... QueryCache and FilterCache settings are left as default thanks ak Subject: RE: maxWarmingSearchers Date: Mon, 1 Dec 2008 13:13:15 -0800 From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Probably going to need a bit more information. Such as: What version of Solr and a little info on doc count, index size, etc. How often are you sending updates to your Master? How often are you committing? What are your QueryCache and FilterCache settings for autowarm? Do you have queries set up for newSearcher and firstSearcher? To start looking for your problem, you usually get a pile up of searchers if you are committing too fast, and/or the warming of new searchers is taking an extraordinary long time. If is happening in a repeatable fashion, increasing the number of warming searchers probably won't fix the issue, just delay it. -ToddFeak -Original Message- From: dudes dudes [mailto:[EMAIL PROTECTED] Sent: Monday, December 01, 2008 12:13 PM To: solr-user@lucene.apache.org Subject: maxWarmingSearchers Hello all, I'm having this issue and I hope I get some help.. :) This following happens quite often ... even though searching and indexing are on a safe side... SolrException: HTTP code=503, reason=Error opening new searcher. exceeded limit of maxWarmingSearchers=4, try again later. I have increased the value of maxWarmingSearchers to 8 and I still experience the same problem This issue is happening to the master solr server changing maxWarmingSearchers to higher value would help overcoming this issue ? or I should consider some other points ? Another question is ? from your experience, do you think such error introduces server crash ? thanks for your time.. ak _ Get a bird's eye view of the world with Multimap http://clk.atdmt.com/GBL/go/115454059/direct/01/ _ Get Windows Live Messenger on your Mobile http://clk.atdmt.com/UKM/go/msnnkmgl001001ukm/direct/01/ _ Imagine a life without walls. See the possibilities. http://clk.atdmt.com/UKM/go/122465943/direct/01/
RE: maxWarmingSearchers
thanks for your explanation and time :) Subject: RE: maxWarmingSearchers Date: Mon, 1 Dec 2008 13:57:59 -0800 From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org The commit after each one may be hurting you. I believe that a new searcher is created after each commit. That searcher then runs through its warm up, which can be costly depending on your warming settings. Even if it's not overly costly, creating another one while the first one is running makes both of them run just a bit slower. Then creating a third exacerbates it, etc. If you are commiting faster then it can warm, you will get the pile-up of searchers you are seeing. And the more that pile up, the longer it takes each one to finish up. I would suggest trying to group those 4-10 documents into a single update job and doing a single commit. That way only 1 searcher is created per 4 minute window. Also (sorry I forgot this earlier) you can see how long your searcher is spending warming up by looking at the stats page under the admin. (/admin/stats.jsp) There is timing information on how long it took for the searcher and caches to warm up. -Todd Feak -Original Message- From: dudes dudes [mailto:[EMAIL PROTECTED] Sent: Monday, December 01, 2008 1:46 PM To: solr-user@lucene.apache.org Subject: RE: maxWarmingSearchers Subject: RE: maxWarmingSearchers Date: Mon, 1 Dec 2008 13:35:53 -0800 From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Ok sounds reasonable. When you index/update those 4-10 documents, are you doing a single commit? OR are you doing a commit after each one? well, commits after each one.. How big is your index? How big are your documents? Ballpark figures are ok. more than couple of MBs one final piece of information: I only have 2 G of RAM on that machine( linux on VMware environment ) and increased the memory of tomcat to 1 G thanks -ToddFeak -Original Message- From: dudes dudes [mailto:[EMAIL PROTECTED] Sent: Monday, December 01, 2008 1:24 PM To: solr-user@lucene.apache.org Subject: RE: maxWarmingSearchers Hi ToddFeak, thanks for your response... solr version is 1.3. Roughly about every 4 minutes there are indexing/updaing of 4 to 10 documents that is from multiple clients to one master server... It is also worth mentioning that I have postCommit uncommented under solrconfig ... QueryCache and FilterCache settings are left as default thanks ak Subject: RE: maxWarmingSearchers Date: Mon, 1 Dec 2008 13:13:15 -0800 From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Probably going to need a bit more information. Such as: What version of Solr and a little info on doc count, index size, etc. How often are you sending updates to your Master? How often are you committing? What are your QueryCache and FilterCache settings for autowarm? Do you have queries set up for newSearcher and firstSearcher? To start looking for your problem, you usually get a pile up of searchers if you are committing too fast, and/or the warming of new searchers is taking an extraordinary long time. If is happening in a repeatable fashion, increasing the number of warming searchers probably won't fix the issue, just delay it. -ToddFeak -Original Message- From: dudes dudes [mailto:[EMAIL PROTECTED] Sent: Monday, December 01, 2008 12:13 PM To: solr-user@lucene.apache.org Subject: maxWarmingSearchers Hello all, I'm having this issue and I hope I get some help.. :) This following happens quite often ... even though searching and indexing are on a safe side... SolrException: HTTP code=503, reason=Error opening new searcher. exceeded limit of maxWarmingSearchers=4, try again later. I have increased the value of maxWarmingSearchers to 8 and I still experience the same problem This issue is happening to the master solr server changing maxWarmingSearchers to higher value would help overcoming this issue ? or I should consider some other points ? Another question is ? from your experience, do you think such error introduces server crash ? thanks for your time.. ak _ Get a bird's eye view of the world with Multimap http://clk.atdmt.com/GBL/go/115454059/direct/01/ _ Get Windows Live Messenger on your Mobile http://clk.atdmt.com/UKM/go/msnnkmgl001001ukm/direct/01/ _ Imagine a life without walls. See the possibilities. http://clk.atdmt.com/UKM/go/122465943/direct/01
SolrException: HTTP code=503
Hello all, I'm having this issue bellow .. can some one tell me what I have to change in the config file to overcome this issue ? SolrException: HTTP code=503, reason=Error opening new searcher. exceeded limit of maxWarmingSearchers=4, try again later. thanks a lot Ak _ See the most popular videos on the web http://clk.atdmt.com/GBL/go/115454061/direct/01/
RE: upgrading solr
hi again, I guess I'm doing something wrong, I have downloaded the latest stable version... untar it ,,, then I have copied /index directory from the old version to the newer version version under data/ schema are the same... the old default one I have start it via java -jar start... ( solr1-3 ) checked the http://localhost:8983/solr/admin/stats.jsp and no indexed files were detected ! Either I'm doing it wrong or I have missed something ! thanks for your time ak From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: Re: upgrading solr Date: Wed, 8 Oct 2008 07:29:33 -0400 I've upgraded solr several times from nightly to nightly and then to the 1.3 release without reindexing, with no apparent ill effects. On Oct 8, 2008, at 6:12 AM, dudes dudes wrote: Hello all, I would like to upgrade to the latest Solr from its nightly version. MY understanding is to re-index all the data after upgrading .. Is there a way that doesn't require re-indexing all the data ? for example a solr script or any third party tools ? or do I have to re- index all the docs for the new upgrade ? thanks for your time ak _ Get all your favourite content with the slick new MSN Toolbar - FREE http://clk.atdmt.com/UKM/go/111354027/direct/01/ _ Make a mini you and download it into Windows Live Messenger http://clk.atdmt.com/UKM/go/111354029/direct/01/
RE: upgrading solr
thanks for your quick response.. yes it was under the right path... However, the problem was fixed by changing the ownership under index folder :) thanks again ak From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: Re: upgrading solr Date: Wed, 8 Oct 2008 08:30:25 -0400 Check again that you put the index directory in the right place. If you're using the example config which comes with the release package, it needs to be in BASE/example/solr/data/index. On Oct 8, 2008, at 8:18 AM, dudes dudes wrote: hi again, I guess I'm doing something wrong, I have downloaded the latest stable version... untar it ,,, then I have copied /index directory from the old version to the newer version version under data/ schema are the same... the old default one I have start it via java -jar start... ( solr1-3 ) checked the http://localhost:8983/solr/admin/stats.jsp and no indexed files were detected ! Either I'm doing it wrong or I have missed something ! thanks for your time ak From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: Re: upgrading solr Date: Wed, 8 Oct 2008 07:29:33 -0400 I've upgraded solr several times from nightly to nightly and then to the 1.3 release without reindexing, with no apparent ill effects. On Oct 8, 2008, at 6:12 AM, dudes dudes wrote: Hello all, I would like to upgrade to the latest Solr from its nightly version. MY understanding is to re-index all the data after upgrading .. Is there a way that doesn't require re-indexing all the data ? for example a solr script or any third party tools ? or do I have to re- index all the docs for the new upgrade ? thanks for your time ak _ Get all your favourite content with the slick new MSN Toolbar - FREE http://clk.atdmt.com/UKM/go/111354027/direct/01/ _ Make a mini you and download it into Windows Live Messenger http://clk.atdmt.com/UKM/go/111354029/direct/01/ _ Discover Bird's Eye View now with Multimap from Live Search http://clk.atdmt.com/UKM/go/111354026/direct/01/
RE: upgrading solr
thanks, I will give it a try ,,, any probs will let you know :) ak From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: Re: upgrading solr Date: Wed, 8 Oct 2008 07:29:33 -0400 I've upgraded solr several times from nightly to nightly and then to the 1.3 release without reindexing, with no apparent ill effects. On Oct 8, 2008, at 6:12 AM, dudes dudes wrote: Hello all, I would like to upgrade to the latest Solr from its nightly version. MY understanding is to re-index all the data after upgrading .. Is there a way that doesn't require re-indexing all the data ? for example a solr script or any third party tools ? or do I have to re- index all the docs for the new upgrade ? thanks for your time ak _ Get all your favourite content with the slick new MSN Toolbar - FREE http://clk.atdmt.com/UKM/go/111354027/direct/01/ _ Get all your favourite content with the slick new MSN Toolbar - FREE http://clk.atdmt.com/UKM/go/111354027/direct/01/
upgrading solr
Hello all, I would like to upgrade to the latest Solr from its nightly version. MY understanding is to re-index all the data after upgrading .. Is there a way that doesn't require re-indexing all the data ? for example a solr script or any third party tools ? or do I have to re-index all the docs for the new upgrade ? thanks for your time ak _ Get all your favourite content with the slick new MSN Toolbar - FREE http://clk.atdmt.com/UKM/go/111354027/direct/01/
solr servers synchronisation
Hello experts, I've gotta a question with regards to synchronisation under solr. I would like to have 2 Linux servers both running Solr. One that could act as master and the other one as slave.. Then I want to use HeartBeat in order change the IP when the master is down... My question is : do you think of any open source third party tools that sync both solrs ( or may be data/index directories ) when master is re-indexed at any time ? In another word, I would like to use the master for indexing and searching. Then a third party sync tool to do the synchronisation between master/slave I have Tsync in mind ( as a snyc tool) , but surely I would like to know your suggestions.. many thanks ak _ Win New York holidays with Kellogg’s Live Search http://clk.atdmt.com/UKM/go/111354033/direct/01/
RE: solr servers synchronisation
Thanks Bill, I'm aware of these links.. I have also deployed them in my environment,,, However; I'm looking for a complete sync between 2 server rather than using one server for indexing and the other one for searching. It would be nice to have a complete transparency.. thanks for your time ak Date: Thu, 2 Oct 2008 08:39:02 -0400 From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: Re: solr servers synchronisation Have you seen these two Wiki pages: http://wiki.apache.org/solr/CollectionDistribution http://wiki.apache.org/solr/SolrCollectionDistributionOperationsOutline Solr comes with tools to let you sync the index directory. Bill On Thu, Oct 2, 2008 at 3:52 AM, dudes dudes wrote: Hello experts, I've gotta a question with regards to synchronisation under solr. I would like to have 2 Linux servers both running Solr. One that could act as master and the other one as slave.. Then I want to use HeartBeat in order change the IP when the master is down... My question is : do you think of any open source third party tools that sync both solrs ( or may be data/index directories ) when master is re-indexed at any time ? In another word, I would like to use the master for indexing and searching. Then a third party sync tool to do the synchronisation between master/slave I have Tsync in mind ( as a snyc tool) , but surely I would like to know your suggestions.. many thanks ak _ Win New York holidays with Kellogg's Live Search http://clk.atdmt.com/UKM/go/111354033/direct/01/ _ Win New York holidays with Kellogg’s Live Search http://clk.atdmt.com/UKM/go/111354033/direct/01/
Synonym questions
Hello all, Sorry if this question sound stupid ! :) Instead of mapping or grouping the Synonym terms in the Synonym.txt file... is it possible to to define a field in the schema ( for the Synonyms) and index them then at query, the index directory is used for the purpose of Synonyming not the Synonym.txt file ? thanks ak _ Discover Bird's Eye View now with Multimap from Live Search http://clk.atdmt.com/UKM/go/111354026/direct/01/
RE: Synonym questions
thanks Date: Wed, 1 Oct 2008 05:55:33 -0700 From: [EMAIL PROTECTED] Subject: Re: Synonym questions To: solr-user@lucene.apache.org Hm, No, at this point in time synonyms have to be loaded from the text file. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message From: dudes dudes To: solr-user@lucene.apache.org Sent: Wednesday, October 1, 2008 4:24:33 AM Subject: Synonym questions Hello all, Sorry if this question sound stupid ! :) Instead of mapping or grouping the Synonym terms in the Synonym.txt file... is it possible to to define a field in the schema ( for the Synonyms) and index them then at query, the index directory is used for the purpose of Synonyming not the Synonym.txt file ? thanks ak _ Discover Bird's Eye View now with Multimap from Live Search http://clk.atdmt.com/UKM/go/111354026/direct/01/ _ Get all your favourite content with the slick new MSN Toolbar - FREE http://clk.atdmt.com/UKM/go/111354027/direct/01/
RE: matser /slave issue on solr
Thanks Bill for your suggestions, they helped a lot,,, problems are resolved :) cheers ak Date: Fri, 5 Sep 2008 15:24:06 -0400 From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: Re: matser /slave issue on solr Try running snappuller with the -V option to show debug output. Here's the closest thing to a step by step doc: http://wiki.apache.org/solr/SolrCollectionDistributionOperationsOutline Please note the first bullet under slave Solr server that the user id under which the scripts run must be able to ssh/scp from the slave to the master without being prompted for a password. Bill On Fri, Sep 5, 2008 at 9:17 AM, dudes dudes wrote: Hi Bill, Thanks very much for your kind reply... I have tried your suggestion, but unfortunately didn't work... and tried other tweaks from the link you sent,,, but no luck :(,,, I also don't find any errors in the log files.. is there any online step by step docs on this topic by any chance ? thanks ak Date: Thu, 4 Sep 2008 09:40:01 -0400 From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: Re: matser /slave issue on solr On your slave, solr_hostname should be localhost and master_host should be the hostname of your master server Check out the following Wiki for a full description of the variables in scripts.conf: http://wiki.apache.org/solr/SolrCollectionDistributionScripts Bill On Thu, Sep 4, 2008 at 4:46 AM, dudes dudes wrote: Hello All, I have taken the following steps to configure master and slave servers However, the slave doesn't seem to sync with the master... Please let me know what I have done wrong ,,, both are nightly version 2008-7-7 on ubuntu machine java 1.6 On the master machine: 1) the scripts.conf file . user= solr_hostname= localhost solr_port= 8983 rsyncd_port= 18983 data_dir= webapp_name= solr master_host= master_data_dir= master_status_dir= 2) Indexed some docs 3) Then I issued the following commands.. ./rsyncd-enable; rsyncd-start ./snapshooter On the slave machine: 1) the scripts.conf file user= solr_hostname=mastereserver.companyname.com solr_port=8080 rsyncd_port=18983 data_dir= webapp_name=solr master_host=localhost master_data_dir=/root/masterSolr/apache-solr-nightly/example/solr/data/ master_status_dir=/root/masterSolr/apache-solr-nightly/example/solr/logs/clients/ 2) Then the following commands are issued: ./snappuller -P 18983 ./snapinstaller ./commit 3) however on the stats.jsp it says numDocs=0 ( on the salve machine). thanks for your time and suggestions ak _ Get all your favourite content with the slick new MSN Toolbar - FREE http://clk.atdmt.com/UKM/go/111354027/direct/01/ _ Discover Bird's Eye View now with Multimap from Live Search http://clk.atdmt.com/UKM/go/111354026/direct/01/ _ Discover Bird's Eye View now with Multimap from Live Search http://clk.atdmt.com/UKM/go/111354026/direct/01/
RE: matser /slave issue on solr
Hi Bill, Thanks very much for your kind reply... I have tried your suggestion, but unfortunately didn't work... and tried other tweaks from the link you sent,,, but no luck :(,,, I also don't find any errors in the log files.. is there any online step by step docs on this topic by any chance ? thanks ak Date: Thu, 4 Sep 2008 09:40:01 -0400 From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: Re: matser /slave issue on solr On your slave, solr_hostname should be localhost and master_host should be the hostname of your master server Check out the following Wiki for a full description of the variables in scripts.conf: http://wiki.apache.org/solr/SolrCollectionDistributionScripts Bill On Thu, Sep 4, 2008 at 4:46 AM, dudes dudes wrote: Hello All, I have taken the following steps to configure master and slave servers However, the slave doesn't seem to sync with the master... Please let me know what I have done wrong ,,, both are nightly version 2008-7-7 on ubuntu machine java 1.6 On the master machine: 1) the scripts.conf file . user= solr_hostname= localhost solr_port= 8983 rsyncd_port= 18983 data_dir= webapp_name= solr master_host= master_data_dir= master_status_dir= 2) Indexed some docs 3) Then I issued the following commands.. ./rsyncd-enable; rsyncd-start ./snapshooter On the slave machine: 1) the scripts.conf file user= solr_hostname=mastereserver.companyname.com solr_port=8080 rsyncd_port=18983 data_dir= webapp_name=solr master_host=localhost master_data_dir=/root/masterSolr/apache-solr-nightly/example/solr/data/ master_status_dir=/root/masterSolr/apache-solr-nightly/example/solr/logs/clients/ 2) Then the following commands are issued: ./snappuller -P 18983 ./snapinstaller ./commit 3) however on the stats.jsp it says numDocs=0 ( on the salve machine). thanks for your time and suggestions ak _ Get all your favourite content with the slick new MSN Toolbar - FREE http://clk.atdmt.com/UKM/go/111354027/direct/01/ _ Discover Bird's Eye View now with Multimap from Live Search http://clk.atdmt.com/UKM/go/111354026/direct/01/
matser /slave issue on solr
Hello All, I have taken the following steps to configure master and slave servers However, the slave doesn't seem to sync with the master... Please let me know what I have done wrong ,,, both are nightly version 2008-7-7 on ubuntu machine java 1.6 On the master machine: 1) the scripts.conf file . user= solr_hostname= localhost solr_port= 8983 rsyncd_port= 18983 data_dir= webapp_name= solr master_host= master_data_dir= master_status_dir= 2) Indexed some docs 3) Then I issued the following commands.. ./rsyncd-enable; rsyncd-start ./snapshooter On the slave machine: 1) the scripts.conf file user= solr_hostname=mastereserver.companyname.com solr_port=8080 rsyncd_port=18983 data_dir= webapp_name=solr master_host=localhost master_data_dir=/root/masterSolr/apache-solr-nightly/example/solr/data/ master_status_dir=/root/masterSolr/apache-solr-nightly/example/solr/logs/clients/ 2) Then the following commands are issued: ./snappuller -P 18983 ./snapinstaller ./commit 3) however on the stats.jsp it says numDocs=0 ( on the salve machine). thanks for your time and suggestions ak _ Get all your favourite content with the slick new MSN Toolbar - FREE http://clk.atdmt.com/UKM/go/111354027/direct/01/
solr doc
Hello all, I'm looking for a doc that full-fill the following situation? How can two solr servers synchronised with each other ? And if one of them down for whatever reason the how other one can take over... does solr has anything like master/slave tajke over ? any docs or suggestions are thankfully welcomed ? many thanks ak _ Win New York holidays with Kellogg’s Live Search http://clk.atdmt.com/UKM/go/107571440/direct/01/
RE: solr doc
thanks :) Date: Mon, 18 Aug 2008 17:54:20 +0530 From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: Re: solr doc Take a look at http://wiki.apache.org/solr/CollectionDistribution On Mon, Aug 18, 2008 at 4:44 PM, dudes dudes wrote: Hello all, I'm looking for a doc that full-fill the following situation? How can two solr servers synchronised with each other ? And if one of them down for whatever reason the how other one can take over... does solr has anything like master/slave tajke over ? any docs or suggestions are thankfully welcomed ? many thanks ak _ Win New York holidays with Kellogg's Live Search http://clk.atdmt.com/UKM/go/107571440/direct/01/ -- Regards, Shalin Shekhar Mangar. _ Win a voice over part with Kung Fu Panda Live Search and 100’s of Kung Fu Panda prizes to win with Live Search http://clk.atdmt.com/UKM/go/107571439/direct/01/
RE: spell-checker and faceting
thanks :) Date: Thu, 24 Jul 2008 15:09:55 +0530 From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: Re: spell-checker and faceting No, nothing of that sort right now. On Thu, Jul 24, 2008 at 2:44 PM, dudes dudes wrote: hi again, I have one more question to ask with regards to following statements.. http://localhost:8080/solr/spellCheckCompRH?q=smathspellcheck=truefacet=truefacet.limit=-1facet.field=lastname lastname is a field that is defined under schema.xml... what if I want to list all the fields that are defined under the schema ? is it possible to use some wild cards ? thanks again. ak Date: Thu, 24 Jul 2008 13:32:05 +0530 From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: Re: spell-checker and faceting On Thu, Jul 24, 2008 at 1:24 PM, dudes dudes wrote: hi, thanks for your response and suggestions. I can get all the facet working now if I issue: http://localhost:8080/solr/spellCheckCompRH?q=smathspellcheck.q=smathspellcheck=truerows=0facet=truefacet.limit=-1facet.field=lastname The above statement retrieves all the last-names and facet them, but since Smith was miss-spelled as smath, therefore it says int name = smith 0 what I would like to achieve is to type smath , solr corrects it to smith and also facet it to something like this ( at the same time): int name = smith 2 can this be done in one go ? or the end user has to decide the suggestions and then solr facets them ? No, you must issue another request to get the updated facet counts and search results. -- Regards, Shalin Shekhar Mangar. _ Find the best and worst places on the planet http://clk.atdmt.com/UKM/go/101719807/direct/01/ -- Regards, Shalin Shekhar Mangar. _ 100’s of Nikon cameras to be won with Live Search http://clk.atdmt.com/UKM/go/101719808/direct/01/
data directory under solr
Hi all, I have changed the data directory from /solr/data to /var/solr/data ...The directory is created once I start solr from tomcat. However; I'm a bit confused once it comes to indexing data to /var/solr/data/index. NB: I'm using the post script (post.sh) that is provided by solr itself. To what do I have to change URL=http://localhost:8080/solr/update in post.sh ? thanks for any suggestions and thoughts. ak _ Find the best and worst places on the planet http://clk.atdmt.com/UKM/go/101719807/direct/01/
multicores issue..
thanks Erik, I'm experiencing some problems here.. solr version: solr-2008-07-07 Out of the box multicores directory: apache-solr-nightly/example/multicore multcore.xml: shown bellow: I can easily see the admin page http://localhost:8983/solr/core0/admin/ and http://localhost:8983/solr/core1/admin/ .However, if I click on schema or config it says HTTP ERROR: 404 NOT_FOUND RequestURI=/solr/admin/file/ So edited the main solrconfg.xml file by uncommenting But I still have the problem... Any thoughts on this ? thanks all, ak From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: Re: 2 IDs in schema.xml Date: Wed, 16 Jul 2008 04:50:18 -0400 On Jul 16, 2008, at 3:29 AM, dudes dudes wrote: and also I suppose it is not possible to have 2 schemas on one solr ? You can have multiple cores per Solr webapp (see MultiCore in the wiki). But each core has a single schema. Erik _ 100’s of Nikon cameras to be won with Live Search http://clk.atdmt.com/UKM/go/101719808/direct/01/
RE: multicores issue..
it's ok guys,,, fixed the problem :) I have 2 different schemas up and running thanks anyway ak From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: multicores issue.. Date: Thu, 17 Jul 2008 09:55:04 +0100 thanks Erik, I'm experiencing some problems here.. solr version: solr-2008-07-07 Out of the box multicores directory: apache-solr-nightly/example/multicore multcore.xml: shown bellow: I can easily see the admin page http://localhost:8983/solr/core0/admin/ and http://localhost:8983/solr/core1/admin/ .However, if I click on schema or config it says HTTP ERROR: 404 NOT_FOUND RequestURI=/solr/admin/file/ So edited the main solrconfg.xml file by uncommenting But I still have the problem... Any thoughts on this ? thanks all, ak From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: Re: 2 IDs in schema.xml Date: Wed, 16 Jul 2008 04:50:18 -0400 On Jul 16, 2008, at 3:29 AM, dudes dudes wrote: and also I suppose it is not possible to have 2 schemas on one solr ? You can have multiple cores per Solr webapp (see MultiCore in the wiki). But each core has a single schema. Erik _ 100’s of Nikon cameras to be won with Live Search http://clk.atdmt.com/UKM/go/101719808/direct/01/ _ Find the best and worst places on the planet http://clk.atdmt.com/UKM/go/101719807/direct/01/
RE: 2 IDs in schema.xml
oh right so the uniquekey is used by Solr to do internal house keeping ? and also I suppose it is not possible to have 2 schemas on one solr ? thnx ak Date: Wed, 16 Jul 2008 03:07:41 +0530 From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: Re: 2 IDs in schema.xml Multiple uniqueKeys are not supported. You must use only one field as the uniqueKey. On Tue, Jul 15, 2008 at 11:52 PM, dudes dudes wrote: Hi With some strange reason hotmail doesn't send any XML tags through. I have attached a file with all the necessary xml tags there , thanks :) I have a rare situation and I'm not too sure how to resolve it. I have defined 2 fields.. one is call userID and the other one is called companyID in schema.xml file Please see part 1 of the attached xml file. Then I have both of them fields specified as uniquekeys . PLease see part 2 of the attached document. when I try to post a test6.xml ( ie java -jar post.jar test6.xml) it gives me the following error: SimplePostTool:FATAL:Solr returned an error: Document_null_missing_required_field_userID However; if I replace CompanyID with userID under test6.xml file, it commits without any problems. any thoughts about this ? Many thanks to all ak _ The John Lewis Clearance - save up to 50% with FREE delivery http://clk.atdmt.com/UKM/go/101719806/direct/01/ -- Regards, Shalin Shekhar Mangar. _ The John Lewis Clearance - save up to 50% with FREE delivery http://clk.atdmt.com/UKM/go/101719806/direct/01/
RE: 2 IDs in schema.xml
thanks, I will have a try and for any technical issues I will bother you guys again :) ak From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: Re: 2 IDs in schema.xml Date: Wed, 16 Jul 2008 04:50:18 -0400 On Jul 16, 2008, at 3:29 AM, dudes dudes wrote: and also I suppose it is not possible to have 2 schemas on one solr ? You can have multiple cores per Solr webapp (see MultiCore in the wiki). But each core has a single schema. Erik _ Find the best and worst places on the planet http://clk.atdmt.com/UKM/go/101719807/direct/01/
RE: Solr searching issue..
thanks ! I think I fixed the issue and it's doing good :) From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: RE: Solr searching issue.. Date: Mon, 14 Jul 2008 20:12:00 + Copy field dest=text. I am not sure if u can copy into text or something like that. We copy it into a field of type text or string etc.. Plus what is ur query string. what gives u no results. How do u index it?? need more clues to figure out answer dude :) From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: RE: Solr searching issue.. Date: Mon, 14 Jul 2008 09:34:47 +0100 again whatever I have pasted it didn't work ! .. I have attached the schema.xml file instead,,, sorry for spamming you all thanks ak From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: RE: Solr searching issue.. Date: Mon, 14 Jul 2008 09:28:16 +0100 with some strange reason my copy and paste didn't work !!! sorry to terrible you all.. hope you can see them now.. From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: RE: Solr searching issue.. Date: Mon, 14 Jul 2008 09:17:32 +0100 Hi again, I have done the followings, but I do get zero replies .. please let me know what I have done wrong... thanks version type: nightly build solr-2008-07-07 // for n-gram So, if i search for john,,, john will be found with out any problems... if I search for joh I'm not getting any results back,,, thanks ak Date: Fri, 11 Jul 2008 20:14:11 +0530 From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: Re: Solr searching issue.. You can use EdgeNGramTokenizer available with Solr 1.3 to achieve this. But I'd think again about introducing this kind of search as n-grams can bloat your index size. On Fri, Jul 11, 2008 at 3:58 PM, dudes dudes wrote: Hi solr-users, version type: nightly build solr-2008-07-07 If I search for name John, it finds it with out any issues On the other hand if I search for Joh* , it also finds all the possible matches. However, if I search for Joh.. it doesn't find any possible match in other word, it doesn't find name john if you don't specify the exact name.. Does anybody know what I'm missing here? thanks ak _ The John Lewis Clearance - save up to 50% with FREE delivery http://clk.atdmt.com/UKM/go/101719806/direct/01/ -- Regards, Shalin Shekhar Mangar. _ 100’s of Nikon cameras to be won with Live Search http://clk.atdmt.com/UKM/go/101719808/direct/01/ _ Play and win great prizes with Live Search and Kung Fu Panda http://clk.atdmt.com/UKM/go/101719966/direct/01/ _ The John Lewis Clearance - save up to 50% with FREE delivery http://clk.atdmt.com/UKM/go/101719806/direct/01/ _ Missed your favourite programme? Stop surfing TV channels and start planning your weekend TV viewing with our comprehensive TV Listing http://entertainment.in.msn.com/TV/TVListing.aspx _ Invite your Facebook friends to chat on Messenger http://clk.atdmt.com/UKM/go/101719649/direct/01/
2 IDs in schema.xml
Hi With some strange reason hotmail doesn't send any XML tags through. I have attached a file with all the necessary xml tags there , thanks :) I have a rare situation and I'm not too sure how to resolve it. I have defined 2 fields.. one is call userID and the other one is called companyID in schema.xml file Please see part 1 of the attached xml file. Then I have both of them fields specified as uniquekeys . PLease see part 2 of the attached document. when I try to post a test6.xml ( ie java -jar post.jar test6.xml) it gives me the following error: SimplePostTool:FATAL:Solr returned an error: Document_null_missing_required_field_userID However; if I replace CompanyID with userID under test6.xml file, it commits without any problems. any thoughts about this ? Many thanks to all ak _ The John Lewis Clearance - save up to 50% with FREE delivery http://clk.atdmt.com/UKM/go/101719806/direct/01/ //I have defined 2 fields as shown bellow: field name=userID type=string indexed=true stored=true required=false / field name=companyID type=string indexed=true stored=true required=false / //UniqueKeys uniqueKeyuserID/uniqueKey uniqueKeycompanyID/uniqueKey //copy field commands copyField source=userID dest=text/ copyField source=companyID dest=text/ add doc field name=companyid44/field /doc /add
RE: Solr searching issue..
Hi again, I have done the followings, but I do get zero replies .. please let me know what I have done wrong... thanks version type: nightly build solr-2008-07-07 // for n-gram So, if i search for john,,, john will be found with out any problems... if I search for joh I'm not getting any results back,,, thanks ak Date: Fri, 11 Jul 2008 20:14:11 +0530 From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: Re: Solr searching issue.. You can use EdgeNGramTokenizer available with Solr 1.3 to achieve this. But I'd think again about introducing this kind of search as n-grams can bloat your index size. On Fri, Jul 11, 2008 at 3:58 PM, dudes dudes wrote: Hi solr-users, version type: nightly build solr-2008-07-07 If I search for name John, it finds it with out any issues On the other hand if I search for Joh* , it also finds all the possible matches. However, if I search for Joh.. it doesn't find any possible match in other word, it doesn't find name john if you don't specify the exact name.. Does anybody know what I'm missing here? thanks ak _ The John Lewis Clearance - save up to 50% with FREE delivery http://clk.atdmt.com/UKM/go/101719806/direct/01/ -- Regards, Shalin Shekhar Mangar. _ 100’s of Nikon cameras to be won with Live Search http://clk.atdmt.com/UKM/go/101719808/direct/01/
RE: Solr searching issue..
with some strange reason my copy and paste didn't work !!! sorry to terrible you all.. hope you can see them now.. From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: RE: Solr searching issue.. Date: Mon, 14 Jul 2008 09:17:32 +0100 Hi again, I have done the followings, but I do get zero replies .. please let me know what I have done wrong... thanks version type: nightly build solr-2008-07-07 // for n-gram So, if i search for john,,, john will be found with out any problems... if I search for joh I'm not getting any results back,,, thanks ak Date: Fri, 11 Jul 2008 20:14:11 +0530 From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: Re: Solr searching issue.. You can use EdgeNGramTokenizer available with Solr 1.3 to achieve this. But I'd think again about introducing this kind of search as n-grams can bloat your index size. On Fri, Jul 11, 2008 at 3:58 PM, dudes dudes wrote: Hi solr-users, version type: nightly build solr-2008-07-07 If I search for name John, it finds it with out any issues On the other hand if I search for Joh* , it also finds all the possible matches. However, if I search for Joh.. it doesn't find any possible match in other word, it doesn't find name john if you don't specify the exact name.. Does anybody know what I'm missing here? thanks ak _ The John Lewis Clearance - save up to 50% with FREE delivery http://clk.atdmt.com/UKM/go/101719806/direct/01/ -- Regards, Shalin Shekhar Mangar. _ 100’s of Nikon cameras to be won with Live Search http://clk.atdmt.com/UKM/go/101719808/direct/01/ _ Play and win great prizes with Live Search and Kung Fu Panda http://clk.atdmt.com/UKM/go/101719966/direct/01/
RE: Solr searching issue..
again whatever I have pasted it didn't work ! .. I have attached the schema.xml file instead,,, sorry for spamming you all thanks ak From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: RE: Solr searching issue.. Date: Mon, 14 Jul 2008 09:28:16 +0100 with some strange reason my copy and paste didn't work !!! sorry to terrible you all.. hope you can see them now.. From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: RE: Solr searching issue.. Date: Mon, 14 Jul 2008 09:17:32 +0100 Hi again, I have done the followings, but I do get zero replies .. please let me know what I have done wrong... thanks version type: nightly build solr-2008-07-07 // for n-gram So, if i search for john,,, john will be found with out any problems... if I search for joh I'm not getting any results back,,, thanks ak Date: Fri, 11 Jul 2008 20:14:11 +0530 From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: Re: Solr searching issue.. You can use EdgeNGramTokenizer available with Solr 1.3 to achieve this. But I'd think again about introducing this kind of search as n-grams can bloat your index size. On Fri, Jul 11, 2008 at 3:58 PM, dudes dudes wrote: Hi solr-users, version type: nightly build solr-2008-07-07 If I search for name John, it finds it with out any issues On the other hand if I search for Joh* , it also finds all the possible matches. However, if I search for Joh.. it doesn't find any possible match in other word, it doesn't find name john if you don't specify the exact name.. Does anybody know what I'm missing here? thanks ak _ The John Lewis Clearance - save up to 50% with FREE delivery http://clk.atdmt.com/UKM/go/101719806/direct/01/ -- Regards, Shalin Shekhar Mangar. _ 100’s of Nikon cameras to be won with Live Search http://clk.atdmt.com/UKM/go/101719808/direct/01/ _ Play and win great prizes with Live Search and Kung Fu Panda http://clk.atdmt.com/UKM/go/101719966/direct/01/ _ The John Lewis Clearance - save up to 50% with FREE delivery http://clk.atdmt.com/UKM/go/101719806/direct/01/?xml version=1.0 encoding=UTF-8 ? !-- Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to You under the Apache License, Version 2.0 (the License); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an AS IS BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. -- !-- This is the Solr schema file. This file should be named schema.xml and should be in the conf directory under the solr home (i.e. ./solr/conf/schema.xml by default) or located where the classloader for the Solr webapp can find it. This example schema is the recommended starting point for users. It should be kept correct and concise, usable out-of-the-box. For more information, on how to customize this file, please see http://wiki.apache.org/solr/SchemaXml -- schema name=Test version=1.1 !-- attribute name is the name of this schema and is only used for display purposes. Applications should change this to reflect the nature of the search collection. version=1.1 is Solr's version number for the schema syntax and semantics. It should not normally be changed by applications. 1.0: multiValued attribute did not exist, all fields are multiValued by nature 1.1: multiValued attribute introduced, false by default -- types !-- field type definitions. The name attribute is just a label to be used by field definitions. The class attribute and any other attributes determine the real behavior of the fieldType. Class names starting with solr refer to java classes in the org.apache.solr.analysis package. -- !-- The StrField type is not analyzed, but indexed/stored verbatim. - StrField and TextField support an optional compressThreshold which limits compression (if enabled in the derived fields) to values which exceed a certain size (in characters). -- fieldType name=string class=solr.StrField sortMissingLast
Solr searching issue..
Hi solr-users, version type: nightly build solr-2008-07-07 If I search for name John, it finds it with out any issues On the other hand if I search for Joh* , it also finds all the possible matches. However, if I search for Joh.. it doesn't find any possible match in other word, it doesn't find name john if you don't specify the exact name.. Does anybody know what I'm missing here? thanks ak _ The John Lewis Clearance - save up to 50% with FREE delivery http://clk.atdmt.com/UKM/go/101719806/direct/01/
RE: Solr searching issue..
thanks,, I will give it a try and get back to you Date: Fri, 11 Jul 2008 20:14:11 +0530 From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: Re: Solr searching issue.. You can use EdgeNGramTokenizer available with Solr 1.3 to achieve this. But I'd think again about introducing this kind of search as n-grams can bloat your index size. On Fri, Jul 11, 2008 at 3:58 PM, dudes dudes wrote: Hi solr-users, version type: nightly build solr-2008-07-07 If I search for name John, it finds it with out any issues On the other hand if I search for Joh* , it also finds all the possible matches. However, if I search for Joh.. it doesn't find any possible match in other word, it doesn't find name john if you don't specify the exact name.. Does anybody know what I'm missing here? thanks ak _ The John Lewis Clearance - save up to 50% with FREE delivery http://clk.atdmt.com/UKM/go/101719806/direct/01/ -- Regards, Shalin Shekhar Mangar. _ Invite your Facebook friends to chat on Messenger http://clk.atdmt.com/UKM/go/101719649/direct/01/
spell-checker on solr
Hello all, Does spell-checking done automatically under solr or it needs to be coded in ? any docs on this topic ? thanks for your valuable time. ak _ All new Live Search at Live.com http://clk.atdmt.com/UKM/go/msnnkmgl001006ukm/direct/01/
RE: spell-checker on solr
yes you are quite right ! please accept my apologies too much going on my head ! thanks anyway Date: Tue, 1 Jul 2008 14:33:42 +0530 From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: Re: spell-checker on solr You asked a similar question a few days ago and you got a few links in the reply. Did you try looking into them? On Tue, Jul 1, 2008 at 1:04 PM, dudes dudes wrote: Hello all, Does spell-checking done automatically under solr or it needs to be coded in ? any docs on this topic ? thanks for your valuable time. ak _ All new Live Search at Live.com http://clk.atdmt.com/UKM/go/msnnkmgl001006ukm/direct/01/ -- Regards, Shalin Shekhar Mangar. _ Get Messenger on your mobile, text MSN to 63463 now! http://mobile.uk.msn.com/pc/messenger.aspx
Solr spell-checker
Hello all, I have Solr 1.2 installed and I was wandering how Solr 1.2 deals with checking miss spelled strings and also how to configure it ? appreciate any docs on this topic .. thanks a lot ak _ All new Live Search at Live.com http://clk.atdmt.com/UKM/go/msnnkmgl001006ukm/direct/01/
RE: Solr spell-checker
thanks for your kind reply Date: Wed, 25 Jun 2008 14:48:38 +0530 From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: Re: Solr spell-checker Take a look at http://wiki.apache.org/solr/SpellCheckerRequestHandler If you can use a nightly build of Solr 1.3 then you can use the new and better http://wiki.apache.org/solr/SpellCheckComponent On Wed, Jun 25, 2008 at 2:36 PM, dudes dudes wrote: Hello all, I have Solr 1.2 installed and I was wandering how Solr 1.2 deals with checking miss spelled strings and also how to configure it ? appreciate any docs on this topic .. thanks a lot ak _ All new Live Search at Live.com http://clk.atdmt.com/UKM/go/msnnkmgl001006ukm/direct/01/ -- Regards, Shalin Shekhar Mangar. _ http://clk.atdmt.com/UKM/go/msnnkmgl001002ukm/direct/01/
Solr system and numbers
Hello experts, How does Solr deal with numbers or phone numbers .. For example if you have 1234 and 12 34 or 1 234... with spaces between the numbers .. Or this is dealt by lucene ? any documentations or tutorial on this ? many thanks, ak _ All new Live Search at Live.com http://clk.atdmt.com/UKM/go/msnnkmgl001006ukm/direct/01/
RE: Solr system and numbers
great info ,,, thanks a lot all Date: Mon, 9 Jun 2008 05:58:50 -0700 From: [EMAIL PROTECTED] Subject: Re: Solr system and numbers To: solr-user@lucene.apache.org Hi, Solr/Lucene can treat phone numbers as strings. If you want to clean them up and normalize them outside of Solr, you can do that and feed them into Solr as pure numbers. How the phone numbers will be treated after you pump them into Solr depends on the analyzer you choose to use for this data. If you don't need to search on subsets of phone numbers, then just don't tokenize them (i.e. use string type if the phone numbers contain any non-numeric characters, sint otherwise). Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message From: dudes dudes To: solr-user@lucene.apache.org Sent: Monday, June 9, 2008 2:10:20 PM Subject: Solr system and numbers Hello experts, How does Solr deal with numbers or phone numbers .. For example if you have 1234 and 12 34 or 1 234... with spaces between the numbers .. Or this is dealt by lucene ? any documentations or tutorial on this ? many thanks, ak _ All new Live Search at Live.com http://clk.atdmt.com/UKM/go/msnnkmgl001006ukm/direct/01/ _ All new Live Search at Live.com http://clk.atdmt.com/UKM/go/msnnkmgl001006ukm/direct/01/
Solr - Norwegian language
Hi all, Does Solr support Norwegian language ? if yes can someone direct me to a right documentation ? thanks ak _ Great deals on almost anything at eBay.co.uk. Search, bid, find and win on eBay today! http://clk.atdmt.com/UKM/go/msnnkmgl001004ukm/direct/01/
RE: Solr hardware specs
thanks all, they were all valuable information . btw: is there any e-book on Solr ? many thanks, ak Date: Fri, 9 May 2008 13:45:05 -0700 Subject: Re: Solr hardware specs From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org And use a log of real queries, captured from your website or one like it. Query statistics are not uniform. wunder On 5/9/08 6:20 AM, Erick Erickson wrote: This still isn't very helpful. How big are the docs? How many fields do you expect to index? What is your expected query rate? You can get away with an old laptop if your docs are, say, 5K each and you only expect to query it once a day and have one text field. If each doc is 10M, you're indexing 250 fields and your expected query rate is 100/sec, you need some serious hardware. But 400K docs isn't very big by SOLR standards in terms of the number of docs. What I'd really recommend is that you just take an existing machine, create an index on it and measure. Be aware that the first few queries will be much slower than subsequent queries, so throw out the first few queries from your timings. Best Erick On Fri, May 9, 2008 at 8:27 AM, dudes dudes wrote: HI Nick, I'm quite new to solr, so excuse my ignorance for any solr related settings :). We think that would have up to 400K docs in a loady environment. We surely don't want to have solr to be publicly accessible ( Just for the internal use). We are not sure if we could have 2 network interfaces will help the speed issues that we have due to side location of the company. thanks, ak Date: Sat, 10 May 2008 00:13:49 +1200 From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: Re: Solr hardware specs Hi It all depends on the load your server is under, how many documents you have etc. -- I am not sure what you mean by network connectivity -- solr really should not be run on a publicly accessible IP address. Can you provide some more info on the setup? -Nick On 5/10/08, dudes dudes wrote: Hello, Can someone kindly advice me on hardware specs (CPU/HHD/RAM) to install solr on a production server ? We are planning to have it on Debian. Also what network connectivities does it require (incoming and outgoing)? Thanks fr your time. ak _ Great deals on almost anything at eBay.co.uk. Search, bid, find and win on eBay today! http://clk.atdmt.com/UKM/go/msnnkmgl001004ukm/direct/01/ _ Be a Hero and Win with Iron Man http://clk.atdmt.com/UKM/go/msnnkmgl001009ukm/direct/01/ _ Be a Hero and Win with Iron Man http://clk.atdmt.com/UKM/go/msnnkmgl001009ukm/direct/01/
RE: Solr hardware specs
HI Nick, I'm quite new to solr, so excuse my ignorance for any solr related settings :). We think that would have up to 400K docs in a loady environment. We surely don't want to have solr to be publicly accessible ( Just for the internal use). We are not sure if we could have 2 network interfaces will help the speed issues that we have due to side location of the company. thanks, ak Date: Sat, 10 May 2008 00:13:49 +1200 From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: Re: Solr hardware specs Hi It all depends on the load your server is under, how many documents you have etc. -- I am not sure what you mean by network connectivity -- solr really should not be run on a publicly accessible IP address. Can you provide some more info on the setup? -Nick On 5/10/08, dudes dudes wrote: Hello, Can someone kindly advice me on hardware specs (CPU/HHD/RAM) to install solr on a production server ? We are planning to have it on Debian. Also what network connectivities does it require (incoming and outgoing)? Thanks fr your time. ak _ Great deals on almost anything at eBay.co.uk. Search, bid, find and win on eBay today! http://clk.atdmt.com/UKM/go/msnnkmgl001004ukm/direct/01/ _ Be a Hero and Win with Iron Man http://clk.atdmt.com/UKM/go/msnnkmgl001009ukm/direct/01/
RE: issues with solr
thanks for your help Erik, ak From: [EMAIL PROTECTED] Subject: Re: issues with solr Date: Mon, 14 Apr 2008 14:50:34 -0400 To: solr-user@lucene.apache.org There is an Ant script section on that mySolr page. But there is no need to use any of that for your project. All you need is Solr's WAR file and the appropriate Solr configuration files and you're good to go. Erik On Apr 14, 2008, at 9:12 AM, dudes dudes wrote: thanks Erik, Basically I have used the build file from solr not from that page,... I have had a look and couldn't really find their build.xml file ! thanks ak From: [EMAIL PROTECTED] Subject: Re: issues with solr Date: Mon, 14 Apr 2008 08:54:39 -0400 To: solr-user@lucene.apache.org The mysolr.dist target is defined in the Ant file on that page. My guess is that you were not using the Ant build file bits there. My take is that the mySolr page is not quite what folks should be cloning for incorporation of Solr into their application. Maybe that page should be removed or reworked? Erik On Apr 14, 2008, at 8:21 AM, dudes dudes wrote: Hello there I'm new to Solr I'm trying to deploy the example under http://wiki.apache.org/solr/ mySolr .However, every time I issue ant mysolr.dist it generates: Buildfile: build.xml BUILD FAILED Target mysolr.dist does not exist in the project solr. I'm running Ubuntu getty and the ant version is 1.7.0 What have I missed ? many thanks for your help ak _ Get Hotmail on your mobile. Text MSN to 63463 now! http://mobile.uk.msn.com/pc/mail.aspx _ The next generation of Windows Live is here http://www.windowslive.co.uk/get-live _ Welcome to the next generation of Windows Live http://www.windowslive.co.uk/get-live
issues with solr
Hello there I'm new to Solr I'm trying to deploy the example under http://wiki.apache.org/solr/mySolr .However, every time I issue ant mysolr.dist it generates: Buildfile: build.xml BUILD FAILED Target mysolr.dist does not exist in the project solr. I'm running Ubuntu getty and the ant version is 1.7.0 What have I missed ? many thanks for your help ak _ Get Hotmail on your mobile. Text MSN to 63463 now! http://mobile.uk.msn.com/pc/mail.aspx
RE: issues with solr
thanks Erik, Basically I have used the build file from solr not from that page,... I have had a look and couldn't really find their build.xml file ! thanks ak From: [EMAIL PROTECTED] Subject: Re: issues with solr Date: Mon, 14 Apr 2008 08:54:39 -0400 To: solr-user@lucene.apache.org The mysolr.dist target is defined in the Ant file on that page. My guess is that you were not using the Ant build file bits there. My take is that the mySolr page is not quite what folks should be cloning for incorporation of Solr into their application. Maybe that page should be removed or reworked? Erik On Apr 14, 2008, at 8:21 AM, dudes dudes wrote: Hello there I'm new to Solr I'm trying to deploy the example under http://wiki.apache.org/solr/ mySolr .However, every time I issue ant mysolr.dist it generates: Buildfile: build.xml BUILD FAILED Target mysolr.dist does not exist in the project solr. I'm running Ubuntu getty and the ant version is 1.7.0 What have I missed ? many thanks for your help ak _ Get Hotmail on your mobile. Text MSN to 63463 now! http://mobile.uk.msn.com/pc/mail.aspx _ The next generation of Windows Live is here http://www.windowslive.co.uk/get-live
