Same id on two shards

2011-08-06 Thread Pooja Verlani
Hi, We have a multicore solr with 6 cores. We merge the results using shards parameter or distrib handler. I have a problem, I might post one document on one of the cores and then post it after some days on another core, as I have a time-sliced multicore setup! The question is if I retrieve a

csv responsewriter and numfound

2011-08-03 Thread Pooja Verlani
Hi, Is there anyway to get numFound from csv response format? Some parameter? Or shall I change the code for csvResponseWriter for this? Thanks, Pooja

Restricting the Solr Posting List (retrieved set)

2011-07-11 Thread Pooja Verlani
Hi, We want to search in an index in such a way that even if a clause has a long posting list - Solr should stop collecting documents for the clause after receiving X documents that match the clause. For example, if for query India,solr can return 5M documents, we would like to restrict the set

Re: Restricting the Solr Posting List (retrieved set)

2011-07-11 Thread Pooja Verlani
Thanks for the reply. I am having a very huge index, so to retrieve older documents when not needed definitely wastes time and also at the same time I would need to do recency boosts/ time sort. So, I am looking for a way to avoid that. Thats why I am in need to restrict my docset and recently

Query time noun, verb boosting

2011-06-22 Thread Pooja Verlani
Hi, At the query time, I want to make the lucene query such that it should boost only the noun from the query or some concept existing in the index. Are there any possibilities or any possible ideas that can be worked around? Regards, Pooja

Re: Query time noun, verb boosting

2011-06-22 Thread Pooja Verlani
://ai-cafe.blogspot.com On Thu, Jun 23, 2011 at 11:02 AM, Pooja Verlani pooja.verl...@gmail.com wrote: Hi, At the query time, I want to make the lucene query such that it should boost only the noun from the query or some concept existing in the index. Are there any possibilities or any

Removing duplicate field at the time of search

2011-06-21 Thread Pooja Verlani
Hi, I have a X field in my index, which is a feature hash I would like to use to remove the duplicates in my result. I cant keep this as the unique id field. Is there any method or any parameter at the search time to remove the duplicates on a particular field(hash in this case)? Thanks in

Re: Removing duplicate field at the time of search

2011-06-21 Thread Pooja Verlani
this is what you're looking for: http://wiki.apache.org/solr/Deduplication Best Erick On Tue, Jun 21, 2011 at 1:40 PM, Pooja Verlani pooja.verl...@gmail.com wrote: Hi, I have a X field in my index, which is a feature hash I would like to use to remove the duplicates in my result. I cant

Re: Removing duplicate field at the time of search

2011-06-21 Thread Pooja Verlani
Erickson erickerick...@gmail.comwrote: Well, in trunk and the soon-to-be-released Solr 3.3, you could use grouping, what is the use-case here? Are you going to show all the docs (even duplicates) some of the time? Best Erick On Tue, Jun 21, 2011 at 1:53 PM, Pooja Verlani pooja.verl

Re: Regd WSTX EOFException

2010-08-26 Thread Pooja Verlani
Hi, The client being used is php curl. Could that be a problem? On Wed, Aug 25, 2010 at 7:10 PM, Yonik Seeley yo...@lucidimagination.com wrote: On Wed, Aug 25, 2010 at 6:41 AM, Pooja Verlani pooja.verl...@gmail.com wrote: Hi, Sometimes while indexing to solr, I am getting  the following

Regd WSTX EOFException

2010-08-25 Thread Pooja Verlani
Hi, Sometimes while indexing to solr, I am getting the following exception. com.ctc.wstx.exc.WstxEOFException: Unexpected end of input block in end tag I think its some configuration issue. Kindly suggest. I have a solr working with Tomcat 6 Thanks Pooja

Re: Long Lucene queries

2010-05-12 Thread Pooja Verlani
suggestions? Regards, Pooja On Fri, May 7, 2010 at 4:39 PM, Erik Hatcher erik.hatc...@gmail.com wrote: On May 7, 2010, at 6:56 AM, Pooja Verlani wrote: In my web-app, i have to fire a query thats too long due to the various boosts I have to give. The size changes according to the query and many

Too many clauses in lucene query

2010-05-12 Thread Pooja Verlani
Hi all, I am forming a query to boost a certain ids, the list of ids can go till 2000 too. I am sometimes getting the error for too many clauses in the boolean query and otherwise i am getting a null page. Can you suggest any config changes regarding this. I am using solr 1.3. Regards, Pooja

Long Lucene queries

2010-05-07 Thread Pooja Verlani
Hi all, In my web-app, i have to fire a query thats too long due to the various boosts I have to give. The size changes according to the query and many a times I get a blank page as I probably cross lucene's character limit. Is it possible to post it otherwise, to solr. Shall I be using POST

numFound:0 when documents exists

2010-04-08 Thread Pooja Verlani
Hi, In our search engine, we are getting numFound to be 0 for some queries where documents actually exist and also they are returned too. It randomly sometimes returns numfound=0. Does any one has an idea what can be the possible reason for the same? Regards, Pooja

distributed solr and tf-idf

2010-03-22 Thread Pooja Verlani
Hi, How good is the distributed solr shards tf-idf (If at all its working with solr 1.4) ? Is there a chance of it getting better. I have to implement a huge index with many shards. How is it possible to get a global tf-idf for the same, any ideas? Regards, Pooja

SOLR Multivalued field and length norm

2010-02-25 Thread Pooja Verlani
Hi, I understand if I query on a multivalued field, length norm takes the total length of the multivalued field. Is it possible to use the length of only the particular value in the array of multivalued field? It would be easier and more efficient in searching then. Regards, Pooja

Changing term frequency according to value of one of the fields

2010-02-25 Thread Pooja Verlani
Hi, I want to modify Similarity class for my app like the following- Right now tf is Math.sqrt(termFrequency) I would like to modify it to Math.sqrt(termFrequncy/solrDoc.getFieldValue(count)) where count is one of the fields in the particular solr document. Is it possible to do so? Can I import

Hierarchical xml

2009-12-01 Thread Pooja Verlani
Hi, I want to index an xml like following: officer nameJohn/name dob1979-29-17T28:14:48Z/dob collegeGroup college nameABC College/name year1998/year /college college namePQRS College/name year2001/year

Re: Solr Random field

2009-10-26 Thread Pooja Verlani
No I dont have the field with this type and neither do I want to re-index .. is it possible otherwise ? 2009/10/26 Noble Paul നോബിള്‍ नोब्ळ् noble.p...@corp.aol.com do you have a field whose type=random . If yes then u can sort by that field On Mon, Oct 26, 2009 at 3:35 PM, Pooja Verlani

Date field being null

2009-10-06 Thread Pooja Verlani
Hi, My fieldtype definition is like: fieldType name=solrDate class=solr.DateField sortMissingLast=true omitNorms=true/ I am defining a field: field name=UPDATE_DATE type=solrDate indexed=false stored=false / Can I have a null for such a field? or is there a way I can use it as a date field only

Using recency rord on /distrib

2009-09-24 Thread Pooja Verlani
Hi, I have to put recency using recip and rord functions on an app using /distrib requesthandler. Can i put bf param in /distrib directly call the url like: http://localhost:8983/solr/distrib/?q=cable where in /distrib requesthandler bf is defined as: str name=bf

Phrase stopwords

2009-09-23 Thread Pooja Verlani
Hi, Is it possible to have a phrase as a stopword in solr? In case, please share how to do so? regards, Pooja

Hierarchical schema design

2009-08-31 Thread Pooja Verlani
Hi all, Is there a possibility to have a hierarchical schema in solr, meaning can we have objects under objects. For example, for a doc like: doc a1 b1 b2 b3 /a1 a2 b1 b2 ,b3 /a2 . . . . . . . /doc I need to make schema with 3 types of such objects and all of

Re: Word frequency count in the index

2009-07-22 Thread Pooja Verlani
, you can use the LukeRequestHandler to get the top words in each field. Alternatively, you may just want to point Luke at your index. On Jul 16, 2009, at 6:29 AM, Pooja Verlani wrote: Hi, Is there any way in SOLR to know the count of each word indexed in the solr ? I want to find out

Synonyms from index

2009-07-22 Thread Pooja Verlani
Hi, Is there a possible way to generate synonyms from the index ? I have an index with lots of searchable terms turning out to be having synonyms and users too have different synonyms. If not then the only way if to learn from the query logs and click logs but in case there exists one, please

Word frequency count in the index

2009-07-16 Thread Pooja Verlani
Hi, Is there any way in SOLR to know the count of each word indexed in the solr ? I want to find out the different word frequencies to figure out ' application specific stop words'. Please let me know if its possible. Thank you, Regards, Pooja

user feedback in solr

2009-06-10 Thread Pooja Verlani
Hi all, I wanted to know if there is any provision to accommodate user feedback in the form of query logs and click logs, to improve the search relevance and ranking. Also, is there a possibility of it being included in the next version ? Thank you, Regards, Pooja

Regd. Difference check at the time of updation

2009-04-07 Thread Pooja Verlani
Hi all, I am looking for a mechanism to check the amount of difference between a document already in the index with the one updated with some new content. Basically, I want to design a criteria to decide whether or not to update the document with the new one. In case solr already has something

Re: javax.xml.stream.XMLStreamException while posting

2009-03-03 Thread Pooja Verlani
the syntax error. --wunder On 3/2/09 6:46 AM, Noble Paul നോബിള്‍ नोब्ळ् noble.p...@gmail.com wrote: the parser you are using is not the standard woodstox one. try this http://docs.sun.com/app/docs/doc/819-3672/gfkoy?a=view On Mon, Mar 2, 2009 at 6:24 PM, Pooja Verlani pooja.verl

javax.xml.stream.XMLStreamException while posting

2009-03-02 Thread Pooja Verlani
Hi, When I posting a valid xml document to solr, its giving the following error: {http--10003-7} javax.xml.stream.XMLStreamException: :2:20 expected '-' at '[' {http--10003-7} at com.caucho.xml.stream.XMLStreamReaderImpl.error(XMLStreamReaderImpl.java:1268) {http--10003-7} at

Release of solr 1.4 autosuggest

2009-02-15 Thread Pooja Verlani
Hi All, I am interested in TermComponent addition in solr 1.4 ( http://wiki.apache.org/solr/TermsComponent). When should we expect solr 1.4 to be available for use? Also, can this Termcomponent be made available as a plugin for solr 1.3? Kindly reply if you have any idea. Regards, Pooja

Re: Problem with WT parameter when upgrading from Solr1.2 to solr1.3

2009-01-09 Thread Pooja Verlani
yeah, finally I did it by modifying the required solrDocumentList and using it instead of DocList object as in Solr 1.2 Thanks Pooja On Fri, Jan 9, 2009 at 9:01 AM, Yonik Seeley ysee...@gmail.com wrote: On Thu, Jan 8, 2009 at 9:40 PM, Chris Hostetter hossman_luc...@fucit.org wrote: you have

Querying back with top few results in the same XMLWriter!

2009-01-08 Thread Pooja Verlani
in the same reponsewriter? Or is there any functionality provided by solr in either 1.2 or 1.3 version. Thank you. Regards, Pooja Verlani

Problem with query response writer when upgrading from Solr1.2 to solr1.3

2008-12-30 Thread Pooja Verlani
Hi, I just upgraded my system from Solr 1.2 to Solr 1.3. I am using the same plugin for the queryResponseWriter that I used in Solr1.2. Problem here is that when I am using *wt* parameter as the plugin name with full package then I don't get the response which I used to get in 1.2 and when I

Problem with WT parameter when upgrading from Solr1.2 to solr1.3

2008-12-29 Thread Pooja Verlani
Hi, I just upgraded my system from Solr 1.2 to Solr 1.3. I am using the same plugin for the queryResponseWriter that I used in Solr1.2. Problem here is that when I am using *wt* parameter as the plugin name with full package then I don't get the response which I used to get in 1.2 and when I

Fwd: Distributed Searching - Limitations?

2008-12-18 Thread Pooja Verlani
Hi, I am planning to use Solr's distributed searching for my project. But while going through http://wiki.apache.org/solr/DistributedSearch, i found a few limitations with it. Can anyone please explain the 2nd and 3rd points in the limitations sections on the page. The points are: - When

Re: Dynamic Boosting at query time with boost value as another fieldvalue

2008-12-14 Thread Pooja Verlani
-b1b1cdedcb9cd9bfd9c994709b4d7e540359b1fd On Thu, Dec 11, 2008 at 7:01 PM, Pooja Verlani pooja.verl...@gmail.com wrote: Hi all, I have a specific requirement for query time boosting. I have to boost a field on the basis of the value returned from one of the fields of the document. Basically, I have

Re: Dynamic Boosting at query time with boost value as another fieldvalue

2008-12-14 Thread Pooja Verlani
(title:Java). You can use hypen '-' or some other character in the field name instead of colon. On Mon, Dec 15, 2008 at 12:11 PM, Pooja Verlani pooja.verl...@gmail.com wrote: hi, Is it possible to have a fieldname with colon for example source:site? I want to apply query time boost as per

Re: Dynamic Boosting at query time with boost value as another fieldvalue

2008-12-12 Thread Pooja Verlani
in Solr: http://wiki.apache.org/solr/FunctionQuery http://wiki.apache.org/solr/SolrRelevancyFAQ#head-b1b1cdedcb9cd9bfd9c994709b4d7e540359b1fd On Thu, Dec 11, 2008 at 7:01 PM, Pooja Verlani pooja.verl...@gmail.com wrote: Hi all, I have a specific requirement for query time boosting. I have