Is there any limit how many documents can be indexed by apache solr

2013-11-26 Thread Kamal Palei
Dear All I am using Apache solr 3.6.2 with Drupal 7. Users keeps adding their profiles (resumes) and with cron task from Drupal, documents get indexed. Recently I observed, after indexing around 11,000 documents, further documents are not getting indexed. Is there any configuration for max

Re: Is there any limit how many documents can be indexed by apache solr

2013-11-26 Thread Kamal Palei
are reusing IDs so the new documents overwrite the old ones? 2013/11/26 Kamal Palei palei.ka...@gmail.com Dear All I am using Apache solr 3.6.2 with Drupal 7. Users keeps adding their profiles (resumes) and with cron task from Drupal, documents get indexed. Recently I

Re: Is there any limit how many documents can be indexed by apache solr

2013-11-26 Thread Kamal Palei
=solrrows=10} hits=11 status=0 QTime=25 Nov 26, 2013 5:46:53 AM org.apache.solr.core.SolrCore execute INFO: [] webapp=null path=null params={start=0event=newSearcherq=rocksrows=10} hits=38 status=0 QTime=15 Thanks kamal On Tue, Nov 26, 2013 at 6:19 PM, Kamal Palei palei.ka...@gmail.com

Re: LIMIT on number of OR in fq

2013-06-11 Thread Kamal Palei
into an apparent problem should just be a wakeup call that you need to reconsider your basic design assumptions. -- Jack Krupansky -Original Message- From: Kamal Palei Sent: Sunday, June 09, 2013 9:07 AM To: solr-user@lucene.apache.org Subject: LIMIT on number of OR in fq Dear All

Re: Help required with fq syntax

2013-06-09 Thread Kamal Palei
Hi Otis Your suggestion worked fine. Thanks kamal On Sun, Jun 9, 2013 at 7:58 AM, Kamal Palei palei.ka...@gmail.com wrote: Though the syntax looks fine, but I get all the records. As per example given above I get all the documents, meaning filtering did not work. I am curious to know if my

LIMIT on number of OR in fq

2013-06-09 Thread Kamal Palei
Dear All I am using below syntax to check for a particular field. fq=locations:(5000 OR 1 OR 15000 OR 2 OR 75100) With this I get the expected result properly. In a particular situations the number of ORs are more (looks around 280) something as below. fq=pref_work_locations:(5000 OR

Help required with fq syntax

2013-06-08 Thread Kamal Palei
Dear All I have a multi-valued field blocked_company_ids in index. You can think like 1. document1 , blocked_company_ids: 1, 5, 7 2. document2 , blocked_company_ids: 2, 6, 7 3. document3 , blocked_company_ids: 4, 5, 6 and so on . If I want to retrieve all the documents where

Re: Help required with fq syntax

2013-06-08 Thread Kamal Palei
Also please note that for some documents, blocked_company_ids may not be present as well. In such cases that document should be present in search result as well. BR, Kamal On Sun, Jun 9, 2013 at 7:07 AM, Kamal Palei palei.ka...@gmail.com wrote: Dear All I have a multi-valued field

Re: Help required with fq syntax

2013-06-08 Thread Kamal Palei
...@gmail.com wrote: Try: ...q=*:*fq=-blocked_company_ids:5 Otis -- Solr ElasticSearch Support http://sematext.com/ On Sat, Jun 8, 2013 at 9:37 PM, Kamal Palei palei.ka...@gmail.com wrote: Dear All I have a multi-valued field blocked_company_ids in index. You can think like 1

Re: Sorting results by last update date

2013-05-31 Thread Kamal Palei
that misleads asc and desc ordering result. After I get data from solr, again I do mysql query where the order changes again. Regards Kamal On Wed, May 29, 2013 at 2:54 PM, Shalin Shekhar Mangar shalinman...@gmail.com wrote: On Wed, May 29, 2013 at 12:10 PM, Kamal Palei palei.ka

Re: Sorting results by last update date

2013-05-30 Thread Kamal Palei
. Regards Kamal On Wed, May 29, 2013 at 2:54 PM, Shalin Shekhar Mangar shalinman...@gmail.com wrote: On Wed, May 29, 2013 at 12:10 PM, Kamal Palei palei.ka...@gmail.com wrote: Hi All I am trying to sort the results as per last updated date. My url looks as below. *fq=last_updated_date

Sorting results by last update date

2013-05-29 Thread Kamal Palei
Hi All I am trying to sort the results as per last updated date. My url looks as below. *fq=last_updated_date:[NOW-60DAY TO NOW]fq=experience:[0 TO 588]fq=salary:[0 TO 500] OR salary:0fq=-bundle:jobfq=-bundle:panelfq=-bundle:pagefq=-bundle:articlespellcheck=trueq=+java

How apache solr stores indexes

2013-05-28 Thread Kamal Palei
Dear All I have a basic doubt how the data is stored in apache solr indexes. Say I have thousand registered users in my site. Lets say I want to store skills of each users as a multivalued string index. Say user 1 has skill set - Java, MySql, PHP user 2 has skill set - C++, MySql, PHP user 3 has

Re: How apache solr stores indexes

2013-05-28 Thread Kamal Palei
that keeps events from happening all at once. Lately, it doesn't seem to be working. (Anonymous - via GTD book) On Tue, May 28, 2013 at 10:13 PM, Kamal Palei palei.ka...@gmail.com wrote: Dear All I have a basic doubt how the data is stored in apache solr indexes. Say I have thousand

Re: How apache solr stores indexes

2013-05-28 Thread Kamal Palei
on complexity if performance or capacity become problematic. If the data is naturally a string, use a string. If it is naturally a number, use a number. Use whatever the query client's will be most comfortable with. -- Jack Krupansky -Original Message- From: Kamal Palei Sent: Tuesday

Re: search filter

2013-05-23 Thread Kamal Palei
) at java.lang.Long.parseLong(Long.java:438) at java.lang.Long.parseLong(Long.java:478) Regards kamal On Thu, May 23, 2013 at 11:19 AM, Kamal Palei palei.ka...@gmail.com wrote: HI Rafał Kuć I tried fq=Salary:[5+TO+10]+OR+Salary:0 and as well as fq=Salary:[5 TO 10] OR Salary:0 both, both the cases I

search filter

2013-05-22 Thread Kamal Palei
Dear All Can I write a search filter for a field having a value in a range or a specific value. Say if I want to have a filter like 1. Select profiles with salary 5 to 10 or Salary 0. So I expect profiles having salary either 0 , 5, 6, 7, 8, 9, 10 etc. It should be possible, can somebody help

Re: search filter

2013-05-22 Thread Kamal Palei
HI Rafał Kuć I tried fq=Salary:[5+TO+10]+OR+Salary:0 and as well as fq=Salary:[5 TO 10] OR Salary:0 both, both the cases I retrieved 0 results. I use drupal along with solr, my code looks as below. * if($include_0_salary == 1) { $conditions['fq'][0]

Re: Adding filed in Schema.xml

2013-05-19 Thread Kamal Palei
, 2013 at 9:12 AM, Gora Mohanty g...@mimirtech.com wrote: On 19 May 2013 08:36, Kamal Palei palei.ka...@gmail.com wrote: Hi Alex I just saw in* types *area, long is already defined as * fieldType name=long class=solr.TrieLongField precisionStep=0 omitNorms=true positionIncrementGap=0

Re: Adding filed in Schema.xml

2013-05-18 Thread Kamal Palei
. Personal blog: http://blog.outerthoughts.com/ LinkedIn: http://www.linkedin.com/in/alexandrerafalovitch - Time is the quality of nature that keeps events from happening all at once. Lately, it doesn't seem to be working. (Anonymous - via GTD book) On Fri, May 17, 2013 at 8:49 AM, Kamal Palei

Re: Adding filed in Schema.xml

2013-05-18 Thread Kamal Palei
indexed=true stored=true / field name=experience type=long indexed=true stored=true / Not sure, why it is not taking effect. Best Regards Kamal On Sat, May 18, 2013 at 6:23 PM, Kamal Palei palei.ka...@gmail.com wrote: Hi Alex, Where I need to mention the types. Kindly tell me in detail. I

Adding filed in Schema.xml

2013-05-17 Thread Kamal Palei
Hi All I am trying to add few fields in schema.xml file as below. field name=salary type=long indexed=true stored=true / field name=experience type=long indexed=true stored=true / * field name=last_updated_date type=tdate indexed=true stored=true default=NOW multiValued=false / *

Re: Can we search some mandatory words and some optional words in SOLR

2013-05-16 Thread Kamal Palei
Thanks Hoss, I modified accordingly. One more thing I observed, if I give search key as one of the below 1. +Java +mysql +php +(TCL Perl Selenium) -ethernet -switching -routing 2. +(TCL Perl Selenium) -ethernet -switching -routing 3. +(TCL Perl Selenium) It works as expected. Like if key is

Adding a field in schema , storing it and use it to search

2013-05-16 Thread Kamal Palei
Hi All Need help in adding a new field and making use of it during search. As of today I just search some keywords and whatever document (actually these are resumes of individuals) is retrieved from SOLR search I take these as input, then search in mysql for experience, salary etc and then

Re: Can we search some mandatory words and some optional words in SOLR

2013-05-16 Thread Kamal Palei
Hi Hoss I was wondering between this two keys. Though they look similar, but result set differs. In 1st case I give key as +c +c++ +sip +( *tcl* perl shell script) -manual testing -ss7 In 2nd case I give key as +c +c++ +sip +(*tcl* perl shell script) -manual testing -ss7 Please note that

Re: Can we search some mandatory words and some optional words in SOLR

2013-05-14 Thread Kamal Palei
: +Java +mysql +php TCL Perl Selenium And you can decide if min should match (mm) is 0, 1, 2, 3, etc. for the optional terms (TCL, Perl, Selenium) -- Jack Krupansky -Original Message- From: Kamal Palei Sent: Monday, May 13, 2013 9:56 AM To: solr-user@lucene.apache.org Subject: Can we

Mandatory words search in SOLR

2013-05-13 Thread Kamal Palei
Hi SOLR Experts When I search documents with keyword as *java, mysql* then I get the documents containing either *java* or *mysql* or both. Is it possible to get the documents those contains both *java* and *mysql*. In that case, how the query would look like. Thanks a lot Kamal

Re: Mandatory words search in SOLR

2013-05-13 Thread Kamal Palei
Hi Rafał Kuć I added q.op=AND as per you suggested. I see though some initial record document contains both keywords (*java* and *mysql*), towards end I see still there are number of documents, they have only one key word either *java* or *mysql*. Is it the SOLR behaviour or can I ask for a

Re: Mandatory words search in SOLR

2013-05-13 Thread Kamal Palei
' parameter to require a minimum match, or you could prepend '+' to each required term. Cheers François On May 13, 2013, at 7:57 AM, Kamal Palei palei.ka...@gmail.com wrote: Hi Rafał Kuć I added q.op=AND as per you suggested. I see though some initial record document contains both

Re: Mandatory words search in SOLR

2013-05-13 Thread Kamal Palei
Hi François As per suggestion, I used 'mm' param and was able to do search for mandatory fields. In Drupal, one need to do as $query-addParam('mm' , '100%'); in query alter hook. Thanks a lot for guiding me. Best Regards Kamal On Mon, May 13, 2013 at 5:56 PM, Kamal Palei palei.ka

Can we search some mandatory words and some optional words in SOLR

2013-05-13 Thread Kamal Palei
Dear SOLR Experts Llets say I want to search some mandatory words and some optional words. Say I want to search all documents those contains all *Java, mysql, php*keywords along with atleast one keyword out of * TCL, Perl, Selenium*. *Basically I am looking at few mandatory keywords and few

SOLR query performance

2013-05-07 Thread Kamal Palei
Dear All I am using Apache SOLR 3.6.2 version for my search engine in a job site. I am observing for a solr query taking around 15 seconds to complete. I am sure there is something wrong in my approach or I am doing indexing wrongly. I need assistance/pointer to resolve this issue. I am providing

Re: SOLR query performance

2013-05-07 Thread Kamal Palei
. On Tue, May 7, 2013 at 10:10 AM, Kamal Palei palei.ka...@gmail.com wrote: Now, my question is, Is there any mechanism, I can tell to solr that, my start row is X, rows is Y, then it will return search result from Xth row with Y number of rows (Please note that this is similar with LIMIT stuff