Re: NRT and warmupTime of filterCache

2011-03-10 Thread stockii
it'll negatively impact the desired goal of low latency new index readers? - yes, i think so, thats the reason because i dont understand the wiki-article ... i set the warmupCount to 500 and i got no error messages, that solr isnt available ... but solr-stats.jsp show me a warmuptime of

Re: NRT and warmupTime of filterCache

2011-03-10 Thread stockii
okay, not the time ... the items ... - --- System One Server, 12 GB RAM, 2 Solr Instances, 7 Cores, 1 Core with 31 Million Documents other Cores 100.000 - Solr1 for Search-Requests - commit every Minute - 5GB Xmx -

Re: SolrJ and digest authentication

2011-03-10 Thread Erlend GarĂ¥sen
I figured it out. Since this Solr server does not has an SSL interface, I had to change the following line from 443 to 80: AuthScope scope = new AuthScope(host, 80, resin); Erlend On 09.03.11 17.09, Erlend GarĂ¥sen wrote: I'm trying to do a search with SolrJ using digest authentication, but

Possible to sort in .xml file?

2011-03-10 Thread Andy Newby
Hi, I'm trying to setup Solr so that we can sort using: document_views asc,score ...is this possible via the solrconfig.xml/schema.xml file? I know its possible to do via adding sort= , but the Perl module (WebService::Solr) doesn't seem to offer the option to pass in this value :( TIA --

Re: Possible to sort in .xml file?

2011-03-10 Thread Markus Jelsma
Is there no generic parameter store in the Solr module you can use for passing the sort parameter? If not, you can define your sort parameter as default in the request handler you use in solrconfig. See the shipped config for examples. On Thursday 10 March 2011 11:25:01 Andy Newby wrote: Hi,

Re: Possible to sort in .xml file?

2011-03-10 Thread Markus Jelsma
No, look for request handlers. requestHandler name=search class=solr.SearchHandler default=true !-- default values for query parameters can be specified, these will be overridden by parameters in the request -- lst name=defaults str name=echoParamsexplicit/str

disquery - difference qf qs / pf ps

2011-03-10 Thread Gastone Penzo
Hi i understand what qf and qs parameters are but i can't understand what pf and ps are exactly. someone can explain it to me?? for example qf=title^2 name^1.2 surname^1 qs=3 it means i search in title field with boost 2 or in name field with boost 1.2 or in surname field with boost 1 and the

Re: disquery - difference qf qs / pf ps

2011-03-10 Thread Ahmet Arslan
Hi i understand what qf and qs parameters are but i can't understand what pf and ps are exactly. someone can explain it to me?? for example qf=title^2 name^1.2 surname^1 qs=3 it means i search in title field with boost 2 or in name field with boost 1.2 or in surname field with

Re: disquery - difference qf qs / pf ps

2011-03-10 Thread Gastone Penzo
Thank you very much. i understand the difference beetween qs and ps but not what pf is...is it necessary to use ps? Yes you can use all 4 parameters together. Please see similar discussion: http://search-lucene.com/m/KWkYf2kE4Ng1/ -- Gastone Penzo

Re: Math-generated fields during query

2011-03-10 Thread Markus Jelsma
Not at the moment if i'm not mistaken. The same issue is with Solr 3.1 where relative distances are not being returned as field value when doing spatial filtering. To retrieve the value one must use the score as the some pseudo field.

Re: disquery - difference qf qs / pf ps

2011-03-10 Thread Ahmet Arslan
i understand the difference beetween qs and ps but not what pf is...is it necessary to use ps? pf (Phrase Fields) and ps (Phrase Slop) related to each other. Lets say you have q=term1 term1pf=title textps=10 We can think as if dismax adds title:term1 term2~10 text:term1 term2~10 imaginary

Re: NRT in Solr

2011-03-10 Thread Jason Rutherglen
Bill, I think all of the improvements can be made, however they are fairly large structural changes that would require perhaps several patches. The other issue is we'll likely land RT this year (or next) and then the cached values need to be appended to as the documents are added, that and

Re: FunctionQueries and FieldCache and OOM

2011-03-10 Thread Markus Jelsma
Well, it's quite hard to debug because the values listed on the stats page in the fieldCache section don't make much sense. Reducing precision with NOW/HOUR, however, does seem to make a difference. It is hard (or impossible) to reproduce this is a test setup with the same index but without

Re: NRT and warmupTime of filterCache

2011-03-10 Thread Jason Rutherglen
- yes, i think so, thats the reason because i dont understand the wiki-article ... Maybe the article is out of date? I think it's grossly inefficient to warm the searchers at all in the NRT case. Queries are being performed across *all* segments, even though there should only be 1 that's new

DIH : modify document in sibling entity of root entity

2011-03-10 Thread Chantal Ackermann
Dear all, in DIH, is it possible to have two sibling entities where: - the first one is the root entity that creates the documents by iterating over a table that has one row per document. - the second one is executed after the completion of the first entity iteration, and it provides more data

Re: FunctionQueries and FieldCache and OOM

2011-03-10 Thread Markus Jelsma
Alright, i can now confirm the issue has been resolved by reducing precision. The garbage collector on nodes without reduced precision has a real hard time keeping up and clearly shows a very different graph of heap consumption. Consider using MINUTE, HOUR or DAY as precision in case you suffer

Re: NRT and warmupTime of filterCache

2011-03-10 Thread stockii
Maybe the article is out of date? - maybe .. i dont know in my case it make no sense and i use another configuration ... - --- System One Server, 12 GB RAM, 2 Solr Instances, 7 Cores, 1 Core with 31 Million Documents

Error on string searching # [STRANGE]

2011-03-10 Thread Dario Rigolin
I have a text field indexed using WordDelimeter Indexed in that way doc field name=myfieldS.#L.W.VI.37/field ... /doc Serching in that way: http://192.168.3.3:8983/solr3.1/core0/select?q=myfield:(S.#L.W.VI.37) Makes this error: org.apache.lucene.queryParser.ParseException: Cannot parse

Re: Error on string searching # [STRANGE]

2011-03-10 Thread Juan Grande
I think that the problem is with the # symbol, because it has a special meaning when used inside a URL. Try replacing it with %23, like this: http://192.168.3.3:8983/solr3.1/core0/select?q=myfield:(S.%23L.W.VI.37) Regards, * Juan G. Grande* -- Solr Consultant @ http://www.plugtree.com -- Blog @

Re: Math-generated fields during query

2011-03-10 Thread dan sutton
As a workaround can you not have a search component run after the querycomponent, and have the qty_ordered,unit_price as stored fields and returned with the fl parameter and have your custom component do the calc, unless you need to sort by this value too? Dan On Wed, Mar 9, 2011 at 10:06 PM,

Re: Error on string searching # [STRANGE]

2011-03-10 Thread Dario Rigolin
On Thursday, March 10, 2011 04:53:51 pm Juan Grande wrote: I think that the problem is with the # symbol, because it has a special meaning when used inside a URL. Try replacing it with %23, like this: http://192.168.3.3:8983/solr3.1/core0/select?q=myfield:(S.%23L.W.VI.37) If I do urlencoding

Re: DIH : modify document in sibling entity of root entity

2011-03-10 Thread Stefan Matheis
Hi Chantal, i'm not sure if i understood you correctly (if at all)? Two entities, not arranged as sub-entitiy, but using values from the previous entity? Could you paste your dataimport the relevant part of the logging-output? Regards Stefan On Thu, Mar 10, 2011 at 4:12 PM, Chantal Ackermann

Re: True master-master fail-over without data gaps (choosing CA in CAP)

2011-03-10 Thread Otis Gospodnetic
Hi, - Original Message From: Jake Luciani jak...@gmail.com To: solr-user@lucene.apache.org Sent: Wed, March 9, 2011 8:07:00 PM Subject: Re: True master-master fail-over without data gaps (choosing CA in CAP) Yeah sure. Let me update this on the Solandra wiki. I'll send across

question regarding proper placement of geofilt in fq=

2011-03-10 Thread Jerry Mindek
Hi, I am using rev 1036236 of solr trunk running as a servlet in Tomcat 7. The doc set is sharded over 11 shards. Currently, I have all the shards running in a single tomcat. Please see the bottom of the email for the bits of my schema.xml and solrconfig.xml that might help you understand my

Re: Error on string searching # [STRANGE] [FIX]

2011-03-10 Thread Dario Rigolin
On Thursday, March 10, 2011 04:58:43 pm Dario Rigolin wrote: It seems fixed by setting into WordDelimiterTokenizer catenateWords=0 catenateNumbers=0 Instead of 1 on both... Nice to know... On Thursday, March 10, 2011 04:53:51 pm Juan Grande wrote: I think that the problem is with the #

Re: DIH : modify document in sibling entity of root entity

2011-03-10 Thread Gora Mohanty
On Thu, Mar 10, 2011 at 8:42 PM, Chantal Ackermann chantal.ackerm...@btelligent.de wrote: [...] Is this supposed to work at all? I haven't found anything so far on the net but I could have used the wrong keywords for searching, of course. As answer to the maybe obvious question why I'm not

Re: disquery - difference qf qs / pf ps

2011-03-10 Thread Jonathan Rochkind
On 3/10/2011 8:15 AM, Gastone Penzo wrote: Thank you very much. i understand the difference beetween qs and ps but not what pf is...is it necessary to use ps? It's not neccesary to use anything, including Solr. pf: Will take the entire query the user entered, make it into a single phrase,

Re: DIH : modify document in sibling entity of root entity

2011-03-10 Thread Chantal Ackermann
Hi Stefan, thanks for your time! No, the second entity is not reusing values from the previous one. It just provides more fields to it, and, of course the unique identifier - which in case of the second entity is not unique: document name=contributor entity name=contributor pk=id

Re: Math-generated fields during query

2011-03-10 Thread Peter Sturge
Hi Dan, Yes, you're right - in fact that was precisely what I was thinking of doing! Also looking at SOLR-1298 SOLR-1566 - which would be good for applying functions generically rather than on a per-use-case basis. Thanks! Peter On Thu, Mar 10, 2011 at 3:58 PM, dan sutton danbsut...@gmail.com

Re: DIH : modify document in sibling entity of root entity

2011-03-10 Thread Chantal Ackermann
Hi Gora, thanks for making me read this part of the documentation again! This processor probably cannot do what I need out of the box but I will try to extend it to allow specifying a regular expression in its where attribute. Thanks! Chantal On Thu, 2011-03-10 at 17:39 +0100, Gora Mohanty

Custom fieldtype with sharding?

2011-03-10 Thread Peter Cline
Hi all, I'm having an issue with using a custom fieldtype with distributed search. It may be the case that what I'm looking for could be accomplished in a different way, but this is my first stab at it. I'm looking to store XML in a field. What I've done, which works fine, is to: - on

Re: question regarding proper placement of geofilt in fq=

2011-03-10 Thread Bill Bell
Can you use 2 fq parameters ? The default op is usually set to AND. Bill Bell Sent from mobile On Mar 10, 2011, at 9:33 AM, Jerry Mindek jmin...@manta.com wrote: Hi, I am using rev 1036236 of solr trunk running as a servlet in Tomcat 7. The doc set is sharded over 11 shards. Currently,

Re: question regarding proper placement of geofilt in fq=

2011-03-10 Thread Bill Bell
Also _query_ is the right approach when using fq with 2 Boolean values. Just make sure you double quote the {!geofilt} when using that. Bill Bell Sent from mobile On Mar 10, 2011, at 9:33 AM, Jerry Mindek jmin...@manta.com wrote: Hi, I am using rev 1036236 of solr trunk running as a

Re: docBoost

2011-03-10 Thread Brian Lamb
Okay I think I have the idea: dataConfig dataSource type=JdbcDataSource name=animals batchSize=-1 driver=com.mysql.jdbc.Driver url=jdbc:mysql://localhost/animals?characterEncoding=UTF8amp;zeroDateTimeBehavior=convertToNull

Re: Sorting

2011-03-10 Thread Brian Lamb
Any ideas on this one? On Wed, Mar 9, 2011 at 2:00 PM, Brian Lamb brian.l...@journalexperts.comwrote: Hi all, I know that I can add sort=score desc to the url to sort in descending order. However, I would like to sort a MoreLikeThis response which returns records like this: lst

Solr

2011-03-10 Thread yazhini.k vini
Hi , I need notes and detail about solr because of Now I am working in solr so i need help . Regards , Yazhini . K NCSI , M.Sc ( Software Engineering ) .

Re: Possible to sort in .xml file?

2011-03-10 Thread Chris Hostetter
: I know its possible to do via adding sort= , but the Perl module : (WebService::Solr) doesn't seem to offer the option to pass in this value :( according to the docs, you can pass any query params you want to the sort method...

Re: Solr

2011-03-10 Thread Geert-Jan Brits
Start by reading http://wiki.apache.org/solr/FrontPage and the provided links (introduction, tutorial, etc. ) 2011/3/10 yazhini.k vini yazhini@gmail.com Hi , I need notes and detail about solr because of Now I am working in solr so i need help . Regards , Yazhini . K NCSI ,

If statements in DataImportHandler?

2011-03-10 Thread Jason Rutherglen
Is it possible to conditionally load sub-entities in DataImportHandler, based on the gathered value of parent entities?

Re: New PHP API for Solr (Logic Solr API)

2011-03-10 Thread Liam O'Boyle
How about the Solr PHP Client (http://code.google.com/p/solr-php-client/)? We use this and have been quite happy with it, and it seems that it addresses all of the concerns you expressed. What advantages does yours offer? Liam On 8 March 2011 17:02, Burak burak...@gmail.com wrote: On

Solr and Permissions

2011-03-10 Thread Liam O'Boyle
Morning, We use solr to index a range of content to which, within our application, access is restricted by a system of user groups and permissions. In order to ensure that search results don't reveal information about items which the user doesn't have access to, we need to somehow filter the

Re: Solr and Permissions

2011-03-10 Thread Sujit Pal
How about assigning content types to documents in the index, and map users to a set of content types they are allowed to access? That way you will pass in fewer parameters in the fq. -sujit On Fri, 2011-03-11 at 11:53 +1100, Liam O'Boyle wrote: Morning, We use solr to index a range of

Re: If statements in DataImportHandler?

2011-03-10 Thread Gora Mohanty
On Fri, Mar 11, 2011 at 4:48 AM, Jason Rutherglen jason.rutherg...@gmail.com wrote: Is it possible to conditionally load sub-entities in DataImportHandler, based on the gathered value of parent entities? Probably the easies way to do that is with a transformer. Please see the DIH Wiki page for

Re: If statements in DataImportHandler?

2011-03-10 Thread Jason Rutherglen
Right that's not within the XML however, and it's unclear how to access the upper level entities that have already been instantiated, eg, beyond the given 'transform' row. On Thu, Mar 10, 2011 at 8:02 PM, Gora Mohanty g...@mimirtech.com wrote: On Fri, Mar 11, 2011 at 4:48 AM, Jason Rutherglen

Re: Solr and Permissions

2011-03-10 Thread go canal
I have similar requirements. Content type is one solution; but there are also other use cases where this not enough. Another requirement is, when the access permission is changed, we need to update the field - my understanding is we can not unless re-index the whole document again. Am I

Re: If statements in DataImportHandler?

2011-03-10 Thread Gora Mohanty
On Fri, Mar 11, 2011 at 10:23 AM, Jason Rutherglen jason.rutherg...@gmail.com wrote: Right that's not within the XML however, and it's unclear how to access the upper level entities that have already been instantiated, eg, beyond the given 'transform' row. The second example for a

Re: DIH : modify document in sibling entity of root entity

2011-03-10 Thread Lance Norskog
The DIH is strictly tree-structured. Data flows down the tree. If the first sibling is the root entity, nothing is used from the second sibling. This configuration is something that it the DIH should fail. On Thu, Mar 10, 2011 at 9:14 AM, Chantal Ackermann chantal.ackerm...@btelligent.de wrote:

Re: Solr and Permissions

2011-03-10 Thread Liam O'Boyle
As Canal points out, grouping into types is not always possible. In our case, permissions are not on a per-type level, but either on a per folder (of which there can be hundreds) or per item in some cases (of which there can be... any number at all). Reindexing is also to slow to really be an

Re: Solr and Permissions

2011-03-10 Thread go canal
To be fair, I think there is a slight difference between a Content Management and a Search Engine. Access control at per document level, per type level, supporting dynamic role changes, etc.are more like content management use cases; where search solution like Solr focuses on different set of

Problem with copyfield

2011-03-10 Thread nidhi gupta
I want to implement type ahead styling feature for description field.For that I defined ngtext fieldtype.I indexed description as text and then using copyfield indexed into ngtext field.But I found out that it is not working. If I put ngtext directly as a field type value without using