Unbuffered Exception while setting permissions

2010-06-30 Thread Rakhi Khatwani
Hi, I am trying out solr security on my setup from the following links: http://wiki.apache.org/solr/SolrSecurity http://www.lucidimagination.com/search/document/d1e338dc452db2e4/how_can_i_protect_the_solr_cores Following is my configuration: realms.properties: admin:

Re: Unbuffered Exception while setting permissions

2010-06-30 Thread Rakhi Khatwani
PS: I am using solr 1.4 Regards, Raakhi On Wed, Jun 30, 2010 at 12:05 PM, Rakhi Khatwani rkhatw...@gmail.comwrote: Hi, I am trying out solr security on my setup from the following links: http://wiki.apache.org/solr/SolrSecurity

Strange problem when use dismax handler

2010-06-30 Thread Scott Zhang
Hi. All. I am using default dismax to search within solr. The problem is when I search I want to specify the type to restrict the result. Here is what I do: 1. Query String with one type (Works!) :design)) AND ((type:product) ))) 2. Query String with 2 types (Works!) :design)) AND

Re: Strange problem when use dismax handler

2010-06-30 Thread Scott Zhang
I use debugQuery to check my query url: I notice the query url is parsed incorrectly. The type:book was parsed as query string too. Sign~~~ +((+DisjunctionMaxQuery((keyword_level1:design^10.0 | keyword_level2:design)~0.01) DisjunctionMaxQuery((keyword_level1:type^10.0 |

Re: [ANN] Solr 1.4.1 Released

2010-06-30 Thread Stevo Slavić
Created issue https://issues.apache.org/jira/browse/SOLR-1977 for this. Regards, Stevo. On Sun, Jun 27, 2010 at 2:54 AM, Ken Krugler kkrugler_li...@transpac.comwrote: On Jun 26, 2010, at 5:18pm, Jason Chaffee wrote: It appears the 1.4.1 version was deployed with a new maven groupId For

Re: Strange problem when use dismax handler

2010-06-30 Thread Scott Zhang
Well. I figured it out. I should use fq parameter. fq=type:music type:movie type:product On Wed, Jun 30, 2010 at 4:15 PM, Scott Zhang macromars...@gmail.com wrote: I use debugQuery to check my query url: I notice the query url is parsed incorrectly. The type:book was parsed as query

Re: Unbuffered Exception while setting permissions

2010-06-30 Thread Rakhi Khatwani
I was going through the logs, Everytime i try doing an update (and ofcourse ending up with unbuffered exception) the log outputs the following line [30/Jun/2010:09:02:52 +] POST /solr/core1/update?wt=javabinversion=1 HTTP/1.1 401 1389 Regards Raakhi On Wed, Jun 30, 2010 at 12:27 PM, Rakhi

Re: problem with formulating a negative query

2010-06-30 Thread Sascha Szott
Hi Erick, thanks for your explanations. But why are all docs being *removed* from the set of all docs that contain R in their topic field? This would correspond to a boolean AND and would stand in conflict with the clause q.op=OR. This seems a bit strange to me. Furthermore, Smiley Pugh

Re: Unbuffered Exception while setting permissions

2010-06-30 Thread Rakhi Khatwani
This error usually occurs when i do a server.add(inpDoc). Behind the logs: 192.168.0.106 - - [30/Jun/2010:11:30:38 +] GET /solr/GPTWPI/update?qt=%2Fupdateoptimize=truewt=javabinversion=1 HTTP/1.1 200 41 192.168.0.106 - - [30/Jun/2010:11:30:38 +] GET

Re: ArrayIndexOutOfBoundsException heeeeeelp !?!?!?!!?! Sorting

2010-06-30 Thread stockii
I get only this exception when i sort on my popularity field. WHY ??? ...sort=score desc, popularity desc -- BAD ...sort=score desc -- All fine. thats not good =( -- View this message in context:

Re: ArrayIndexOutOfBoundsException heeeeeelp !?!?!?!!?! Sorting

2010-06-30 Thread Koji Sekiguchi
(10/06/30 20:27), stockii wrote: Hello. I get an SEVERE: java.lang.ArrayIndexOutOfBoundsException and i dont know the reason for this. I have 4 cores. and every core is running but. for few minutes i get these bad exception in one core. its absolutlety not acceptable ... When i search with

Re: ArrayIndexOutOfBoundsException heeeeeelp !?!?!?!!?! Sorting

2010-06-30 Thread stockii
aha. the type is sint do i need to use string ore which field did not use any tokenizer ? ^^ i thought sint is untokenized... -- View this message in context: http://lucene.472066.n3.nabble.com/ArrayIndexOutOfBoundsException-heelp-Sorting-tp932956p933003.html Sent from the Solr - User

Re: ArrayIndexOutOfBoundsException heeeeeelp !?!?!?!!?! Sorting

2010-06-30 Thread stockii
it makes no sense. i can on my playground-core sort for popularity, but not on my live-core. both cores, have the same configuration ... the problem occurs after use facet-search. thats maybe an reason ? or too many data ? to low server ? any idea -- View this message in context:

Re: REST calls

2010-06-30 Thread Tim Williams
On Wed, Jun 30, 2010 at 12:39 AM, Don Werve d...@madwombat.com wrote: 2010/6/27 Jason Chaffee jchaf...@ebates.com The solr docs say it is RESTful, yet it seems that it doesn't use http headers in a RESTful way.  For example, it doesn't seem to use the Accept: request header to determine the

Re: REST calls

2010-06-30 Thread Tim Williams
On Wed, Jun 30, 2010 at 9:17 AM, Jak Akdemir jakde...@gmail.com wrote: On Wed, Jun 30, 2010 at 7:39 AM, Don Werve d...@madwombat.com wrote: 2010/6/27 Jason Chaffee jchaf...@ebates.com The solr docs say it is RESTful, yet it seems that it doesn't use http headers in a RESTful way.  For

Re: REST calls

2010-06-30 Thread Yonik Seeley
Solr's APIs are described as REST-like, and probably do qualify as restful the way the term is commonly used. I'm personally much more interested in making our APIs more powerful and easier to use, regardless of any REST purity tests. -Yonik http://www.lucidimagination.com

Re: dataimport.properties is not updated on delta-import

2010-06-30 Thread warb
I've finally found the problem causing the delta-import to fail and thought I would post it here for future reference (if someone makes the same mistake I did). I had forgot to collect the id column in the deltaImportQuery. I should, of course, have known this from the log entires about

Is there a way to delete multiple documents using wildcard?

2010-06-30 Thread bbarani
Hi, I am trying to delete a group of documents using wildcard. Something like update?commit=true%20-H%20Content-Type:%20text/xml%20--data-binary%20'deletedocfield%20name=uid6-HOST*/field/doc/delete' I want to delete all documents which contains the uid starting with 6-HOST but this query

Re: REST calls

2010-06-30 Thread Chantal Ackermann
On Wed, 2010-06-30 at 16:12 +0200, Yonik Seeley wrote: Solr's APIs are described as REST-like, and probably do qualify as restful the way the term is commonly used. I'm personally much more interested in making our APIs more powerful and easier to use, regardless of any REST purity tests.

Re: Is there a way to delete multiple documents using wildcard?

2010-06-30 Thread Sascha Szott
Hi, you can delete all docs that match a certain query: deletequeryuid:6-HOST*/query/delete -Sascha bbarani wrote: Hi, I am trying to delete a group of documents using wildcard. Something like

Re: Is there a way to delete multiple documents using wildcard?

2010-06-30 Thread bbarani
Hi, Thanks a lot for your reply.. I tried the below query update?commit=true%20-H%20Content-Type:%20text/xml%20--data-binary%20'deletequeryuid:6-HOST*/query/delete' But even now none of the documents are getting deleted.. Am I forming the URL wrong? Thanks, BB -- View this message in

SolrQueryResponse - Solr Documents

2010-06-30 Thread Amdebirhan, Samson, VF-Group
Hello all, How can I view solr docs in response writers before the response is sent to the client ? What I get is only DocSlice with int values having size equal the docs requested. All this while debugging on the SolrQueryResponse Object. Thanks Sam

Re: Leading Wildcard query strangeness

2010-06-30 Thread dbashford
An update in case someone stumbles upon this... At first I thought you mean the fields I intend to do leading wildcard searches on needed to have ReversedWildcardFilterFactory on them. But that didn't make sense because our prod app isn't using that at all. But our prod app does have the

Re: Is there a way to delete multiple documents using wildcard?

2010-06-30 Thread Sascha Szott
Hi, does /select?q=uid:6-HOST* return any documents? -Sascha bbarani wrote: Hi, Thanks a lot for your reply.. I tried the below query update?commit=true%20-H%20Content-Type:%20text/xml%20--data-binary%20'deletequeryuid:6-HOST*/query/delete' But even now none of the documents are getting

Re: Leading Wildcard query strangeness

2010-06-30 Thread Ahmet Arslan
I'm going to guess that is what you meant, that the very presence of the filter in the schema, whether it is used or not, allows you to do wildcard searches. Exactly. Is that documented anywhere and I just missed it?  I'm sure it is. I knew it from source code of SolrQueryParser.

Re: Is there a way to delete multiple documents using wildcard?

2010-06-30 Thread bbarani
Yeah, I am getting the results when I use /select handler. I tried the below query.. /select?q=uid:6-HOST* Got result name=response numFound=52920 start=0 Thanks BB -- View this message in context:

Re: Is there a way to delete multiple documents using wildcard?

2010-06-30 Thread Jan Høydahl / Cominvent
Hi, You need to use HTTP POST in order to send those parameters I believe. Try with curl: curl http://localhost:8983/solr/update?commit=true -H Content-Type: text/xml --data-binary deletequeryuid:6-HOST*/query/delete -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com

Wiki Documentation of facet.sort

2010-06-30 Thread Chantal Ackermann
Hi there, in the wiki, on http://wiki.apache.org/solr/SimpleFacetParameters it says: The default is true/count if facet.limit is greater than 0, false/index otherwise. I've just migrated to 1.4.1 (reindexed). I can't remember how it was with 1.4.0. When I specify my facet query with

Re: Is there a way to delete multiple documents using wildcard?

2010-06-30 Thread Sascha Szott
Hi, take a look inside Solr's log file. Are there any error messages with respect to the update request? Furthermore, you could try the following two commands instead: curl http://host:port/solr/update; --form-string stream.body=deletequeryuid:6-HOST*/query/delete curl

Disable Solr Response Formatting

2010-06-30 Thread JohnRodey
By default my SOLR response comes back formatted, like such C/ Is there a way to tell it to return it unformatted? like: C/ -- View this message in context: http://lucene.472066.n3.nabble.com/Disable-Solr-Response-Formatting-tp933785p933785.html Sent from the Solr - User

Re: Disable Solr Response Formatting

2010-06-30 Thread JohnRodey
Oops, let me try that again... By default my SOLR response comes back formatted, like such C/ Is there a way to tell it to return it unformatted? like: C/ -- View this message in context:

Re: Is there a way to delete multiple documents using wildcard?

2010-06-30 Thread bbarani
Hi, I was able to sucessfully delete multiple documents using the below URL /update?stream.body=deletequeryuid:6-HOST*/query/delete Thanks, BB -- View this message in context: http://lucene.472066.n3.nabble.com/Is-there-a-way-to-delete-multiple-documents-using-wildcard-tp933468p933799.html

GC tuning - heap size autoranging

2010-06-30 Thread Robert Petersen
Is this a true statement??? This seems to contradict other statements regarding setting the heap size I have seen here... Default Heap Size If not otherwise set on the command line, the initial and maximum heap sizes are calculated based on the amount of memory on the machine. The proportion

RE: Re: Disable Solr Response Formatting

2010-06-30 Thread Markus Jelsma
Hi,   My client makes a mess out of your example but if you mean formatting as in indenting, then send indent=false, but it's already false by default. Check your requestHandler settings.   Cheers,   -Original message- From: JohnRodey timothydd...@yahoo.com Sent: Wed 30-06-2010 18:39

Re: Is there a way to delete multiple documents using wildcard?

2010-06-30 Thread Jan Høydahl / Cominvent
Hmm, nice one - I was not aware of that trick. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com Training in Europe - www.solrtraining.com On 30. juni 2010, at 18.41, bbarani wrote: Hi, I was able to sucessfully delete multiple documents using the below URL

RE: Re: Disable Solr Response Formatting

2010-06-30 Thread JohnRodey
Thanks! I was looking for things to change in the solrconfig.xml file. indent=off -- View this message in context: http://lucene.472066.n3.nabble.com/Disable-Solr-Response-Formatting-tp933785p933966.html Sent from the Solr - User mailing list archive at Nabble.com.

Bizarre Terms revisited

2010-06-30 Thread Darren Govoni
Hi, I really think there is something not quite right going on here after much study. Here is my findings. Using MLT, I get terms that appear to be long concatenations of words that are space delimited in the original text. I can't think of any reason for these sentence-like terms to exist

RE: OOM on uninvert field request

2010-06-30 Thread Robert Petersen
Hey so after adding those GC options, I was able to incrementally push my max (and min) memory settings up and when we got to max=min=12GB we started looking much better! One slave handles all the load with no OOMs at all! I'm watching the live tomcat log using 'tail'. Next I will convert

Multiple Solr servers and a shared index vs master+slaves

2010-06-30 Thread David Thompson
I'm a newbie looking at setting up an intranet search service using Solr, so I'm having a hard time understanding why I should forego the high availability and clustering mechanisms we already have available, and use Solr's implementations instead. I'm hoping some experienced Solr architects

Re: OOM on uninvert field request

2010-06-30 Thread Yonik Seeley
On Tue, Jun 29, 2010 at 7:32 PM, Robert Petersen rober...@buy.com wrote: Hello I am trying to find the right max and min settings for Java 1.6 on 20GB index with 8 million docs, running 1.6_018 JVM with solr 1.4, and am currently have java set to an even 4GB (export JAVA_OPTS=-Xmx4096m

Re: Unbuffered Exception while setting permissions

2010-06-30 Thread Lance Norskog
Other problems with this error have been solved by doing pre-emptive authentication. On Wed, Jun 30, 2010 at 4:26 AM, Rakhi Khatwani rkhatw...@gmail.com wrote: This error usually occurs when i do a server.add(inpDoc). Behind the logs: 192.168.0.106 - - [30/Jun/2010:11:30:38 +] GET

Re: REST calls

2010-06-30 Thread Lance Norskog
The stream.file/stream.url/stream.body parameters allow a GET to alter the index. The core management operations are also useable from GET. This allows one to bookmark and mail around a link that changes or blows up the index. Apparently this is not ReStFuL It is IMVHO insane. On Wed, Jun 30,

Re: REST calls

2010-06-30 Thread Yonik Seeley
On Wed, Jun 30, 2010 at 4:55 PM, Lance Norskog goks...@gmail.com wrote: Apparently this is not ReStFuL It is IMVHO insane. Patches welcome... -Yonik http://www.lucidimagination.com

Re: OOM on uninvert field request

2010-06-30 Thread Lance Norskog
On Wed, Jun 30, 2010 at 1:38 PM, Yonik Seeley yo...@lucidimagination.com wrote: On Tue, Jun 29, 2010 at 7:32 PM, Robert Petersen rober...@buy.com wrote: Hello I am trying to find the right max and min settings for Java 1.6 on 20GB index with 8 million docs, running 1.6_018 JVM with solr 1.4,

Re: REST calls

2010-06-30 Thread Lance Norskog
I've looked at the problem. It's fairly involved. It probably would take several iterations. (But not as many as field collapsing :) On Wed, Jun 30, 2010 at 2:11 PM, Yonik Seeley yo...@lucidimagination.com wrote: On Wed, Jun 30, 2010 at 4:55 PM, Lance Norskog goks...@gmail.com wrote:  

tomcat solr logs

2010-06-30 Thread Robert Petersen
Sorry if this is at all off topic. Our solr log files need grooming and we would also like to analyze them, perhaps pulling various data points into a DB table, is there a preferred app for doing log file analysis and/or an easy way to delete the old log files?

Re: REST calls

2010-06-30 Thread Ryan McKinley
If there is a real desire/need to make things restful in the official sense, it is worth looking at using a REST framework as the controller rather then the current solution. perhaps: http://www.restlet.org/ https://jersey.dev.java.net/ These would be cool since they encapsulate lots of the

RE: OOM on uninvert field request

2010-06-30 Thread Robert Petersen
Most of these hundreds of facet fields have tens of values but a couple have thousands, is thousands of different values too many to do enum or is that still ok? If so I could apply it carte blanche to the whole field... -Original Message- From: ysee...@gmail.com

Re: Very basic questions: Faceted front-end?

2010-06-30 Thread Peter Spam
Wow, thanks Lance - it's really fast now! The last piece of the puzzle is setting up a nice front-end. Are there any pre-built front-ends available, that mimic Google (for example), with facets? -Peter On Jun 29, 2010, at 9:04 PM, Lance Norskog wrote: To highlight a field, Solr needs some

Disk usage per-field

2010-06-30 Thread Shawn Heisey
Is it possible for Solr (or Luke/Lucene) to tell me exactly how much of the total index disk space is used by each field? It would also be very nice to know, for each field, how much is used by the index and how much is used for stored data.

RE: REST calls

2010-06-30 Thread Jason Chaffee
Using Accept headers is a pretty standard practice and so are conditional GETs. Quite easy to test with curl: curl  -X GET -H Accept:application/xml http://solr.com/search curl -X GET -H Accept:application/json http://solr.com/search Jason -Original Message- From: Don

RE: REST calls

2010-06-30 Thread Jason Chaffee
In that case, being able to use Accept headers and conditional GET's would make them more powerful and easier to use. The Accept header could be used, if present, otherwise use the query parameter. Or, vice versa. Also, conditional GET's are a big win when you know the data and results are not

RE: REST calls

2010-06-30 Thread Jason Chaffee
Two more jaxrs solutions: http://www.jboss.org/resteasy http://cxf.apache.org/docs/jax-rs.html However, I am not suggesting changing the core implementation. Just want to make it more powerful by utilizing headers. I can accept the other issues that have been mentioned as not RESTful.

Re: Very basic questions: Faceted front-end?

2010-06-30 Thread Peter Spam
Ah, I found this: https://issues.apache.org/jira/browse/SOLR-634 ... aka solr-ui. Is there anything else along these lines? Thanks! -Peter On Jun 30, 2010, at 3:59 PM, Peter Spam wrote: Wow, thanks Lance - it's really fast now! The last piece of the puzzle is setting up a nice

Re: OOM on uninvert field request

2010-06-30 Thread Yonik Seeley
On Wed, Jun 30, 2010 at 6:19 PM, Robert Petersen rober...@buy.com wrote: Most of these hundreds of facet fields have tens of values but a couple have thousands, is thousands of different values too many to do enum or is that still ok?  If so I could apply it carte blanche to the whole

Re: Wiki Documentation of facet.sort

2010-06-30 Thread Koji Sekiguchi
(10/07/01 1:12), Chantal Ackermann wrote: Hi there, in the wiki, on http://wiki.apache.org/solr/SimpleFacetParameters it says: The default is true/count if facet.limit is greater than 0, false/index otherwise. I've just migrated to 1.4.1 (reindexed). I can't remember how it was with 1.4.0.

Re: REST calls

2010-06-30 Thread Erik Hatcher
Solr has 304 support with the last-modified and etag headers. Erik On Jun 30, 2010, at 7:52 PM, Jason Chaffee wrote: In that case, being able to use Accept headers and conditional GET's would make them more powerful and easier to use. The Accept header could be used, if present,

Dilemma - Very Frequent Synonym updates for Huge Index

2010-06-30 Thread Ravi Kiran
Hello, Hoping some solr guru can help me out here. We are a news organization trying to migrate 10 million documents from FAST to solr. The plan is to have our Editorial team add/modify synonyms multiple times during a day as they deem appropriate. Hence we plan on using query time