Re: build.xml errors

2009-08-12 Thread viorelhojda
Thank you for your reply. You were right, I could run the targets from build.xml :working:. All the best, Viorel Shalin Shekhar Mangar wrote: On Tue, Aug 11, 2009 at 1:31 PM, viorelhojda viorelho...@yahoo.com wrote: Hello. I've downloaded SOLR using the SVN and Eclipse IDE. After

Re: Indexing date into multiple fields

2009-08-12 Thread Shalin Shekhar Mangar
On Wed, Aug 12, 2009 at 7:15 AM, Bernadette Houghton bernadette.hough...@deakin.edu.au wrote: Am very new to SOLR, so this question may seem overly basic - In schema.xml, I have a date field type - fieldType name=date class=solr.DateField sortMissingLast=true omitNorms=true/ used by

Re: Newbie problem ordering results

2009-08-12 Thread Shalin Shekhar Mangar
On Tue, Aug 11, 2009 at 9:56 PM, Avlesh Singh avl...@gmail.com wrote: However the RuntimeException that Solr throws has a misleading error message - ... but it's impossible to sort on tokenized fields. The field in this case is untokenized. The error is thrown by Lucene. Actually, multi

Re: Newbie problem ordering results

2009-08-12 Thread Avlesh Singh
The error is thrown by Lucene. Actually, multi valued fields are not very different from tokenized fields. Multiple values are indexed with their respective token positions differing by the positionIncrementGap value as specified in schema. I truly understand that. But I guess, that is

How to boost some documents at query-time ?

2009-08-12 Thread Fabrice Estiévenart
Hello, I need to sort my hits according to a rate of popularity which dynamically and periodically changes. Thus, I can't store this popularity in the index and I have to get it, from memory, at query-time. Is it possible with Solr ? Thank you. Fabrice

Re: JVM Heap utilization Memory leaks with Solr

2009-08-12 Thread Gunnar Wagenknecht
Rahul R schrieb: I tried using a profiling tool - Yourkit. The trial version was free for 15 days. But I couldn't find anything of significance. You should try to generate heap dumps and analyze the heap using a tool like the Eclipse Memory Analyzer. Maybe it helps spotting a group of objects

Re: Searching for reservations/availability with Solr

2009-08-12 Thread Avlesh Singh
Searches would be for documents (rooms) that don't have certain dates in their multi-valued fields for the a particular month. E.g if you wanted to find out rooms available on 15th, 16th and 17th of August, the query could be: q=!(+reserved_dates_August:15 +reserved_dates_August:16

Problem regarding Solr MultiCore

2009-08-12 Thread deepak agrawal
Hi all, I am having a solr single instance.Now i just want to use Solr Multi Core. So for this i just change solr.xml - solr persistent=true cores adminPath=/admin/cores persistent=true core name=core0 instanceDir=C:\PointCross\WIP\DevBuild\trunk\Orchestra Product\Search\solr

Re: Searching for reservations/availability with Solr

2009-08-12 Thread Constantijn Visinescu
Hi, This seems like a bit of an unconventional suggestion but it just might work. I'd have to add the year because things might end up reserved far ahead, or they might be reserved again on the same day next year. I do have 2 questions: 1) Wouldn't it be terribly inefficient when I have

Re: Using Lucene's payload in Solr

2009-08-12 Thread Grant Ingersoll
On Aug 11, 2009, at 5:30 PM, Bill Au wrote: It looks like things have changed a bit since this subject was last brought up here. I see that there are support in Solr/Lucene for indexing payload data (DelimitedPayloadTokenFilterFactory and DelimitedPayloadTokenFilter). Overriding the

Re: Searching for reservations/availability with Solr

2009-08-12 Thread Constantijn Visinescu
On Tue, Aug 11, 2009 at 6:13 PM, Shalin Shekhar Mangar shalinman...@gmail.com wrote: On Tue, Aug 11, 2009 at 7:08 PM, Constantijn Visinescu baeli...@gmail.comwrote: doc str name=nameRoom1/str date name=reserved_from_112000-08-01T00:00:00Z/date date

Re: Searching for reservations/availability with Solr

2009-08-12 Thread Avlesh Singh
I'd have to add the year because things might end up reserved far ahead, or they might be reserved again on the same day next year. If that is the case, then yes you'll have to take year into account too. Wouldn't it be terribly inefficient when I have 10million+ documents in my index and i

Re: How to boost some documents at query-time ?

2009-08-12 Thread Avlesh Singh
Is it possible with Solr ? My understanding says, No. I am waiting to be surprised. Cheers Avlesh 2009/8/12 Fabrice Estiévenart fabrice.estieven...@cetic.be Hello, I need to sort my hits according to a rate of popularity which dynamically and periodically changes. Thus, I can't store

Test SPEED

2009-08-12 Thread viorelhojda
Hello. I'm trying to do some speed tests on the SOLR server (Average Response Time, etc). I tried all kinds of tool and software but I didn't manage because at one point some errors appeared. The *:* query works just fine, but when I try to test another query the tool complains that the

Re: Searching for reservations/availability with Solr

2009-08-12 Thread Constantijn Visinescu
Hmm .. I looked up the transformer class and that should work, thanks for the tip :) Thinking about it a bit more, wouldn't it be easier to just add a field like field name=reserved_date type=sint indexed=true stored=true multiValued=true / And use a function in the transformer to converts the

Re: Problem regarding Solr MultiCore

2009-08-12 Thread Noble Paul നോബിള്‍ नोब्ळ्
It somehow looks that the solr is started as a single core. are you sure the solr.solr.home points to a directory which contains the solr.xml On Wed, Aug 12, 2009 at 4:00 PM, deepak agrawaldk.a...@gmail.com wrote: Hi all, I am having a solr single instance.Now i just want to use Solr Multi

Re: Searching for reservations/availability with Solr

2009-08-12 Thread Avlesh Singh
field name=reserved_date type=sint indexed=true stored=true multiValued=true / I think this should be good enough with the number of days since ... kind of data. Cheers Avlesh On Wed, Aug 12, 2009 at 5:26 PM, Constantijn Visinescu baeli...@gmail.comwrote: Hmm .. I looked up the transformer

Re: Searching for reservations/availability with Solr

2009-08-12 Thread Constantijn Visinescu
Ok, i'm going to go and implement this solution then. Thanks for the help :) On Wed, Aug 12, 2009 at 2:11 PM, Avlesh Singh avl...@gmail.com wrote: field name=reserved_date type=sint indexed=true stored=true multiValued=true / I think this should be good enough with the number of days

Re: How to boost some documents at query-time ?

2009-08-12 Thread Shalin Shekhar Mangar
2009/8/12 Fabrice Estiévenart fabrice.estieven...@cetic.be Hello, I need to sort my hits according to a rate of popularity which dynamically and periodically changes. Thus, I can't store this popularity in the index and I have to get it, from memory, at query-time. Is it possible with Solr

Re: Test SPEED

2009-08-12 Thread Shalin Shekhar Mangar
On Wed, Aug 12, 2009 at 5:07 PM, viorelhojda viorelho...@yahoo.com wrote: Hello. I'm trying to do some speed tests on the SOLR server (Average Response Time, etc). I tried all kinds of tool and software but I didn't manage because at one point some errors appeared. The *:* query works just

Re: Problem regarding Solr MultiCore

2009-08-12 Thread deepak agrawal
yaa it points the directory contains solr.xml. But Solr Folder having the conf and bin folder. for multicore any other thing is required. 2009/8/12 Noble Paul നോബിള്‍ नोब्ळ् noble.p...@corp.aol.com It somehow looks that the solr is started as a single core. are you sure the solr.solr.home

Re: How to boost some documents at query-time ?

2009-08-12 Thread Fabrice Estiévenart
Thank you for your suggestions. Since my initial email, I have found/guessed two other indications : - The CustomScoreQuery of Lucene : http://lucene.apache.org/java/2_4_0/api/org/apache/lucene/search/function/package-summary.html - To create a temporary index, at query-time, containing the

Re: Revisiting IDF Problems and Index Slices

2009-08-12 Thread Grant Ingersoll
Some thoughts below, sorry for the late reply... On Aug 6, 2009, at 2:27 PM, Mark Bennett wrote: I'm investigating a problem I bet some of you have hit before, and exploring several options to address it. I suspect that this specific IDF scenario is common enough that it even has a name,

Fwd: Sign up for ApacheCon US by 14 August and save up to $500!

2009-08-12 Thread Grant Ingersoll
Forwarding the ApacheCon announcement. Also note we have a lot of Lucene ecosystem talks and a meetup scheduled, as well as training on both Lucene and Solr, so I hope you will join us. Cheers, Grant Begin forwarded message: From: Sally Khudairi s...@apache.org Date: August 7, 2009

RE: Performance Tuning: segment_merge:index_update=5:1 (timing)

2009-08-12 Thread Fuad Efendi
Hi Grant, Looks like I temporarily solved the problem with not-so-obvious settings: ramBufferSizeMB=8192 mergeFactor=10 Starting from scratch on a different hardware (with much more RAM and CPU; regular SATA) I have added/updated 30 millions docs within 3 hours... without any merge yet! Index

RE: NativeFSLockFactory, ConcurrentMergeScheduler: why locks?

2009-08-12 Thread Fuad Efendi
Thank a lot Jason! I'll go into depths with MergePolicy; I use temporarily ramBufferSizeMB=8192 mergeFactor=10 and looks like I have constantly few thousands docs per second with very rare merge (already 3 hours, 8Gb index size, 30 mlns docs) I don't do delete; I execute SOLR /update and I

Re: ArrayIndexOutOfBounds on Some Searches

2009-08-12 Thread Mark Miller
First thing I see (and it may be it) is that nextDoc must also set the doc - not just return it. -- - Mark http://www.lucidimagination.com Stephen Duncan Jr wrote: On Tue, Aug 11, 2009 at 2:09 PM, Stephen Duncan Jr stephen.dun...@gmail.com wrote: This is with trunk for Solr

Re: ArrayIndexOutOfBounds on Some Searches

2009-08-12 Thread Stephen Duncan Jr
Doesn't that happen with the call to this.termDocs.next() ? Since I'm essentially delegating the tracking to the TermDocs object? On Wed, Aug 12, 2009 at 10:08 AM, Mark Miller markrmil...@gmail.com wrote: First thing I see (and it may be it) is that nextDoc must also set the doc - not just

facet performance tips

2009-08-12 Thread Jérôme Etévé
Hi everyone, I'm using some faceting on a solr index containing ~ 160K documents. I perform facets on multivalued string fields. The number of possible different values is quite large. Enabling facets degrades the performance by a factor 3. Because I'm using solr 1.3, I guess the facetting

RE: facet performance tips

2009-08-12 Thread Manepalli, Kalyan
Jerome, Yes you need to increase the filterCache size to something close to unique number of facet elements. But also consider the RAM required to accommodate the increase. I did see a significant performance gain by increasing the filterCache size Thanks, Kalyan Manepalli

Solr 1.3 and JDK1.6

2009-08-12 Thread vaibhav joshi
Hi I am using Solr 1.3 ( official released version) and JDk1.5. My company is moving towards upgrading all systems to JDK1.6. is it safe to upgrade to JDK1.6 with Solr 1.3 wars? Are there any compatible issues with JDK1.6? Thanks Vaibhav

Solr1.4 and snapinstalling/optimize script

2009-08-12 Thread KaktuChakarabati
Hey, I noticed in recent SVN versions the example/solr/bin dir has been empty. I understand the various snappulling scripts are basically deprecated since replication is now handled in-process, however I was wondering what is the state of the optimize script, i.e how do I control optimization

Re: Solr 1.3 and JDK1.6

2009-08-12 Thread Jérôme Etévé
Hi, I'm running solr 1.3 with java -version java version 1.6... . No problem to report. Cheers. J 2009/8/12 vaibhav joshi callvaib...@hotmail.com: Hi I am using Solr 1.3 ( official released version) and JDk1.5. My company is moving towards upgrading all systems to JDK1.6. is it safe to

Re: Solr1.4 and snapinstalling/optimize script

2009-08-12 Thread Yonik Seeley
A script isn't really needed for something as simple as a commit: curl 'http://localhost:8983/solr/update?commit=true' -Yonik http://www.lucidimagination.com On Wed, Aug 12, 2009 at 2:27 PM, KaktuChakarabatijimmoe...@gmail.com wrote: Hey, I noticed in recent SVN versions the example/solr/bin

Re: Solr1.4 and snapinstalling/optimize script

2009-08-12 Thread Yonik Seeley
Then replace commit with optimize? curl 'http://localhost:8983/solr/update?optimize=true' -Yonik http://www.lucidimagination.com On Wed, Aug 12, 2009 at 2:43 PM, KaktuChakarabatijimmoe...@gmail.com wrote: Hey Yonik, Thanks for the quick reply, However my first question was more specific:

RE: Solr 1.3 and JDK1.6

2009-08-12 Thread Manepalli, Kalyan
We have been using solr 1.3 with jdk1.6 for quite sometime in production, no issues yet Thanks, Kalyan Manepalli -Original Message- From: vaibhav joshi [mailto:callvaib...@hotmail.com] Sent: Wednesday, August 12, 2009 1:21 PM To: solr-user@lucene.apache.org Subject: Solr 1.3 and JDK1.6

Re: Solr1.4 and snapinstalling/optimize script

2009-08-12 Thread Erik Hatcher
Same works with optimize... /solr/update?optimize=true Erik On Aug 12, 2009, at 2:43 PM, KaktuChakarabati wrote: Hey Yonik, Thanks for the quick reply, However my first question was more specific: * I'm not worried about a commit but about the *optimize* operation which I might

RE: facet performance tips

2009-08-12 Thread Fuad Efendi
I am currently faceting on tokenized multi-valued field at http://www.tokenizer.org (25 mlns simple docs) It uses some home-made quick fixes similar to SOLR-475 (SOLR-711) and non-synchronized cache (similar to LingPipe's FastCache, SOLR-665, SOLR-667) Average faceting on query results: 0.2 -

RE: Solr 1.3 and JDK1.6

2009-08-12 Thread Fuad Efendi
Oracle JRockit (Mission Control 1.3) latest-greatest (Java 6), -server, AMD64, SLES 10 Solr 1.3/1.4 Tomcat 6.0.20, APR No any problem. But you need licensing for production. JRockit seems to be at least 20 times faster than SUN's JVM. P.S. I only had constant problems with latest Apache

Re: Solr1.4 and snapinstalling/optimize script

2009-08-12 Thread KaktuChakarabati
Hey Yonik, Thanks for the quick reply, However my first question was more specific: * I'm not worried about a commit but about the *optimize* operation which I might want to run very infrequently in respect to commits ( e.g I can commit every 15 minutes but optimize once a day ) Yonik

Re: facet performance tips

2009-08-12 Thread Erik Hatcher
Yes, increasing the filterCache size will help with Solr 1.3 performance. Do note that trunk (soon Solr 1.4) has dramatically improved faceting performance. Erik On Aug 12, 2009, at 1:30 PM, Jérôme Etévé wrote: Hi everyone, I'm using some faceting on a solr index containing ~

Query with no cache without editing solrconfig?

2009-08-12 Thread Jason Rutherglen
Is there a way to do this via a URL?

Solr support for Lucene Near realtime search

2009-08-12 Thread fansnap_alan
Hi, Does the latest version of Solr 1.4 dev (including DIH) take advantage of Lucene's Near Realtime Search features? I've read several past postings about providing near-real time search using a small and large index and was wondering if that will still be necessary when Solr 1.4 releases.

Re: Solr1.4 and snapinstalling/optimize script

2009-08-12 Thread Chris Hostetter
: I noticed in recent SVN versions the example/solr/bin dir has been empty. FYI: example/solr/bin is empty, because thescripts aren't part of the example anymore ... but the scripts themselves are still included in the releases (src/scripts) -Hoss

DIH problem passing HTTP parameters into data-config

2009-08-12 Thread John Lowe
Hmmm...perhaps my original note was a bit TLTR. Trying again: The v1.3 docs say that one can pass one's own parameters in to DIH via the HTTP request: http://wiki.apache.org/solr/DataImportHandler#head-520f8e527d9da55e8ed1e274e29709c8805c8eae SO if I have a URL like the following to

Re: Solr support for Lucene Near realtime search

2009-08-12 Thread Jason Rutherglen
Hi Alan, Solr 1.4 does not contain near realtime search capabilities and it could be variously detrimental to call commit too often as indexing and searches could precipitously degrade. That being said, most of the NRT functionality is not too difficult to add, except for per segment caching

Re: facet performance tips

2009-08-12 Thread Jason Rutherglen
For your fields with many terms you may want to try Bobo http://code.google.com/p/bobo-browse/ which could work well with your case. On Wed, Aug 12, 2009 at 12:02 PM, Fuad Efendif...@efendi.ca wrote: I am currently faceting on tokenized multi-valued field at http://www.tokenizer.org (25 mlns

Re: [OT] Solr Webinar

2009-08-12 Thread Grant Ingersoll
I believe it will be, but am not sure of the procedure for distributing. I think if you register, but don't show, you will get a notification. -Grant On Aug 10, 2009, at 12:26 PM, Lucas F. A. Teixeira wrote: Hello Grant, Will the webinar be recorded and available to download later

Example dir

2009-08-12 Thread Francis Yakin
As of right now when I installed and configure the Solr, I will get example dir ( like /opt/apache-solr-1.3.0/example ). How can I change that to something else, because example to me is not real? Thanks Francis

Re: DIH problem passing HTTP parameters into data-config

2009-08-12 Thread Erik Hatcher
My hunch, though I'll try to make some time to test this out thoroughly, is that the entity is parsed initially with variables resolved, but not per request. Variables/expressions do get expanded for fields of course, but perhaps not for other high-level attributes? Erik On Aug

Distributed query returns time consumed by each Solr shard?

2009-08-12 Thread Jason Rutherglen
Is there a way to do this currently? If a shard takes an inordinate amount of time compared to the other shards, it's useful to see the various qtimes per shard, with the aggregated results.

defaultOperator=AND and queries with (

2009-08-12 Thread Subbacharya, Madhu
Hello, We have Solr running with the defaultOperator set to AND. Am not able to get any results for queries like q=( Ferrari AND ( 599 GTB Fiorano OR 612 Scaglietti OR F430 )) , which contain ( for grouping. Anyone have any ideas for a workaround ? Thanks madhu

Re: facet performance tips

2009-08-12 Thread Stephen Duncan Jr
Note that depending on the profile of your field (full text and how many unique terms on average per document), the improvements from 1.4 may not apply, as you may exceed the limits of the new faceting technique in Solr 1.4. -Stephen On Wed, Aug 12, 2009 at 2:12 PM, Erik Hatcher

RE: Example dir

2009-08-12 Thread Francis Yakin
Any one has any inputs for this? I really appreciated. Thanks Francis -Original Message- From: Francis Yakin [mailto:fya...@liquid.com] Sent: Wednesday, August 12, 2009 3:39 PM To: 'solr-user@lucene.apache.org' Subject: Example dir As of right now when I installed and configure the

Re: Example dir

2009-08-12 Thread ant
http://wiki.apache.org/solr/SolrJetty#head-5663a826c263727cad83bc58cac0cb02f53d6a80 SolrJetty and others http://wiki.apache.org/solr/SolrInstall#head-ec97d15a70656e9c0308009db70d71af3efc7cd2 2009/8/13 Francis Yakin fya...@liquid.com Any one has any inputs for this? I really appreciated.

Re: JVM Heap utilization Memory leaks with Solr

2009-08-12 Thread Rahul R
*You should try to generate heap dumps and analyze the heap using a tool like the Eclipse Memory Analyzer. Maybe it helps spotting a group of objects holding a large amount of memory* The tool that I used also allows to capture heap snap shots. Eclipse had a lot of pre-requisites. You need to