Re: UpdateProcessor and copyField

2011-02-23 Thread Markus Jelsma
You are right, i misread. Fields a copied first, then analyzed and then behave like other fields and pass the same way through the update processor. Cheers, Markus, I searched but I couldn't find a definite answer, so I posted this question. The article you quoted talks about implementing

How to support fault tolerant indexing?

2011-02-23 Thread kristofd
Hi, I am working on a setup where we will need fault tolerant indexing. This seems not to be supported by Solr per default, and I wonder what the options are. My plan is to: * Use 2 separate, self-contained Solr nodes (no master-slave config in Solr) * Use a hot standby failover setup in front

Re: Configure 2 or more Tomcat instances.

2011-02-23 Thread rajini maski
I created 2 tomcat instances. With respective folders tomcat0 tomcat1 And server xml edited with the different port numbers respecitvely(all the 3 ports). Now when I am tryin to connect .. http://localhost:8090/ or http://localhost:8091/ webpage failed to open in both the cases. Is

Re: UpdateProcessor and copyField

2011-02-23 Thread Jan Høydahl
This is how I've got it: A document first passes through the UpdateChain (processors), which is document centric. Then copyFields are processed And finally the analysis in fieldTypes are processed So you cannot use copyField before UpdateProcessors nor after Analysis :( -- Jan Høydahl, search

Re: How to support fault tolerant indexing?

2011-02-23 Thread Jan Høydahl
Hi, This is what we're aiming for SolrCloud and ZooKeeper to handle for us. It does not currently do that, but the vision is that ZK will keep track of the state of each node, and do master election and everything. Contributions welcome :) http://wiki.apache.org/solr/SolrCloud -- Jan Høydahl,

Re: UpdateProcessor and copyField

2011-02-23 Thread Erik Hatcher
Maybe copy fields should be refactored to happen in a new, core, update processor, so there is nothing special/awkward about them? It seems they fit as part of what an update processor is all about, augmenting/modifying incoming documents. Erik On Feb 23, 2011, at 04:40 , Jan Høydahl

fq field with facets

2011-02-23 Thread Rosa (Anuncios)
Hi, I'm trying to reduce results from facets. (by category with my schema) My category field is String type in my schema.xml. The problem i've got is when the category value has space or special caracter it doen't work? Example: ?q=homefq=category:Appartement --- works fine

Re: fq field with facets

2011-02-23 Thread Savvas-Andreas Moysidis
Hello, you could try wrapping your fq terms in double quotes as in: ?q=homefq=category:Appartement Sale On 23 February 2011 13:25, Rosa (Anuncios) rosaemailanunc...@gmail.comwrote: Hi, I'm trying to reduce results from facets. (by category with my schema) My category field is String

Re: fq field with facets

2011-02-23 Thread Erik Hatcher
Try - fq={!field f=category}insert value, URL encoded of course, here You can also try surrounding with quotes, but that gets tricky and you'll need to escape things possibly. Or you could simply backslash escape the whitespace (and colon, etc) characters. Erik On Feb 23, 2011, at

Re: fq field with facets

2011-02-23 Thread Savvas-Andreas Moysidis
Hi Eric, could you please let us know where can we find more info about this notation ( fq={!field f=category})? What is it called, how to use it etc? Is there a wiki page? Thanks, - Savvas On 23 February 2011 14:17, Erik Hatcher erik.hatc...@gmail.com wrote: Try - fq={!field

Re: fq field with facets

2011-02-23 Thread Stefan Matheis
Savvas, have a look here: http://wiki.apache.org/solr/FunctionQuery On Wed, Feb 23, 2011 at 3:25 PM, Savvas-Andreas Moysidis savvas.andreas.moysi...@googlemail.com wrote: Hi Eric, could you please let us know where can we find more info about this notation ( fq={!field f=category})? What is

Re: fq field with facets

2011-02-23 Thread Erik Hatcher
On Feb 23, 2011, at 09:25 , Savvas-Andreas Moysidis wrote: Hi Eric, could you please let us know where can we find more info about this notation ( fq={!field f=category})? What is it called, how to use it etc? Is there a wiki page? There's some details of this here:

Re: Problem with XML encode UFT-8

2011-02-23 Thread jayronsoares
Hi Jan, I appreciate you attention. I've tried to answer your questions to the best of my knowledge. 2011/2/22 Jan Høydahl / Cominvent [via Lucene] ml-node+2551500-1071759141-363...@n3.nabble.com Hi, Please explain some more. a) What version of Solr? Solr version 1.4 b) Are you

Re: fq field with facets

2011-02-23 Thread Stefan Matheis
On Wed, Feb 23, 2011 at 3:57 PM, Erik Hatcher erik.hatc...@gmail.com wrote: There's some details of this here: http://wiki.apache.org/solr/SolrQuerySyntax Oh yes, i'm wrong - just ignore my post .. got confused from the similar syntax, i'm sorry.

Re: fq field with facets

2011-02-23 Thread Rosa (Anuncios)
Thanks Erik, this works well. the only thing, but i'm not sure is comes from there is with the accents: q=memoire+sdfq={!field f=category}Electronique++Cartes+mémoires any tricks for that? I've noticed that i've got the same issue in a normal simple query? Le 23/02/2011 15:17, Erik Hatcher

Re: fq field with facets

2011-02-23 Thread Erik Hatcher
On Feb 23, 2011, at 10:06 , Rosa (Anuncios) wrote: Thanks Erik, this works well. the only thing, but i'm not sure is comes from there is with the accents: q=memoire+sdfq={!field f=category}Electronique++Cartes+mémoires any tricks for that? Hard to say what the problem is. Maybe it

Re: fq field with facets

2011-02-23 Thread Rosa (Anuncios)
I've got it, the problem was from php-solr-client... for some reason the php urlencode function does not work in this script? So the accent are not converted. Thanks anyway Le 23/02/2011 16:11, Erik Hatcher a écrit : On Feb 23, 2011, at 10:06 , Rosa (Anuncios) wrote: Thanks Erik, this

Re: fq field with facets

2011-02-23 Thread Bill Bell
Double quotes should work as well. Bill Bell Sent from mobile On Feb 23, 2011, at 7:17 AM, Erik Hatcher erik.hatc...@gmail.com wrote: Try - fq={!field f=category}insert value, URL encoded of course, here You can also try surrounding with quotes, but that gets tricky and you'll need

Re: Problem with XML encode UFT-8

2011-02-23 Thread Bill Bell
Certain Utf characters are not valid and need to be stripped. BOT etc. Bill Bell Sent from mobile On Feb 23, 2011, at 5:29 AM, jayronsoares jayronsoa...@gmail.com wrote: Hi Jan, I appreciate you attention. I've tried to answer your questions to the best of my knowledge. 2011/2/22 Jan

Re: Sort Stability With Date Boosting and Rounding

2011-02-23 Thread Stephen Duncan Jr
That would improve things for recent documents, but documents that were close to each other, but a long time from NOW, would still have very small differences that would be susceptible to rounding errors that can cause results to get shuffled. Stephen Duncan Jr www.stephenduncanjr.com On Tue,

Re: Date Math

2011-02-23 Thread Andreas Kemkes
Thank you, that clarifies it. Good catch on -DAY. I had noticed it after submitting but as -1DAY causes the same ParseException, I didn't amend the question. Andreas From: Chris Hostetter hossman_luc...@fucit.org To: solr-user@lucene.apache.org Sent: Tue,

Re: hierarchical faceting, SOLR-792 - confused on config

2011-02-23 Thread kmf
I'm really confused now. Is this page completely out of date - http://wiki.apache.org/solr/HierarchicalFaceting - as it seems to imply that solr-792 is a form of hierarchical faceting. There are currently two similar, non-competing, approaches to generating tree/hierarchical facets from Solr:

Re: Sorting - bad performance

2011-02-23 Thread Ahmet Arslan
--- On Tue, 2/22/11, Jon Drukman j...@cluttered.com wrote: From: Jon Drukman j...@cluttered.com Subject: Sorting - bad performance To: solr-user@lucene.apache.org Date: Tuesday, February 22, 2011, 9:44 PM The performance factors wiki says: If you do a lot of field based sorting, it is

DataImportHandler in Solr 4.0

2011-02-23 Thread Alexandre Rocco
Hi guys, I'm having some issues when trying to use the DataImportHandler on Solr 4.0. I've downloaded the latest nightly build of Solr 4.0 and configured normally (on the example folder) solrconfig.xml file like this: requestHandler name=/dataimport

Getting lucene index differences

2011-02-23 Thread raimon.bosch
When you are working with full-imports in Solr you have to send over the net all your index to your slaves, with the correspondent loss of time and resources in some cases. Is it a way to get the differences between two indexes and send only the differences? -- View this message in context:

Re: Getting lucene index differences

2011-02-23 Thread Otis Gospodnetic
Raimon, You want to use incremental indexing instead of full reindexing. Look for deltaQuery mentions on DIH Wiki page. Otis Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch Lucene ecosystem search :: http://search-lucene.com/ - Original Message From: raimon.bosch

Re: Indexing languages, dataimporthandler

2011-02-23 Thread Otis Gospodnetic
Hi Greg, I think you simply need to ID the language (e.g. Using Lang ID like http://sematext.com/products/language-identifier/index.html ) and then analyze/index it appropriately. Otis Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch Lucene ecosystem search ::

Re: Question about Nested Span Near Query

2011-02-23 Thread Otis Gospodnetic
Hi, What do you mean by this doesn't work fine? Does it not work correctly or is it slow or ... I was going to suggest you look at Surround QP, but it looks like you already did that. Wouldn't it be better to get Surround QP to work? Otis Sematext :: http://sematext.com/ :: Solr -

Spellcheck Phrases

2011-02-23 Thread Tanner Postert
right now when I search for 'brake a leg', solr returns valid results with no indication of misspelling, which is understandable since all of those terms are valid words and are probably found in a few pieces of our content. My question is: is there any way for it to recognize that the phase

Re: AlternateDistributedMLT.patch not working

2011-02-23 Thread Otis Gospodnetic
Hi Isha, The patch is out of date. You need to look at the patch and rejection and update your local copy of the code to match the logic from the patch, if it's still applicable to the version of Solr source code you have. Otis Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch

Re: Faceting

2011-02-23 Thread Otis Gospodnetic
Hi Praveen, I know this is not your original question, but if you have a product search system, you should really look into adding auto-completion of queries to it. Concretely, you probably want to start with auto-suggesting product names. People like this, know how to use it, and it allows

More Date Math: NOW/WEEK

2011-02-23 Thread Andreas Kemkes
Date Math is great. NOW/MONTH, NOW/DAY are all working and very useful, so naively I tried NOW/WEEK, which failed. Digging into the source code of DateMathParser.java, i found the following comment: 99 // NOTE: consciously choosing not to support WEEK at this time, 100 //

Re: Getting lucene index differences

2011-02-23 Thread raimon.bosch
Hi Otis, The problem is that we are using hadoop for batch index building. So in this case we are not capable to do incremental indexing by now. It will be cool if we could simulate incremental indexing only for the index uploads. -- View this message in context:

Re: Sort Stability With Date Boosting and Rounding

2011-02-23 Thread Markus Jelsma
Hi, This seems to be a tricky issue judging from the other replies. I'm just thinking out of the box now and the following options come to mind: 1) can you store the timestamp in the session in your middleware for each user? This way it stays fixed and doesn't change the order between

Re: UpdateProcessor and copyField

2011-02-23 Thread Teruhiko Kurosaka
Jan, So you are implying that the fields made by copyField are not processed by UpdateProcessors, right? Erik, Logically this makes sense but then copyField operations must move to solrconfig.xml? Editing solrconfig.xml is more challenging than schema.xml, I feel. Kuro On 2/23/11 2:09 AM, Erik

Re: Solr Ajax

2011-02-23 Thread Markus Jelsma
Hi, I may have misread it all but SolrJ is the Java client and you don't need it for a pretty AJAX interface. Cheers, Hello list, I'm in the process of trying to implement Ajax within my Solr-backed webapp I have been reading both the Solrj wiki as well as the tutorial provided via the

DataImportHandler in Solr 4.0

2011-02-23 Thread Alexandre Rocco
Hi guys, I'm having some issues when trying to use the DataImportHandler on Solr 4.0. I've downloaded the latest nightly build of Solr 4.0 and configured normally (on the example folder) solrconfig.xml file like this: requestHandler name=/dataimport

Re: Help with parsing configuration using SolrParams/NamedList

2011-02-23 Thread Markus Jelsma
Hi, The params you have suggest you're planning to use SweetSpotSimilarity. There already is a factory you can use in Jira. https://issues.apache.org/jira/browse/SOLR-1365 Cheers, Hi, I'm trying to use a CustomSimilarityFactory and pass in per-field options from the schema.xml, like so:

Re: Detailed Steps for Scaling Solr

2011-02-23 Thread Markus Jelsma
Hi, Scaling might be required. How large is the index going to be in number of documents, fields and bytes and what hardware do you have? Powerful CPU's and a lot of RAM will help. And, how many queries per second do you expect? And how many updates per minute? Depending on average document

Re: UpdateProcessor and copyField

2011-02-23 Thread Yonik Seeley
On Wed, Feb 23, 2011 at 5:09 AM, Erik Hatcher erik.hatc...@gmail.com wrote: Maybe copy fields should be refactored to happen in a new, core, update processor, so there is nothing special/awkward about them?  It seems they fit as part of what an update processor is all about,

Re: 1.4.1 replication failure is still 200 OK

2011-02-23 Thread Markus Jelsma
Hi, I'd guess a non-200 HTTP response code would be more appropriate indeed but it's just a detail. A successful replication will change a few things on the slave: - increment of generation value - updated indexVersion value - lastReplication will have a new timestamp You can also check for a

MailEntityProcessor

2011-02-23 Thread Husrev Yilmaz
Hi, I am new to Solr, without any Java knowledge. I downloaded and run Solr under Tomcat. At the other hand I have a working IMAP server on the same machine. I want to index Date, From, To, Cc, Bcc, Subject, Body. How can I set up Solr to do this? Could you write a small guide to help me?

Re: [ANN] new SolrMeter release

2011-02-23 Thread Lance Norskog
Cool! On 2/23/11, Tomás Fernández Löbbe tomasflo...@gmail.com wrote: Hi All, I'm happy to announce a new release of SolrMeter, an open source stress test tool for Solr. You can obtain the code or executable jar from the google code page at: http://code.google.com/p/solrmeter There have

Re: MailEntityProcessor

2011-02-23 Thread Smiley, David W.
I assume you found this?: http://wiki.apache.org/solr/MailEntityProcessor You don't provide enough information to get assistance when you simply say I couldn't get it working. (disclaimer: I haven't used DIH's mail feature) ~ David On Feb 23, 2011, at 5:15 PM, Husrev Yilmaz wrote: Hi, I am

Re: DataImportHandler in Solr 4.0

2011-02-23 Thread Smiley, David W.
The DIH is no longer supplied embedded in the Solr war file. You need to get it on the classpath somehow. You could add another lib... statement to solrconfig.xml to resolve this. ~ David Smiley Author: http://www.packtpub.com/solr-1-4-enterprise-search-server/ On Feb 23, 2011, at 4:11 PM,

Re: fq field with facets

2011-02-23 Thread Chris Hostetter
: fq={!field f=category}insert value, URL encoded of course, here There are subtle nuanced cases where field won't work properly, which is why i usually recommend raw, but there are also subtle nuanced cases where raw won't work either (although in my opinion those cases are much less

Re: DataImportHandler in Solr 4.0

2011-02-23 Thread Estrada Groups
Curious...why was this feature removed? Adam On Feb 23, 2011, at 6:55 PM, Smiley, David W. dsmi...@mitre.org wrote: The DIH is no longer supplied embedded in the Solr war file. You need to get it on the classpath somehow. You could add another lib... statement to solrconfig.xml to resolve

Re: [ANN] new SolrMeter release

2011-02-23 Thread Savvas-Andreas Moysidis
Nice! will definitely give it a try! :) On 23 February 2011 22:55, Lance Norskog goks...@gmail.com wrote: Cool! On 2/23/11, Tomás Fernández Löbbe tomasflo...@gmail.com wrote: Hi All, I'm happy to announce a new release of SolrMeter, an open source stress test tool for Solr. You can

Re: DataImportHandler in Solr 4.0

2011-02-23 Thread Bill Bell
It is a contrib module. But the example solrconfig should have the lib set. Bill Bell Sent from mobile On Feb 23, 2011, at 5:13 PM, Estrada Groups estrada.adam.gro...@gmail.com wrote: Curious...why was this feature removed? Adam On Feb 23, 2011, at 6:55 PM, Smiley, David W.

Re: MailEntityProcessor

2011-02-23 Thread Lance Norskog
The DIH config does not mention port numbers, or security options. I recently wrote a custom app to download and index mail- there were several complexities (the above problems, attachments, calculating mail threads). I think your best bet is to find a utility that downloads mail into mbox files.

Re: DataImportHandler in Solr 4.0

2011-02-23 Thread Chris Hostetter
: Curious...why was this feature removed? it hasn't been removed, it still ships with the solr releases as a contrib jar the same way it always did. what changed is that in the past it was mistakenly/foolishly/inexplicable also included in the solr.war -- even though it didn't need to be.

Re: DataImportHandler in Solr 4.0

2011-02-23 Thread Alexandre Rocco
I got it working by building the DIH from the contrib folder and made a change on the lib statements to map the folder that contains the .jar files. Thanks! Alexandre On Wed, Feb 23, 2011 at 8:55 PM, Smiley, David W. dsmi...@mitre.org wrote: The DIH is no longer supplied embedded in the Solr

Re: UpdateProcessor and copyField

2011-02-23 Thread Chris Hostetter
: Maybe copy fields should be refactored to happen in a new, core, : update processor, so there is nothing special/awkward about them?  It : seems they fit as part of what an update processor is all about, : augmenting/modifying incoming documents. : : Seems reasonable. : By default, the

Re: taxonomy faceting

2011-02-23 Thread Chris Hostetter
: I have many taxonomies and each document can apply to some of them. I dont : know how many taxonomies they are, so i cant define a field in the schema : for each taxonomy (one field per each taxonomy). : : I want to use these feature but i need to know if i can handle the context : where each

Re: disable replication in a persistent way

2011-02-23 Thread Otis Gospodnetic
Hi, - Original Message From: Ahmet Arslan iori...@yahoo.com Subject: disable replication in a persistent way Hello, solr/replication?command=disablepoll disables replication on slave(s). However it is not persistent. After solr/tomcat restart, slave(s) will continue

custom query parameters

2011-02-23 Thread Michael Moores
I'm required to provide a handler with some specialized query string inputs. I'd like to translate the query inputs to a lucene/solr query and delegate the request to the existing lucene/dismax handler. What's the best way to do this? Do I implement SolrRequestHandler, or a QParser? Do I

Re: Question about Nested Span Near Query

2011-02-23 Thread Ahsan |qbal
Hi It didn't search.. (means no results found even results exist) one observation is that it works well even in the long phrases but when the long phrases contain stop words and same stop word exist two or more time in the phrase then, solr can't search with query parsed in this way. On Wed,

Re: custom query parameters

2011-02-23 Thread Michael Moores
Trying to answer my own question.. seems like it would be a good idea to create a SearchComponent and add this to the list of existing components. My component just converts query parameters to something that the solr QueryComponent understands. One good way of doing it? On Feb 23, 2011, at

Re: fq field with facets

2011-02-23 Thread dhanesh
Hi I have faced the same problem and I solved it by adding double quotes dhanesh s.r On 2/23/2011 7:47 PM, Erik Hatcher wrote: Try - fq={!field f=category}insert value, URL encoded of course, here You can also try surrounding with quotes, but that gets tricky and you'll need to escape