Re: Dynamically loading xml files from webapplication to index

2011-04-28 Thread Grijesh
You need to write some script using solrj or some other connector to parse your data file and post to solr for indexing - Thanx: Grijesh www.gettinhahead.co.in -- View this message in context:

XS DateTime format

2011-04-28 Thread Jens Flaaris
Hi, I just have a small question regarding the output format of fields of type TrieDateField. If a document containing the date 0001-01-01T01.01.01Z is passed to Solr and I then try to search for that document the output of the date field is of format Y-MM-DDThh:mm:ssZ. The first three zeros

fq parameter with partial value

2011-04-28 Thread elisabeth benoit
Hello, I would like to know if there is a way to use the fq parameter with a partial value. For instance, if I have a request with fq=NAME:Joe, and I would like to retrieve all answers where NAME contains Joe, including those with NAME = Joe Smith. Thanks, Elisabeth

Re: fq parameter with partial value

2011-04-28 Thread Stefan Matheis
Hi Elisabeth, that's not what FilterQueries are made for :) What against using that Criteria in the Query? Perhaps you want to describe your UseCase and we'll see if there's another way to solve it? Regards Stefan On Thu, Apr 28, 2011 at 9:09 AM, elisabeth benoit elisaelisael...@gmail.com

Spatial Search

2011-04-28 Thread Jonas Lanzendörfer
Dear list :) I am new to solr and try to use the spatial search feature which was added in 3.1. In my schema.xml I have 2 double fields for latitude and longitude. How can I get them into the location field type? I use solrj to fill the index with data. If I would use a location field instead

Re: fq parameter with partial value

2011-04-28 Thread elisabeth benoit
Hi Stefan, Thanks for answering. In more details, my problem is the following. I'm working on searching points of interest (POIs), which can be hotels, restaurants, plumbers, psychologists, etc. Those POIs can be identified among other things by categories or by brand. And a single POIs might

how to update database record after indexing

2011-04-28 Thread vrpar...@gmail.com
Hello, i am using dataimporthandler to import data from sql server database. my requirement is when solr completed indexing on particular database record i want to update that record in database or after indexing all records if i can get all ids and update all records how to achieve same ?

manual background re-indexing

2011-04-28 Thread Paul Libbrecht
Hello list, I am planning to implement a setup, to be run on unix scripts, that should perform a full pull-and-reindex in a background server and index then deploy that index. All should happen on the same machine. I thought the replication methods would help me but they seem to rather solve

Re: Formatted date/time in long field and javabinRW exception

2011-04-28 Thread Markus Jelsma
Any thoughts on this one? Why does Solr output a string in a long field with XMLResponseWriter but fails doing so (as it should) with the javabin format? On Tuesday 19 April 2011 10:52:33 Markus Jelsma wrote: Hi, Nutch 1.3-dev seems to have changed its tstamp field from a long to a properly

Re: manual background re-indexing

2011-04-28 Thread Shaun Campbell
Hi Paul Would a multi-core set up and the swap command do what you want it to do? http://wiki.apache.org/solr/CoreAdmin Shaun On 28 April 2011 12:49, Paul Libbrecht p...@hoplahup.net wrote: Hello list, I am planning to implement a setup, to be run on unix scripts, that should perform a

Re: fq parameter with partial value

2011-04-28 Thread Erick Erickson
So, I assume your CATEGORY field is multiValued but each value is not broken up into tokens, right? If that's the case, would it work to have a second field CATEGORY_TOKENIZED and run your fq against that field instead? You could have this be a multiValued field with an increment gap if you

Re: how to update database record after indexing

2011-04-28 Thread Erick Erickson
I don't think you can do this through DIH, you'll probably have to write a separate process that queries the Solr index and updates your table. You'll have to be a bit cautious that you coordinate the commits, that is wait for the DIH to complete and commit before running your separate db update

Re: Spatial Search

2011-04-28 Thread Yonik Seeley
On Thu, Apr 28, 2011 at 5:15 AM, Jonas Lanzendörfer jonas.lanzendoer...@affinitas.de wrote: I am new to solr and try to use the spatial search feature which was added in 3.1. In my schema.xml I have 2 double fields for latitude and longitude. How can I get them into the location field type? I

Re: manual background re-indexing

2011-04-28 Thread Paul Libbrecht
Just where to do I put the new index data with such a command? Simply replacing the segment files appears dangerous to me. Also, what is the best practice to move from single-core to multi-core? My current set-up is single-core, do I simply need to add a solr.xml in my solr-home and one core1

Re: manual background re-indexing

2011-04-28 Thread Erick Erickson
It would probable be safest just to set up a separate system as multi-core from the start, get the process working and then either use the new machine or copy the whole setup to the production machine. Best Erick On Thu, Apr 28, 2011 at 8:49 AM, Paul Libbrecht p...@hoplahup.net wrote: Just

Re: fq parameter with partial value

2011-04-28 Thread elisabeth benoit
yes, the multivalued field is not broken up into tokens. so, if I understand well what you mean, I could have a field CATEGORY with multiValued=true a field CATEGORY_TOKENIZED with multiValued= true and then some POI field name=NAMEPOI_Name/field ... field name=*CATEGORY*Restaurant

RE: fq parameter with partial value

2011-04-28 Thread Jonathan Rochkind
Yep, what you describe is what I do in similar situations, it works fine. It is certainly possible to facet on a tokenized field... but your individual facet values will be the _tokens_, not the complete values. And they'll be the post-analyzed tokens at that. Which is rarely what you want.

boost fields which have value

2011-04-28 Thread Zoltán Altfatter
Hi, How can I achieve that documents which don't have field1 and field2 filled in, are returned in the end of the search result. I have tried with *bf* parameter, which seems to work but just with one field. Is there any function query which I can use in bf value to boost two fields? Thank

Boost newer documents only if date is different from timestamp

2011-04-28 Thread Dietrich
I am trying to boost newer documents in Solr queries. The ms function http://wiki.apache.org/solr/SolrRelevancyFAQ#How_can_I_boost_the_score_of_newer_documents seems to be the right way to go, but I need to add an additional condition: I am using the last-Modified-Date from crawled web pages as

Searching for escaped characters

2011-04-28 Thread Paul
I'm trying to create a test to make sure that character sequences like egrave; are successfully converted to their equivalent utf character (that is, in this case, è). So, I'd like to search my solr index using the equivalent of the following regular expression: \w{1,6}; To find any escaped

Re: Concatenate multivalued DIH fields

2011-04-28 Thread jimtronic
I solved this problem using the flatten=true attribute. Given this schema people person names name firstNameJoe/firstName lastNameSmith/firstName /name /names /person /people field column=attr_names xpath=/people/person/names/name flatten=true / attr_names is a multiValued

RE: boost fields which have value

2011-04-28 Thread Robert Petersen
I believe the sortMissingLast fieldtype attribute is what you want: fieldType ... sortMissingLast=true ... / http://wiki.apache.org/solr/SchemaXml -Original Message- From: Zoltán Altfatter [mailto:altfatt...@gmail.com] Sent: Thursday, April 28, 2011 6:11 AM To:

Re: Searching for escaped characters

2011-04-28 Thread Mike Sokolov
StandardTokenizer will have stripped punctuation I think. You might try searching for all the entity names though: (agrave | egrave | omacron | etc... ) The names are pretty distinctive. Although you might have problems with greek letters. -Mike On 04/28/2011 12:10 PM, Paul wrote: I'm

Re: SolrQuery#setStart(Integer) ???

2011-04-28 Thread Leonardo Souza
Hi Erick, Correct, i cut some zeros while reading the javadocs, thanks for the heads up! [ ]'s Leonardo da S. Souza °v° Linux user #375225 /(_)\ http://counter.li.org/ ^ ^ On Wed, Apr 27, 2011 at 8:13 PM, Erick Erickson erickerick...@gmail.comwrote: Well, the java native int fomat

Re: Replicaiton Fails with Unreachable error when master host is responding.

2011-04-28 Thread Jed Glazner
Anybody? On 04/27/2011 01:51 PM, Jed Glazner wrote: Hello All, I'm having a very strange problem that I just can't figure out. The slave is not able to replicate from the master, even though the master is reachable from the slave machine. I can telnet to the port

Re: Replicaiton Fails with Unreachable error when master host is responding.

2011-04-28 Thread Mike Sokolov
No clue. Try wireshark to gather more data? On 04/28/2011 02:53 PM, Jed Glazner wrote: Anybody? On 04/27/2011 01:51 PM, Jed Glazner wrote: Hello All, I'm having a very strange problem that I just can't figure out. The slave is not able to replicate from the master, even though the master is

Re: fq parameter with partial value

2011-04-28 Thread Erick Erickson
See below: On Thu, Apr 28, 2011 at 9:03 AM, elisabeth benoit elisaelisael...@gmail.com wrote: yes, the multivalued field is not broken up into tokens. so, if I understand well what you mean, I could have a field CATEGORY with  multiValued=true a field CATEGORY_TOKENIZED with  multiValued=

Re: Extra facet query from within a custom search component

2011-04-28 Thread Erick Erickson
Have you looked at: http://wiki.apache.org/solr/TermsComponent? Best Erick On Thu, Apr 28, 2011 at 2:44 PM, Frederik Kraus frederik.kr...@gmail.com wrote: Hi Guys, I'm currently working on a custom search component and need to fetch a list of all possible values within a certain field. An

Problem with autogeneratePhraseQueries=false

2011-04-28 Thread solr_beginner
Hi,   I'm new to solr. My solr instance version is:   Solr Specification Version: 3.1.0 Solr Implementation Version: 3.1.0 1085815 - grantingersoll - 2011-03-26 18:00:07 Lucene Specification Version: 3.1.0 Lucene Implementation Version: 3.1.0 1085809 - 2011-03-26 18:06:58 Current Time: Tue Apr 26

Re: Problem with autogeneratePhraseQueries

2011-04-28 Thread Marcin Kostuch
Thank you very much for answer. You were right. There was no luceneMatchVersion in solrconfig.xml of our dev core. We thought that values not present in core configuration are copied from main solrconfig.xml. I will investigate if our administrators did something wrong during upgrade to 3.1. On

Dynamically loading xml files from webapplication to index

2011-04-28 Thread sankar
In our webapp, we need to upload a xml data file from the UI(dialogue box) for indexing we are not able to find the solution in documentation. plz suggest what is the way to implement it -- View this message in context:

Re: fieldCache only on stats page

2011-04-28 Thread Marcin Kostuch
Solr version: Solr Specification Version: 3.1.0 Solr Implementation Version: 3.1.0 1085815 - grantingersoll - 2011-03-26 18:00:07 Lucene Specification Version: 3.1.0 Lucene Implementation Version: 3.1.0 1085809 - 2011-03-26 18:06:58 Current Time: Wed Apr 27 14:28:34 CEST 2011 Server Start

Re: Extra facet query from within a custom search component

2011-04-28 Thread Frederik Kraus
Haaa fantastic! Thanks a lot! Fred. On Donnerstag, 28. April 2011 at 22:21, Erick Erickson wrote: Have you looked at: http://wiki.apache.org/solr/TermsComponent? Best Erick On Thu, Apr 28, 2011 at 2:44 PM, Frederik Kraus frederik.kr...@gmail.com wrote: Hi Guys, I'm currently

Re: AlternateDistributedMLT.patch not working (SOLR-788)

2011-04-28 Thread Shawn Heisey
On 2/23/2011 11:53 AM, Otis Gospodnetic wrote: Hi Isha, The patch is out of date. You need to look at the patch and rejection and update your local copy of the code to match the logic from the patch, if it's still applicable to the version of Solr source code you have. We have a need for

Re: Spatial Search

2011-04-28 Thread Jan Høydahl
1) Create an extra String field on your bean as Yonik suggests or 2) Write an UpdateRequestHandler which reads the doubles and creates the LatLon from that -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com On 28. apr. 2011, at 14.44, Yonik Seeley wrote: On Thu, Apr

Rép : Re: manual background re-indexing

2011-04-28 Thread Paul Libbrecht
It would probable be safest just to set up a separate system as multi-core from the start, get the process working and then either use the new machine or copy the whole setup to the production machine. On Thu, Apr 28, 2011 at 8:49 AM, Paul Libbrecht p...@hoplahup.net wrote: Just where to do

Re: Rép : Re: manual background re-indexing

2011-04-28 Thread Erick Erickson
You simply create two cores. One in solr/cores/core1 and another in solr/cores/core2 They each have a separate conf and data directory,and the index in in core#/data/index. Really, its' just introducing one more level. You can experiment just by configuring a core and copying your index to

Location of Solr Logs

2011-04-28 Thread Geeta Subramanian
Hi, I am newbee to SOLR. Can you please help me to know where can see the logs written by SOLR? Is there any configuration required to see the logs of SOLR? Thanks for your time and help, Geeta **Legal Disclaimer*** This communication may contain

Can the Suggester be updated incrementally?

2011-04-28 Thread Andy
I'm interested in using Suggester (http://wiki.apache.org/solr/Suggester) for auto-complete on the field Document Title. Does Suggester (either FST, TST or Jaspell) support incremental updates? Say I want to add a new document title to the Suggester, or to change the weight of an existing

Re: Can the Suggester be updated incrementally?

2011-04-28 Thread Jason Rutherglen
It's answered on the wiki site: TSTLookup - ternary tree based representation, capable of immediate data structure updates Although the EdgeNGram technique is probably more widely adopted, eg, it's closer to what Google has implemented.

Re: Question on Batch process

2011-04-28 Thread Otis Gospodnetic
Charles, Maybe the question to ask is why you are committing at all? Do you need somebody to see index changes while you are indexing? If not, commit just at the end. And optimize if you won't touch the index for a while. Otis Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch