RE: How to read values from dataimport.properties in a production environment

2011-11-18 Thread Ephraim Ofir
You can add it yourself in admin-extra.html Ephraim Ofir -Original Message- From: Nico Luna [mailto:nicolaslun...@gmail.com] Sent: Friday, November 11, 2011 7:57 PM To: solr-user@lucene.apache.org Subject: How to read values from dataimport.properties in a production environment I'm

RE: DIH import and postImportDeleteQuery

2011-05-25 Thread Ephraim Ofir
Search the list for my post DIH - deleting documents, high performance (delta) imports, and passing parameters which shows my solution a similar problem. Ephraim Ofir -Original Message- From: Alexandre Rocco [mailto:alel...@gmail.com] Sent: Tuesday, May 24, 2011 11:24 PM To: solr-user

RE: How could each core share configuration files

2011-04-20 Thread Ephraim Ofir
I just use soft-links... Ephraim Ofir -Original Message- From: lboutros [mailto:boutr...@gmail.com] Sent: Wednesday, April 20, 2011 10:09 AM To: solr-user@lucene.apache.org Subject: Re: How could each core share configuration files Perhaps this could help : http://lucene.472066.n3

RE: Fast DIH with 1:M multValue entities

2011-04-17 Thread Ephraim Ofir
Search the list for my post DIH - deleting documents, high performance (delta) imports, and passing parameters which shows a different approach to 1:M sub entities Ephraim Ofir -Original Message- From: Tim Gilbert [mailto:tim.gilb...@morningstar.com] Sent: Thursday, April 14, 2011 6:02

RE: Very very large scale Solr Deployment = how to do (Expert Question)?

2011-04-07 Thread Ephraim Ofir
You can't view it online, but you should be able to download it from: https://docs.google.com/leaf?id=0BwOEbnJ7oeOrNmU5ZThjODUtYzM5MS00YjRlLWI 2OTktZTEzNDk1YmVmOWU4hl=enauthkey=COGel4gP Enjoy, Ephraim Ofir -Original Message- From: Jens Mueller [mailto:supidupi...@googlemail.com] Sent

RE: FW: Very very large scale Solr Deployment = how to do (Expert Question)?

2011-04-06 Thread Ephraim Ofir
core for this instance -- indexers have 2 cores, one prod and one for full reindex /cores /solr Let me know if I can assist any further. Ephraim Ofir -Original Message- From: Jonathan DeMello [mailto:demello@googlemail.com

RE: Very very large scale Solr Deployment = how to do (Expert Question)?

2011-04-05 Thread Ephraim Ofir
might want to look into SolrCloud as well. Ephraim Ofir -Original Message- From: Jens Mueller [mailto:supidupi...@googlemail.com] Sent: Tuesday, April 05, 2011 4:25 AM To: solr-user@lucene.apache.org Subject: Very very large scale Solr Deployment = how to do (Expert Question)? Hello

RE: multicore controlled by properties

2011-01-09 Thread Ephraim Ofir
I use a script to generate the appropriate solr.xml for each host according to a config file. You could also prepare separate files and create a soft link from solr.xml to the appropriate one on each host. Ephraim Ofir -Original Message- From: Lance Norskog [mailto:goks...@gmail.com

RE: DataImportHanlder - Multiple entities will step into each other

2011-01-05 Thread Ephraim Ofir
You could get around that by doing the concatenation at the SQL level, that way deletes would work as well. Ephraim Ofir -Original Message- From: Matti Oinas [mailto:matti.oi...@gmail.com] Sent: Tuesday, January 04, 2011 3:57 PM To: solr-user@lucene.apache.org Subject: Re

RE: UPDATE query in deltaquery

2010-12-30 Thread Ephraim Ofir
This may sound silly, but are you sure the user you're using has permissions to do the updates you want? Not sure about postgres but I think some jdbc's require that the connection be defined as rw, maybe you should try adding readOnly=false to your jdbc definition. Ephraim Ofir -Original

RE: UPDATE query in deltaquery

2010-12-30 Thread Ephraim Ofir
Does your function get_deltaimport_items perform the update first and then the select? Does it make a difference if you change the order? Did you try omitting the TRANSACTION_SERIALIZABLE part? Ephraim Ofir -Original Message- From: Juan Manuel Alvarez [mailto:naici...@gmail.com] Sent

RE: Dataimport performance

2010-12-16 Thread Ephraim Ofir
Check out http://mail-archives.apache.org/mod_mbox/lucene-solr-user/201008.mbox/%3c9f8b39cb3b7c6d4594293ea29ccf438b01702...@icq-mail.icq.il.office.aol.com%3e This approach of not using sub entities really improved our load time. Ephraim Ofir -Original Message- From: Robert Gründler

RE: Corename after Swap in MultiCore

2010-11-07 Thread Ephraim Ofir
mean to. Are you using DIH? If so, I'd go with querying the status of the import until it's done and then performing the swap. Ephraim Ofir -Original Message- From: sivaram [mailto:yogendra.bopp...@gmail.com] Sent: Wednesday, November 03, 2010 4:46 PM To: solr-user@lucene.apache.org

RE: Updating last_modified field when using DIH

2010-11-03 Thread Ephraim Ofir
/mod_mbox/lucene-solr-user/201008.mbox/%3 c9f8b39cb3b7c6d4594293ea29ccf438b01702...@icq-mail.icq.il.office.aol.com %3E Ephraim Ofir -Original Message- From: Stefan Matheis [mailto:matheis.ste...@googlemail.com] Sent: Wednesday, November 03, 2010 12:58 PM To: solr-user@lucene.apache.org Subject

RE: Solr MySQL Adding new column to table

2010-11-02 Thread Ephraim Ofir
Not if you use 'SELECT * FROM person' Ephraim Ofir -Original Message- From: nitin.vanaku...@gmail.com [mailto:nitin.vanaku...@gmail.com] Sent: Tuesday, November 02, 2010 11:19 AM To: solr-user@lucene.apache.org Subject: RE: Solr MySQL Adding new column to table Hi Sivaprasad, first

RE: Solr MySQL Adding new column to table

2010-11-02 Thread Ephraim Ofir
Your uniqueKey field is defined as id (in schema.xml) and your query doesn't return an id field. Ephraim Ofir -Original Message- From: nitin.vanaku...@gmail.com [mailto:nitin.vanaku...@gmail.com] Sent: Tuesday, November 02, 2010 12:10 PM To: solr-user@lucene.apache.org Subject: RE: Solr

RE: If I want to move a core from one physical machine to another....

2010-10-28 Thread Ephraim Ofir
How is this better than replication? Ephraim Ofir -Original Message- From: Ken Stanley [mailto:doh...@gmail.com] Sent: Thursday, October 28, 2010 1:59 PM To: solr-user@lucene.apache.org Subject: Re: If I want to move a core from one physical machine to another On Wed, Oct 27, 2010

RE: How to index on basis of a condition?

2010-10-26 Thread Ephraim Ofir
This is probably just a date format problem, nothing to do with the IF() statement. Try applying this on your date: DATE_FORMAT(yourDate, '%Y-%m-%dT00:00:00Z') Ephraim Ofir -Original Message- From: Pawan Darira [mailto:pawan.dar...@gmail.com] Sent: Tuesday, October 26, 2010 12:26 PM

RE: Does Solr reload schema.xml dynamically?

2010-10-26 Thread Ephraim Ofir
Note that usually when you change the schema.xml you have not only to restart solr, but also rebuild the index, so the issue of how to reload the file seems like a small problem... Ephraim Ofir -Original Message- From: Peter Karich [mailto:peat...@yahoo.de] Sent: Tuesday, October 26

RE: How to index on basis of a condition?

2010-10-26 Thread Ephraim Ofir
Try: select IF(sub_cat_id=2002, DATE_FORMAT(ad_post_date, '%Y-%m-%dT00:00:00Z/DAY'), null) as 'ad_sort_field' from tcuser.ad_details where SOME_CONDiTION Ephraim Ofir -Original Message- From: Pawan Darira [mailto:pawan.dar...@gmail.com] Sent: Tuesday, October 26, 2010 1:29 PM To: solr

RE: How to index on basis of a condition?

2010-10-25 Thread Ephraim Ofir
/solr/DataImportHandler#RegexTransformer) or (worst case and worst performance) ScriptTransformer(http://wiki.apache.org/solr/DataImportHandler#ScriptTransformer) and actually write a JS script to do your logic. Ephraim Ofir -Original Message- From: Jan Høydahl / Cominvent [mailto:jan

RE: DIH delta-import question

2010-10-19 Thread Ephraim Ofir
According to the DIH wiki, delta-import is only supported by sql (http://wiki.apache.org/solr/DataImportHandler#Using_delta-import_comman d-1) Ephraim Ofir -Original Message- From: Bernd Fehling [mailto:bernd.fehl...@uni-bielefeld.de] Sent: Friday, October 15, 2010 8:20 AM To: solr

RE: DIH - configure password in 1 place and store it in encrypted form?

2010-10-19 Thread Ephraim Ofir
configuration for all cores with soft-linked config files, so I only have to change the config in one place. Ephraim Ofir -Original Message- From: Gora Mohanty [mailto:g...@mimirtech.com] Sent: Sunday, October 17, 2010 7:05 PM To: solr-user@lucene.apache.org Subject: Re: DIH - configure

RE: multicore defaultCoreName not working

2010-10-13 Thread Ephraim Ofir
Which version of solr are you using? I believe this is only available on trunk, not even on 1.4.1 (SOLR-1722). Also, watch out for SOLR-2127 bug, haven't gotten around to creating a patch yet... Ephraim Ofir -Original Message- From: Ron Chan [mailto:rc...@i-tao.com] Sent: Wednesday

RE: Speeding up solr indexing

2010-10-10 Thread Ephraim Ofir
imports, you can get serious improvement in performance by not using sub-entities http://mail-archives.apache.org/mod_mbox/lucene-solr-user/201008.mbox/%3c9f8b39cb3b7c6d4594293ea29ccf438b01702...@icq-mail.icq.il.office.aol.com%3e Ephraim Ofir -Original Message- From: Dennis Gearon

RE: multi level faceting

2010-10-05 Thread Ephraim Ofir
Take a look at Mastering the Power of Faceted Search with Chris Hostetter (http://www.lucidimagination.com/solutions/webcasts/faceting). I think there's an example of what you're looking for there. Ephraim Ofir -Original Message- From: Otis Gospodnetic [mailto:otis_gospodne...@yahoo.com

RE: DIH sub-entity not indexing

2010-10-04 Thread Ephraim Ofir
The closest you can get to debugging (without actually debugging...) is to look at the logs and use http://wiki.apache.org/solr/DataImportHandler#Interactive_Development_Mo de Ephraim Ofir -Original Message- From: Allistair Crossley [mailto:a...@roxxor.co.uk] Sent: Monday, October 04

RE: DIH sub-entity not indexing

2010-10-04 Thread Ephraim Ofir
to look into a different approach than sub-entities - http://mail-archives.apache.org/mod_mbox/lucene-solr-user/201008.mbox/%3 c9f8b39cb3b7c6d4594293ea29ccf438b01702...@icq-mail.icq.il.office.aol.com %3E Ephraim Ofir -Original Message- From: Allistair Crossley [mailto:a...@roxxor.co.uk

RE: Is Solr right for our project?

2010-10-03 Thread Ephraim Ofir
The shards parameter can be added by the search handler if you configure it to do so, then the client doesn't have to know about it. You can put your replicated shards behind a proxy/balancer which will check their health and that way fallback will be automatic. Ephraim Ofir -Original

RE: Concurrent DB updates and delta import misses few records

2010-09-26 Thread Ephraim Ofir
/lucene-solr-user/201009.mbox/%3 c9f8b39cb3b7c6d4594293ea29ccf438b0174c...@icq-mail.icq.il.office.aol.com %3e Ephraim Ofir -Original Message- From: Shashikant Kore [mailto:shashik...@gmail.com] Sent: Thursday, September 23, 2010 8:48 AM To: solr-user@lucene.apache.org Subject: Re

RE: DataImportHandler with multiline SQL

2010-09-19 Thread Ephraim Ofir
I'd go with moving this logic to the DB in a stored procedure... Ephraim Ofir | Reporting and Host Development team | ICQ P: +972 3 7665510 | M: + 972 52 4888510 | F: +972 3 7665566 | ICQ#: 18981 | E: ephra...@icq.com   -Original Message- From: David Yang [mailto:dy...@nextjump.com

RE: using variables/properties in dataconfig.xml

2010-09-16 Thread Ephraim Ofir
No, it's not possible. See workaround: http://mail-archives.apache.org/mod_mbox/lucene-solr-user/201008.mbox/%3c9f8b39cb3b7c6d4594293ea29ccf438b01702...@icq-mail.icq.il.office.aol.com%3e Ephraim Ofir | Reporting and Host Development team | ICQ P: +972 3 7665510 | M: + 972 52 4888510 | F: +972

RE: Delta Import with something other than Date

2010-09-12 Thread Ephraim Ofir
the query. Ephraim Ofir -Original Message- From: Shawn Heisey [mailto:s...@elyograg.org] Sent: Friday, September 10, 2010 4:54 AM To: solr-user@lucene.apache.org Subject: Re: Delta Import with something other than Date On 9/9/2010 1:23 PM, Vladimir Sutskever wrote: Shawn, Can you

RE: SolrJ and Multi Core Set up

2010-09-05 Thread Ephraim Ofir
you swap them your rebuild would become your live. Whenever you swap them a different one will point to the same data dir core0, but you won't really care which one points where. Ephraim Ofir -Original Message- From: Shaun Campbell [mailto:campbell.sh...@gmail.com] Sent: Friday

RE: Download document from solr

2010-09-05 Thread Ephraim Ofir
You could index into your id (or another field) the download url of the document and then use that to enable download of the document. Ephraim Ofir -Original Message- From: Lance Norskog [mailto:goks...@gmail.com] Sent: Friday, September 03, 2010 1:07 AM To: solr-user

DIH - deleting documents, high performance (delta) imports, and passing parameters

2010-08-30 Thread Ephraim Ofir
as soon as I get a chance. Hope this helps somebody and open to any suggestions, Ephraim Ofir

RE: How to delete documents from SOLR index using DIH

2010-08-26 Thread Ephraim Ofir
preImportDeleteQuery/postImportDeleteQuery in your full/delta query If you want to use any of these separately from your import, you can put them in a separate entity and do a full/delta import just on that entity. Ephraim Ofir -Original Message- From: Pawan Darira [mailto:pawan.dar...@gmail.com] Sent

RE: How to do ? Articles and Its Associated Comments Indexing , One to Many relationship

2010-08-26 Thread Ephraim Ofir
Why not define the comment field as multiValued? That way you only index each document once and you don't need to collapse anything... Ephraim Ofir -Original Message- From: Sumit Arora [mailto:sumit1...@gmail.com] Sent: Thursday, August 26, 2010 12:54 PM To: solr-user@lucene.apache.org

RE: Candidate Profile Search which have multiple employers and Educations.

2010-08-26 Thread Ephraim Ofir
to clarify the idea. You might have to pick a different field separator if pipe (|) might be in your data... Ephraim Ofir -Original Message- From: Sumit Arora [mailto:sumit1...@gmail.com] Sent: Thursday, August 26, 2010 1:36 PM To: solr-user@lucene.apache.org Subject: Candidate Profile Search