Re: Tika Integration problem with DIH and JDBC

2014-11-04 Thread Alexandre Rafalovitch
Yes, DIH (and used to be Solr schema parser too) is great at ignoring the things it does not know about and just using defaults instead. Regards, Alex. Personal: http://www.outerthoughts.com/ and @arafalov Solr resources and newsletter: http://www.solr-start.com/ and @solrstart Solr popularize

Re: Tika Integration problem with DIH and JDBC

2014-11-04 Thread Dan Davis
All, The problem here was that I gave driver="BinURLDataSource" rather than type="BinURLDataSource". Of course, saying driver="BinURLDataSource" caused it not to be able to find it.

Re: Problem with DIH

2014-10-16 Thread Dan Davis
This seems a little abstract. What I'd do is double check that the SQL is working correctly by running the stored procedure outside of Solr and see what you get. You should also be able to look at the corresponding .properties file and see the inputs used for the delta import. If the data impo

Problem with DIH

2014-10-15 Thread Jay Potharaju
Hi I 'm using DIH for updating my core. I 'm using store procedure for doing a full/ delta imports. In order to avoid running delta imports for a long time, i limit the rows returned to a max of 100,000 rows at a given time. On an average the delta import runs for less than 1 minute. For the last

Re: Tika Integration problem with DIH and JDBC

2014-10-10 Thread Dan Davis
it out, mention the Solr version on > the next email. Sometimes it makes difference, though DIH has been > largely unchanged for a while. > > -- Forwarded message -- > From: Dan Davis > Date: 10 October 2014 15:00 > Subject: Re: Tika Integration problem wit

Fwd: Tika Integration problem with DIH and JDBC

2014-10-10 Thread Alexandre Rafalovitch
er 2014 15:00 Subject: Re: Tika Integration problem with DIH and JDBC To: Alexandre Rafalovitch The definition of dataSource name="bin" type="BinURLDataSource" is in each of the dih-*.xml files. But only the xml version has the definition at the top, above the document. Mov

Re: Tika Integration problem with DIH and JDBC

2014-10-10 Thread Alexandre Rafalovitch
You say "dataSource='bin'" but I don't see you defining that datasource. E.g.: So, there might be some weird default fallback that's just causes strange problems. Regards, Alex. Personal: http://www.outerthoughts.com/ and @arafalov Solr resources and newsletter: http://www.solr-start.com/

Tika Integration problem with DIH and JDBC

2014-10-10 Thread Dan Davis
What I want to do is to pull an URL out of an Oracle database, and then use TikaEntityProcessor and BinURLDataSource to go fetch and process that URL. I'm having a problem with this that seems general to JDBC with Tika - I get an exception as follows: Exception in entity : extract:org.apache.sol

RE: Performance problem with DIH in solr 3.3

2012-04-23 Thread Dyer, James
[mailto:pravin_agra...@persistent.co.in] Sent: Monday, April 23, 2012 5:51 AM To: solr-user@lucene.apache.org Subject: Performance problem with DIH in solr 3.3 Hi All, I am using Delta import handler(solr 3.3) to index data from my database (using 19 tables) Total Number of solr documents that get

Performance problem with DIH in solr 3.3

2012-04-23 Thread Pravin Agrawal
Hi All, I am using Delta import handler(solr 3.3) to index data from my database (using 19 tables) Total Number of solr documents that get created from these 19 table is 444 Total number of request send to data source during clean full import is 91083. My problem is that, DIH makes too many

AW: Problem with DIH: How to map key value pair stored in 1-N relation from a JDBC Source?

2011-08-10 Thread Christian Bordis
k.com] Gesendet: Dienstag, 9. August 2011 16:03 An: solr-user@lucene.apache.org Betreff: RE: Problem with DIH: How to map key value pair stored in 1-N relation from a JDBC Source? Christian, It looks like you should probably write a Transformer for your DIH script. I assume you have a child entity set u

RE: Problem with DIH: How to map key value pair stored in 1-N relation from a JDBC Source?

2011-08-09 Thread Dyer, James
s [mailto:c.bor...@epages.com] Sent: Tuesday, August 09, 2011 5:22 AM To: 'solr-user@lucene.apache.org' Subject: Problem with DIH: How to map key value pair stored in 1-N relation from a JDBC Source? Hi! After 1,5 days digging on google, solr wiki, solr 1.4 book (Smiley/Pugh), solr-user m

Problem with DIH: How to map key value pair stored in 1-N relation from a JDBC Source?

2011-08-09 Thread Christian Bordis
Hi! After 1,5 days digging on google, solr wiki, solr 1.4 book (Smiley/Pugh), solr-user mailing list no solution turn up for my problem *sigh*. I use: - solr 3.3 - Date Import Handler 3.3 - JDBC source is MySQL Constrains: - No changes to core database schema - I can only add new views, stored p

Re: Problem with DIH delta-import delete.

2011-01-11 Thread Matti Oinas
Problem was incorrect pk definition on data-config.xml pk attribute needs to be the same as Solr uniqueField, so in my case changing pk value from id to uuid solved the problem. 2010/12/7 Matti Oinas : > Thanks Koji. > > Problem seems to be that template transformer is

Re: Problem with DIH delta-import delete.

2010-12-06 Thread Matti Oinas
Thanks Koji. Problem seems to be that template transformer is not used when delete is performed. ... Dec 7, 2010 7:19:43 AM org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed ModifiedRowKey for Entity: entry rows obtained : 0 Dec 7, 2010 7:19:43 AM org.apache.solr.handler.

Re: Problem with DIH delta-import delete.

2010-12-04 Thread Koji Sekiguchi
(10/11/17 20:18), Matti Oinas wrote: Solr does not delete documents from index although delta-import says it has deleted n documents from index. I'm using version 1.4.1. The schema looks like uuid Relevant fields from database tables: TABLE: blogs and en

Problem with DIH delta-import delete.

2010-11-17 Thread Matti Oinas
Solr does not delete documents from index although delta-import says it has deleted n documents from index. I'm using version 1.4.1. The schema looks like uuid Relevant fields from database tables: TABLE: blogs and entries both have Field: id Type: int(11)

Re: Problem with DIH delta-import on JDBC

2010-04-29 Thread Jon Baer
ing objected in >> the deltaQuery, so the deltaImportQuery should be using >> dataimporter.delta.objectid >> >> So try this: >> >> >query="select * from table" >>deltaImportQuery="select * from table where >> objectid

RE: Problem with DIH delta-import on JDBC

2010-04-29 Thread safl
t; objectid='${dataimporter.delta.objectid}'" > deltaQuery="select objectid from table where lastupdate > > '${dataimporter.last_index_time}'"> > > > Colin. > -- View this message in context: http://lucene.472066.n3.nabble.com/Problem-with-DIH-delta-import-on-JDBC-tp763469p765262.html Sent from the Solr - User mailing list archive at Nabble.com.

RE: Problem with DIH delta-import on JDBC

2010-04-29 Thread cbennett
; From: safl [mailto:s...@salamin.net] > Sent: Wednesday, April 28, 2010 3:05 PM > To: solr-user@lucene.apache.org > Subject: Problem with DIH delta-import on JDBC > > > Hello, > > I'm just new on the list. > I searched a lot on the list, but I didn't find an answe

Re: Problem with DIH delta-import on JDBC

2010-04-28 Thread safl
s message in context: http://lucene.472066.n3.nabble.com/Problem-with-DIH-delta-import-on-JDBC-tp763469p763722.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Problem with DIH delta-import on JDBC

2010-04-28 Thread Jon Baer
index. > > It behave the same if I replace ${dataimporter.delta.id} by > ${dataimporter.delta.objectid}. > Can someone tell what is wrong with it? > > Thanks a lot, > Florian > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Problem-with-DIH-delta-import-on-JDBC-tp763469p763469.html > Sent from the Solr - User mailing list archive at Nabble.com.

Problem with DIH delta-import on JDBC

2010-04-28 Thread safl
ndex. It behave the same if I replace ${dataimporter.delta.id} by ${dataimporter.delta.objectid}. Can someone tell what is wrong with it? Thanks a lot, Florian -- View this message in context: http://lucene.472066.n3.nabble.com/Problem-with-DIH-delta-import-on-JDBC-tp763469p763469.html Sent fro

Re: problem with DIH and MySQL

2009-01-21 Thread Shalin Shekhar Mangar
I guess Noble meant the Solr log. On Tue, Jan 20, 2009 at 9:29 PM, Nick Friedrich < nick.friedr...@student.uni-magdeburg.de> wrote: > no, there are no exceptions > but I have to admit, that I'm not sure what you mean with console > > > Zitat von Noble Paul ??? ?? : > > it got rolled bac

Re: problem with DIH and MySQL

2009-01-20 Thread Nick Friedrich
no, there are no exceptions but I have to admit, that I'm not sure what you mean with console Zitat von Noble Paul ??? ?? : it got rolled back any exceptions on solr console? -- --Noble Paul

Re: problem with DIH and MySQL

2009-01-20 Thread Noble Paul നോബിള്‍ नोब्ळ्
it got rolled back any exceptions on solr console? On Tue, Jan 20, 2009 at 9:07 PM, Nick Friedrich wrote: > Hi, > > I'm new to Solr and I have a problem. > I want to use DIH to index data stored in a MySQL database. > > I added to solrconfig.xml > > class="org.apache.solr.handler.dataimport.Data

problem with DIH and MySQL

2009-01-20 Thread Nick Friedrich
Hi, I'm new to Solr and I have a problem. I want to use DIH to index data stored in a MySQL database. I added to solrconfig.xml class="org.apache.solr.handler.dataimport.DataImportHandler"> data-config.xml The schema.xml is modified. Now there are just two fields require