> One thing that might help indexing speed - create a *single* SQL query > to grab all the data you need without using DIH's sub-entities, at > least the non-cached ones. > Not sure how much that would help. As I mentioned that without the item description import the full process takes 4 hours which is bearable. However once I started to import the item description which is located on a separate machine/database the import process exploded to over 24 hours. -- View this message in context: http://lucene.472066.n3.nabble.com/Importing-large-datasets-tp863447p865324.html Sent from the Solr - User mailing list archive at Nabble.com.
- Re: Importing large datasets Grant Ingersoll
- Re: Importing large datasets Andrzej Bialecki
- Re: Importing large datasets Grant Ingersoll
- Re: Importing large datasets Andrzej Bialecki
- Re: Importing large datasets Dennis Gearon
- Re: Importing large datasets David Stuart
- Re: Importing large datasets Blargy
- Re: Importing large datasets Blargy
- Re: Importing large datasets Blargy
- Re: Importing large datasets Erik Hatcher
- Re: Importing large datasets Blargy
- Re: Importing large datasets David Stuart
- Re: Importing large datasets Lance Norskog
- Re: Importing large datasets Blargy
- Re: Importing large datasets Grant Ingersoll
- Re: Importing large datasets Blargy
- Re: Importing large datasets David Stuart
- Re: Importing large datasets Erik Hatcher
- Re: Importing large datasets Dennis Gearon
- Re: Importing large datasets Blargy
- Re: Importing large datasets Alexey Serba