Thanks James.
Your idea worked well( using multiple request handlers).
I will try and implement some code when I have some spare cycles. By the way
by coding you mean using the same request handler and some how querying it
simultaneously. Howz it possible?
Thanks
meena
--
View this message in
bruary 03, 2015 4:24 PM
To: solr-user@lucene.apache.org
Subject: RE: Solr 4.9 Calling DIH concurrently
Thanks James. After lots of search and reading now I think I understand a
little from your answer.
If I understand correctly my solrconfig.xml will have section like this
gt;
>> > Batch Doc count : 10 docs
>> > No of Threads : 16/32
>> >
>> > Solr Memory Allocated : 200 GB
>> >
>> > The reason can be as below.
>> >
>> > Solr is taking the snapsho
.
> > Due to this more memory is getting consumed & solr is extremely
> > slow while running 16 or more threads for loading.
> >
> > If anyone have already done the multithreaded data load into Solr in a
> > quicker way, Can you please share the code or logic in
titions})=${dataimporter.request.currentPartition}".
>
> I think, though, most users who want to make the most out of
> multithreading write their own program and use the solrj api to send the
> updates.
>
> James Dyer
> Ingram Content Group
>
>
> -Original Mes
Thanks James. After lots of search and reading now I think I understand a
little from your answer.
If I understand correctly my solrconfig.xml will have section like this
db-data-config1.xml
db-data-config1.xml
.
.
.
.
.
db-data-config1.xml
in using the SolrJ API?
Thanks in advance.
Regards,
Suresh.A
-Original Message-
From: Dyer, James [mailto:james.d...@ingramcontent.com]
Sent: Tuesday, February 03, 2015 1:58 PM
To: solr-user@lucene.apache.org
Subject: RE: Solr 4.9 Calling DIH concurrently
DIH is single-threaded. There wa
James Dyer
Ingram Content Group
-Original Message-
From: meena.sri...@mathworks.com [mailto:meena.sri...@mathworks.com]
Sent: Tuesday, February 03, 2015 3:43 PM
To: solr-user@lucene.apache.org
Subject: Solr 4.9 Calling DIH concurrently
Hi
I am using solr 4.9 and need to index
Hi
I am using solr 4.9 and need to index million of documents from database. I
am using DIH and sending request to fetch by ids. Is there a way to run
multiple indexing threads, concurrently in DIH.
I want to take advantage of
parameter. How do I do it. I am just invoking DIH handler using sol
