I run on parallel using REST API On Wed, Jan 21, 2015 at 2:42 PM, David Pilato <da...@pilato.fr> wrote:
> Did you try to send each bulk request on different nodes in parallel? > Or does only one node get the BULK request? > > David > > Le 21 janv. 2015 à 05:47, Hajime <placeofnomemor...@gmail.com> a écrit : > > I have 440 cores in my cluster and I find that having 100 shards are much > more faster in searching compare to 20 shards. > Does having many shards per index too costly, even I have so much cores? > > > > On Wed, Jan 21, 2015 at 12:12 PM, Mark Walkom <markwal...@gmail.com> > wrote: > >> Is that 100 shards per index? If to it's too many and you should drop >> that to 10-20 per index. >> >> Check your hot threads, it might show something. >> >> On 21 January 2015 at 15:09, Hajime <placeofnomemor...@gmail.com> wrote: >> >>> Hi, >>> >>> I have a 10 indexes with 100 shards using 10 nodes which have 40 cores >>> each. >>> >>> I have a problem when indexing 1000~2000/doc or 2M~4M per sec in new >>> index, searching to the other old indexes happen to be very slow. >>> >>> How can I prevent from indexing to interfere the searching activity? >>> >>> >>> Additional info: >>> /_cat/thread_pool is almost 0 in every column. >>> load average / cpu usage / memory usage /reading usage is low and stable. >>> I use bulk api of rest client not transport client. >>> My version is 1.4.0 >>> >>> thanks, >>> >>> hajime >>> >>> -- >>> You received this message because you are subscribed to the Google >>> Groups "elasticsearch" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to elasticsearch+unsubscr...@googlegroups.com. >>> To view this discussion on the web visit >>> https://groups.google.com/d/msgid/elasticsearch/CAHm3Zso%2Bu0H_uG3Dw33Ubk7OxJYU8CLdypmASPZJiwto5CM_0w%40mail.gmail.com >>> <https://groups.google.com/d/msgid/elasticsearch/CAHm3Zso%2Bu0H_uG3Dw33Ubk7OxJYU8CLdypmASPZJiwto5CM_0w%40mail.gmail.com?utm_medium=email&utm_source=footer> >>> . >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> -- >> You received this message because you are subscribed to the Google Groups >> "elasticsearch" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to elasticsearch+unsubscr...@googlegroups.com. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/elasticsearch/CAEYi1X-7TG5sxuCxnEjyWRWTb%2BUs9SXcREtSe-seT068L9wGmg%40mail.gmail.com >> <https://groups.google.com/d/msgid/elasticsearch/CAEYi1X-7TG5sxuCxnEjyWRWTb%2BUs9SXcREtSe-seT068L9wGmg%40mail.gmail.com?utm_medium=email&utm_source=footer> >> . >> For more options, visit https://groups.google.com/d/optout. >> > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to elasticsearch+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/CAHm3ZsopXSg6k_-iygZMRSrkx5x5c-u8bbLtrk_uxYp24Og%2B-A%40mail.gmail.com > <https://groups.google.com/d/msgid/elasticsearch/CAHm3ZsopXSg6k_-iygZMRSrkx5x5c-u8bbLtrk_uxYp24Og%2B-A%40mail.gmail.com?utm_medium=email&utm_source=footer> > . > For more options, visit https://groups.google.com/d/optout. > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to elasticsearch+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/7499EC08-36D4-4419-A1A7-1ED63F90C5DA%40pilato.fr > <https://groups.google.com/d/msgid/elasticsearch/7499EC08-36D4-4419-A1A7-1ED63F90C5DA%40pilato.fr?utm_medium=email&utm_source=footer> > . > > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAHm3ZspteZhmpf1fSo_ZcGnh_sQ%3DaoMfMqksEM8GWU674XYM-Q%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
