1. Yes, it is spread automatically 2. No
The bulk queue up is where the shards are. So check your shard distribution. They should be equal on each node for an index. Otherwise your system load is unbalanced. Jörg On Wed, Aug 6, 2014 at 10:36 PM, Pavel P <[email protected]> wrote: > Still interested to know your view on the issue. > > On Wednesday, August 6, 2014 5:12:41 PM UTC+3, Pavel P wrote: >> >> Hi, >> >> Could someone clarify me the next: >> >> When I have the ES cluster, consisting from 2 machines, how should I send >> the bulk index requests to them. >> >> 1. Do I understand right that I can send everything to any node I have, >> then it would be spreaded for indexing among the cluster automatically? >> 2. Do I need to cover the cluster with the load balancer so each node >> would receive some portion of the indexing pressure? >> >> How it supposed to work by design? >> >> Currently I use the load balancer over my two instances, and as I see >> with the Bigdesk - the bulk queue is growing on the master node, while the >> slave node feels itself quite relaxed. >> >> Master node: >> >> >> <https://lh6.googleusercontent.com/-muM2VK-lKwM/U-I2iLbXh3I/AAAAAAAAAH0/RkYg6DVf7fI/s1600/master_node_queue.png> >> >> >> Slave node: >> >> >> <https://lh5.googleusercontent.com/-Ed4nY_7nrw4/U-I2Yzdb76I/AAAAAAAAAHs/ozL7MnZR1lA/s1600/Screen+Shot+2014-08-06+at+5.05.55+PM.png> >> >> >> Is that ok, that my ES cluster from 2 machines, which are c3.large (4 >> CPU, 8Gb memory) is only able to index 13k small documents per 10 seconds >> (I use it as output for the logstash)? >> Which performance should I expect? >> >> Regards, >> >> -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/2fa3fe97-ddfd-403c-98f3-22dc0bd1c70b%40googlegroups.com > <https://groups.google.com/d/msgid/elasticsearch/2fa3fe97-ddfd-403c-98f3-22dc0bd1c70b%40googlegroups.com?utm_medium=email&utm_source=footer> > . > > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAKdsXoHOe-0ppbhZ_%2ByROzww7YprMBh8RjrM8WYRiYhExopBAQ%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
