I managed to split the shards by restarting ES on the master, then retested. Throughput is the same.
4500/sec seems a bit low, each doc is just 8k. Network doesn't seems to be the bottleneck. I check the IO on disk, and it's between 0 (probably when it's buffering before flushing, and 50/70). Do you think I should get Provisionned IO on my EC2 instance ? On Friday, February 14, 2014 12:53:11 PM UTC-5, Binh Ly wrote: > > Shards should distribute over the 2 nodes assuming they are part of a > single cluster. Theoretically, yes more shards *distributed across multiple > nodes* will increase indexing speed. But you can still be limited by other > resources such as network, CPU, memory so it's hard to say how much exactly > will your throughput be. > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/fd2c61ca-8e6a-4961-8dfd-ea5c7cb4b563%40googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.
