Thanks Mathieu for you response. I will try your suggestions. "It's a huge value. Shards can be split between nodes, do you target tu use 15 nodes?"
Hi Mat, - For examples if I have just one node, shards = 5, replica = 0. Then I can easily backup the data by "cp /var/lib/elasticsearch/nodename /somewhere/backup -rfp" - Now I add one more node, so the cluster has two nodes, shards = 5, replica = 0. The shards are redistributed, maybe 1st node holds 0 2 4, 2nd node holds 1 3. => How can I backup, each node does not hold the whole data, can not simple cp ... - If I update replicas = 1, each node now have full 5 shards, I can easy cp backup on any node. If you know the better way for backup which can handle distributed shards, plz let me know. Thank you. PS : Can I reduce shards from 5 to 4 without losing data ? On Sunday, October 26, 2014 12:57:40 AM UTC+7, Mathieu Lecarme wrote: > > > > Le vendredi 24 octobre 2014 10:43:21 UTC+2, Atrus a écrit : >> >> - There is 15 shards per index, is this too much or enough ? I've used >> the default config. I know that this could be effect the load but dont know >> how to figure out the exact number. >> >> It's a huge value. Shards can be split between nodes, do you target tu > use 15 nodes? > > >> - Is there any way to show the running queries ? something like mysql >> show process list ? to show what queries have eat CPU alot. I have enable >> slow log queries >1s but found nothing. >> > You can watch HTTP traffic, with pcap (I hack packetbeat, for that). It's > from the outside, from the inside, use the hot thread. strace can help, too. > > >> - Any suggestion is appreciate. >> > Do you poll the _nodes/stat url? a monitoring tool, or a web page like > kopf? > > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/4ab77f45-177d-4546-b953-5f38c7f4f5d1%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
