Dear elastic users,
We use elastic for a document store containing around 100M documents in
200G. We used to run a single elastic node on the same server that
functioned as the web server, but this caused a lot of performance issues
(and the need of re-indexing all data in case of failure). So, we just
acquired two new servers that will function almost exclusively as elastic
nodes, both have single SSD disks, 48G ram and a decent modern processor.
The web server has 64GB ram and raid 10 spinning disks. The web site is not
particularly high-traffic but the elastic queries can be pretty heavy with
lots of terms, wildcards, and aggregations (the site is used for scientific
text analysis - http://amcat.vu.nl)
We can imagine three possible configurations:
1) Separate elastic cluster
Use the new "elastic" servers only for elastic with data=true,master=true,
and use the web server only for other tasks.
Advantage: simple;
disadvantage: capacity of the existing ("web") server under utilized
2) Use all servers
Use all servers for elastic, all with data=true,master=true.
Advantage: all resources utilized.
Disadvantage: web server has no SSD and also has other tasks, so maybe
lower overall performance because it becomes the weakest link?
3) Use web server as 'coordinator'
Use the elastic servers as data nodes (with data=true,master=false) and the
web server as master node (data=false,master=true).
advantage: this seems to use the web server capacity (esp. CPU?) while
still having all the data on the SSD's in the new elastic servers
disadvantage: more complicated to setup, only a single master node
In case (3) is the best option, two more questions:
- How do you change a node from data=true to data=false? Just change the
config and restart the node? Will it automatically relocate the shards?
- What happens if the only master=true node disappears. Will the rest just
way for it to come online again? Is the data preserved?
What would you recommend?
Thanks,
-- Wouter
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/c991cff8-52af-49e7-96df-0f7dd6675a4c%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
