Just went through these slides https://speakerdeck.com/bhaskarvk/scaling-elasticsearch-washington-dc-meetup
First of all, thats one HUGE cluster Second, "Prefer JBODs for data disks over RAID, SAN/NAS", would be ok, maybe then to be safe go with 2x replicas, goes well with having 3x nodes On Friday, December 12, 2014 4:18:01 PM UTC, Jack Park wrote: > > I cannot put my finger on it, but I think I recall that someone in this > group once said that ES is IO intensive, that RAID would slow things down, > arguing in favor of redundant servers over RAID. Does that still make sense? > > On Fri, Dec 12, 2014 at 8:00 AM, Mark Walkom <[email protected] > <javascript:>> wrote: > >> It's a risk thing, you need to be comfy with the risk of losing one disk >> and all that it entails. >> If you can mitigate that through a process and you are happy with the >> remaining risk, then :) >> >> On 12 December 2014 at 16:13, Elvar Böðvarsson <[email protected] >> <javascript:>> wrote: >> >>> This would be for log storage, plan is to go with HDD's for the long >>> term storage and SSD's for short term storage. Total storage will be maybe >>> 8tb total, using replica's would bring that to 16tb and if using raid1 or >>> raid10 would bring total raw storage up to 32tb >>> >>> >>> >>> On Friday, December 12, 2014 1:30:32 PM UTC, Nikolas Everett wrote: >>>> >>>> Striping raid is viable for 2 or 3 disks because of the redundancy. >>>> Software raid works fine for me. Hardware raid enables battery backed >>>> write >>>> behind but I don't know how important that is with ssds. Either way, we go >>>> 2xSSDs per server with os in mirrored raid and data striped. >>>> >>>> Depending on your data you may want spinning disks instead, then >>>> battery backed writes are probably a bigger win. >>>> On Dec 12, 2014 7:32 AM, "Elvar Böðvarsson" <[email protected]> wrote: >>>> >>>>> When running Elasticsearch on physical hardware you have it create >>>>> replicas to make sure no node is a single point of failure. From >>>>> everyone's >>>>> experiance should I use Hardware Raid as well, or is it not needed? >>>>> >>>>> -- >>>>> You received this message because you are subscribed to the Google >>>>> Groups "elasticsearch" group. >>>>> To unsubscribe from this group and stop receiving emails from it, send >>>>> an email to [email protected]. >>>>> To view this discussion on the web visit https://groups.google.com/d/ >>>>> msgid/elasticsearch/4827efb1-b5cf-4407-97ef-f6c4c3029cea% >>>>> 40googlegroups.com >>>>> <https://groups.google.com/d/msgid/elasticsearch/4827efb1-b5cf-4407-97ef-f6c4c3029cea%40googlegroups.com?utm_medium=email&utm_source=footer> >>>>> . >>>>> For more options, visit https://groups.google.com/d/optout. >>>>> >>>> -- >>> You received this message because you are subscribed to the Google >>> Groups "elasticsearch" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to [email protected] <javascript:>. >>> To view this discussion on the web visit >>> https://groups.google.com/d/msgid/elasticsearch/13b36ab6-7fb6-4f6f-b11d-79069aed74ad%40googlegroups.com >>> >>> <https://groups.google.com/d/msgid/elasticsearch/13b36ab6-7fb6-4f6f-b11d-79069aed74ad%40googlegroups.com?utm_medium=email&utm_source=footer> >>> . >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> -- >> You received this message because you are subscribed to the Google Groups >> "elasticsearch" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected] <javascript:>. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/elasticsearch/CAEYi1X9_ULd9j7jFVJaMYvLz3NNwYsqCAwHsfUxkxCwg1oV3-A%40mail.gmail.com >> >> <https://groups.google.com/d/msgid/elasticsearch/CAEYi1X9_ULd9j7jFVJaMYvLz3NNwYsqCAwHsfUxkxCwg1oV3-A%40mail.gmail.com?utm_medium=email&utm_source=footer> >> . >> >> For more options, visit https://groups.google.com/d/optout. >> > > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/02040a16-9718-4fc8-be28-4ff781de5c40%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
