Re: High performance disk io

2013-05-23 Thread Igor
? Thanks Chris *From:*Igor [mailto:i...@4friends.od.ua] *Sent:* 22 May 2013 15:07 *To:* user@cassandra.apache.org *Subject:* Re: High performance disk io Hello What level of read performance do you expect? We have limit 15 ms for 99 percentile with average read latency near 0.9ms. For some CF 99

RE: High performance disk io

2013-05-23 Thread Christopher Wirt
the same setup. Chris From: Igor [mailto:i...@4friends.od.ua] Sent: 23 May 2013 15:00 To: user@cassandra.apache.org Subject: Re: High performance disk io Hello Christopher, BTW, are you talking about 99th percentiles on client side, or about percentiles from cassandra histograms for CF

Re: High performance disk io

2013-05-23 Thread Edward Capriolo
moving all of nodes to have the same setup. ** ** ** ** Chris ** ** *From:* Igor [mailto:i...@4friends.od.ua] *Sent:* 23 May 2013 15:00 *To:* user@cassandra.apache.org *Subject:* Re: High performance disk io ** ** Hello Christopher, BTW, are you talking about 99th

Re: High performance disk io

2013-05-23 Thread aaron morton
one SSD against that. Then have a dedicated SSD per large column family. We’re now moving all of nodes to have the same setup. Chris From: Igor [mailto:i...@4friends.od.ua] Sent: 23 May 2013 15:00 To: user@cassandra.apache.org Subject: Re: High performance disk io

High performance disk io

2013-05-22 Thread Christopher Wirt
Hello, We're looking at deploying a new ring where we want the best possible read performance. We've setup a cluster with 6 nodes, replication level 3, 32Gb of memory, 8Gb Heap, 800Mb keycache, each holding 40/50Gb of data on a 200Gb SSD and 500Gb SATA for OS and commitlog Three column

Re: High performance disk io

2013-05-22 Thread Igor
Hello What level of read performance do you expect? We have limit 15 ms for 99 percentile with average read latency near 0.9ms. For some CF 99 percentile actually equals to 2ms, for other - to 10ms, this depends on the data volume you read in each query. Tuning read performance involved

Re: High performance disk io

2013-05-22 Thread Hiller, Dean
Date: Wednesday, May 22, 2013 8:06 AM To: user@cassandra.apache.orgmailto:user@cassandra.apache.org user@cassandra.apache.orgmailto:user@cassandra.apache.org Subject: Re: High performance disk io Hello What level of read performance do you expect? We have limit 15 ms for 99 percentile

RE: High performance disk io

2013-05-22 Thread Christopher Wirt
not options. Do you use SSDs or multiple SSDs in any kind of configuration or RAID? Thanks Chris From: Igor [mailto:i...@4friends.od.ua] Sent: 22 May 2013 15:07 To: user@cassandra.apache.org Subject: Re: High performance disk io Hello What level of read performance do you expect

RE: High performance disk io

2013-05-22 Thread Christopher Wirt
price tag easily worth the effort. Cheers, Chris -Original Message- From: Hiller, Dean [mailto:dean.hil...@nrel.gov] Sent: 22 May 2013 15:33 To: user@cassandra.apache.org Subject: Re: High performance disk io Well, if you just want to lower your I/O util %, you could always just add more

Re: High performance disk io

2013-05-22 Thread Igor
? No, single SSD per host Thanks Chris *From:*Igor [mailto:i...@4friends.od.ua] *Sent:* 22 May 2013 15:07 *To:* user@cassandra.apache.org *Subject:* Re: High performance disk io Hello What level of read performance do you expect? We have limit 15 ms for 99 percentile with average read latency near

Re: High performance disk io

2013-05-22 Thread Wei Zhu
: Re: High performance disk io On 05/22/2013 05:41 PM, Christopher Wirt wrote: Hi Igor, Yea same here, 15ms for 99 th percentile is our max. Currently getting one or two ms for most CF. It goes up at peak times which is what we want to avoid. Our 99 percentile also goes up at peak times

Re: High performance disk io

2013-05-22 Thread Hiller, Dean
@cassandra.apache.orgmailto:user@cassandra.apache.org Subject: Re: High performance disk io For us, the biggest killer is repair and compaction following repair. If you are running VNodes, you need to test the performance while running repair. From: Igor i...@4friends.od.uamailto:i

Re: High performance disk io

2013-05-22 Thread Wei Zhu
how it goes. -Wei - Original Message - From: Dean Hiller dean.hil...@nrel.gov To: user@cassandra.apache.org, Wei Zhu wz1...@yahoo.com Sent: Wednesday, May 22, 2013 12:19:44 PM Subject: Re: High performance disk io If you are only running repair on one node, should it not skip