On Tue, May 5, 2009 at 10:43 AM, Tom Nichols <[email protected]> wrote: > So I did a rough calculation and it looks like I'm getting less than > 1MB/s throughput in CouchDB -- > > 3072 MB total / 6900 sec = 0.445 MB/s > > So if the disk throughput is ~20 to 30 MB/s then the bottleneck is > somewhere in the database. It's obviously not going to be anywhere > close to raw disk I/O speeds but this still seems incredibly slow. > Granted, I'm using a small instance... I'll try a c1.medium and see > if the results are drastically different. >
Can you try running this benchmark script and see what you get for insert performance: http://gist.github.com/79279 > On Mon, May 4, 2009 at 5:29 PM, Jason Smith <[email protected]> > wrote: >> Tom Nichols wrote: >>> >>> Hi, I have some questions about insert performance. >>> >>> I have a single CouchDB 0.9.0 node running on small EC2 instance. I >>> attached a huge EBS volume to it and mounted it where CouchDB's data >>> files are stored. I fired up about ruby scripts running inserts and >>> after a weekend I only have about 30GB/ 12M rows of data... Which >>> seems small. 'top' tells me that my CPU is only about 30% utilized. >>> >>> Any idea what I might be doing wrong? I pretty much just followed >>> these instructions: >>> http://wiki.apache.org/couchdb/Getting_started_with_Amazon_EC2 >> >> Hi, Tom. I believe I read somewhere before that the smallest EC2 instances >> have a slower and/or higher-latency connection to EBS, so you might want to >> consider a large instance, or maybe even a high-memory small instance and >> see whether you get better "hardware" performance. >> >> Although strangely, when googling it, the first article I found says that >> their benchmarks found no difference between EBS or even the ephemeral >> filesystem. >> >> http://www.paessler.com/blog/2009/04/07/prtg-7/monitoring-cloud-performance-with-prtg-comparing-disk-speed-for-instance-stores-and-ebs-volumes-on-amazon-ec2/ >> >> On the other hand, here is a forum posting and a random benchmark indicating >> that more expensive instances get better throughput: >> >> http://developer.amazonwebservices.com/connect/message.jspa?messageID=125197 >> http://blog.getasysadmin.com/2009/02/mysql-benchmarks-using-amazon-ec2.html >> >> -- >> Jason Smith >> Proven Corporation >> Bangkok, Thailand >> http://www.proven-corporation.com >> > -- Chris Anderson http://jchrisa.net http://couch.io
