Re: Cassandra as a key/object store for many small (10-60k) files

2017-05-05 Thread daemeon reiydelle
I would guess you have network overload issues, I have seen pretty much exactly what you describe many times, (so far ;{) always this is the issue. Especially with 1gbit networks, no jumbo frames, etc. Get your network guys to monitor the error retry packets across ALL of the interfaces (all the

Re: Cassandra as a key/object store for many small (10-60k) files

2017-05-05 Thread Jonathan Guberman
Yes, local storage volumes on each machine. > On May 5, 2017, at 3:25 PM, daemeon reiydelle wrote: > > These numbers do not match e.g. AWS, so guessing you are using local storage? > > > ... > Making a billion dollar startup is easy: "take a human desire, preferably

Re: Cassandra as a key/object store for many small (10-60k) files

2017-05-05 Thread daemeon reiydelle
These numbers do not match e.g. AWS, so guessing you are using local storage? *...* *Making a billion dollar startup is easy: "take a human desire, preferably one that has been around for a really long time … Identify that desire and use modern technology to take out steps."*

Cassandra as a key/object store for many small (10-60k) files

2017-05-05 Thread Jonathan Guberman
Hello, We’re currently testing Cassandra for use as a pure key-object store for data blobs around 10kB - 60kB each. Our use case is storing on the order of 10 billion objects with about 5-20 million new writes per day. A written object will never be updated or deleted. Objects will be read at