Re: sstableloader throughput

2016-01-11 Thread Noorul Islam Kamal Malmiyoda
On Mon, Jan 11, 2016 at 10:25 PM, Jeff Jirsa wrote: > > Make sure streaming throughput isn’t throttled on the destination cluster. > How do I do that? Is stream_throughput_outbound_megabits_per_sec the attribute in cassandra.yaml. I think we can set that on the fly using nodetool setstreamthrou

Re: sstableloader throughput

2016-01-11 Thread Jeff Jirsa
Make sure streaming throughput isn’t throttled on the destination cluster. Stream from more machines (divide sstables between a bunch of machines, run in parallel). On 1/11/16, 5:21 AM, "Noorul Islam K M" wrote: > >I have a need to stream data to new cluster using sstableloader. I >spa

sstableloader throughput

2016-01-11 Thread Noorul Islam K M
I have a need to stream data to new cluster using sstableloader. I spawned a machine with 32 cores assuming that sstableloader scaled with respect to cores. But it doesn't look like so. I am getting an average throughput of 18 MB/s which seems to be pretty low (I might be wrong). Is there any wa

RE: sstableloader throughput

2013-04-10 Thread Viktor Jevdokimov
Thanks, that could help to consider migration of the cluster to a newer version. We'll check the difference. From: Edward Capriolo [mailto:edlinuxg...@gmail.com] Sent: Wednesday, April 10, 2013 18:03 To: user@cassandra.apache.org Subject: Re: sstableloader throughput Yes. I did confirm

Re: sstableloader throughput

2013-04-10 Thread Edward Capriolo
wrote: > Rsync is not for our case. > > Is sstableloader for 1.2.x faster? > > > > From: Edward Capriolo [mailto:edlinuxg...@gmail.com] > Sent: Wednesday, April 10, 2013 15:52 > To: user@cassandra.apache.org > Subject: Re: sstableloader throughput > > Stables

RE: sstableloader throughput

2013-04-10 Thread Viktor Jevdokimov
Rsync is not for our case. Is sstableloader for 1.2.x faster? From: Edward Capriolo [mailto:edlinuxg...@gmail.com] Sent: Wednesday, April 10, 2013 15:52 To: user@cassandra.apache.org Subject: Re: sstableloader throughput Stables loader was slow in 1:0:x I had better luck with rsync. It was

Re: sstableloader throughput

2013-04-10 Thread Edward Capriolo
gt; Sent: Wednesday, April 10, 2013 11:12 > To: user@cassandra.apache.org > Subject: sstableloader throughput > > > > Hi, > > > > We’re using Casandra 1.0.12 sstableloader to import data from dedicated machine located in DC1 into the cluster of 32 nodes (R

RE: sstableloader throughput

2013-04-10 Thread Viktor Jevdokimov
form.com] Sent: Wednesday, April 10, 2013 11:12 To: user@cassandra.apache.org Subject: sstableloader throughput Hi, We're using Casandra 1.0.12 sstableloader to import data from dedicated machine located in DC1 into the cluster of 32 nodes (RF=4), 16 nodes in DC1 and 16 nodes in DC2. To disa

sstableloader throughput

2013-04-10 Thread Viktor Jevdokimov
n with 50MB/s import should take less than a minute. Why sstableloader throughput is so low/slow? Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com<mailto:viktor.jevdoki...@adform.com> Phone: +370 5 212 3063, Fax +370 5 261 0453 J. Jasins