Of all the settings you could change, why one that’s related to memtables?
Streaming doesn’t go through the write path, memtables aren’t involved unless
you’re using materialized views or CDC.
> On Oct 31, 2017, at 11:44 AM, Anubhav Kale
> <anubhav.k...@microsoft.com.INVALID> wrote:
> You can change YAML setting of memtable_cleanup_threshold to 0.7 (from the
> default of 0.3). This will push SSTables to disk less often and will reduce
> the compaction time.
> While this won’t change the streaming time, it will reduce the overall time
> for your node to be healthy.
> From: Harikrishnan Pillai [mailto:hpil...@walmartlabs.com]
> Sent: Tuesday, October 31, 2017 11:28 AM
> To: firstname.lastname@example.org
> Subject: Re: Re: Tuning bootstrap new node
> There is no magic in speeding up the node addition other than increasing
> stream throughput and compaction throughput.
> it has been noticed that with heavy compactions the latency may go up if the
> node also start serving data.
> if you really don't want this node to service traffic till all compactions
> settle down, you can disable gossip and binary protocol using the nodetool
> command. This will allow compactions to continue but requires a repair to fix
> the stale data later.
> From: Nitan Kainth <nitankai...@gmail.com <mailto:nitankai...@gmail.com>>
> Sent: Tuesday, October 31, 2017 5:47 AM
> To: email@example.com <mailto:firstname.lastname@example.org>
> Subject: EXT: Re: Tuning bootstrap new node
> Do not stop compaction, you will end up with thousands of sstables.
> You increase stream throughput from default 200 to a heifer value if your
> network can handle it.
> Sent from my iPhone
> On Oct 31, 2017, at 6:35 AM, Peng Xiao <2535...@qq.com
> <mailto:2535...@qq.com>> wrote:
> Can we stop the compaction during the new node bootstraping and enable it
> after the new node joined?
> ------------------ Original ------------------
> From: "我自己的邮箱";<2535...@qq.com <mailto:2535...@qq.com>>;
> Date: Tue, Oct 31, 2017 07:18 PM
> To: "user"<email@example.com <mailto:firstname.lastname@example.org>>;
> Subject: Tuning bootstrap new node
> Dear All,
> Can we make some tuning to make bootstrap new node more quick?We have a three
> DC cluster(RF=3 in two DCs,RF=1 in another ,48 nodes in the DC with RF=3).As
> the Cluster is becoming larger and larger,we need to spend more than 24 hours
> to bootstrap a new node.
> Could you please advise how to tune this ?
> Many Thanks,
> Peng Xiao