We noticed that streaming will take about 10 hours,all the left is compaction,we will improve concurrent_compactors first.
Thanks all for your reply. ------------------ ???????? ------------------ ??????: "Jon Haddad";<j...@jonhaddad.com>; ????????: 2017??11??1??(??????) ????4:06 ??????: "user"<email@example.com>; ????: Re: Tuning bootstrap new node Of all the settings you could change, why one that??s related to memtables? Streaming doesn??t go through the write path, memtables aren??t involved unless you??re using materialized views or CDC. On Oct 31, 2017, at 11:44 AM, Anubhav Kale <anubhav.k...@microsoft.com.INVALID> wrote: You can change YAML setting of memtable_cleanup_threshold to 0.7 (from the default of 0.3). This will push SSTables to disk less often and will reduce the compaction time. While this won??t change the streaming time, it will reduce the overall time for your node to be healthy. From: Harikrishnan Pillai [mailto:hpil...@walmartlabs.com] Sent: Tuesday, October 31, 2017 11:28 AM To: firstname.lastname@example.org Subject: Re: Re: Tuning bootstrap new node There is no magic in speeding up the node addition other than increasing stream throughput and compaction throughput. it has been noticed that with heavy compactions the latency may go up if the node also start serving data. if you really don't want this node to service traffic till all compactions settle down, you can disable gossip and binary protocol using the nodetool command. This will allow compactions to continue but requires a repair to fix the stale data later. Regards Hari From: Nitan Kainth <nitankai...@gmail.com> Sent: Tuesday, October 31, 2017 5:47 AM To: email@example.com Subject: EXT: Re: Tuning bootstrap new node Do not stop compaction, you will end up with thousands of sstables. You increase stream throughput from default 200 to a heifer value if your network can handle it. Sent from my iPhone On Oct 31, 2017, at 6:35 AM, Peng Xiao <2535...@qq.com> wrote: Can we stop the compaction during the new node bootstraping and enable it after the new node joined? Thanks ------------------ Original ------------------ From: "????????????";<2535...@qq.com>; Date: Tue, Oct 31, 2017 07:18 PM To: "user"<firstname.lastname@example.org>; Subject: Tuning bootstrap new node Dear All, Can we make some tuning to make bootstrap new node more quick?We have a three DC cluster(RF=3 in two DCs,RF=1 in another ,48 nodes in the DC with RF=3).As the Cluster is becoming larger and larger,we need to spend more than 24 hours to bootstrap a new node. Could you please advise how to tune this ? Many Thanks, Peng Xiao