Tuning bootstrap new node

2017-10-31 Thread Peng Xiao
Dear All, Can we make some tuning to make bootstrap new node more quick?We have a three DC cluster(RF=3 in two DCs,RF=1 in another ,48 nodes in the DC with RF=3).As the Cluster is becoming larger and larger,we need to spend more than 24 hours to bootstrap a new node. Could you please advise how

Re: Tuning bootstrap new node

2017-10-31 Thread Peng Xiao
Can we stop the compaction during the new node bootstraping and enable it after the new node joined? Thanks -- Original -- From: "";<2535...@qq.com>; Date: Tue, Oct 31, 2017 07:18 PM To: "user"; Subject: Tuning bootstrap new node Dear All, Can

Re: How do TTLs generate tombstones

2017-10-31 Thread eugene miretsky
Thanks, We have turned off read repair, and read with consistency = one. This leaves repairs and old timestamps (generate by the client) as possible causes for the overlap. We are writing from Spark, and don't have NTP set up on the cluster - I think that was causing some of the issues, but we hav

Re: Tuning bootstrap new node

2017-10-31 Thread Nitan Kainth
Do not stop compaction, you will end up with thousands of sstables. You increase stream throughput from default 200 to a heifer value if your network can handle it. Sent from my iPhone > On Oct 31, 2017, at 6:35 AM, Peng Xiao <2535...@qq.com> wrote: > > Can we stop the compaction during the ne

Databasde connections based Cassandra users

2017-10-31 Thread Chuck Reynolds
Is there a way to see who is connected to Cassandra based on a Cassandra user?

Re: Cassandra Compaction Metrics - CompletedTasks vs TotalCompactionCompleted

2017-10-31 Thread Chris Lohfink
CompactionMetrics is a combination of the compaction executor (sstable compactions, secondary index build, view building, relocate, garbagecollect, cleanup, scrub etc) and validation executor (repairs). Keep in mind not all jobs execute 1 task per operation, things that use the parallelAllSSTableOp

RE: Cassandra proxy to control read/write throughput

2017-10-31 Thread Anubhav Kale
There are some caveats with coordinator only nodes. You can read about our experience in detail here. From: Nate McCall [mailto:n...@thelastpickle.com] Sent: Sunday, October 29, 2017 2:12 PM To: Cassandra Us

Re: Snapshot verification

2017-10-31 Thread Varun Gupta
We use COPY command to generate a file, from source and destination. After that you can use diff tool. On Mon, Oct 30, 2017 at 10:11 PM Pradeep Chhetri wrote: > Hi, > > We are taking daily snapshots for backing up our cassandra data and then > use our backups to restore in a different environment

Re: Re: Tuning bootstrap new node

2017-10-31 Thread Harikrishnan Pillai
There is no magic in speeding up the node addition other than increasing stream throughput and compaction throughput. it has been noticed that with heavy compactions the latency may go up if the node also start serving data. if you really don't want this node to service traffic till all compac

RE: Re: Tuning bootstrap new node

2017-10-31 Thread Anubhav Kale
You can change YAML setting of memtable_cleanup_threshold to 0.7 (from the default of 0.3). This will push SSTables to disk less often and will reduce the compaction time. While this won’t change the streaming time, it will reduce the overall time for your node to be healthy. From: Harikrishna

Re: Tuning bootstrap new node

2017-10-31 Thread Jon Haddad
Of all the settings you could change, why one that’s related to memtables? Streaming doesn’t go through the write path, memtables aren’t involved unless you’re using materialized views or CDC. > On Oct 31, 2017, at 11:44 AM, Anubhav Kale > wrote: > > You can change YAML setting of memtable_c

Error 1609 while installing Cassandra on Windows 2012 R2

2017-10-31 Thread varun bhatnagar
Hi, I am new to Cassandra and I am trying to install cassandra 2.2.8 using saltstack on Windows 2012 R2 but when I do that I get the below error: Action start 1:17:58: CreateFolders. MSI (s) (94:A8) [01:17:58:072]: Error 1609. An error occurred while applying security settings. WORKGROUP\SYSTEM i

Re: Snapshot verification

2017-10-31 Thread Pradeep Chhetri
Hi Varun, Thank you for the reply. I was looking for some kind of automated way (eg. if i can get some kind of md5 per table while taking snapshot and compare it with md5 after restoring that snapshot). Regards. On Tue, Oct 31, 2017 at 10:47 PM, Varun Gupta wrote: > We use COPY command to gene

?????? Tuning bootstrap new node

2017-10-31 Thread Peng Xiao
We noticed that streaming will take about 10 hours,all the left is compaction,we will improve concurrent_compactors first. Thanks all for your reply. -- -- ??: "Jon Haddad";; : 2017??11??1??(??) 4:06 ??: "user"; : Re: Tun