Re: Keyspace Clone in Existing Cluster

2019-10-30 Thread Paul Carlucci
When in doubt, repair. Nodetool snapshot won't be perfectly consistent across all the nodes anyway since you're snapshotting on each node individually. On Tue, Oct 29, 2019, 8:31 PM Ankit Gadhiya wrote: > Thanks Paul. This is interesting. > So, anything I need to do after cp? - nodetool

Re: Cassandra 3.11.4 Node the load starts to increase after few minutes to 40 on 4 CPU machine

2019-10-30 Thread Sergio
Hi Reid, I don't have anymore this loading problem. I solved by changing the Cassandra Driver Configuration. Now my cluster is pretty stable and I don't have machines with crazy CPU Load. The only thing not urgent but I need to investigate is the number of ESTABLISHED TCP connections. I see just

Re: Cassandra on Kubernetes

2019-10-30 Thread John Sanda
One of the problems I have experienced in the past has more to do with Java than Cassandra in particular, and that is the JVM ignoring cgroups. With Cassandra in particular I would often see memory usage go higher than what was desired. This would lead to pods getting oom killed. This was fixed in

Re: Cassandra 3.11.4 Node the load starts to increase after few minutes to 40 on 4 CPU machine

2019-10-30 Thread Reid Pinchback
Oh nvm, didn't see the later msg about just posting what your fix was. R On 10/30/19, 4:24 PM, "Reid Pinchback" wrote: Message from External Sender Hi Sergio, Assuming nobody is actually mounting a SYN flood attack, then this sounds like you're either being hammered

Re: Cassandra 3.11.4 Node the load starts to increase after few minutes to 40 on 4 CPU machine

2019-10-30 Thread Reid Pinchback
Hi Sergio, Assuming nobody is actually mounting a SYN flood attack, then this sounds like you're either being hammered with connection requests in very short periods of time, or your TCP backlog tuning is off. At least, that's where I'd start looking. If you take that log message and google

Re: Cassandra on Kubernetes

2019-10-30 Thread Jean-Armel Luce
Hi Jain, Thanks for your comments about CassKop. We began the development of Casskop at the beginning of 2018. At this time, some K8S objects (i.e. statefulsets, operators, …) were still in beta version and we discovered a few strange behaviours. We upgraded to K8S 1.12 in mid-2018. After

Re: Cassandra 3.11.4 Node the load starts to increase after few minutes to 40 on 4 CPU machine

2019-10-30 Thread Sergio Bilello
https://docs.datastax.com/en/drivers/java/2.2/com/datastax/driver/core/policies/LatencyAwarePolicy.html I had to change the Policy in the Cassandra Driver. I solved this problem few weeks ago. I am just posting the solution for anyone that could hit the same issue. Best, Sergio On 2019/10/17

Re: Where to get old RPMs?

2019-10-30 Thread Reid Pinchback
Oh, my mistake, there was also another subdirectory there with the old rpm’s, I missed that the first time. Thanks. From: Reid Pinchback Reply-To: "user@cassandra.apache.org" Date: Wednesday, October 30, 2019 at 1:47 PM To: "user@cassandra.apache.org" Subject: Re: Where to get old RPMs?

Re: Where to get old RPMs?

2019-10-30 Thread Reid Pinchback
Alas, that wasn’t the info I was looking for Jon, the archive site you pointed to is for the jars, not the rpms. The rpm site you pointed at only has the current, not the past point releases. Michael had the magic link though, I’m all set.  R From: Jon Haddad Reply-To:

Re: Cassandra on Kubernetes

2019-10-30 Thread Akshit Jain
Hi Jean Thanks for replying. I had seen CassKop and the amount functionality it provides is quite awesome as compared to other operators. I would like to know how stable is kubernetes for stateful/database applications right now? I haven't read/heard any major production stateful application

Re: What is the status of counters? Should I use them?

2019-10-30 Thread Jon Haddad
It's possible to overcount when a server is overwhelmed or slow to respond and you're getting exceptions on the client. If you retry your query, it's possible you'll increment twice, once for the original query (which maybe threw an exception) and again on the retry. Use counters if you're OK

Re: Where to get old RPMs?

2019-10-30 Thread Jon Haddad
Archives are here: http://archive.apache.org/dist/cassandra/ For example, the RPM for 3.11.x you can find here: http://archive.apache.org/dist/cassandra/redhat/311x/ The old releases are removed by Apache automatically as part of their policy, it's not specific to Cassandra. On Wed, Oct 30,

Re: Where to get old RPMs?

2019-10-30 Thread Reid Pinchback
Thanks Michael, that was exactly the info I needed. On 10/30/19, 1:44 PM, "Michael Shuler" wrote: Message from External Sender On 10/30/19 12:39 PM, Reid Pinchback wrote: > With the latest round of C* updates, the yum repo no longer has > whatever the previous

Re: Where to get old RPMs?

2019-10-30 Thread Michael Shuler
On 10/30/19 12:39 PM, Reid Pinchback wrote: With the latest round of C* updates, the yum repo no longer has whatever the previous version is. For environments that try to do more controlled stepping of release changes instead of just taking the latest, is there any URL for previous versions of

Where to get old RPMs?

2019-10-30 Thread Reid Pinchback
With the latest round of C* updates, the yum repo no longer has whatever the previous version is. For environments that try to do more controlled stepping of release changes instead of just taking the latest, is there any URL for previous versions of RPMs? Previous jars I can find easily

Re: What is the status of counters? Should I use them?

2019-10-30 Thread advicerywo555
What about repairs? Can I just repair that table on a regular basis as any other? ‐‐‐ Original Message ‐‐‐ On Wednesday, 30 October 2019 16:26, Jon Haddad wrote: > Counters are good for things like page views, bad for money. Yes they can > under or overcount in certain situations.

Re: What is the status of counters? Should I use them?

2019-10-30 Thread Jon Haddad
Counters are good for things like page views, bad for money. Yes they can under or overcount in certain situations. If your cluster is stable, you'll see very little of it in practice. I've done quite a bit of tuning of counters. Here's the main takeaways: * They do a read before a write, so

Re: Cassandra on Kubernetes

2019-10-30 Thread Jean-Armel Luce
Hi, We are currently developping CassKop, a Cassandra operator for K8S. This operator is developped in Go, based on the operator-sdk framework. At this time of the project, the goal is to deploy a Cassandra cluster in 1 Kubernetes datacenter, but this will change in next versions to deal with

What is the status of counters? Should I use them?

2019-10-30 Thread advicerywo555
Hi, I would like to use counters but I am not sure I should. I read a lot of articles on the Internet how counters are bad / wrong / inaccurate etc etc ... Let's be honest, counters in Cassandra have quite a bad reputation. But all stuff I read about that was quite old, I know there was

Cassandra on Kubernetes

2019-10-30 Thread Akshit Jain
Hi everyone, Is there anyone who is running Cassandra on K8s clusters. It would be great if you can share your experience , the operator you are using and the overall stability of stateful sets in Kubernetes -Akshit

Re: Aws instance stop and star with ebs

2019-10-30 Thread Rahul Reddy
And also aws ec2 stop and start comes with new instance with same ip and all our file systems are in ebs mounted fine. Does coming new instance with same ip cause any gossip issues? On Tue, Oct 29, 2019, 6:16 PM Rahul Reddy wrote: > Thanks Alex. We have 6 nodes in each DC with RF=3 with CL