Unable to start cassandra on GCP (Google cloud) using public email address

2019-12-18 Thread Manu Chadha
Hi Apologies if this isn’t the right group to ask questions. If it isn’t, please let me know wehre I should send such messages. I am trying to run cassandra on google cloud and want to use external IP to run cassandra. I specified the external address in rpc_address in but got error when

RE: Reducing no. of nodes to 0 without losing data

2020-10-08 Thread Manu Chadha
Tried persistence as well (just table schemas, no data). It works as well across restarts. Next challenge for me is to find out how to backup the data in case there is a cluster wide data loss. Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows 10 From: Manu

RE: Reducing no. of nodes to 0 without losing data

2020-10-08 Thread Manu Chadha
, 2020 at 12:40 AM Oleksandr Shulgin mailto:oleksandr.shul...@zalando.de>> wrote: On Thu, Oct 8, 2020 at 12:21 AM Manu Chadha mailto:manu.cha...@hotmail.com>> wrote: Hi I have created a Cassandra cluster on Kubernetes using cass-operator on gcp. It is for my personal experimentation. T

backup data with Cass-operator and Medusa

2020-10-09 Thread Manu Chadha
Hi By when the Medusa integration for backing up C* using Cass-Operator would be available? Found this discussion - https://community.datastax.com/questions/6364/triggering-consistent-backups.html Would this be the recommended way? Till the time it becomes available what other options could I

Re: backup data with Cass-operator and Medusa

2020-10-09 Thread Manu Chadha
ets. I hope to have medusa integration land within the next couple releases of cass-operator. [1] https://github.com/thelastpickle/cassandra-medusa/pull/141 [2] https://github.com/thelastpickle/medusa-operator Cheers John On Fri, Oct 9, 2020 at 12:04 PM Manu Chadha mailto:manu.cha...@hotmail.com&g

Reducing no. of nodes to 0 without losing data

2020-10-07 Thread Manu Chadha
Hi I have created a Cassandra cluster on Kubernetes using cass-operator on gcp. It is for my personal experimentation. To avoid incurring cost, I want to stop the cluster when I am not using it and start it when I need it without losing data. Is there a way to do so? Would setting number of

RE: Reducing no. of nodes to 0 without losing data

2020-10-08 Thread Manu Chadha
wlink/?LinkId=550986> for Windows 10 From: Oleksandr Shulgin<mailto:oleksandr.shul...@zalando.de> Sent: 08 October 2020 05:40 To: User<mailto:user@cassandra.apache.org> Subject: Re: Reducing no. of nodes to 0 without losing data On Thu, Oct 8, 2020 at 12:21 AM Manu Chadha mailto:man

reverse paging state

2020-10-23 Thread Manu Chadha
In Java driver 3.4.0, how does one revert the order of paging? I want to implement a “Back” button but I can’t figure out from the API docs if/how I can make Cassandra (via the Java driver) search backwards. https://docs.datastax.com/en/drivers/java/3.4/ The code I have written currently is

RE: reverse paging state

2020-10-26 Thread Manu Chadha
ith tradeoff for performance: https://docs.datastax.com/en/developer/java-driver/4.9/manual/core/paging/#offset-queries On Fri, Oct 23, 2020 at 10:00 AM Manu Chadha mailto:manu.cha...@hotmail.com>> wrote: In Java driver 3.4.0, how does one revert the order of paging? I want to implement a “Back” butt

migrating driver from 3.4 to 4.9

2020-10-26 Thread Manu Chadha
I am considering migration my application Cassandra Java driver from 3.4 to 4.9. Are there breaking changes between 3.4 and 4.9 (I expect so to be honest but I want to get a feel of how much effort there might be). I want to implement backward paging feature in my application. I can either

RE: migrating driver from 3.4 to 4.9

2020-10-27 Thread Manu Chadha
g on your testing guidelines) probably warrants a lot of testing on the app itself. Have a look at resiliance4j retry component if you need to go down that route - it’s pretty handy. Regards, Johnny On Tue, 27 Oct 2020 at 08:14, Manu Chadha mailto:manu.cha...@hotmail.com>> wrote: Than

RE: migrating driver from 3.4 to 4.9

2020-10-27 Thread Manu Chadha
Thanks Erick. I agree that I should considering moving to latest version. Sent from Mail for Windows 10 From: Erick Ramirez Sent: 26 October 2020 22:55 To:

what is allowed and not allowed w.r.t altering cassandra table schema

2020-07-15 Thread Manu Chadha
Hi What is allowed and not allowed w.r.t altering Cassandra table schema? Creating the right schema seems like the most step w.r.t using Cassandra. Coming from relational background, I still struggle to create schema which leverages duplication and per-query table (I end up creating

Is there a cqlsh method which could tell me if a column is empty or not?

2020-08-02 Thread Manu Chadha
Hi I am storing image data as `base64` in rows of my table. If I query all records then the image data (which is large text) makes it difficult to read results in cqlsh. Is there a `cqlsh` method which can just tell me if the column is empty or not? Something like select

RE: What is the way to scale down Cassandra/Kubernetes cluster from 3 to 1 nodes using cass-operator

2020-07-02 Thread Manu Chadha
h just the size parameter changed. Operator will bring down Cassandra nodes accordingly. No need to shut down or restart. Thanks and Regards, Vishal On Thu, Jul 2, 2020, 3:41 AM Oleksandr Shulgin mailto:oleksandr.shul...@zalando.de>> wrote: On Thu, Jul 2, 2020 at 9:29 AM Manu Chadha mailto:manu

RE: Cassandra container, Google Cloud and Kubernetes

2020-06-30 Thread Manu Chadha
Hi Erick It might be useful if the answer from Willrof is added to your Wiki. It solved my problem and could be very useful to people wanting to run Cass-Operator. Please check -

design principle to manage roll back

2020-07-14 Thread Manu Chadha
Hi What are the design approaches I can follow to ensure that data is consistent from an application perspective (not from individual tables perspective). I am thinking of issues which arise due to unavailability of rollback or executing atomic transactions in Cassandra. Is Cassandra not

RE: design principle to manage roll back

2020-07-14 Thread Manu Chadha
discussing to come up with new ideas and sort out my doubts. Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows 10 From: Manu Chadha<mailto:manu.cha...@hotmail.com> Sent: 14 July 2020 09:32 To: user@cassandra.apache.org<mailto:user@cassandra.apache.org> S

RE: design principle to manage roll back

2020-07-14 Thread Manu Chadha
data) & Relational/Single Database (for transactional non-big data part) Sent using Zoho Mail<https://www.zoho.com/mail/> On Tue, 14 Jul 2020 10:47:33 +0430 Manu Chadha wrote Hi What are the design approaches I can follow to ensure that data is consistent from an appli

RE: design principle to manage roll back

2020-07-14 Thread Manu Chadha
om/scalar-labs/scalardb When you do operations through Scalar DB to Cassandra, you can achieve ACID transactions on Cassandra. If there is a failure during a transaction, it will be properly rollbacked or rollforwarded based on the transaction states. Hope it helps. Thanks, Hiro On Tue, Jul 14,

Question on cass-operator

2020-07-03 Thread Manu Chadha
Hi I have a 3 node Kubernetes cluster and I have set up Cassandra on it using Cass-Operator. What does the 2/2 mean in the output of the following command kubectl get all -n cass-operator NAMEREADY STATUSRESTARTS AGE pod/cass-operator-78c6469c6-6qhsb

What is the way to scale down Cassandra/Kubernetes cluster from 3 to 1 nodes using cass-operator

2020-07-02 Thread Manu Chadha
Hi I have created a cluster using cass-operator - https://github.com/datastax/cass-operator. I suppose by default 3 replicas (3 node cluster) are created. I want to scale down the cluster from 3 to 1 nodes? I executed kubectl scale sts cluster1-dc1-default-sts --replicas=1 -n cass-operator

RE: What is the way to scale down Cassandra/Kubernetes cluster from 3 to 1 nodes using cass-operator

2020-07-02 Thread Manu Chadha
.de> Sent: 02 July 2020 08:27 To: User<mailto:user@cassandra.apache.org> Subject: Re: What is the way to scale down Cassandra/Kubernetes cluster from 3 to 1 nodes using cass-operator On Thu, Jul 2, 2020 at 9:21 AM Manu Chadha mailto:manu.cha...@hotmail.com>> wrote: Hi I have crea

RE: What is the way to scale down Cassandra/Kubernetes cluster from 3 to 1 nodes using cass-operator

2020-07-02 Thread Manu Chadha
Re-edited as code and my notes are mixed up. Changed color of code to red Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows 10 From: Manu Chadha<mailto:manu.cha...@hotmail.com> Sent: 02 July 2020 08:21 To: user@cassandra.apache.org<mailto:user@cassa

RE: Cassandra container, Google Cloud and Kubernetes

2020-06-29 Thread Manu Chadha
? Thanks Manu Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows 10 From: Manu Chadha<mailto:manu.cha...@hotmail.com> Sent: 25 June 2020 07:48 To: user@cassandra.apache.org<mailto:user@cassandra.apache.org> Cc: christopher.bradf...@datastax.com<mai

RE: Cassandra container, Google Cloud and Kubernetes

2020-06-29 Thread Manu Chadha
application can access it. Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows 10 From: Manu Chadha<mailto:manu.cha...@hotmail.com> Sent: 29 June 2020 22:02 To: user@cassandra.apache.org<mailto:user@cassandra.apache.org> Cc: christopher.bradf...@datastax.com<mai

Cassandra container, Google Cloud and Kubernetes

2020-06-24 Thread Manu Chadha
Hi I want to run Cassandra container in GCP and want to orchestrate the containers using Kubernetes. I have a Cassandra image in my Docker Registry. Following the steps from the following tutorial, I have created a cluster and have Cassandra running on it.

RE: Cassandra container, Google Cloud and Kubernetes

2020-06-25 Thread Manu Chadha
dle these tasks for you and should be considered. ~Chris Christopher Bradford On Thu, Jun 25, 2020 at 2:39 AM Manu Chadha mailto:manu.cha...@hotmail.com>> wrote: Thanks. One more concern popped up. It seems Cass is not recommended for production. However, I need this specifically for

RE: Cassandra container, Google Cloud and Kubernetes

2020-06-25 Thread Manu Chadha
Dear Erick I have started looking at Cass. Referring to the release notes, does Cass support 3.11.4? https://docs.datastax.com/en/cass-operator/doc/cass-operator/cassOperatorReleaseNotes.html regards Manu Sent from Mail for Windows 10 From:

RE: Cassandra container, Google Cloud and Kubernetes

2020-06-25 Thread Manu Chadha
Thanks. One more concern popped up. It seems Cass is not recommended for production. However, I need this specifically for production. What is your take on this? “ The use of Cass Operator with Cassandra 3.11.6 is intended as a Technology Preview only. Using Cass Operator with Cassandra is not

RE: Cassandra container, Google Cloud and Kubernetes

2020-06-25 Thread Manu Chadha
6.8.0 will not function with the current Cass Operator.” Thanks Manu From: Manu Chadha<mailto:manu.cha...@hotmail.com> Sent: 25 June 2020 07:12 To: user@cassandra.apache.org<mailto:user@cassandra.apache.org> Subject: RE: Cassandra container, Google Cloud and Kubernetes Dear Erick I

Can cassandra pick configuration from environment variables

2020-06-28 Thread Manu Chadha
Hi Cassandra pick configuration from Cassandra.yaml (eg. Listen_address). Can I set the values of listen_address, rpc_address etc. from environment variables? Thanks Manu Sent from Mail for Windows 10

Unable to connect with Cassandra Docker image from outside

2020-06-04 Thread Manu Chadha
Hi I want to run cassandra docker image and want to connect it with my application running in another container. I am on Windows10 and both containers are running on same Windows10 Home machine. I also have Cassandra installed on the machine as standalone application (without Docker). I

Consistency level shows as null in Java driver

2020-06-12 Thread Manu Chadha
Hi In my Cassandra Java driver code, I am creating a query and then I print the consistency level of the query val whereClause = whereConditions(tablename, id); cassandraRepositoryLogger.trace("getRowsByPartitionKeyId: looking in table "+tablename+" with partition key

Do I understand the working of RF and CL correctly?

2020-06-12 Thread Manu Chadha
Hi Just want to confirm whether I understand RF and CL correctly. I have got 2 Cassandra nodes up C:\Users\manuc\Documents\manu\codingjedi>docker container ps -a CONTAINER IDIMAGE COMMAND CREATED STATUSPORTS

ServerError: java.lang.AssertionError on running Docker container with mounted data directory

2020-06-13 Thread Manu Chadha
I am running Cassandra Docker image on my Windows 10 following the steps here -https://hub.docker.com/_/cassandra Specifically about the section - Where to store data - I have started the Images as follows container 1 docker run -v

persist data such that a new container can reuse existing schema and data

2020-06-13 Thread Manu Chadha
Hi I create a Cassandra Container, run it, create schema and add data to it. When I later stop the Container and delete it and create a new one from the image, the previously created schema and data is lost. Can I/How can I persist data and schema such that whenever a container is created

Cassandra and Docker

2020-06-03 Thread Manu Chadha
Hi I want to run Cassandra within Docker. I am new to both to be honest. 1. Is it better to use Cassandra within Docker or is it better to install/run Cassandra directly on a VM in the cloud? 2. Is there a Docker image for Cassandra (for 3.11.4) which I can pull/use? 3. How will data

RE: Cassandra and Docker

2020-06-03 Thread Manu Chadha
I forgot to mention, I am on Windows 10 Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows 10 From: Manu Chadha Sent: Wednesday, June 3, 2020 7:04:03 AM To: user@cassandra.apache.org Subject: Cassandra and Docker Hi I want

How to specify a configuration in cass-operator for Cassandra.yaml

2020-07-26 Thread Manu Chadha
Hi I am using cass-operator to run Cassandra in Kubernetes. I am also using ScalarDB to provide ACID support in Cassandra. One pre-requisite for ScalarDB is to change the commitlog_sync to batch. “Change commitlog_sync from periodic to batch in cassandra.yaml not to lose data when quorum of

RE: How to specify a configuration in cass-operator for Cassandra.yaml

2020-07-27 Thread Manu Chadha
Thanks. I am making a personal project so stopping K8S isn’t an issue for me personally. The reason I asked about stopping K8S is because I could run the `kubectl edit` command on the cass-operator...yaml file but not on example..yaml file. As the configuration is in the example...yaml file, I

RE: How to specify a configuration in cass-operator for Cassandra.yaml

2020-07-27 Thread Manu Chadha
w to specify a configuration in cass-operator for Cassandra.yaml Yes, you're right -- you need to override the defaults by specifying the configuration in the operator yaml spec: spec: ... config: cassandra-yaml: ... commitlog_sync: batch ... Cheers! On Mon, 27 Ju

Application level pagination in Cassandra

2020-07-30 Thread Manu Chadha
Hi This question is part-Cassandra and part ScalarDB. I am using ScalarDB which provide ACID support on top of `Cassandra`. The library seem to be working well! Unfortunately, ScalarDB doesn't support pagination though so I have to implement it in the application. Consider this scenario in

RE: Enable Ttracing

2020-11-30 Thread Manu Chadha
Hi Mick I just took a cursory look at the presentation and Zipkin.io. Would using Zipkin degrade performance? Would it be considerable? Regards Manu Sent from Mail for Windows 10 From: Mick Semb Wever Sent: 29 November

ScalarDB

2020-12-10 Thread Manu Chadha
Hi Has anyone in the group used ScalarDB which adds ACID functionality to Cassandra? I am facing couple of issues (which actually might be how ScalarDB is suppose to work). I need advice on how to solve the issues I have created the issues in `SO` 1.

Cassandra and GCP

2020-12-17 Thread Manu Chadha
Hi I am moving my MVP application to GCP. It is a general web application with standard database workload (CRUD). I am not expecting much traffic to begin with. I don’t have any experience in putting applications in production. Would it be possible to change the machine configuration later

Cassandra monitoring

2020-12-18 Thread Manu Chadha
Hi Could the group please suggest options for monitoring Cassandra in production (GCP)? I am trying to use Prometheus and followed this tutorial - https://www.robustperception.io/monitoring-cassandra-with-prometheus Sent from Mail for Windows

RE: Cassandra monitoring

2020-12-18 Thread Manu Chadha
itoring would be welcome. Thanks Manu Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows 10 From: Manu Chadha<mailto:manu.cha...@hotmail.com> Sent: 18 December 2020 08:57 To: user@cassandra.apache.org<mailto:user@cassandra.apache.org> Subject: Cassand

RE: Cassandra monitoring

2020-12-18 Thread Manu Chadha
t you try MCAC for DataStax, available here => https://github.com/datastax/metric-collector-for-apache-cassandra Cheers, Le ven. 18 déc. 2020 à 10:01, Manu Chadha mailto:manu.cha...@hotmail.com>> a écrit : Sorry, clicked send too soon. I am trying to use Prometheus and followed th

RE: Cassandra monitoring

2020-12-18 Thread Manu Chadha
ackslash to frontslash at the end. To be honest, still clueless on how to get metrics on my windows machine. Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows 10 From: Manu Chadha<mailto:manu.cha...@hotmail.com> Sent: 18 December 2020 10:04 To: user@cassandra.apache.

Use NetworkTopologyStrategy for single data center and add data centers later

2020-12-19 Thread Manu Chadha
Is it possible to use NetworkTopologyStrategy when creating a keyspace and add data centers later? I am just starting with an MVP application and I don't expect much traffic or data. Thus I have created only one data center. However, I'll like to add more data centers later if needed I notice

add javaagent MCAC (metric collector for apache cassandra) using cass-operator

2020-12-19 Thread Manu Chadha
I am using cass-operator (https://github.com/datastax/cass-operator) I want to add MCAC javaagent in my production system to monitor metrics (https://github.com/datastax/metric-collector-for-apache-cassandra). How can I do it? The general way is to add the agent information is to change

RE: add javaagent MCAC (metric collector for apache cassandra) using cass-operator

2020-12-19 Thread Manu Chadha
fwlink/?LinkId=550986> for Windows 10 From: Manu Chadha<mailto:manu.cha...@hotmail.com> Sent: 19 December 2020 09:31 To: user@cassandra.apache.org<mailto:user@cassandra.apache.org> Subject: add javaagent MCAC (metric collector for apache cassandra) using cass-operator I am using cass

Why the default value for reclaimPolicy is Delete and not Retain

2020-12-19 Thread Manu Chadha
Hi In cass-operator, the storage.yaml has reclaim policy Delete. Should it be Retain by default to avoid accidental deletion of data? thanks Sent from Mail for Windows 10

RE: Cassandra in a container - what to do (sequence of events) to snapshot the storage volume?

2020-11-12 Thread Manu Chadha
Hi Jeff By “dropping” the periodic time, do you mean making it 0 or commenting commit log or changing commit log to batch? Referring to the comments in Cassandra.yaml, if I use commitlog_sync as batch with 2ms window, does it mean that when a write is done on the db, then it is immediately

Cassandra and Vertica

2020-11-15 Thread Manu Chadha
Has anyone here used Vertica? Out of curiosity, are Cassandra and Vertica databases similar? I recently spent time reading about Vertica. It has features like columnar data structures called projections which optimise query execution. It also has no single point of failure. But it comes out as

RE: username/password error when using nodetool flush

2021-01-01 Thread Manu Chadha
In fact, I notice that I can’t run any nodetool command. I get the error even when running nodetool status command Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows 10 From: Manu Chadha<mailto:manu.cha...@hotmail.com> Sent: 01 January 2021 20

Re: username/password error when using nodetool flush

2021-01-01 Thread Manu Chadha
just try nodetool flush and see if that works. Regards Paul Sent from my iPhone On 1 Jan 2021, at 20:41, Manu Chadha wrote:  In fact, I notice that I can’t run any nodetool command. I get the error even when running nodetool status command Sent from Mail<https://go.microsoft.com/fwl

username/password error when using nodetool flush

2021-01-01 Thread Manu Chadha
Hi Happy New Year. I am trying to use `nodetool flush -u username` but I get error `nodetool: Failed to connect to '127.0.0.1:7199' - FailedLoginException: 'Invalid username or password'.` I am using the same credentials which I use in `cqlsh -u -p`. As far as I can observe, I am using the

RE: unable to restore data from copied data directory

2021-01-04 Thread Manu Chadha
rms as one back-up solution. They can attach that disk snapshot to a new VM (configured the same as the previous one) as needed. I don’t know all the particulars of this approach, though. Sean Durity – Staff Systems Engineer, Cassandra From: Manu Chadha Sent: Saturday, January 2, 202

unable to restore data from copied data directory

2021-01-02 Thread Manu Chadha
Hi Can I just copy the keyspace folders into new cassandra installation s backup and restore strategy? I am trying to do that but it isn’t working. I am using `K8ssandra` to run my single node C* cluster. I am experimenting with data backup and restore. Though K8ssandra uses medusa for data

RE: unable to restore data from copied data directory

2021-01-02 Thread Manu Chadha
gmail.com> Sent: 02 January 2021 20:57 To: user@cassandra.apache.org<mailto:user@cassandra.apache.org> Subject: Re: unable to restore data from copied data directory On Jan 2, 2021, at 7:30 AM, Manu Chadha wrote:  Hi Can I just copy the keyspace folders into new cassandra ins

RE: Fatal Java error when starting cassandra

2021-03-18 Thread Manu Chadha
Thanks. No success unfortunately From: Regis Le Bretonnic Sent: 18 March 2021 07:13 To: user@cassandra.apache.org Subject: RE: Fatal Java error when starting cassandra Probably DLLs that are not registered. You should cleanly install Cassandra and java... and then copy your keyspaces

Fatal Java error when starting cassandra

2021-03-18 Thread Manu Chadha
Hi Cassandra doesn't start on my PC. I recently changed my machine. I simply copied the old Cassandra folder in the new machine. When I start Cassandra, I get error. Sorry for dumping the whole thing here but I don't know where to look. My preference is not to reinstall Cassandra. I am using