Re: Cassandra container, Google Cloud and Kubernetes

[Erick Ramirez]

It's really a Kubernetes question but the TL;DR is you need to expose the
services of your k8s cluster to the outside world.

Have a look at this blog post to get you started --
http://alesnosek.com/blog/2017/02/14/accessing-kubernetes-pods-from-outside-of-the-cluster/.
Cheers!

>

Re: Cassandra write path during the decommissioning process

[Jai Bheemsen Rao Dhanwada]

Thank you

On Mon, Jun 29, 2020 at 1:01 PM Jeff Jirsa  wrote:

> When range movements happen (bootstrap and decom are the same here), the
> reads go to the existing replicas, and the writes go to both existing and
> the gaining replicas.
>
> This is because the decom (or bootstrap, or move) may fail at any time, so
> you need to make sure the consistency contract is maintained whether the
> range movement succeeds or fails.
>
> Quorum calculations are adjusted to accommodate this - for example, if you
> have RF=3, and you add a new host , the RF = 3 (existing) + 1 (pending),
> quorum becomes 3 of 4.
>
> On Mon, Jun 29, 2020 at 12:48 PM Jai Bheemsen Rao Dhanwada <
> jaibheem...@gmail.com> wrote:
>
>> Can someone please share thoughts on this?
>>
>> On Wed, Jun 24, 2020 at 4:25 PM Jai Bheemsen Rao Dhanwada <
>> jaibheem...@gmail.com> wrote:
>>
>>> Hello,
>>>
>>> I would like to understand how the writes happen when there is a node in
>>> the cluster that is being decommissioned.
>>>
>>> During the decommission process, the node will send the streams to the
>>> rest of the nodes that it owns. what happened to the read and write of the
>>> data that is owned by the node that is being decommissioned? does it even
>>> receive reads and writes or the nodes doesn't receive any writes?
>>>
>>>
>>>

RE: Cassandra container, Google Cloud and Kubernetes

[Manu Chadha]

In continuation to my previous message, I can see the nodes are up on the GCP 
dashboard. I can ping the external IP from my laptop but when I run `cqlsh 
external_ip 9042` then the connection fails.

How do I go about connecting the K8s/Cassandra cluster to outside work so that 
my web application can access it.

Sent from Mail for Windows 10

From: Manu Chadha
Sent: 29 June 2020 22:02
To: user@cassandra.apache.org
Cc: christopher.bradf...@datastax.com
Subject: RE: Cassandra container, Google Cloud and Kubernetes

Hi

I have started using Cass-Operator and the setup worked like a charm! 
https://github.com/datastax/cass-operator

I have an issue though. My cluster is up and running on GCP. But how do I 
access it from my laptop? Sorry, new to Kubernetes so do not know how to access 
the cluster from outside?

Thanks
Manu

Sent from Mail for Windows 10

From: Manu Chadha
Sent: 25 June 2020 07:48
To: user@cassandra.apache.org
Cc: christopher.bradf...@datastax.com
Subject: RE: Cassandra container, Google Cloud and Kubernetes

Thanks Chris. This is useful.

Sent from Mail for Windows 10

From: Christopher Bradford
Sent: 25 June 2020 07:46
To: user@cassandra.apache.org
Cc: christopher.bradf...@datastax.com
Subject: Re: Cassandra container, Google Cloud and Kubernetes

Hi Manu,

OSS Cassandra support in cass-operator is marked as a Technology Preview as 
there is no integrated solution for repairs or backup / restore functionality 
at this time. If you are comfortable managing these operational tasks either 
manually or through other complementary tools (Reaper and Medusa come to mind) 
then there should not be anything blocking you from using this operator. As 
Erick mentioned there are other operators available that may or may not handle 
these tasks for you and should be considered.

~Chris

Christopher Bradford



On Thu, Jun 25, 2020 at 2:39 AM Manu Chadha 
mailto:manu.cha...@hotmail.com>> wrote:
Thanks. One more concern popped up. It seems Cass is not recommended for 
production. However, I need this specifically for production. What is your take 
on this?

“
The use of Cass Operator with Cassandra 3.11.6 is intended as a Technology 
Preview only. Using Cass Operator with Cassandra is not recommended at this 
time for production environments.
“

Sent from Mail for Windows 10

From: Erick Ramirez
Sent: 25 June 2020 07:25
To: user@cassandra.apache.org
Subject: Re: Cassandra container, Google Cloud and Kubernetes

It seems that 3.11.4 is not supported. I am happy to move up to 3.11.6 but is 
3.11.6 backward compatible with 3.11.4? I don’t want start changing my driver 
code in the application.

There isn't a breaking change from a driver perspective between 3.11.4 and 
3.11.6 so you don't need to rewrite your code. Cheers!

RE: Cassandra container, Google Cloud and Kubernetes

[Manu Chadha]

Hi

I have started using Cass-Operator and the setup worked like a charm! 
https://github.com/datastax/cass-operator

I have an issue though. My cluster is up and running on GCP. But how do I 
access it from my laptop? Sorry, new to Kubernetes so do not know how to access 
the cluster from outside?

Thanks
Manu

Sent from Mail for Windows 10

From: Manu Chadha
Sent: 25 June 2020 07:48
To: user@cassandra.apache.org
Cc: christopher.bradf...@datastax.com
Subject: RE: Cassandra container, Google Cloud and Kubernetes

Thanks Chris. This is useful.

Sent from Mail for Windows 10

From: Christopher Bradford
Sent: 25 June 2020 07:46
To: user@cassandra.apache.org
Cc: christopher.bradf...@datastax.com
Subject: Re: Cassandra container, Google Cloud and Kubernetes

Hi Manu,

OSS Cassandra support in cass-operator is marked as a Technology Preview as 
there is no integrated solution for repairs or backup / restore functionality 
at this time. If you are comfortable managing these operational tasks either 
manually or through other complementary tools (Reaper and Medusa come to mind) 
then there should not be anything blocking you from using this operator. As 
Erick mentioned there are other operators available that may or may not handle 
these tasks for you and should be considered.

~Chris

Christopher Bradford



On Thu, Jun 25, 2020 at 2:39 AM Manu Chadha 
mailto:manu.cha...@hotmail.com>> wrote:
Thanks. One more concern popped up. It seems Cass is not recommended for 
production. However, I need this specifically for production. What is your take 
on this?

“
The use of Cass Operator with Cassandra 3.11.6 is intended as a Technology 
Preview only. Using Cass Operator with Cassandra is not recommended at this 
time for production environments.
“

Sent from Mail for Windows 10

From: Erick Ramirez
Sent: 25 June 2020 07:25
To: user@cassandra.apache.org
Subject: Re: Cassandra container, Google Cloud and Kubernetes

It seems that 3.11.4 is not supported. I am happy to move up to 3.11.6 but is 
3.11.6 backward compatible with 3.11.4? I don’t want start changing my driver 
code in the application.

There isn't a breaking change from a driver perspective between 3.11.4 and 
3.11.6 so you don't need to rewrite your code. Cheers!

Re: Cassandra write path during the decommissioning process

[Jeff Jirsa]

When range movements happen (bootstrap and decom are the same here), the
reads go to the existing replicas, and the writes go to both existing and
the gaining replicas.

This is because the decom (or bootstrap, or move) may fail at any time, so
you need to make sure the consistency contract is maintained whether the
range movement succeeds or fails.

Quorum calculations are adjusted to accommodate this - for example, if you
have RF=3, and you add a new host , the RF = 3 (existing) + 1 (pending),
quorum becomes 3 of 4.

On Mon, Jun 29, 2020 at 12:48 PM Jai Bheemsen Rao Dhanwada <
jaibheem...@gmail.com> wrote:

> Can someone please share thoughts on this?
>
> On Wed, Jun 24, 2020 at 4:25 PM Jai Bheemsen Rao Dhanwada <
> jaibheem...@gmail.com> wrote:
>
>> Hello,
>>
>> I would like to understand how the writes happen when there is a node in
>> the cluster that is being decommissioned.
>>
>> During the decommission process, the node will send the streams to the
>> rest of the nodes that it owns. what happened to the read and write of the
>> data that is owned by the node that is being decommissioned? does it even
>> receive reads and writes or the nodes doesn't receive any writes?
>>
>>
>>

Re: Cassandra write path during the decommissioning process

[Jai Bheemsen Rao Dhanwada]

Can someone please share thoughts on this?

On Wed, Jun 24, 2020 at 4:25 PM Jai Bheemsen Rao Dhanwada <
jaibheem...@gmail.com> wrote:

> Hello,
>
> I would like to understand how the writes happen when there is a node in
> the cluster that is being decommissioned.
>
> During the decommission process, the node will send the streams to the
> rest of the nodes that it owns. what happened to the read and write of the
> data that is owned by the node that is being decommissioned? does it even
> receive reads and writes or the nodes doesn't receive any writes?
>
>
>

Re: Can cassandra pick configuration from environment variables

[Reid Pinchback]

It’s pretty easy to make Ansible, or Python with Jinja by itself if you don’t 
use Ansible, and just templatize your config file so the environment variables 
get substituted.

From: Jeff Jirsa 
Reply-To: "user@cassandra.apache.org" 
Date: Monday, June 29, 2020 at 10:36 AM
To: cassandra 
Subject: Re: Can cassandra pick configuration from environment variables

Message from External Sender
You can probably implement a custom config loader that pulls all the config 
from env vars, if you're so inclined (a bit of java, the interface has a single 
method, maybe one or two hooks into the db, which may be suitable for 
committing for general purpose use).

On Mon, Jun 29, 2020 at 4:35 AM Angelo Polo 
mailto:language.de...@gmail.com>> wrote:
You can, however, set the environment variable CASSANDRA_CONF to direct the 
startup script to the configuration directory that holds cassandra.yaml, 
cassandra-env.sh, etc. So while you can't set individual C* configuration 
parameters from environment variables, you could have different configuration 
directories (can think of them as different profiles) and specify at startup 
which to use.

Best,
Angelo Polo

On Sun, Jun 28, 2020 at 2:28 PM Erick Ramirez 
mailto:erick.rami...@datastax.com>> wrote:
You can't. You can only configure Cassandra by setting the properties in 
cassandra.yaml file. Cheers!

Re: Can cassandra pick configuration from environment variables

[Jeff Jirsa]

You can probably implement a custom config loader that pulls all the config
from env vars, if you're so inclined (a bit of java, the interface has a
single method, maybe one or two hooks into the db, which may be suitable
for committing for general purpose use).

On Mon, Jun 29, 2020 at 4:35 AM Angelo Polo 
wrote:

> You can, however, set the environment variable CASSANDRA_CONF to direct
> the startup script to the configuration directory that holds
> cassandra.yaml, cassandra-env.sh, etc. So while you can't set individual C*
> configuration parameters from environment variables, you could have
> different configuration directories (can think of them as different
> profiles) and specify at startup which to use.
>
> Best,
> Angelo Polo
>
> On Sun, Jun 28, 2020 at 2:28 PM Erick Ramirez 
> wrote:
>
>> You can't. You can only configure Cassandra by setting the properties in
>> cassandra.yaml file. Cheers!
>>
>>>

Announcing ApacheCon @Home 2020

[Rich Bowen]

Hi, Apache enthusiast!

(You’re receiving this because you’re subscribed to one or more dev or 
user mailing lists for an Apache Software Foundation project.)


The ApacheCon Planners and the Apache Software Foundation are pleased to 
announce that ApacheCon @Home will be held online, September 29th 
through October 1st, 2020. We’ll be featuring content from dozens of our 
projects, as well as content about community, how Apache works, business 
models around Apache software, the legal aspects of open source, and 
many other topics.


Full details about the event, and registration, is available at 
https://apachecon.com/acah2020


Due to the confusion around how and where this event was going to be 
held, and in order to open up to presenters from around the world who 
may previously have been unable or unwilling to travel, we’ve reopened 
the Call For Presentations until July 13th. Submit your talks today at 
https://acna2020.jamhosted.net/


We hope to see you at the event!
Rich Bowen, VP Conferences, The Apache Software Foundation

-
To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org
For additional commands, e-mail: user-h...@cassandra.apache.org

Re: Can cassandra pick configuration from environment variables

[Angelo Polo]

You can, however, set the environment variable CASSANDRA_CONF to direct the
startup script to the configuration directory that holds cassandra.yaml,
cassandra-env.sh, etc. So while you can't set individual C* configuration
parameters from environment variables, you could have different
configuration directories (can think of them as different profiles) and
specify at startup which to use.

Best,
Angelo Polo

On Sun, Jun 28, 2020 at 2:28 PM Erick Ramirez 
wrote:

> You can't. You can only configure Cassandra by setting the properties in
> cassandra.yaml file. Cheers!
>
>>