RE: Check out new features in K8ssandra and Mission Control

[Durity, Sean R via user]

The k8ssandra requirement is a major blocker.


Sean R. Durity


INTERNAL USE
From: Christopher Bradford 
Sent: Tuesday, February 27, 2024 9:49 PM
To: user@cassandra.apache.org
Cc: Christopher Bradford 
Subject: [EXTERNAL] Re: Check out new features in K8ssandra and Mission Control

Hey Jon, * What aspects of Mission Control are dependent on using K8ssandra? 
Mission Control bundles in K8ssandra for the core automation workflows 
(lifecycle management, cluster operations, medusa &. reaper). In fact we 
include the K8ssandraSpec

Hey Jon,

* What aspects of Mission Control are dependent on using K8ssandra?

Mission Control bundles in K8ssandra for the core automation workflows 
(lifecycle management, cluster operations, medusa &. reaper). In fact we 
include the K8ssandraSpec in the top-level MissionControlCluster resource 
verbatim.

 * Can Mission Control work without K8ssandra?

Not at this time, K8ssandra powers a significant portion of the C* side of the 
stack. Mission Control provides additional functionality (web interface, 
certificate coordination, observability stack, etc) and applies some 
conventions to how K8ssandra objects are created / templated out, but the 
actually K8ssandra operator present in MC is the same one available via the 
Helm charts.

* Is mission control open source?

Not at this time. While the majority of the Kubernetes operators are open 
source as part of K8ssandra, there are some pieces which are closed source. I 
expect some of the components may move from closed source into K8ssandra over 
time.

* I'm not familiar with Vector - does it require an agent?

Vector 
[vector.dev]<https://urldefense.com/v3/__https:/vector.dev/__;!!M-nmYVHPHQ!L0M2-GDjSTuPzpD3TvfxiLgm2I5pLnFGmW5BhdhaYQBI6RlxK6e6ZMM2khnp8YUhfnqy2wYzjPX-UYAG9q8HOgVBPg$>
 is a pretty neat project. We run a few of their components as part of the 
stack. There is a DaemonSet which runs on each worker to collect host level 
metrics and scrape logs being emitted by containers, a sidecar for collecting 
logs from the C* container, and an aggregator which performs some filtering and 
transformation before pushing to an object store.

* Is Reaper deployed separately or integrated in?

Reaper is deployed as part of the cluster creation workflow. It is spun up and 
configured to connect to the cluster automatically.

~Chris

Christopher Bradford



On Tue, Feb 27, 2024 at 6:55 PM Jon Haddad 
mailto:j...@jonhaddad.com>> wrote:
Hey Chris - this looks pretty interesting!  It looks like there's a lot of 
functionality in here.

* What aspects of Mission Control are dependent on using K8ssandra?
* Can Mission Control work without K8ssandra?
* Is mission control open source?
* I'm not familiar with Vector - does it require an agent?
* Is Reaper deployed separately or integrated in?

Thanks!  Looking forward to trying this out.
Jon


On Tue, Feb 27, 2024 at 7:07 AM Christopher Bradford 
mailto:bradfor...@gmail.com>> wrote:

Hey C* folks,


I'm excited to share that the DataStax team has just released Mission Control 
[datastax.com]<https://urldefense.com/v3/__https:/datastax.com/products/mission-control__;!!M-nmYVHPHQ!L0M2-GDjSTuPzpD3TvfxiLgm2I5pLnFGmW5BhdhaYQBI6RlxK6e6ZMM2khnp8YUhfnqy2wYzjPX-UYAG9q-QlbHB9g$>,
 a new operations platform for running Apache Cassandra and DataStax 
Enterprise. Built around the open source core of K8ssandra 
[k8ssandra.io]<https://urldefense.com/v3/__https:/k8ssandra.io/__;!!M-nmYVHPHQ!L0M2-GDjSTuPzpD3TvfxiLgm2I5pLnFGmW5BhdhaYQBI6RlxK6e6ZMM2khnp8YUhfnqy2wYzjPX-UYAG9q9NjbtYtg$>
 we've been hard at work expanding multi-region capabilities. If you haven't 
seen some of the new features coming in here are some highlights:


  *   Management API support in Reaper - no more JMX credentials, YAY
  *   Additional support for TLS across the stack- including operator to node, 
Reaper to management API, etc
  *   Updated metrics pipeline - removal of collectd from nodes, Vector for 
monitoring log files (goodbye tail -f)
  *   Deterministic node selection for cluster operations
  *   Top-level management tasks in the control plane (no more forced 
connections to data planes to trigger a restart)


On top of this Mission Control offers:


  *   A single web-interface to monitor and manage your clusters wherever 
they're deployed
  *   Automatic management of internode and operator to node certificates - 
this includes integration with third party CAs and rotation of all 
certificates, keys, and various Java stores
  *   Centralized metrics and logs aggregation, querying and storage with the 
capability to split the pipeline allowing for exporting of streams to other 
observability tools within your environment
  *   Per-node configuration (this is an edge case, but still something we 
wanted to make possible)


While building our Mission Control, K8ssandra has seen a number of releases 
with quite a few contributions from the community. From Helm chart updates to 
oper

Re: Check out new features in K8ssandra and Mission Control

[Christopher Bradford]

Hey Jon,

* What aspects of Mission Control are dependent on using K8ssandra?
>

Mission Control bundles in K8ssandra for the core automation workflows
(lifecycle management, cluster operations, medusa &. reaper). In fact we
include the K8ssandraSpec in the top-level MissionControlCluster resource
verbatim.

 * Can Mission Control work without K8ssandra?


Not at this time, K8ssandra powers a significant portion of the C* side of
the stack. Mission Control provides additional functionality (web
interface, certificate coordination, observability stack, etc) and
applies some conventions to how K8ssandra objects are created / templated
out, but the actually K8ssandra operator present in MC is the same one
available via the Helm charts.

* Is mission control open source?
>

Not at this time. While the majority of the Kubernetes operators are open
source as part of K8ssandra, there are some pieces which are closed source.
I expect some of the components may move from closed source into K8ssandra
over time.

* I'm not familiar with Vector - does it require an agent?


Vector  is a pretty neat project. We run a few of
their components as part of the stack. There is a DaemonSet which runs on
each worker to collect host level metrics and scrape logs being emitted by
containers, a sidecar for collecting logs from the C* container, and an
aggregator which performs some filtering and transformation before pushing
to an object store.

* Is Reaper deployed separately or integrated in?
>

Reaper is deployed as part of the cluster creation workflow. It is spun up
and configured to connect to the cluster automatically.

~Chris

Christopher Bradford



On Tue, Feb 27, 2024 at 6:55 PM Jon Haddad  wrote:

> Hey Chris - this looks pretty interesting!  It looks like there's a lot of
> functionality in here.
>
> * What aspects of Mission Control are dependent on using K8ssandra?
> * Can Mission Control work without K8ssandra?
> * Is mission control open source?
> * I'm not familiar with Vector - does it require an agent?
> * Is Reaper deployed separately or integrated in?
>
> Thanks!  Looking forward to trying this out.
> Jon
>
>
> On Tue, Feb 27, 2024 at 7:07 AM Christopher Bradford 
> wrote:
>
>> Hey C* folks,
>>
>> I'm excited to share that the DataStax team has just released Mission
>> Control , a new
>> operations platform for running Apache Cassandra and DataStax Enterprise.
>> Built around the open source core of K8ssandra 
>> we've been hard at work expanding multi-region capabilities. If you haven't
>> seen some of the new features coming in here are some highlights:
>>
>>
>>-
>>
>>Management API support in Reaper - no more JMX credentials, YAY
>>-
>>
>>Additional support for TLS across the stack- including operator to
>>node, Reaper to management API, etc
>>-
>>
>>Updated metrics pipeline - removal of collectd from nodes, Vector for
>>monitoring log files (goodbye tail -f)
>>-
>>
>>Deterministic node selection for cluster operations
>>-
>>
>>Top-level management tasks in the control plane (no more forced
>>connections to data planes to trigger a restart)
>>
>>
>> On top of this Mission Control offers:
>>
>>
>>-
>>
>>A single web-interface to monitor and manage your clusters wherever
>>they're deployed
>>-
>>
>>Automatic management of internode and operator to node certificates -
>>this includes integration with third party CAs and rotation of all
>>certificates, keys, and various Java stores
>>-
>>
>>Centralized metrics and logs aggregation, querying and storage with
>>the capability to split the pipeline allowing for exporting of streams to
>>other observability tools within your environment
>>-
>>
>>Per-node configuration (this is an edge case, but still something we
>>wanted to make possible)
>>
>>
>> While building our Mission Control, K8ssandra has seen a number of
>> releases with quite a few contributions from the community. From Helm chart
>> updates to operator tweaks we want to send out a huge THANK YOU to everyone
>> who has filed issues, opened pull requests, and helped us test bugfixes and
>> new functionality.
>>
>> If you've been sleeping on K8ssandra, now is a good time to check it out
>> . It has all of the pieces needed to
>> run Cassandra in production. Looking for something out of the box instead
>> of putting the pieces together yourself, take Mission Control for a spin
>> and sign up for the trial
>> . I'm happy to
>> answer any K8ssandra or Mission Control questions you may have here or on
>> our Discord .
>>
>> Cheers,
>>
>> ~Chris
>>
>> Christopher Bradford
>>
>>

Re: Check out new features in K8ssandra and Mission Control

[Jon Haddad]

Hey Chris - this looks pretty interesting!  It looks like there's a lot of
functionality in here.

* What aspects of Mission Control are dependent on using K8ssandra?
* Can Mission Control work without K8ssandra?
* Is mission control open source?
* I'm not familiar with Vector - does it require an agent?
* Is Reaper deployed separately or integrated in?

Thanks!  Looking forward to trying this out.
Jon


On Tue, Feb 27, 2024 at 7:07 AM Christopher Bradford 
wrote:

> Hey C* folks,
>
> I'm excited to share that the DataStax team has just released Mission
> Control , a new operations
> platform for running Apache Cassandra and DataStax Enterprise. Built around
> the open source core of K8ssandra  we've been hard
> at work expanding multi-region capabilities. If you haven't seen some of
> the new features coming in here are some highlights:
>
>
>-
>
>Management API support in Reaper - no more JMX credentials, YAY
>-
>
>Additional support for TLS across the stack- including operator to
>node, Reaper to management API, etc
>-
>
>Updated metrics pipeline - removal of collectd from nodes, Vector for
>monitoring log files (goodbye tail -f)
>-
>
>Deterministic node selection for cluster operations
>-
>
>Top-level management tasks in the control plane (no more forced
>connections to data planes to trigger a restart)
>
>
> On top of this Mission Control offers:
>
>
>-
>
>A single web-interface to monitor and manage your clusters wherever
>they're deployed
>-
>
>Automatic management of internode and operator to node certificates -
>this includes integration with third party CAs and rotation of all
>certificates, keys, and various Java stores
>-
>
>Centralized metrics and logs aggregation, querying and storage with
>the capability to split the pipeline allowing for exporting of streams to
>other observability tools within your environment
>-
>
>Per-node configuration (this is an edge case, but still something we
>wanted to make possible)
>
>
> While building our Mission Control, K8ssandra has seen a number of
> releases with quite a few contributions from the community. From Helm chart
> updates to operator tweaks we want to send out a huge THANK YOU to everyone
> who has filed issues, opened pull requests, and helped us test bugfixes and
> new functionality.
>
> If you've been sleeping on K8ssandra, now is a good time to check it out
> . It has all of the pieces needed to
> run Cassandra in production. Looking for something out of the box instead
> of putting the pieces together yourself, take Mission Control for a spin
> and sign up for the trial
> . I'm happy to
> answer any K8ssandra or Mission Control questions you may have here or on
> our Discord .
>
> Cheers,
>
> ~Chris
>
> Christopher Bradford
>
>