Re: understand bootstrapping

2021-01-25 Thread Yifan Cai
Hi Han,

How / when do the existing nodes update their Token Ring state?

The new joining node sets its tokens and populates to the cluster via
gossip after completing data streaming.

is that different between the seed node and non-seed node?

Data streaming step is skipped if a node is seed.

Checkout `StorageService#joinTokenRing()` for the details.

I'm particularly trying to understand the fault-tolerant part of updating
> Token Ring state on every node

The new node only joins the ring (updates the rings state) when the data
streaming (bootstrapping) is successful. Otherwise, the existing ring
remains as is, the joining node remains in JOINING state, and it won't get
any client traffic. If I understand the question correctly.

Hopefully, the answers help.

- Yifan

On Sun, Jan 24, 2021 at 1:00 PM Han  wrote:

> Hi,
>
> I wanted to understand how the bootstrapping (add a new node) works. My
> understanding is that the first step is Token Allocation and the new node
> will get a number of tokens.
>
> My question is:
>
> How / when do the existing nodes update their Token Ring state?  and is
> that different between the seed node and non-seed node?
>
> I'm particularly trying to understand the fault-tolerant part of updating
> Token Ring state on every node, but couldn't find relevant info by
> searching.
>
> Any info or pointers are appreciated.
>
> Thanks!
> Han
>
>


Cassandra on ZFS: disable compression?

2021-01-25 Thread Lapo Luchini

Hi,
I'm using a fairly standard install of Cassandra 3.11 on FreeBSD 
12, by default filesystem is compressed using LZ4 and Cassandra tables 
are compressed using LZ4 as well.


I was wondering if anybody had data about this already (or else, I will 
probably do some tests myself, eventually): would it be a nice idea to 
disable Cassandra compression and rely only on ZFS one?


In principle I can see some pros:
1. it's done in kernel, might be slightly faster
2. can (probably) compress more data, as I see a 1.02 compression factor
   on filesystem even if I have compressed data in tables already
3. in upcoming ZFS version I will be able to use Zstd compression
   (probably before Cassandra 4.0 is gold)
4. (can inspect  compression directly at filesystem level)

But on the other hand application-level compression could have its 
advantages.


cheers,

--
Lapo Luchini
l...@lapo.it


-
To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org
For additional commands, e-mail: user-h...@cassandra.apache.org