Re: About Map column

2023-12-19 Thread Sébastien Rebecchi
t; >> I can see you also mentioned big partitions. Large partitions in >> Cassandra usually is a bad idea, regardless it's a single row with a few >> columns or many rows with many columns. There's some exceptions that may >> work well, but generally you should avoid creating

About Map column

2023-12-18 Thread Sébastien Rebecchi
Hello If i have a colum of type Map, then with many insertions, the map grows, but after compation, as the full map is 1 column of a table, will it be contained fully in 1 SSTable? I guess yes cause the map is contained in a single row. Am I right? Versus if we use a clustering key + a standard

Re: Remove folders of deleted tables

2023-12-07 Thread Sébastien Rebecchi
may fit your use case better than creating and deleting > tables every day. > > > On 06/12/2023 08:26, Sébastien Rebecchi wrote: > > Hello Jeff, Bowen > > Thanks for your answer. > Now I understand that there is a bug in Cassandra that can not handle > concurrent schem

Re: Remove folders of deleted tables

2023-12-06 Thread Sébastien Rebecchi
ground, and you don't realise it until you suddenly > do, and then everything seems to blow up at the same time. You need to sort > this out ASAP. > > > On 05/12/2023 19:57, Sébastien Rebecchi wrote: > > Hi Bowen, > > Thanks for your answer. > > I was thinking of

Re: Remove folders of deleted tables

2023-12-05 Thread Sébastien Rebecchi
will lead to a large number of tombstones in the system tables. > On 04/12/2023 19:55, Sébastien Rebecchi wrote: > > Thank you Dipan. > > Do you know if there is a good reason for Cassandra to let tables folder > even when there is no snapshot? > > I'm thinking of use cases

Re: Remove folders of deleted tables

2023-12-04 Thread Sébastien Rebecchi
Dipan Shah a écrit : > Hello Sebastien, > > There are no inbuilt tools that will automatically remove folders of > deleted tables. > > Thanks, > > Dipan Shah > -- > *From:* Sébastien Rebecchi > *Sent:* 04 December 2023 13:54 > *To:*

Remove folders of deleted tables

2023-12-04 Thread Sébastien Rebecchi
Hello, When we delete a table with Cassandra, it lets the folder of that table on file system, even if there is no snapshot (auto snapshots disabled). So we end with the empty folder {data folder}/{keyspace name}/{table name-table id} containing only 1 subfolder, backups, which is itself empty.

Re: Memory and caches

2023-11-28 Thread Sébastien Rebecchi
t; https://rustyrazorblade.com/post/2023/2023-11-07-async-profiler/ > https://rustyrazorblade.com/post/2023/2023-11-14-bcc-tools/ > https://rustyrazorblade.com/post/2023/2023-11-21-bpftrace/ > > Jon > > On 2023/11/27 14:59:55 Sébastien Rebecchi wrote: > > Hello > > > > W

Memory and caches

2023-11-27 Thread Sébastien Rebecchi
Hello When I use nodetool info, it prints that relevant information Heap Memory (MB) : 14229.31 / 32688.00 Off Heap Memory (MB) : 5390.57 Key Cache : entries 670423, size 100 MiB, capacity 100 MiB, 13152259 hits, 47205855 requests, 0.279 recent hit rate, 14400 save period in

Re: Cassandra 4 production settings

2023-11-20 Thread Sébastien Rebecchi
> regarding what’s published here, aside from JDK version. > > Cassandra 4.0 supports JDK11 and adopting it is recommended given JDK8’s > age. > > – Scott > > On Nov 20, 2023, at 12:31 AM, Sébastien Rebecchi > wrote: > > Hello > > There is no such page for Cass

Cassandra 4 production settings

2023-11-20 Thread Sébastien Rebecchi
Hello There is no such page for Cassandra 4: https://docs.datastax.com/en/cassandra-oss/3.0/cassandra/install/installRecommendSettings.html Do the recommended settings for Cassandra 3 still apply as such to Cassandra 4. Thank you in advance. Sébastien.

Delete too wide partitions

2023-07-16 Thread Sébastien Rebecchi
Hi everyone Is there a way to tell Cassandra to automatically delete a partition when its size increase a given threshold? Best regard Sébastien

Re: Codec not found for list

2022-09-19 Thread Sébastien Rebecchi
Please ignore that message, I found my mistake, it was clear in the error message, I forgot to collect the Java stream as List... :) Sorry for the disturbance Le lun. 19 sept. 2022 à 11:08, Sébastien Rebecchi < sebastien.rebec...@gmail.com> a écrit : > Hello, > > I have a tabl

Codec not found for list

2022-09-19 Thread Sébastien Rebecchi
Hello, I have a table where I store data in a column of type list I get that error when inserting data com.datastax.oss.driver.api.core.type.codec.CodecNotFoundException: Codec not found for requested operation: [List(BLOB, not frozen) <-> java.util.stream.ReferencePipeline$3] Do you know how I

Re: UDF: adding custom jar to classpath

2022-03-28 Thread Sébastien Rebecchi
having the answer to that issue, how to add jar in classpath so that its classes are taken into account in UDF? Thanks you! Sébastien. Le mer. 23 mars 2022 à 17:30, Sébastien Rebecchi a écrit : > Hello, > > I am trying to create a UDF based on custom methods. &

UDF: adding custom jar to classpath

2022-03-23 Thread Sébastien Rebecchi
Hello, I am trying to create a UDF based on custom methods. So I set enable_user_defined_functions to true and added a jar in "/usr/share/cassandra/lib/" folder on every node, restarted the nodes and I can see from the command line that the jar is indeed used (in the classpath with -cp). But

Reload Cassandra clathpath

2022-03-07 Thread Sébastien Rebecchi
Hi! I want to define an UDF based on a method which is defined in an external jar that I want to add in classpath of every node of my Cassandra cluster. However this external method is going to change with time, then the jar also will change and occasionally replace the current one installed on

OversizedMessageException in AntiEntropyStage

2021-11-10 Thread Sébastien Rebecchi
Hi, Digging in Cassandra logs, I saw this exception happening several times, see trace below. I was wondering, what can cause such big messages, and could this error make a repair session fail? I currently see that my repairs are very long and sometimes I even stop them cause it seems they are

Re: multiple clients making schema changes at once

2021-06-03 Thread Sébastien Rebecchi
Sometimes even waiting hours does not change. I have a cluster where I did like you, synchronization of create tables statement, then even I tried waiting for schema agreement, in loop until success, but sometimes the success never happens, i got that error in loop in the logs of a node, it seems

Re: multiple clients making schema changes at once

2021-06-01 Thread Sébastien Rebecchi
Hello, Yes this is quite annoying. How did you implement that "external lock"? I also thought of doing an external service that would be dedicated to that. Cassandra client apps would send create instruction to that service, that would receive them and do the creates 1 by 1, and the client app

Re: unable to repair

2021-05-30 Thread Sébastien Rebecchi
hema dependent cluster operations.* > > The warning exists for a good reason. You really need to reconsider you > data model. > > > On 30/05/2021 10:12, Sébastien Rebecchi wrote: > > Hello, > > I have a more general question about that, I cannot find clear answer. > >

Re: unable to repair

2021-05-30 Thread Sébastien Rebecchi
is the recommended way of creating tables dynamically? If I am doing "if not exists" queries + wait for schema aggreement before and after each create statement, will it work correctly for Cassandra? Sébastien. Le ven. 28 mai 2021 à 20:45, Sébastien Rebecchi a écrit : > Thank you for your answer.

Re: unable to repair

2021-05-28 Thread Sébastien Rebecchi
Thank you for your answer. If I send all my create operations still from many clients but to 1 coordinator node, always the same, would it prevent schema mismatch? Sébastien. Le ven. 28 mai 2021 à 01:14, Kane Wilson a écrit : > Which client operations could trigger schema change at node

Re: unable to repair

2021-05-27 Thread Sébastien Rebecchi
> > > Regards, > > Bowen > > On 26/05/2021 15:05, Sébastien Rebecchi wrote: > > Hi, > > > > I have an issue with repairing my Casandra cluster, that was already > > the case with Cassandra 3 and the issue is not solved with Cassandra 4 > > RC1. &g

Re: unable to repair

2021-05-27 Thread Sébastien Rebecchi
mai 2021 à 08:33, Sébastien Rebecchi a écrit : > I don't have schema changes, except keyspaces and tables creations. But > they are done from multiple sources indeed. With a "create if not exists" > statement, on demand. Thanks you for your answer, I will try to see if I >

Re: unable to repair

2021-05-27 Thread Sébastien Rebecchi
I don't have schema changes, except keyspaces and tables creations. But they are done from multiple sources indeed. With a "create if not exists" statement, on demand. Thanks you for your answer, I will try to see if I could precreate them then. As for the schema mismatch, what is the best way of

Re: unable to repair

2021-05-26 Thread Sébastien Rebecchi
chema mismatch or node unavailability might result in this. > > Thanks, > > Dipan Shah > > ------ > *From:* Sébastien Rebecchi > *Sent:* Wednesday, May 26, 2021 7:35 PM > *To:* user@cassandra.apache.org > *Subject:* unable to repair > >

unable to repair

2021-05-26 Thread Sébastien Rebecchi
Hi, I have an issue with repairing my Casandra cluster, that was already the case with Cassandra 3 and the issue is not solved with Cassandra 4 RC1. I run in a for loop, one 1 by 1, the following command: nodetool -h THE_NODE -u jTHE_USER -pw THE_PASSWORD repair --full -pr and I always get the