RE: Huge single-node DCs (?)

2021-04-09 Thread Durity, Sean R
DataStax Enterprise has a new-ish feature set called Big Node that is supposed to help with using much denser nodes. We are going to be doing some testing with that for a similar use case with ever-growing disk needs, but no real increase in read or write volume. At some point it may become avai

Re: Huge single-node DCs (?)

2021-04-09 Thread Joe Obernberger
We run a ~1PByte HBase cluster on top of Hadoop/HDFS that works pretty well.  I would love to be able to use Cassandra instead on a system like that.  HBase queries / scans are not the easiest to deal with, but, as with Cassandra, if you know the primary key, you can get to your data fast, ev

Re: Log Rotation of Extended Compaction Logging

2021-04-09 Thread Jens Fischer
Hi Erik, thank you for the link, very instructive. To summarise my understanding of your mail, the code and my experiments: - as long as the compaction logger is running it will write into the same “compaction.log" file - if a new logger gets started (for example through restart of the Cassandr