RE: Streams/RocksDB: Why Universal Compaction?

2023-07-28 Thread miltan
e- From: Colt McNealy [mailto:c...@littlehorse.io] Sent: 26 July 2023 21:08 To: users@kafka.apache.org Cc: Matthias J. Sax Subject: Re: Streams/RocksDB: Why Universal Compaction? Guozhang, Thanks for your response. That makes a lot of sense; I can't promise any super-formal benchma

Re: Streams/RocksDB: Why Universal Compaction?

2023-07-27 Thread Guozhang Wang
re-examine if they > > still make sense, and if yes drive it through and merge. > > > > Guozhang > > > > > > On Sun, Jul 23, 2023 at 10:29 AM Matthias J. Sax wrote: > > > > > > Do you happen to know? > > > > > > > > > Forwarded

Re: Streams/RocksDB: Why Universal Compaction?

2023-07-26 Thread Colt McNealy
the time to do so. I would be very > happy in fact if someone could pick that up and re-examine if they > still make sense, and if yes drive it through and merge. > > Guozhang > > > On Sun, Jul 23, 2023 at 10:29 AM Matthias J. Sax wrote: > > > > Do you happen to k

Re: Streams/RocksDB: Why Universal Compaction?

2023-07-23 Thread Guozhang Wang
-- Forwarded Message ---- > Subject: Streams/RocksDB: Why Universal Compaction? > Date: Fri, 23 Jun 2023 13:19:36 -0700 > From: Colt McNealy > Reply-To: users@kafka.apache.org > To: users@kafka.apache.org > > Hello there! > > I was wondering if anyone (perhaps an early developer

Streams/RocksDB: Why Universal Compaction?

2023-06-23 Thread Colt McNealy
Hello there! I was wondering if anyone (perhaps an early developer or power-user of Kafka Streams) knows why the Streams developers made the default setting for RocksDB compaction "Universal" compaction rather than "Level" compaction? My understanding (in which I am extremely UNconfident) is as f