Re: Kafka segment.index.bytes

2019-02-23 Thread Soheil Pourbafrani
Thanks, Ismael Updating to Java 8 version 202 solved the problem! On Sun, Feb 24, 2019 at 10:09 AM Soheil Pourbafrani wrote: > Thanks, I use CentOS 7 and Java 8 (192) > > > I'll try updating Java to 202 > > On Sat, Feb 23, 2019 at 11:05 PM Ismael Juma wrote: > >> We use sparse files by

Re: Kafka segment.index.bytes

2019-02-23 Thread Soheil Pourbafrani
Thanks, I use CentOS 7 and Java 8 (192) I'll try updating Java to 202 On Sat, Feb 23, 2019 at 11:05 PM Ismael Juma wrote: > We use sparse files by default so they don't actually take space (at least > on Linux). However, there was a bug in Java 8 where sparse files were > taking all the

Re: Kafka segment.index.bytes

2019-02-23 Thread Ismael Juma
We use sparse files by default so they don't actually take space (at least on Linux). However, there was a bug in Java 8 where sparse files were taking all the space. It was fixed in Java 8 update 202. Ismael On Sat, Feb 23, 2019 at 2:19 AM Soheil Pourbafrani wrote: > Hi, > > I have a 2-node

Kafka segment.index.bytes

2019-02-23 Thread Soheil Pourbafrani
Hi, I have a 2-node Kafka cluster. When I create a new topic it preallocates about 21MB for each partition: 10M /data/1-0/.index 0 /data/1-0/.log 10M /data/1-0/.timeindex 4.0K /data/1-0/leader-epoch-checkpoint And because I have many