Re: Questions from new user

2016-02-17 Thread Alexis Midon
0. I don't understand how deleting log files quickly relates to file/page cache. Only consumer read patterns are the main factor here afaik. The OS will eventually discard unused cached pages. I'm not an expert of page cache policies though, and will be happy to learn. 1. have a look at per-topic

Re: Questions from new user

2016-02-16 Thread allen chan
Hi can anyone help with this? On Fri, Jan 29, 2016 at 11:50 PM, allen chan wrote: > Use case: We are using kafka as broker in one of our elasticsearch > clusters. Kafka caches the logs if elasticsearch has any performance > issues. I have Kafka set to delete logs

Questions from new user

2016-01-29 Thread allen chan
Use case: We are using kafka as broker in one of our elasticsearch clusters. Kafka caches the logs if elasticsearch has any performance issues. I have Kafka set to delete logs pretty quickly to keep things in the file cache to limit IO. Questions: 1. in 0.9 it seems like consumer offers are