In the wiki - there is a statement that a partition must fit on a single machine, while technically true, isn't it so that a partition must fit on a single disk on that machine.
https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-HowmanytopicscanIhave ? >A partition is basically a directory of log files. >Each partition must fit entirely on one machine. So if you have only one partition in your topic you >cannot scale your write rate or retention beyond the capability of a single machine. If you have 1000 >partitions you could potentially use 1000 machines. thanks, svante