> The shutdown is expected. All data in a partition is kept in a single > directory (=> single disk)
Is there a specific reason for the collocation of all partitions of a topic? This means, the capacity of required volume is to be determined by the retention size of the topic with largest data load. So it is not as distributed across folders as expected, i.e., across all directories by partition, not by topic. > You could get a bigger disk and copy the data to this one. As a last resort > you can manually delete logs from the full partition (start with the oldest) I will try moving the data from full to less used volumes, though it seems an unclean workaround, not suitable in Prod. Thanks, Zakee > On Mar 21, 2015, at 11:50 AM, svante karlsson <s...@csi.se> wrote: > > The shutdown is expected. All data in a partition is kept in a single > directory (=> single disk) > > I would move some topics/partitions from a full disk to a disk (on the same > broker) with more space. > > If you have very unbalanced topics this might be hard. > > You could get a bigger disk and copy the data to this one > > As a last resort you can manually delete logs from the full partition > (start with the oldest) > > /svante > > 2015-03-21 19:34 GMT+01:00 Zakee <kzak...@netzero.net>: > >> What happens if one of the log directories configured with broker is 100% >> full. Is it expected that brokers will shutdown themselves? >> >> We ran into the full disk space on one of the volumes (out of 8) on each >> of 5 brokers, and brokers shutdown themselves. We still have about 60% of >> total disk space provided by 8 volumes/directories. Should n’t the brokers >> continue to function as long as they have space left on the last log >> directory. >> >> In this case, how do I fix and restart the broker. Trying to restart also >> failed with fatal error. >> >> Opened a kafka core issue: >> https://issues.apache.org/jira/browse/KAFKA-2038 >> >> Thanks >> Zakee >> >> >> >> ____________________________________________________________ >> Old School Yearbook Pics >> View Class Yearbooks Online Free. Search by School & Year. Look Now! >> http://thirdpartyoffers.netzero.net/TGL3231/550db9cebda5839ce0dcbst04vuc > ____________________________________________________________ > Protect what matters > Floods can happen anywhere. Learn your risk and find an agent today. > http://thirdpartyoffers.netzero.net/TGL3255/550dc3e02f76943df7175mp05duc
