[
https://issues.apache.org/jira/browse/MESOS-6575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16393177#comment-16393177
]
James Peach commented on MESOS-6575:
------------------------------------
{quote}
I guess I don't understand the opposition to having the soft limit as in the
current implementation the soft limit is being set, but it happens to be set to
the exact amount as the hard limit. The advantage of the soft limit is that we
don't have to keep track of how long has something been over the soft limit, we
perform the system call which provides us a time when the grace period is over
and once that occurs we can kill the application.
{quote}
My reasoning is that it doesn't matter how long the task has exceeded the
allocated limit for. The `disk/du` isolator doesn't wait for you to be over the
quota for any length of time - the task is terminated as soon as the violation
is detected. It's certainly possible to set a different soft limit, but I can't
see how it helps. The isolator still needs to poll on an interval and verify
the used space.
> Change `disk/xfs` isolator to terminate executor when it exceeds quota
> ----------------------------------------------------------------------
>
> Key: MESOS-6575
> URL: https://issues.apache.org/jira/browse/MESOS-6575
> Project: Mesos
> Issue Type: Task
> Components: agent, containerization
> Reporter: Santhosh Kumar Shanmugham
> Assignee: James Peach
> Priority: Major
>
> Unlike {{disk/du}} isolator which sends a {{ContainerLimitation}} protobuf
> when the executor exceeds the quota, {{disk/xfs}} isolator, which relies on
> XFS's internal quota enforcement, silently fails the {{write}} operation,
> that causes the quota limit to be exceeded, without surfacing the quota
> breach information.
> This task is to change the `disk/xfs` isolator so that, a
> {{ContainerLimitation}} message is triggered when the quota is exceeded.
> This feature will rely on the underlying filesystem being mounted with
> {{pqnoenforce}} (accounting-only mode), so that XFS does not silently causes
> a {{EDQUOT}} error on writes that causes the quota to be exceeded. Now the
> isolator can track the disk quota via {{xfs_quota}}, very much like
> {{disk/du}} using {{du}}, every {{container_disk_watch_interval}} and surface
> the disk quota limit exceed event via a {{ContainerLimitation}} protobuf,
> causing the executor to be terminated. This feature can then be turned on/off
> via the existing {{enforce_container_disk_quota}} option.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
