[
https://issues.apache.org/jira/browse/MAPREDUCE-2638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13066136#comment-13066136
]
Matei Zaharia commented on MAPREDUCE-2638:
------------------------------------------
Hi Tom,
This looks good, except that the preemption intervals you've set are very low.
In my experience it can take a while for Hadoop to preempt a task; when you
call killTask(), it must wait for the next heartbeat from the task's node, send
it a KillTaskAction, and then wait for another heartbeat back to hear that it's
gone. In a larger cluster, this might be more than 10 seconds. I would set this
to 30 seconds. This is the same thing I recommend for users.
> Create a simple stress test for the fair scheduler
> --------------------------------------------------
>
> Key: MAPREDUCE-2638
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2638
> Project: Hadoop Map/Reduce
> Issue Type: Test
> Components: contrib/fair-share
> Reporter: Tom White
> Assignee: Tom White
> Attachments: MAPREDUCE-2638.patch, MAPREDUCE-2638.patch
>
>
> This would be a test that runs against a cluster, typically with settings
> that allow preemption to be exercised.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
