Sidharta Seethana created YARN-5040:
---------------------------------------
Summary: CPU Isolation with CGroups triggers kernel panics on
Centos 7.1/7.2 when yarn.nodemanager.resource.percentage-physical-cpu-limit <
100
Key: YARN-5040
URL: https://issues.apache.org/jira/browse/YARN-5040
Project: Hadoop YARN
Issue Type: Bug
Affects Versions: 2.9.0
Reporter: Sidharta Seethana
/cc [~vvasudev]
We have been running some benchmarks internally with resource isolation
enabled. We have consistently run into kernel panics when running a large job (
a large pi job, terasort ). These kernel panics wen't away when we set
yarn.nodemanager.resource.percentage-physical-cpu-limit=100 . Anything less
than 100 triggers different behavior in YARN's CPU resource handler which seems
to cause these issues. Looking at the kernel crash dumps, the backtraces were
different - sometimes pointing to java processes, sometimes not.
Kernel versions used : 3.10.0-229.14.1.el7.x86_64 and
3.10.0-327.13.1.el7.x86_64 .
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
