Repository: impala Updated Branches: refs/heads/master 91c754bf0 -> 7dbeb6950
IMPALA-5605: [DOCS] Document how to increase memory resource limit Change-Id: I7dde3b87f4c809df74a01952206dbf69c111e333 Reviewed-on: http://gerrit.cloudera.org:8080/12032 Reviewed-by: Alex Rodoni <arod...@cloudera.com> Tested-by: Alex Rodoni <arod...@cloudera.com> Project: http://git-wip-us.apache.org/repos/asf/impala/repo Commit: http://git-wip-us.apache.org/repos/asf/impala/commit/5189300b Tree: http://git-wip-us.apache.org/repos/asf/impala/tree/5189300b Diff: http://git-wip-us.apache.org/repos/asf/impala/diff/5189300b Branch: refs/heads/master Commit: 5189300b2f9b12f147c8dfd39bd5e30613fcfbfe Parents: 91c754b Author: Alex Rodoni <arod...@cloudera.com> Authored: Tue Dec 4 14:35:41 2018 -0800 Committer: Alex Rodoni <arod...@cloudera.com> Committed: Wed Dec 5 18:59:37 2018 +0000 ---------------------------------------------------------------------- docs/topics/impala_troubleshooting.xml | 36 +++++++++++++++++++++-------- 1 file changed, 26 insertions(+), 10 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/impala/blob/5189300b/docs/topics/impala_troubleshooting.xml ---------------------------------------------------------------------- diff --git a/docs/topics/impala_troubleshooting.xml b/docs/topics/impala_troubleshooting.xml index f5dbdd2..250c899 100644 --- a/docs/topics/impala_troubleshooting.xml +++ b/docs/topics/impala_troubleshooting.xml @@ -93,6 +93,32 @@ under the License. </ul> </conbody> </concept> + <concept id="IMPALA-5605"> + <title>Troubleshooting Crashes Caused by Memory Resource Limit</title> + <conbody> + <p>Under very high concurrency, Impala could encounter a serious error due + to usage of various operating system resources. Errors similar to the + following may be caused by operating system resource exhaustion:</p> + <codeblock>F0629 08:20:02.956413 29088 llvm-codegen.cc:111] LLVM hit fatal error: Unable to allocate section memory! +terminate called after throwing an instance of 'boost::exception_detail::clone_impl<boost::exception_detail::error_info_injector<boost::thread_resource_error> >'</codeblock> + <p>The KRPC implementation in Impala 2.12 / 3.0 greatly reduces thread + counts and the chances of hitting a resource limit.</p> + <p>If you still get an error similar to the above in Impala 3.0 and + higher, try increasing the <codeph>max_map_count</codeph> OS virtual + memory parameter. <codeph>max_map_count</codeph> defines the maximum + number of memory map areas that a process can use. Configure each host + running an <codeph>impalad</codeph> daemon with the command to increase + <codeph>max_map_count</codeph> to 8 GB.</p> + <codeblock outputclass="cdoc-input">echo 8000000 > /proc/sys/vm/max_map_count</codeblock> + <p>To make the above settings durable, refer to your OS documentation. For + example, on RHEL 6.x:<ol> + <li>Add the following line to + <codeph>/etc/sysctl.conf</codeph>:<codeblock>vm.max_map_count=8000000</codeblock></li> + <li>Run the following + command:<codeblock outputclass="cdoc-input">sysctl -p</codeblock></li> + </ol></p> + </conbody> + </concept> <concept id="trouble_io" rev=""> <title>Troubleshooting I/O Capacity Problems</title> @@ -442,14 +468,4 @@ hadoop jar $HADOOP_INSTALL/hadoop-*-test.jar TestDFSIO -clean </conbody> </concept> - <concept id="webui_snippet" audience="PDF"> - <title conref="impala_webui.xml#webui/webui_title"/> - <conbody> - <p conref="impala_webui.xml#webui/webui_intro"/> - <p> - For full details, see <xref href="impala_webui.xml#webui"/>. - </p> - </conbody> - </concept> - </concept>
