Repository: incubator-impala Updated Branches: refs/heads/master 717dd73d7 -> 801c32dec
IMPALA-5605: [DOCS] New known issue for upping thread resource limits Change-Id: I4300fcb30c1bc0b1f3cd4eeeb25ad05ec4173fa6 Reviewed-on: http://gerrit.cloudera.org:8080/7348 Reviewed-by: Mostafa Mokhtar <[email protected]> Tested-by: Impala Public Jenkins Project: http://git-wip-us.apache.org/repos/asf/incubator-impala/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-impala/commit/cd443817 Tree: http://git-wip-us.apache.org/repos/asf/incubator-impala/tree/cd443817 Diff: http://git-wip-us.apache.org/repos/asf/incubator-impala/diff/cd443817 Branch: refs/heads/master Commit: cd44381796aa9851e074991290120d0873a010ac Parents: 717dd73 Author: John Russell <[email protected]> Authored: Fri Jun 30 15:23:36 2017 -0700 Committer: Impala Public Jenkins <[email protected]> Committed: Mon Jul 10 23:06:18 2017 +0000 ---------------------------------------------------------------------- docs/topics/impala_known_issues.xml | 33 ++++++++++++++++++++++++++++++++ 1 file changed, 33 insertions(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/incubator-impala/blob/cd443817/docs/topics/impala_known_issues.xml ---------------------------------------------------------------------- diff --git a/docs/topics/impala_known_issues.xml b/docs/topics/impala_known_issues.xml index c3f1e51..30cc245 100644 --- a/docs/topics/impala_known_issues.xml +++ b/docs/topics/impala_known_issues.xml @@ -564,6 +564,39 @@ https://issues.apache.org/jira/browse/IMPALA-2144 - Don't have </conbody> + <concept id="IMPALA-5605"> + <title>Configuration to prevent crashes caused by thread resource limits</title> + <conbody> + <p> + Impala could encounter a serious error due to resource usage under very high concurrency. + The error message is similar to: + </p> +<codeblock><![CDATA[ +F0629 08:20:02.956413 29088 llvm-codegen.cc:111] LLVM hit fatal error: Unable to allocate section memory! +terminate called after throwing an instance of 'boost::exception_detail::clone_impl<boost::exception_detail::error_info_injector<boost::thread_resource_error> >' +]]> +</codeblock> + <p><b>Bug:</b> <xref keyref="IMPALA-5605">IMPALA-5605</xref></p> + <p><b>Severity:</b> High</p> + <p><b>Workaround:</b> + To prevent such errors, configure each host running an <cmdname>impalad</cmdname> + daemon with the following settings: + </p> +<codeblock> +echo 2000000 > /proc/sys/kernel/threads-max +echo 2000000 > /proc/sys/kernel/pid_max +echo 8000000 > /proc/sys/vm/max_map_count +</codeblock> + <p> + Add the following lines in <filepath>/etc/security/limits.conf</filepath>: + </p> +<codeblock> +impala soft nproc 262144 +impala hard nproc 262144 +</codeblock> + </conbody> + </concept> + <concept id="flatbuffers_mem_usage"> <title>Memory usage when compact_catalog_topic flag enabled</title> <conbody>
