[
https://issues.apache.org/jira/browse/IMPALA-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16711770#comment-16711770
]
ASF subversion and git services commented on IMPALA-5605:
---------------------------------------------------------
Commit 5189300b2f9b12f147c8dfd39bd5e30613fcfbfe in impala's branch
refs/heads/master from [~arodoni_cloudera]
[ https://git-wip-us.apache.org/repos/asf?p=impala.git;h=5189300 ]
IMPALA-5605: [DOCS] Document how to increase memory resource limit
Change-Id: I7dde3b87f4c809df74a01952206dbf69c111e333
Reviewed-on: http://gerrit.cloudera.org:8080/12032
Reviewed-by: Alex Rodoni <[email protected]>
Tested-by: Alex Rodoni <[email protected]>
> document how to increase thread resource limits
> -----------------------------------------------
>
> Key: IMPALA-5605
> URL: https://issues.apache.org/jira/browse/IMPALA-5605
> Project: IMPALA
> Issue Type: Task
> Components: Docs
> Affects Versions: Impala 2.9.0
> Reporter: Matthew Mulder
> Assignee: Alex Rodoni
> Priority: Major
> Fix For: Impala 3.2.0
>
>
> Depending on the workload, Impala may need to create a very large number of
> threads. If so, it is necessary to configure the system correctly to prevent
> Impala from crashing because of resource limitations. Such a crash would look
> like this:{code}F0629 08:20:02.956413 29088 llvm-codegen.cc:111] LLVM hit
> fatal error: Unable to allocate section memory!
> terminate called after throwing an instance of
> 'boost::exception_detail::clone_impl<boost::exception_detail::error_info_injector<boost::thread_resource_error>
> >'{code}To prevent this, each Impala host should be configured like
> this:{code}echo 2000000 > /proc/sys/kernel/threads-max
> echo 2000000 > /proc/sys/kernel/pid_max
> echo 8000000 > /proc/sys/vm/max_map_count{code}In /etc/security/limits.conf
> add{code}impala soft nproc 262144
> impala hard nproc 262144{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
