[
https://issues.apache.org/jira/browse/IMPALA-7252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16549375#comment-16549375
]
ASF subversion and git services commented on IMPALA-7252:
---------------------------------------------------------
Commit 940d536f21160cd93a900aa70c003b6d1cb1fac8 in impala's branch
refs/heads/master from [~tianyiwang]
[ https://git-wip-us.apache.org/repos/asf?p=impala.git;h=940d536 ]
IMPALA-7252: Backport rate limiting of fadvise calls into toolchain glog
This patch bumps glog version to 0.3.4-p3 to include the patch limiting
fadvise calls.
Change-Id: I41fd855fbf0e9ec58845ac0d2eb96a87b0172152
Reviewed-on: http://gerrit.cloudera.org:8080/10965
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Backport rate limiting of fadvise calls into toolchain glog
> -----------------------------------------------------------
>
> Key: IMPALA-7252
> URL: https://issues.apache.org/jira/browse/IMPALA-7252
> Project: IMPALA
> Issue Type: Improvement
> Components: Backend
> Affects Versions: Impala 3.0
> Reporter: Todd Lipcon
> Assignee: Tianyi Wang
> Priority: Major
>
> Currently, glog's default behavior is to call fadvise(FADV_DONTNEED) on the
> log file after each entry that is written. In many versions of the Linux
> kernel, each invocation of this call causes work to be scheduled on all other
> CPUs, causing up to one context switch per CPU for every log line. We saw
> this cause an extremely long GC pause in the catalogd in the case where the
> native side of the catalog was logging a lot of messages about publishing
> metadata updates at the same time that the Java side was running a GC. The GC
> spent almost all of its time in the kernel due to the high context switch
> rate causing a lot of TLB clears and misses, and instead of pausing the JVM
> for a couple of seconds took several minutes.
> This was identified and fixed upstream in glog here:
> https://github.com/google/glog/commit/dacd29679633c9b845708e7015bd2c79367a6ea2
> We should backport this fix into the version in the toolchain.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
