[
https://issues.apache.org/jira/browse/MAPREDUCE-6918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Erik Krogen resolved MAPREDUCE-6918.
------------------------------------
Resolution: Duplicate
> ShuffleMetrics.ShuffleConnections Gauge Metric Climbs Infinitely
> ----------------------------------------------------------------
>
> Key: MAPREDUCE-6918
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6918
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Erik Krogen
>
> We recently noticed that the {{mapred.ShuffleMetrics.ShuffleConnections}}
> metric seems to climb infinitely, up to many millions (see attached graph),
> despite being supposedly a gauge measure of the number of open connections:
> {code:title=ShuffleHandler.java}
> @Metric("# of current shuffle connections")
> MutableGaugeInt shuffleConnections;
> {code}
> It seems that shuffleConnections gets incremented once for every map fetched,
> but only decremented once for every request. It seems to me it should be
> modified to only be incremented once for every request rather than for every
> map fetched, but I'm not familiar with the original intent.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
