Erik Krogen created MAPREDUCE-6918:
--------------------------------------
Summary: ShuffleMetrics.ShuffleConnections Gauge Metric Climbs
Infinitely
Key: MAPREDUCE-6918
URL: https://issues.apache.org/jira/browse/MAPREDUCE-6918
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Reporter: Erik Krogen
We recently noticed that the {{mapred.ShuffleMetrics.ShuffleConnections}}
metric seems to climb infinitely, up to many millions (see attached graph),
despite being supposedly a gauge measure of the number of open connections:
{code:title=ShuffleHandler.java}
@Metric("# of current shuffle connections")
MutableGaugeInt shuffleConnections;
{code}
It seems that shuffleConnections gets incremented once for every map fetched,
but only decremented once for every request. It seems to me it should be
modified to only be incremented once for every request rather than for every
map fetched, but I'm not familiar with the original intent.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
