[ https://issues.apache.org/jira/browse/MAPREDUCE-6918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Erik Krogen resolved MAPREDUCE-6918. ------------------------------------ Resolution: Duplicate > ShuffleMetrics.ShuffleConnections Gauge Metric Climbs Infinitely > ---------------------------------------------------------------- > > Key: MAPREDUCE-6918 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6918 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: mrv2 > Reporter: Erik Krogen > > We recently noticed that the {{mapred.ShuffleMetrics.ShuffleConnections}} > metric seems to climb infinitely, up to many millions (see attached graph), > despite being supposedly a gauge measure of the number of open connections: > {code:title=ShuffleHandler.java} > @Metric("# of current shuffle connections") > MutableGaugeInt shuffleConnections; > {code} > It seems that shuffleConnections gets incremented once for every map fetched, > but only decremented once for every request. It seems to me it should be > modified to only be incremented once for every request rather than for every > map fetched, but I'm not familiar with the original intent. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org