[
https://issues.apache.org/jira/browse/HADOOP-3062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tsz Wo (Nicholas), SZE updated HADOOP-3062:
-------------------------------------------
Description:
In order to better understand the relationship between hadoop performance and
the network bandwidth, we need to know
what the aggregated traffic data in a cluster and its breakdown by racks. With
these data, we can determine whether the network
bandwidth is the bottleneck when certain jobs are running on a cluster.
was:
In order to better understand the relationship between hadoop performance and
the network bandwidth, we need to know
what the aggregated traffic data in a cluster and its breakdown by racks. With
these data, we can determine whether the network
bandwidth is the bottleneck when certain jobs are running on a cluster.
Hadoop Flags: [Incompatible change, Reviewed] (was: [Incompatible change])
Got it. Let's work on a utility class in future if there is a need.
+1 the patch is good.
> Need to capture the metrics for the network ios generate by dfs reads/writes
> and map/reduce shuffling and break them down by racks
> ------------------------------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-3062
> URL: https://issues.apache.org/jira/browse/HADOOP-3062
> Project: Hadoop Core
> Issue Type: Improvement
> Components: metrics
> Reporter: Runping Qi
> Assignee: Chris Douglas
> Fix For: 0.19.0
>
> Attachments: 3062-0.patch, 3062-1.patch
>
>
> In order to better understand the relationship between hadoop performance and
> the network bandwidth, we need to know
> what the aggregated traffic data in a cluster and its breakdown by racks.
> With these data, we can determine whether the network
> bandwidth is the bottleneck when certain jobs are running on a cluster.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
