Demux should output detailed per-operation ClientTrace records
--------------------------------------------------------------
Key: CHUKWA-282
URL: https://issues.apache.org/jira/browse/CHUKWA-282
Project: Hadoop Chukwa
Issue Type: Improvement
Components: Data Processors
Affects Versions: 0.2.0
Reporter: Jiaqi Tan
Assignee: Jiaqi Tan
Priority: Minor
Fix For: 0.2.0
Currently, the ClientTrace reducer in Demux summarizes client trace operations
to produce aggregate statistics for each type of operation (e.g. total bytes of
local HDFS reads, total bytes of local HDFS writes). However, more
sophisticated algorithms and visualization will need more detailed information
such as amount of reads/writes to/from every pair of hosts. The ClientTrace
reducer should also output the unsummarized, raw ClientTrace data so they can
be used for analysis/visualization.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.