[
https://issues.apache.org/jira/browse/HTRACE-25?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Long Zhou updated HTRACE-25:
----------------------------
Attachment: htrace-25.001.patch
This patch has the following changes:
1) added TraceSerializer.java that converts flume events to hbase put requests,
and flume-hbase-sink can use it to write spans to hbase. It uses the same table
schema and format as htrace-hbase, so works with the viewer app.
2) added ProtoBuf serialization support to htrace-flume. ProtoBuf format is
more effecient than Json, and is the format used in our hbase schema.
3) added two unit tests to verify the pipeline from FlumeSpanReceiver, via
flume agent, and to hbase. Also refactored test utilities to a seperate class.
4) updated README.md with new setup instructions. Also fixed format issues.
This change makes htrace-flume depend on htrace-hbase module, mainly for the
ProtoBuf generated class (SpanProtos.java). So during deployment, we need to
copy htrace-hbase.jar along with htrace-flume-jar-with-dependency.jar. I wonder
if it would make sense to move SpanProtos.java to htrace-core.
> htrace-flume: add hbase sink support
> ------------------------------------
>
> Key: HTRACE-25
> URL: https://issues.apache.org/jira/browse/HTRACE-25
> Project: HTrace
> Issue Type: Improvement
> Reporter: Long Zhou
> Assignee: Long Zhou
> Attachments: htrace-25.001.patch
>
>
> To put spans collected by flume agent into hbase, we need to implement a
> customized HbaseEventSerializer that can convert flume events to hbase put
> requests.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
