Thanks Pedro. The mention of
*org.apache.flume.sink.hbase.RegexHbaseEventSerializer* was very useful.
This works
# Describing/Configuring the sink
JsonAgent.channels.hdfs-channel-1.type = memory
JsonAgent.channels.hdfs-channel-1.capacity = 300
Probably Flume's mailing list would be a better resource to get help about
this.
SimpleHBaseEventSerializer doesn't do regex, so you can't extract your own
.
Thanks Pedro,
As I understand it tries a default rowkey as follows:
Row keys are default + UUID_like_string
:
defaultfb7cb953-8598-466e-a1c0-277e2863b249
But I send rowkey value as well
*f2d7174e-6299-49a7-9e87-0d66c248e66b*
{"rowkey":"f2d7174e-6299-49a7-9e87-0d66c248e66b","ticker":"BP",
If what you're looking after is not achievable by extracting fields through
regex (it looks like it should) and you are after full control over what's
written to HBase you're probably looking at writing your own serializer.
On Fri, 14 Feb 2020 at 11:05, Mich Talebzadeh
wrote:
> Hi,
>
> I have
