[
https://issues.apache.org/jira/browse/NIFI-817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14742665#comment-14742665
]
Mark Payne commented on NIFI-817:
---------------------------------
Alan,
GetHBase is indeed intended for incremental updates. As-is, it is not "cluster
friendly" and wouldhave to be scheduled for PrimaryNode Only if run in a
cluster. It is not ready for prime-time yet, though,which is why we decided to
push it out to a later release instead of pulling it in to 0.3.0. It does
persist its state so thatif NiFi is restarted, it will continue where it left
off. However, it really should be updated to save its state across thecluster
so that other nodes can either pull in parallel or at least pick up where the
previous node left off.I would say that the current state is a
proof-of-concept, more or less, and in 0.4.0 we should have it ready to go.
I do like your idea of allowing the user to choose which columns to pull.
PutHBaseCell does exactly as you described. The contents of the FlowFile are
pushed into exactly one HBase Cell.We called it PutHBaseCell rather than just
PutHBase because it is very reasonable to expect that at some point we mayneed
to build another processor that will put some sort of structured data (json,
xml, avro, etc.) to HBase, rather thanupdating a single cell.
We have been looking at building processors for some other NoSQL databases, as
well, and will likely be facingsimilar challenges with those. If you have
thoughts on design, please feel free to share, as we want these to be
veryuseful and easy-to-use.
Thanks-Mark
> Create Processors to interact with HBase
> ----------------------------------------
>
> Key: NIFI-817
> URL: https://issues.apache.org/jira/browse/NIFI-817
> Project: Apache NiFi
> Issue Type: New Feature
> Components: Extensions
> Reporter: Mark Payne
> Assignee: Mark Payne
> Fix For: 0.4.0
>
> Attachments:
> 0001-NIFI-817-Initial-implementation-of-HBase-processors.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
