Hi James,
I have started exploring the option of building the scan operator for the
DynamoDB.
I will let you know, how is it going.
Thanks
Rai
On Fri, Oct 14, 2016 at 11:42 AM, James Wing wrote:
> Correct, but I'm afraid I'm no expert on DynamoDB. It is my understanding
> that you have to itera
Correct, but I'm afraid I'm no expert on DynamoDB. It is my understanding
that you have to iterate through the keys in the source table one-by-one,
then put each key's content into the destination table. You can speed this
up by using multiple iterators, each covering a distinct portion of the ke
Thanks James. I would be happy to contribute the scan processor for
DynamoDB. Just to clarify, based on your comment, we can't take all the
rows of the DynamoDB table and put it into another table. We have to do it
for one record at a time?
On Fri, Oct 14, 2016 at 10:50 AM, James Wing wrote:
> N
NiFi's GetDynamoDB processor uses the underlying BatchGetItem API, which
requires item keys as inputs. Iterating over the keys in a table would
require the Scan API, but NiFi does not have a processor to scan a DynamoDB
table.
This would be a great addition to NiFi. If you have any interest in
w
Thanks James. I am looking to iterate through the table so that it takes
hash key values one by one. Do I achieve it through the expression
language? if I write an script to do that, how do I pass it to my processor?
Thanks
Niraj
On Thu, Oct 13, 2016 at 1:42 PM, James Wing wrote:
> Rai,
>
> The
Rai,
The GetDynamoDB processor requires a hash key value to look up an item in
the table. The default setting is an Expression Language statement that
reads the hash key value from a flowfile attribute,
dynamodb.item.hash.key.value. But this is not required. You can change it
to any attribute e
Hi All,
I have been trying to use get and load processor for the dynamodb and I am
almost there. I am able to run the get processor and I see, data is flowing
:)
But I see the following error in my nifi-app.log file:
2016-10-13 18:02:38,823 ERROR [Timer-Driven Process Thread-9]
o.a.n.p.aws.dynamod
