Re: PutDynamoDB processor

2016-10-18 Thread Gop Krr
Hi James, I have started exploring the option of building the scan operator for the DynamoDB. I will let you know, how is it going. Thanks Rai On Fri, Oct 14, 2016 at 11:42 AM, James Wing wrote: > Correct, but I'm afraid I'm no expert on DynamoDB. It is my understanding >

Re: PutDynamoDB processor

2016-10-14 Thread Gop Krr
Thanks James. I would be happy to contribute the scan processor for DynamoDB. Just to clarify, based on your comment, we can't take all the rows of the DynamoDB table and put it into another table. We have to do it for one record at a time? On Fri, Oct 14, 2016 at 10:50 AM, James Wing

Re: PutDynamoDB processor

2016-10-14 Thread James Wing
NiFi's GetDynamoDB processor uses the underlying BatchGetItem API, which requires item keys as inputs. Iterating over the keys in a table would require the Scan API, but NiFi does not have a processor to scan a DynamoDB table. This would be a great addition to NiFi. If you have any interest in

Re: PutDynamoDB processor

2016-10-13 Thread Gop Krr
Thanks James. I am looking to iterate through the table so that it takes hash key values one by one. Do I achieve it through the expression language? if I write an script to do that, how do I pass it to my processor? Thanks Niraj On Thu, Oct 13, 2016 at 1:42 PM, James Wing

Re: PutDynamoDB processor

2016-10-13 Thread James Wing
Rai, The GetDynamoDB processor requires a hash key value to look up an item in the table. The default setting is an Expression Language statement that reads the hash key value from a flowfile attribute, dynamodb.item.hash.key.value. But this is not required. You can change it to any attribute