Re: data flow from one s3 bucket to another

2016-11-18 Thread Gop Krr
ted. > I'd recommend to test a S3 related flow using ListS3 processor, to see > if the credential can properly access the target S3 bucket. > > Thanks, > Koji > > On Fri, Oct 28, 2016 at 7:35 AM, Gop Krr <gop@gmail.com> wrote: > > Has anyone implemented data copy from o

Re: nifi is running out of memory

2016-11-01 Thread Gop Krr
u ever get past this? > > Thanks > Joe > > On Fri, Oct 28, 2016 at 2:36 PM, Gop Krr <gop@gmail.com> wrote: > > James, permission issue got resolved. I still don't see any write. > > > > On Fri, Oct 28, 2016 at 10:34 AM, Gop Krr <gop@gmail.com> wrote:

Re: nifi is running out of memory

2016-10-28 Thread Gop Krr
rate the "failure" relationship to either loop back to FetchS3Object or > go to a LogAttibute processor, or other handling path. > * It looks like the permissions aren't working, you might want to > double-check the access keys or try a sample file with the AWS CLI. > >

Re: nifi is running out of memory

2016-10-28 Thread Gop Krr
at 6:31 AM, Pierre Villard <pierre.villard...@gmail.com > wrote: > Quick remark: the fix has also been merged in master and will be in > release 1.1.0. > > Pierre > > 2016-10-28 15:22 GMT+02:00 Gop Krr <gop@gmail.com>: > >> Thanks Adam. I will try 0.7.1

Re: nifi is running out of memory

2016-10-28 Thread Gop Krr
;>> Hello, > >>> > >>> Are you running with all of the default settings? > >>> > >>> If so you would probably want to try increasing the memory settings in > >>> conf/bootstrap.conf. > >>> > >>> They default

data flow from one s3 bucket to another

2016-10-27 Thread Gop Krr
Has anyone implemented data copy from one s3 bucket to another. i would greatly appreciate if you can share with me your sample processors configuration. Thanks Rai

Re: PutDynamoDB processor

2016-10-18 Thread Gop Krr
S3 > http://docs.aws.amazon.com/datapipeline/latest/DeveloperGuide/dp-template- > exports3toddb.html > > Thanks, > > James > > > On Fri, Oct 14, 2016 at 10:58 AM, Gop Krr <gop@gmail.com> wrote: > >> Thanks James. I would be happy to contribute the scan proces

Re: PutDynamoDB processor

2016-10-14 Thread Gop Krr
a great addition to NiFi. If you have any interest in > working on a scan processor, please open a JIRA ticket at > https://issues.apache.org/jira/browse/NIFI. > > Thanks, > > James > > On Thu, Oct 13, 2016 at 2:12 PM, Gop Krr <gop@gmail.com> wrote: > >

Re: PutDynamoDB processor

2016-10-13 Thread Gop Krr
equired. You can change it > to any attribute expression ${my.hash.key}, or even hard-code a single key > "item123" if you wish. > > Does that help? > > Thanks, > > James > > On Thu, Oct 13, 2016 at 12:17 PM, Gop Krr <gop@gmail.com> wrote: > >> Hi

PutDynamoDB processor

2016-10-13 Thread Gop Krr
Hi All, I have been trying to use get and load processor for the dynamodb and I am almost there. I am able to run the get processor and I see, data is flowing :) But I see the following error in my nifi-app.log file: 2016-10-13 18:02:38,823 ERROR [Timer-Driven Process Thread-9]

Re: Book/Training for NiFi

2016-10-13 Thread Gop Krr
.@gmail.com>* > PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > > On Oct 13, 2016, at 10:28 AM, Gop Krr <gop@gmail.com> wrote: > > Hi All, > Is there any book for apache NiFi? > Also, does Hortonworks conducts training for NiFi? > Thanks > Rai > > >

Book/Training for NiFi

2016-10-13 Thread Gop Krr
Hi All, Is there any book for apache NiFi? Also, does Hortonworks conducts training for NiFi? Thanks Rai

upstream system is invalid

2016-10-07 Thread Gop Krr
Hi, I am getting the following error: " The upstream system is invalid because it needs an upstream system and there is none" I am trying to move data from one dynamodb table to another without doing any transformation and I have configured two processors, one for get and another for put. Do I