Re: data flow from one s3 bucket to another

2016-11-18 Thread Gop Krr
Thanks Koji. I was able to solve this problem but what you have attached is
very useful.

On Wed, Nov 16, 2016 at 6:43 PM, Koji Kawamura 
wrote:

> Hello Gop,
>
> Have you already found how to move data around S3 buckets? I hope you do.
> But just in case if you haven't yet, I wrote a simple NiFi flow and
> shared it in Gist:
> https://gist.github.com/ijokarumawak/26ff675039e252d177b1195f3576cf9a
>
> I misconfigured region and got an error once, but after I setup bucket
> name, region and credential correctly, it worked as expected.
> I'd recommend to test a S3 related flow using ListS3 processor, to see
> if the credential can properly access the target S3 bucket.
>
> Thanks,
> Koji
>
> On Fri, Oct 28, 2016 at 7:35 AM, Gop Krr  wrote:
> > Has anyone implemented data copy from one s3 bucket to another. i would
> > greatly appreciate if you can share with me your sample processors
> > configuration.
> > Thanks
> > Rai
>


Re: data flow from one s3 bucket to another

2016-11-16 Thread Koji Kawamura
Hello Gop,

Have you already found how to move data around S3 buckets? I hope you do.
But just in case if you haven't yet, I wrote a simple NiFi flow and
shared it in Gist:
https://gist.github.com/ijokarumawak/26ff675039e252d177b1195f3576cf9a

I misconfigured region and got an error once, but after I setup bucket
name, region and credential correctly, it worked as expected.
I'd recommend to test a S3 related flow using ListS3 processor, to see
if the credential can properly access the target S3 bucket.

Thanks,
Koji

On Fri, Oct 28, 2016 at 7:35 AM, Gop Krr  wrote:
> Has anyone implemented data copy from one s3 bucket to another. i would
> greatly appreciate if you can share with me your sample processors
> configuration.
> Thanks
> Rai