Re: [EXTERNAL] Re: Nifi putting object to S3 directory

2022-05-16 Thread Peter Turcsanyi
Hi Natalia, You can set the "directory" in the Prefix property of ListS3. In this case no UpdateAttribute is needed, just connect ListS3 -> FetchS3Object. Regards, Peter Turcsanyi On Mon, May 16, 2022 at 4:24 PM Fill, Natalia wrote: > Hi Nifi Team, > > Following from tests below I need to

Re: [DISCUSS] MiNiFi C++ 0.12.0 release

2022-05-16 Thread Marton Szasz
I agree that it's time for a new release, thanks for RM'ing Martin. I have these two issues that I think would be nice to include in the release: 1. MINIFICPP-1828 fix InvokeHTTP Attributes to Send https://github.com/apache/nifi-minifi-cpp/pull/1331 This is a bug that is severe enough that I

Re: [DISCUSS] MiNiFi C++ 0.12.0 release

2022-05-16 Thread Arpad Boda
+1 On Mon, May 16, 2022 at 4:12 PM Joe Witt wrote: > Certainly more than enough there! Thanks Martin > > On Mon, May 16, 2022 at 7:06 AM Martin Zink wrote: > > > Hi community, > > > > I'd like to initiate a discussion about the next release of MiNiFi C++. > The > > last release was five

RE: [EXTERNAL] Re: Nifi putting object to S3 directory

2022-05-16 Thread Fill, Natalia
Hi Nifi Team, Following from tests below I need to retrieve files from specific directories on S3. The files are placed into dir/subdir/. I tried various expression to specify 'filename' variable that feeds to FetchS3Object and still get error that the key doesn't exist. I am not sure if

Re: [DISCUSS] MiNiFi C++ 0.12.0 release

2022-05-16 Thread Joe Witt
Certainly more than enough there! Thanks Martin On Mon, May 16, 2022 at 7:06 AM Martin Zink wrote: > Hi community, > > I'd like to initiate a discussion about the next release of MiNiFi C++. The > last release was five months ago, and there have been many new features, > bug fixes and

[DISCUSS] MiNiFi C++ 0.12.0 release

2022-05-16 Thread Martin Zink
Hi community, I'd like to initiate a discussion about the next release of MiNiFi C++. The last release was five months ago, and there have been many new features, bug fixes and stability improvements committed to the development branch since. (~110 commits) I would be happy to take on RM duties

RE: [EXTERNAL] Re: Nifi putting object to S3 directory

2022-05-16 Thread Fill, Natalia
Thanks Peter, removing leading slash worked and now Nifi puts file into specified subdirectory. This is a simple test flow to test read/write to s3: GenerateFlowFile - on success - UpdateAttribute (filename to meaningful name) - on success - PutS3Object - on success and on failure LogAttribute

Re: Nifi putting object to S3 directory

2022-05-16 Thread Peter Turcsanyi
Hi Natalia, Is the FlowFile transferred to the success or the failure relationship from PutS3Object? In general, you need to use dirtag/subdirtag /${filename}, so no leading slash. Leading slash results in a directory called '/' on S3. Regards, Peter Turcsanyi On Mon, May 16, 2022 at 12:46 PM

Nifi putting object to S3 directory

2022-05-16 Thread Fill, Natalia
Hi Nifi Team, I am working on a solution to put file into S3 server. I used PutS3Object and managed to put some files into a bucket, but it failed to put files into specific directories on S3. No errors, but I don't see the files in the bucket. I used the following format for object key: