Hi Chamil, it looks like MergeContent and UnpackContent are the writer and reader, respectively, for both zip and tar format concatenations of multiple files into one or vice versa. If one specifies zip format, compression will be performed.
So as Mark suggested, if you feed the FetchFile queue of successfully fetched files into MergeContent, with ZIP merge format, you should get what you want. "Filename" delimiter strategy is default, and presumably appropriate for this use case. Hope that works. Thanks, --Matt ________________________________________ From: Chamil Jeewantha <[email protected]> Sent: Friday, June 24, 2016 3:27 AM To: [email protected] Subject: Re: Compress a folder with all its files Thank you Matt & Mark for your immediate attention on this. I have list of flowfiles carying the following attributes A GroupId, IdWithinGroup, FilenameOfIndividualFile, TotalNoOfFilesInGroup TotalNoOfFilesInGroup is same for all the files within a same group. (Assume, TotalNoOfFilesInGroup = 1000) I am fetching the files based on the filename attribute using Fetch File Some of the files may be not fetched because of "permission deny etc..." (980 Successfully Fetched & 20 failed) After this step, I have two queues, One with fetched files & one with failed files. Still all these 1000 flow files individually carry the TotalNoOfFilesInGroup as 1000. What I want is a Zip File, Contains 980 passed files. which can be extracted to somewhere by (Mac/Windows etc...) A small readme file included in the zip file containing stats (Optional) Its comparatively easy to write a custom processor in this case as I feel. But I wanted to check whether we can have some common component out from this implementation which can be useful to everyone. Best Regards, Chamil 2016-06-24 1:42 GMT+05:30 Matt Foley <[email protected]>: > Some clarifying questions about what you want to do (without regard to > what existing NiFi processors can do): > > 1. Is this a one-time compression of a folder with fixed contents? Or > will individual files in the folder need to be added and/or removed over > time? > > 2. Does the resulting compressed file need to be compatible with Windows > or Mac "zip folder" formats, or will any codec suffice? > > 3. Does the compressed file need to be splittable, in particular do you > need to be able to extract individual files from it without decompressing > the whole folder? > > Regards, > --Matt F > ________________________________________ > From: Chamil Jeewantha <[email protected]> > Sent: Thursday, June 23, 2016 12:43 PM > To: [email protected] > Subject: Compress a folder with all its files > > Hello Guru's, > > I have set of files in a directory. I wants read all the content of that > given folder and create a zip file by Nifi. > > > - Will MergeContent processor works for this? > - As I know, there is no such process that I can use for this case. Do > we have one? > - Are there any alternatives (work arounds)? > > Best Regards, > Chamil > > -- > http://kavimalla.blgospot.com > http://kdchamil.blogspot.com > -- http://kavimalla.blgospot.com http://kdchamil.blogspot.com
