Re: merge flowfiles while adding up the line count

2017-12-17 Thread tzhu
Hi Mark, My intent is to get the number of times some strings appeared in the text file. The strings would only appear once in a line and in each line only one string would appear. When the file gets split up or merged, I can get the line count so that I can get the number of times the string

Re: merge flowfiles while adding up the line count

2017-12-13 Thread Mark Payne
Tina, If the intent is to split the data up just so that you can route each line differently, and then re-assemble the data, I would recommend that you look into RouteText. This will likely give you the capability you need but does so without having to split the data up and re-merge it, so your

Re: merge flowfiles while adding up the line count

2017-12-13 Thread Joe Witt
id recommend you look into MergeRecord for this. On Dec 13, 2017 3:35 PM, "tzhu" wrote: > Hi, > > I want to use MergeContent to combine single-lined flowfiles resulted from > a > text file getting split and routed, and record the number of lines. I have > a > few text

merge flowfiles while adding up the line count

2017-12-13 Thread tzhu
Hi, I want to use MergeContent to combine single-lined flowfiles resulted from a text file getting split and routed, and record the number of lines. I have a few text files. First, the text gets split into single lines by SplitText, and then the flowfiles are routed by RouteOnContent. I'm stuck

Re: merge flowfiles

2016-12-19 Thread Lee Laim
Raf, You might be able to use PutFile and 'merge' your flowfiles in a temporary batch directory. Once you are confident that all the flow files have landed, you can pull the contents of the directory. In other words, when a new directory shows up, pull the contents of the older directory back

Re: merge flowfiles

2016-12-19 Thread Jeff
Hello Raf, MergeContent can merge based on a correlation ID (attribute). However, the merging currently operates in two modes: Defragment or Bin-Packing Algorithm. Defragment is completed by defragmenting based on the correlation ID and a known number of fragments. Bin-Packing Algorithm is

merge flowfiles

2016-12-19 Thread Raf Huys
I want to batch incoming flowfiles based on an attribute. As soon as this attributes' value changes, the current batch should be transferred downstream and be reset. So basically I'm looking for a tumbling window. Can this be done with the MergeContent processor (which strategy?) or should I