Re: Best way to wait until everything is finished

2019-04-05 Thread Jean-Sebastien Vachon
I will give it a shot. Thanks for the hint From: Bryan Bende Sent: Friday, April 5, 2019 2:46 PM To: users@nifi.apache.org Subject: Re: Best way to wait until everything is finished Since you are using SplitJson, it should be adding the standard "fragment"

Re: Best way to wait until everything is finished

2019-04-05 Thread Bryan Bende
Since you are using SplitJson, it should be adding the standard "fragment" attributes to each flow file. You can then use MergeContent in Defragment mode, which uses those attributes to merge all the fragments back together. On Fri, Apr 5, 2019 at 2:39 PM Jean-Sebastien Vachon wrote: > > Hi

Best way to wait until everything is finished

2019-04-05 Thread Jean-Sebastien Vachon
Hi again, one of the last issue I am facing with my flow right now is to make one of my MergeContent processor wait until everything has been processed before merging everything into a CSV. What would be the best way to implement this? is this through Wait/Notify? a counter? My whole process

Re: insufficient content written

2019-04-05 Thread Andy LoPresto
Attribute processor to change the filename attribute and > since then I am not able to either view or download the file even if NIfi > reports its size correctly. > > My first thought was a disk full but that is not the case. > > the filename after the updateAttribute looks like

Re: insufficient content written

2019-04-05 Thread Jean-Sebastien Vachon
r view or download the file even if NIfi reports its size correctly. My first thought was a disk full but that is not the case. the filename after the updateAttribute looks like this: 20190405-180910.269-xxx-1.0.csv where xxx is the name of the customer which does not contain any illegal cha

Re: insufficient content written

2019-04-05 Thread Joe Witt
either view or download the file even if > NIfi reports its size correctly. > > My first thought was a disk full but that is not the case. > > the filename after the updateAttribute looks like this: > > 20190405-180910.269-xxx-1.0.csv > > where xxx is the name of the cust

insufficient content written

2019-04-05 Thread Jean-Sebastien Vachon
like this: 20190405-180910.269-xxx-1.0.csv where xxx is the name of the customer which does not contain any illegal character. Any idea?

Re: GetHbase state

2019-04-05 Thread Koji Kawamura
Hi Dwane, Does the Pig job puts HBase data with custom timestamps? For example, the loading data contains last_modified timestamp, and it's used as HBase cell timestamp. If that's the case, GetHbase may miss some HBase rows, unless the Pig job loads raws ordered by the timestamp when Pig and