Sorry about the alignment. I figured out the issue, InvokeHTTP was getting rate limited and no-retry count is not included in original hence there was a mismatch Thanks -Dweep
On Sat, Apr 25, 2020 at 8:20 PM Mark Payne <[email protected]> wrote: > Hi Dweep, > > Can you provide a template of the flow? I don’t think there’s not enough > context from the screenshot to understand what the flow is doing. > > It’s also difficult to follow what’s happening because the processors > aren’t aligned nicely. There are a lot of connections going in many > different directions. Processors have lots of connections coming in and > lots of connections going out. I recommend aligning the processors neatly > so that the flow is easier to comprehend. > > Thanks > -Mark > > > > > On Apr 25, 2020, at 8:29 AM, Dweep Sharma <[email protected]> wrote: > > Hi, > > > I am noticing an inconsistent flowfile output with multiple processors in > NiFi. > > In the below example there are 3 processors in study > > A) ExtractText produces 103 files as can be seen in A.1 queue (This is > correct) > B) InvokeHTTP should receive 103 files but receives only 61 as seen in B.2 > original queue (this is inconsistent) > C) InvokeHTTP should receive 103 files but receives only 65 as seen in C.2 > original queue > > I have two questions. > 1) Why doesn't A receive all 103 files all the time. I notice the counts > vary with every run of this pipeline. ? > 2) C processor is a copy of A so it should receive the same counts but the > counts are inconsistent 65 & 61 respectively. > > Can someone let me know what to look for to identify this issue? > > <image.png> > > > -Dweep > > > > > *::DISCLAIMER:: > ---------------------------------------------------------------------------------------------------------------------------------------------------- > The contents of this e-mail and any attachments are confidential and > intended for the named recipient(s) only.E-mail transmission is not > guaranteed to be secure or error-free as information could be intercepted, > corrupted,lost, destroyed, arrive late or incomplete, or may contain > viruses in transmission. The e mail and its contents(with or without > referred errors) shall therefore not attach any liability on the originator > or redBus.com <http://redBus.com>. Views or opinions, if any, presented in > this email are solely those of the author and may not necessarily reflect > the views or opinions of redBus.com <http://redBus.com>. Any form of > reproduction, dissemination, copying, disclosure, modification,distribution > and / or publication of this message without the prior written consent of > authorized representative of redbus. <http://redbus.in/>com is strictly > prohibited. If you have received this email in error please delete it and > notify the sender immediately.Before opening any email and/or attachments, > please check them for viruses and other defects.* > > > -- *::DISCLAIMER:: ---------------------------------------------------------------------------------------------------------------------------------------------------- The contents of this e-mail and any attachments are confidential and intended for the named recipient(s) only.E-mail transmission is not guaranteed to be secure or error-free as information could be intercepted, corrupted,lost, destroyed, arrive late or incomplete, or may contain viruses in transmission. The e mail and its contents(with or without referred errors) shall therefore not attach any liability on the originator or redBus.com. Views or opinions, if any, presented in this email are solely those of the author and may not necessarily reflect the views or opinions of redBus.com. Any form of reproduction, dissemination, copying, disclosure, modification,distribution and / or publication of this message without the prior written consent of authorized representative of redbus. <http://redbus.in/>com is strictly prohibited. If you have received this email in error please delete it and notify the sender immediately.Before opening any email and/or attachments, please check them for viruses and other defects.*
