Actually - small point of clarification. It’s not the FlowFile Repository that’s having a problem, it’s the State Management. Same guidance still applies, but the place to check for running out of disk space may be different.
On Jul 9, 2021, at 9:44 AM, Ralph Vercauteren <[email protected]<mailto:[email protected]>> wrote: Thx Mark, I will check these points. With regards, Mit freundlichem Gruß, Met vriendelijke groet, Ralph Vercauteren Technical Architect QAD Automation Solutions Mobile NL: +31 6 5397 7230 [email protected]<mailto:[email protected]> This e-mail may contain QAD proprietary information and should be treated as confidential. On Fri, Jul 9, 2021 at 3:38 PM Mark Payne <[email protected]<mailto:[email protected]>> wrote: Ralph, The error: "All Partitions have been blacklisted” indicates that the FlowFile Repository failed to update. Many times. This generally would imply that one of three things happened: - You ran out of disk space for the FlowFile Repository. You need to free up some disk space. - You ran out of open file handles. Make sure you’ve followed instructions in the admin guide for adjusting max open file handles and restart. - You encountered an OutOfMemoryError. Ensure that you have a sufficiently sized Java heap and avoid splitting FlowFiles or adding a lot of large attributes to FlowFiles in the your flow. Thanks -Mark > On Jul 9, 2021, at 7:44 AM, Ralph Vercauteren > <[email protected]<mailto:[email protected]>> wrote: > > Hi All, > > I got the next error in the NIFI 1.8 logfiles. > > 2021-07-09 06:32:58,484 ERROR [Timer-Driven Process Thread-6] > o.a.n.processors.standard.EnforceOrder > EnforceOrder[id=d0dcb868-c571-3925-3fbf-626ce53a77f1] > EnforceOrder[id=d0dcb868-c571-3925-3fbf-626ce53a77f1] failed to process > session due to java.lang.RuntimeException: Failed to update state due to > java.io.IOException: All Partitions have been blacklisted due to failures > when attempting to update. If the Write-Ahead Log is able to perform a > checkpoint, this issue may resolve itself. Otherwise, manual intervention > will be required.. Session will be rollback and processor will be yielded for > a while.; Processor Administratively Yielded for 1 sec: > java.lang.RuntimeException: Failed to update state due to > java.io.IOException: All Partitions have been blacklisted due to failures > when attempting to update. If the Write-Ahead Log is able to perform a > checkpoint, this issue may resolve itself. Otherwise, manual intervention > will be required.. Session will be rollback and processor will be yielded for > a while. > at > org.apache.nifi.processors.standard.EnforceOrder.onTrigger(EnforceOrder.java:310) > at > org.apache.nifi.processors.standard.EnforceOrder.onTrigger(EnforceOrder.java:308) > > This is includeing with a part what is going in front and after that error. > > 2021-07-09 06:32:58,484 WARN [Timer-Driven Process Thread-6] > o.a.n.processors.standard.EnforceOrder > EnforceOrder[id=d0dcb868-c571-3925-3fbf-626ce53a77f1] Skipped, FlowFile order > was 29 but current target is 35. > StandardFlowFileRecord[uuid=f471402f-ffc1-4d3a-8da5-fbfc3a280871,claim=StandardContentClaim > [resourceClaim=StandardResourceClaim[id=1625825644686-4683, > container=default, section=587], offset=821333, > length=785],offset=0,name=b0056024-62a8-45d7-8115-5c3d7897d8d0,size=785] > 2021-07-09 06:32:58,484 WARN [Timer-Driven Process Thread-6] > o.a.n.processors.standard.EnforceOrder > EnforceOrder[id=d0dcb868-c571-3925-3fbf-626ce53a77f1] Skipped, FlowFile order > was 30 but current target is 35. > StandardFlowFileRecord[uuid=847f606c-23e3-4d96-9a41-79b7c3ef26bb,claim=StandardContentClaim > [resourceClaim=StandardResourceClaim[id=1625825644686-4683, > container=default, section=587], offset=884832, > length=1406],offset=0,name=ac5bc555-38af-48d5-ba71-7d69d95b3013,size=1406] > 2021-07-09 06:32:58,484 WARN [Timer-Driven Process Thread-6] > o.a.n.processors.standard.EnforceOrder > EnforceOrder[id=d0dcb868-c571-3925-3fbf-626ce53a77f1] Skipped, FlowFile order > was 31 but current target is 35. > StandardFlowFileRecord[uuid=88fcddec-d7ae-4365-af74-0d6289596dc1,claim=StandardContentClaim > [resourceClaim=StandardResourceClaim[id=1625825630166-4682, > container=default, section=586], offset=1016629, > length=113],offset=0,name=6f86e5b5-52e8-4ba0-8cb3-7de2ce044a10,size=113] > 2021-07-09 06:32:58,484 WARN [Timer-Driven Process Thread-6] > o.a.n.processors.standard.EnforceOrder > EnforceOrder[id=d0dcb868-c571-3925-3fbf-626ce53a77f1] Skipped, FlowFile order > was 32 but current target is 35. > StandardFlowFileRecord[uuid=1dc5ba38-90d0-4e94-9f36-25fb20ebb963,claim=StandardContentClaim > [resourceClaim=StandardResourceClaim[id=1625825644686-4683, > container=default, section=587], offset=867045, > length=113],offset=0,name=ed5d9ec4-54f0-4e21-9ba5-c3228e44d7cc,size=113] > 2021-07-09 06:32:58,484 WARN [Timer-Driven Process Thread-6] > o.a.n.processors.standard.EnforceOrder > EnforceOrder[id=d0dcb868-c571-3925-3fbf-626ce53a77f1] Skipped, FlowFile order > was 33 but current target is 35. > StandardFlowFileRecord[uuid=03952508-5579-4b29-bd86-eeca1d8b3a32,claim=StandardContentClaim > [resourceClaim=StandardResourceClaim[id=1625828359956-4684, > container=default, section=588], offset=43529, > length=113],offset=0,name=096fa15d-38cd-4658-af2d-7b7cb2efb362,size=113] > 2021-07-09 06:32:58,484 WARN [Timer-Driven Process Thread-6] > o.a.n.processors.standard.EnforceOrder > EnforceOrder[id=d0dcb868-c571-3925-3fbf-626ce53a77f1] Skipped, FlowFile order > was 34 but current target is 35. > StandardFlowFileRecord[uuid=47c06960-be2b-488f-8486-f0cdf02745f1,claim=StandardContentClaim > [resourceClaim=StandardResourceClaim[id=1625825644686-4683, > container=default, section=587], offset=814122, > length=113],offset=0,name=3cdc7cea-7c48-4e91-9870-e687689b6a1e,size=113] > 2021-07-09 06:32:58,484 ERROR [Timer-Driven Process Thread-6] > o.a.n.processors.standard.EnforceOrder > EnforceOrder[id=d0dcb868-c571-3925-3fbf-626ce53a77f1] > EnforceOrder[id=d0dcb868-c571-3925-3fbf-626ce53a77f1] failed to process > session due to java.lang.RuntimeException: Failed to update state due to > java.io.IOException: All Partitions have been blacklisted due to failures > when attempting to update. If the Write-Ahead Log is able to perform a > checkpoint, this issue may resolve itself. Otherwise, manual intervention > will be required.. Session will be rollback and processor will be yielded for > a while.; Processor Administratively Yielded for 1 sec: > java.lang.RuntimeException: Failed to update state due to > java.io.IOException: All Partitions have been blacklisted due to failures > when attempting to update. If the Write-Ahead Log is able to perform a > checkpoint, this issue may resolve itself. Otherwise, manual intervention > will be required.. Session will be rollback and processor will be yielded for > a while. > at > org.apache.nifi.processors.standard.EnforceOrder.onTrigger(EnforceOrder.java:310) > at > org.apache.nifi.processors.standard.EnforceOrder.onTrigger(EnforceOrder.java:308) > 2021-07-09 06:32:58,485 WARN [Timer-Driven Process Thread-6] > o.a.n.controller.tasks.ConnectableTask Administratively Yielding > EnforceOrder[id=d0dcb868-c571-3925-3fbf-626ce53a77f1] due to uncaught > Exception: java.lang.RuntimeException: Failed to update state due to > java.io.IOException: All Partitions have been blacklisted due to failures > when attempting to update. If the Write-Ahead Log is able to perform a > checkpoint, this issue may resolve itself. Otherwise, manual intervention > will be required.. Session will be rollback and processor will be yielded for > a while. > at > org.apache.nifi.processors.standard.EnforceOrder.onTrigger(EnforceOrder.java:310) > at > org.apache.nifi.processors.standard.EnforceOrder.onTrigger(EnforceOrder.java:308) > > This is the flow I created. > > <image.png> > And this is the parameter setup of the EnforceOrder processor: > <image.png> > > Upgrading is currently an option, and this is only occurring in the flow of 1 > customer. Other customers including customers who went live, this is not an > issue. > > Please help. > > With regards, > Mit freundlichem Gruß, > Met vriendelijke groet, > > Ralph Vercauteren > Technical Architect QAD Automation Solutions > Mobile NL: +31 6 5397 7230 > [email protected]<mailto:[email protected]> > > This e-mail may contain QAD proprietary information and should be treated as > confidential.
