Re: Deadlock in loop

Wed, 18 Aug 2021 07:19:15 -0700 

Hello Joe,

Thank you for your email. Sure, please find attached a template that
contains the loop itself.

Best,

Aurelien

Le mer. 18 août 2021 à 14:31, Joe Witt <[email protected]> a écrit :

> Hello
>
> This case should work very well.  Please share the details of the flow
> configuration.  Can you download a flow template and share that?
>
> thanks
>
> On Wed, Aug 18, 2021 at 8:20 AM Aurélien Mazoyer <[email protected]>
> wrote:
>
>> Hi,
>>
>> I have a nifi flow that reads zip files. For each non-zip file it
>> performs some treatment on its content and for each zip file it unzips it
>> and performs the treatment on files in the archive. There is a loop in the
>> flow so if a zip contains a zip, this zip will be reinjected at the
>> beginning of the flow to be processed (and so one). However, when I have
>> several zips in an archive, I experience a deadlock in my loop. Is there a
>> solution to mitigate this issue in Nifi, such as having a back pressure on
>> the first processor of the loop depending on the state on the queues in
>> loop?
>>
>> Thank you,
>>
>> Aurelien
>>
>

<template encoding-version="1.2">
<description/>
<groupId>5519650c-017b-1000-0000-00007a4a4440</groupId>
<name>ZipLoop</name>
<snippet>
<connections>
</connections>
<connections>
<id>77d8f33c-ce3a-3a9a-0000-000000000000</id>
<parentGroupId>5aa40cac-cc2b-3734-0000-000000000000</parentGroupId>
<backPressureDataSizeThreshold>1 GB</backPressureDataSizeThreshold>
<backPressureObjectThreshold>10000</backPressureObjectThreshold>
<destination>
<groupId>5aa40cac-cc2b-3734-0000-000000000000</groupId>
<id>fe6b93a7-e674-3703-0000-000000000000</id>
<type>PROCESSOR</type>
</destination>
<flowFileExpiration>0 sec</flowFileExpiration>
<labelIndex>1</labelIndex>
<loadBalanceCompression>DO_NOT_COMPRESS</loadBalanceCompression>
<loadBalancePartitionAttribute/>
<loadBalanceStatus>LOAD_BALANCE_NOT_CONFIGURED</loadBalanceStatus>
<loadBalanceStrategy>DO_NOT_LOAD_BALANCE</loadBalanceStrategy>
<name/>
<selectedRelationships>success</selectedRelationships>
<source>
<groupId>5aa40cac-cc2b-3734-0000-000000000000</groupId>
<id>677ee8fb-02c1-3929-0000-000000000000</id>
<type>PROCESSOR</type>
</source>
<zIndex>0</zIndex>
</connections>
<connections>
<id>94f66e57-477f-3f3a-0000-000000000000</id>
<parentGroupId>5aa40cac-cc2b-3734-0000-000000000000</parentGroupId>
<backPressureDataSizeThreshold>1 GB</backPressureDataSizeThreshold>
<backPressureObjectThreshold>10000</backPressureObjectThreshold>
<destination>
<groupId>5aa40cac-cc2b-3734-0000-000000000000</groupId>
<id>2e35dd06-83d3-3671-0000-000000000000</id>
<type>PROCESSOR</type>
</destination>
<flowFileExpiration>0 sec</flowFileExpiration>
<labelIndex>1</labelIndex>
<loadBalanceCompression>DO_NOT_COMPRESS</loadBalanceCompression>
<loadBalancePartitionAttribute/>
<loadBalanceStatus>LOAD_BALANCE_NOT_CONFIGURED</loadBalanceStatus>
<loadBalanceStrategy>DO_NOT_LOAD_BALANCE</loadBalanceStrategy>
<name/>
<selectedRelationships>tar.gz</selectedRelationships>
<source>
<groupId>5aa40cac-cc2b-3734-0000-000000000000</groupId>
<id>b7deeb0f-9391-3f67-0000-000000000000</id>
<type>PROCESSOR</type>
</source>
<zIndex>0</zIndex>
</connections>
<connections>
<id>9e7948f2-6051-373f-0000-000000000000</id>
<parentGroupId>5aa40cac-cc2b-3734-0000-000000000000</parentGroupId>
<backPressureDataSizeThreshold>1 GB</backPressureDataSizeThreshold>
<backPressureObjectThreshold>10000</backPressureObjectThreshold>
<destination>
<groupId>5aa40cac-cc2b-3734-0000-000000000000</groupId>
<id>871bb501-b5a6-3b19-0000-000000000000</id>
<type>PROCESSOR</type>
</destination>
<flowFileExpiration>0 sec</flowFileExpiration>
<labelIndex>1</labelIndex>
<loadBalanceCompression>DO_NOT_COMPRESS</loadBalanceCompression>
<loadBalancePartitionAttribute/>
<loadBalanceStatus>LOAD_BALANCE_NOT_CONFIGURED</loadBalanceStatus>
<loadBalanceStrategy>DO_NOT_LOAD_BALANCE</loadBalanceStrategy>
<name/>
<selectedRelationships>unmatched</selectedRelationships>
<source>
<groupId>5aa40cac-cc2b-3734-0000-000000000000</groupId>
<id>b7deeb0f-9391-3f67-0000-000000000000</id>
<type>PROCESSOR</type>
</source>
<zIndex>0</zIndex>
</connections>
<connections>
<id>a29079aa-54b9-3a48-0000-000000000000</id>
<parentGroupId>5aa40cac-cc2b-3734-0000-000000000000</parentGroupId>
<backPressureDataSizeThreshold>1 GB</backPressureDataSizeThreshold>
<backPressureObjectThreshold>10000</backPressureObjectThreshold>
<destination>
<groupId>5aa40cac-cc2b-3734-0000-000000000000</groupId>
<id>3d481ca1-4b46-3989-0000-000000000000</id>
<type>PROCESSOR</type>
</destination>
<flowFileExpiration>0 sec</flowFileExpiration>
<labelIndex>1</labelIndex>
<loadBalanceCompression>DO_NOT_COMPRESS</loadBalanceCompression>
<loadBalancePartitionAttribute/>
<loadBalanceStatus>LOAD_BALANCE_NOT_CONFIGURED</loadBalanceStatus>
<loadBalanceStrategy>DO_NOT_LOAD_BALANCE</loadBalanceStrategy>
<name/>
<selectedRelationships>unmatched</selectedRelationships>
<source>
<groupId>5aa40cac-cc2b-3734-0000-000000000000</groupId>
<id>63e0c48e-a6ce-3c2b-0000-000000000000</id>
<type>PROCESSOR</type>
</source>
<zIndex>0</zIndex>
</connections>
<connections>
<id>b2f24c58-a96d-33df-0000-000000000000</id>
<parentGroupId>5aa40cac-cc2b-3734-0000-000000000000</parentGroupId>
<backPressureDataSizeThreshold>1 GB</backPressureDataSizeThreshold>
<backPressureObjectThreshold>10000</backPressureObjectThreshold>
<destination>
<groupId>5aa40cac-cc2b-3734-0000-000000000000</groupId>
<id>c9b6c241-5b41-3c8f-0000-000000000000</id>
<type>PROCESSOR</type>
</destination>
<flowFileExpiration>0 sec</flowFileExpiration>
<labelIndex>1</labelIndex>
<loadBalanceCompression>DO_NOT_COMPRESS</loadBalanceCompression>
<loadBalancePartitionAttribute/>
<loadBalanceStatus>LOAD_BALANCE_NOT_CONFIGURED</loadBalanceStatus>
<loadBalanceStrategy>DO_NOT_LOAD_BALANCE</loadBalanceStrategy>
<name/>
<selectedRelationships>success</selectedRelationships>
<source>
<groupId>5aa40cac-cc2b-3734-0000-000000000000</groupId>
<id>41bbbc03-87a0-3324-0000-000000000000</id>
<type>PROCESSOR</type>
</source>
<zIndex>0</zIndex>
</connections>
<connections>
<id>b3c4f5b9-e2d6-3c0a-0000-000000000000</id>
<parentGroupId>5aa40cac-cc2b-3734-0000-000000000000</parentGroupId>
<backPressureDataSizeThreshold>1 GB</backPressureDataSizeThreshold>
<backPressureObjectThreshold>10000</backPressureObjectThreshold>
<destination>
<groupId>5aa40cac-cc2b-3734-0000-000000000000</groupId>
<id>f4ad6284-9dd1-31d8-0000-000000000000</id>
<type>PROCESSOR</type>
</destination>
<flowFileExpiration>0 sec</flowFileExpiration>
<labelIndex>1</labelIndex>
<loadBalanceCompression>DO_NOT_COMPRESS</loadBalanceCompression>
<loadBalancePartitionAttribute/>
<loadBalanceStatus>LOAD_BALANCE_NOT_CONFIGURED</loadBalanceStatus>
<loadBalanceStrategy>DO_NOT_LOAD_BALANCE</loadBalanceStrategy>
<name/>
<selectedRelationships>success</selectedRelationships>
<source>
<groupId>5aa40cac-cc2b-3734-0000-000000000000</groupId>
<id>2e35dd06-83d3-3671-0000-000000000000</id>
<type>PROCESSOR</type>
</source>
<zIndex>0</zIndex>
</connections>
<connections>
<id>bcdb5e2c-1c0c-3902-0000-000000000000</id>
<parentGroupId>5aa40cac-cc2b-3734-0000-000000000000</parentGroupId>
<backPressureDataSizeThreshold>1 GB</backPressureDataSizeThreshold>
<backPressureObjectThreshold>10000</backPressureObjectThreshold>
<destination>
<groupId>5aa40cac-cc2b-3734-0000-000000000000</groupId>
<id>b7deeb0f-9391-3f67-0000-000000000000</id>
<type>PROCESSOR</type>
</destination>
<flowFileExpiration>0 sec</flowFileExpiration>
<labelIndex>1</labelIndex>
<loadBalanceCompression>DO_NOT_COMPRESS</loadBalanceCompression>
<loadBalancePartitionAttribute/>
<loadBalanceStatus>LOAD_BALANCE_NOT_CONFIGURED</loadBalanceStatus>
<loadBalanceStrategy>DO_NOT_LOAD_BALANCE</loadBalanceStrategy>
<name/>
<selectedRelationships>success</selectedRelationships>
<source>
<groupId>5aa40cac-cc2b-3734-0000-000000000000</groupId>
<id>c9b6c241-5b41-3c8f-0000-000000000000</id>
<type>PROCESSOR</type>
</source>
<zIndex>0</zIndex>
</connections>
<connections>
<id>bd1e16fe-f5ac-32ac-0000-000000000000</id>
<parentGroupId>5aa40cac-cc2b-3734-0000-000000000000</parentGroupId>
<backPressureDataSizeThreshold>1 GB</backPressureDataSizeThreshold>
<backPressureObjectThreshold>10000</backPressureObjectThreshold>
<destination>
<groupId>5aa40cac-cc2b-3734-0000-000000000000</groupId>
<id>63e0c48e-a6ce-3c2b-0000-000000000000</id>
<type>PROCESSOR</type>
</destination>
<flowFileExpiration>0 sec</flowFileExpiration>
<labelIndex>1</labelIndex>
<loadBalanceCompression>DO_NOT_COMPRESS</loadBalanceCompression>
<loadBalancePartitionAttribute/>
<loadBalanceStatus>LOAD_BALANCE_NOT_CONFIGURED</loadBalanceStatus>
<loadBalanceStrategy>DO_NOT_LOAD_BALANCE</loadBalanceStrategy>
<name/>
<selectedRelationships>success</selectedRelationships>
<source>
<groupId>5aa40cac-cc2b-3734-0000-000000000000</groupId>
<id>ca8d8e80-7e5a-376a-0000-000000000000</id>
<type>PROCESSOR</type>
</source>
<zIndex>0</zIndex>
</connections>
<connections>
<id>ca3931e8-f671-3065-0000-000000000000</id>
<parentGroupId>5aa40cac-cc2b-3734-0000-000000000000</parentGroupId>
<backPressureDataSizeThreshold>1 GB</backPressureDataSizeThreshold>
<backPressureObjectThreshold>10000</backPressureObjectThreshold>
<destination>
<groupId>5aa40cac-cc2b-3734-0000-000000000000</groupId>
<id>b7deeb0f-9391-3f67-0000-000000000000</id>
<type>PROCESSOR</type>
</destination>
<flowFileExpiration>0 sec</flowFileExpiration>
<labelIndex>1</labelIndex>
<loadBalanceCompression>DO_NOT_COMPRESS</loadBalanceCompression>
<loadBalancePartitionAttribute/>
<loadBalanceStatus>LOAD_BALANCE_NOT_CONFIGURED</loadBalanceStatus>
<loadBalanceStrategy>DO_NOT_LOAD_BALANCE</loadBalanceStrategy>
<name/>
<selectedRelationships>success</selectedRelationships>
<source>
<groupId>5aa40cac-cc2b-3734-0000-000000000000</groupId>
<id>fe6b93a7-e674-3703-0000-000000000000</id>
<type>PROCESSOR</type>
</source>
<zIndex>0</zIndex>
</connections>
<connections>
<id>f1941052-677d-3722-0000-000000000000</id>
<parentGroupId>5aa40cac-cc2b-3734-0000-000000000000</parentGroupId>
<backPressureDataSizeThreshold>1 GB</backPressureDataSizeThreshold>
<backPressureObjectThreshold>10000</backPressureObjectThreshold>
<destination>
<groupId>5aa40cac-cc2b-3734-0000-000000000000</groupId>
<id>41bbbc03-87a0-3324-0000-000000000000</id>
<type>PROCESSOR</type>
</destination>
<flowFileExpiration>0 sec</flowFileExpiration>
<labelIndex>1</labelIndex>
<loadBalanceCompression>DO_NOT_COMPRESS</loadBalanceCompression>
<loadBalancePartitionAttribute/>
<loadBalanceStatus>LOAD_BALANCE_NOT_CONFIGURED</loadBalanceStatus>
<loadBalanceStrategy>DO_NOT_LOAD_BALANCE</loadBalanceStrategy>
<name/>
<selectedRelationships>zipRoute</selectedRelationships>
<source>
<groupId>5aa40cac-cc2b-3734-0000-000000000000</groupId>
<id>63e0c48e-a6ce-3c2b-0000-000000000000</id>
<type>PROCESSOR</type>
</source>
<zIndex>0</zIndex>
</connections>
<connections>
<id>fe4e1c6d-e48e-3d16-0000-000000000000</id>
<parentGroupId>5aa40cac-cc2b-3734-0000-000000000000</parentGroupId>
<backPressureDataSizeThreshold>1 GB</backPressureDataSizeThreshold>
<backPressureObjectThreshold>10000</backPressureObjectThreshold>
<destination>
<groupId>5aa40cac-cc2b-3734-0000-000000000000</groupId>
<id>871bb501-b5a6-3b19-0000-000000000000</id>
<type>PROCESSOR</type>
</destination>
<flowFileExpiration>0 sec</flowFileExpiration>
<labelIndex>1</labelIndex>
<loadBalanceCompression>DO_NOT_COMPRESS</loadBalanceCompression>
<loadBalancePartitionAttribute/>
<loadBalanceStatus>LOAD_BALANCE_NOT_CONFIGURED</loadBalanceStatus>
<loadBalanceStrategy>DO_NOT_LOAD_BALANCE</loadBalanceStrategy>
<name/>
<selectedRelationships>success</selectedRelationships>
<source>
<groupId>5aa40cac-cc2b-3734-0000-000000000000</groupId>
<id>f4ad6284-9dd1-31d8-0000-000000000000</id>
<type>PROCESSOR</type>
</source>
<zIndex>0</zIndex>
</connections>
<processors>
<id>2e35dd06-83d3-3671-0000-000000000000</id>
<parentGroupId>5aa40cac-cc2b-3734-0000-000000000000</parentGroupId>
<position>
<x>605.9085520216058</x>
<y>839.6090135659136</y>
</position>
<bundle>
<artifact>nifi-standard-nar</artifact>
<group>org.apache.nifi</group>
<version>1.9.0.1.0.1.0-12</version>
</bundle>
<config>
<bulletinLevel>WARN</bulletinLevel>
<comments/>
<concurrentlySchedulableTaskCount>1</concurrentlySchedulableTaskCount>
<descriptors>
<entry>
<key>Mode</key>
<value>
<name>Mode</name>
</value>
</entry>
<entry>
<key>Compression Format</key>
<value>
<name>Compression Format</name>
</value>
</entry>
<entry>
<key>Compression Level</key>
<value>
<name>Compression Level</name>
</value>
</entry>
<entry>
<key>Update Filename</key>
<value>
<name>Update Filename</name>
</value>
</entry>
</descriptors>
<executionNode>ALL</executionNode>
<lossTolerant>false</lossTolerant>
<penaltyDuration>30 sec</penaltyDuration>
<properties>
<entry>
<key>Mode</key>
<value>decompress</value>
</entry>
<entry>
<key>Compression Format</key>
<value>use mime.type attribute</value>
</entry>
<entry>
<key>Compression Level</key>
<value>1</value>
</entry>
<entry>
<key>Update Filename</key>
<value>true</value>
</entry>
</properties>
<runDurationMillis>0</runDurationMillis>
<schedulingPeriod>0 sec</schedulingPeriod>
<schedulingStrategy>TIMER_DRIVEN</schedulingStrategy>
<yieldDuration>1 sec</yieldDuration>
</config>
<executionNodeRestricted>false</executionNodeRestricted>
<name>CompressContent</name>
<relationships>
<autoTerminate>true</autoTerminate>
<name>failure</name>
</relationships>
<relationships>
<autoTerminate>false</autoTerminate>
<name>success</name>
</relationships>
<state>RUNNING</state>
<style/>
<type>
org.apache.nifi.processors.standard.CompressContent
</type>
</processors>
<processors>
<id>3d481ca1-4b46-3989-0000-000000000000</id>
<parentGroupId>5aa40cac-cc2b-3734-0000-000000000000</parentGroupId>
<position>
<x>1906.507323814707</x>
<y>18.403465841224488</y>
</position>
<bundle>
<artifact>nifi-update-attribute-nar</artifact>
<group>org.apache.nifi</group>
<version>1.9.0.1.0.1.0-12</version>
</bundle>
<config>
<annotationData>
<criteria> <flowFilePolicy>USE_CLONE</flowFilePolicy> <rules> <actions> <attribute>priority</attribute> <id>f107bdec-93b7-490d-b715-03c900fe08e8</id> <value>a</value> </actions> <conditions> <expression>${schemaPriorityPattern:isEmpty():not():and(${filename:matches(${schemaPriorityPattern})})}</expression> <id>f680a249-5e98-4b43-a912-b67ec9004a45</id> </conditions> <id>db3e69b1-5f11-4bea-b7c2-8c122a84a3bf</id> <name>HighPriority</name> </rules> <rules> <actions> <attribute>priority</attribute> <id>5beaf8b2-2ea4-4c12-ae08-1f289b6eef46</id> <value>z</value> </actions> <conditions> <expression>${schemaPriorityPattern:isEmpty():not():and(${filename:matches(${schemaPriorityPattern}):not()})}</expression> <id>1f96bf7e-8e64-4407-8351-11e9edd8ddc1</id> </conditions> <id>f42904ac-7f0f-47c0-97cc-68d352641e3e</id> <name>LowPriority</name> </rules> </criteria>
</annotationData>
<bulletinLevel>WARN</bulletinLevel>
<comments/>
<concurrentlySchedulableTaskCount>1</concurrentlySchedulableTaskCount>
<descriptors>
<entry>
<key>Delete Attributes Expression</key>
<value>
<name>Delete Attributes Expression</name>
</value>
</entry>
<entry>
<key>Store State</key>
<value>
<name>Store State</name>
</value>
</entry>
<entry>
<key>Stateful Variables Initial Value</key>
<value>
<name>Stateful Variables Initial Value</name>
</value>
</entry>
<entry>
<key>canonical-value-lookup-cache-size</key>
<value>
<name>canonical-value-lookup-cache-size</name>
</value>
</entry>
<entry>
<key>path</key>
<value>
<name>path</name>
</value>
</entry>
<entry>
<key>segment.original.filename</key>
<value>
<name>segment.original.filename</name>
</value>
</entry>
</descriptors>
<executionNode>ALL</executionNode>
<lossTolerant>false</lossTolerant>
<penaltyDuration>30 sec</penaltyDuration>
<properties>
<entry>
<key>Delete Attributes Expression</key>
</entry>
<entry>
<key>Store State</key>
<value>Do not store state</value>
</entry>
<entry>
<key>Stateful Variables Initial Value</key>
</entry>
<entry>
<key>canonical-value-lookup-cache-size</key>
<value>100</value>
</entry>
<entry>
<key>path</key>
<value>
${path:startsWith('/'):ifElse('','/')}${path}${path:endsWith('/'):ifElse('','/')}
</value>
</entry>
<entry>
<key>segment.original.filename</key>
<value>${segment.original.filename}</value>
</entry>
</properties>
<runDurationMillis>0</runDurationMillis>
<schedulingPeriod>0 sec</schedulingPeriod>
<schedulingStrategy>TIMER_DRIVEN</schedulingStrategy>
<yieldDuration>1 sec</yieldDuration>
</config>
<executionNodeRestricted>false</executionNodeRestricted>
<name>UpdateAttribute</name>
<relationships>
<autoTerminate>false</autoTerminate>
<name>success</name>
</relationships>
<state>DISABLED</state>
<style/>
<type>
org.apache.nifi.processors.attributes.UpdateAttribute
</type>
</processors>
<processors>
<id>41bbbc03-87a0-3324-0000-000000000000</id>
<parentGroupId>5aa40cac-cc2b-3734-0000-000000000000</parentGroupId>
<position>
<x>1475.687096738906</x>
<y>18.112200003681323</y>
</position>
<bundle>
<artifact>nifi-update-attribute-nar</artifact>
<group>org.apache.nifi</group>
<version>1.9.0.1.0.1.0-12</version>
</bundle>
<config>
<annotationData>
<criteria> <flowFilePolicy>USE_CLONE</flowFilePolicy> <rules> <actions> <attribute>priority</attribute> <id>f107bdec-93b7-490d-b715-03c900fe08e8</id> <value>a</value> </actions> <conditions> <expression>${schemaPriorityPattern:isEmpty():not():and(${filename:matches(${schemaPriorityPattern})})}</expression> <id>f680a249-5e98-4b43-a912-b67ec9004a45</id> </conditions> <id>db3e69b1-5f11-4bea-b7c2-8c122a84a3bf</id> <name>HighPriority</name> </rules> <rules> <actions> <attribute>priority</attribute> <id>5beaf8b2-2ea4-4c12-ae08-1f289b6eef46</id> <value>z</value> </actions> <conditions> <expression>${schemaPriorityPattern:isEmpty():not():and(${filename:matches(${schemaPriorityPattern}):not()})}</expression> <id>1f96bf7e-8e64-4407-8351-11e9edd8ddc1</id> </conditions> <id>f42904ac-7f0f-47c0-97cc-68d352641e3e</id> <name>LowPriority</name> </rules> </criteria>
</annotationData>
<bulletinLevel>WARN</bulletinLevel>
<comments/>
<concurrentlySchedulableTaskCount>1</concurrentlySchedulableTaskCount>
<descriptors>
<entry>
<key>Delete Attributes Expression</key>
<value>
<name>Delete Attributes Expression</name>
</value>
</entry>
<entry>
<key>Store State</key>
<value>
<name>Store State</name>
</value>
</entry>
<entry>
<key>Stateful Variables Initial Value</key>
<value>
<name>Stateful Variables Initial Value</name>
</value>
</entry>
<entry>
<key>canonical-value-lookup-cache-size</key>
<value>
<name>canonical-value-lookup-cache-size</name>
</value>
</entry>
<entry>
<key>path</key>
<value>
<name>path</name>
</value>
</entry>
<entry>
<key>segment.original.filename</key>
<value>
<name>segment.original.filename</name>
</value>
</entry>
</descriptors>
<executionNode>ALL</executionNode>
<lossTolerant>false</lossTolerant>
<penaltyDuration>30 sec</penaltyDuration>
<properties>
<entry>
<key>Delete Attributes Expression</key>
</entry>
<entry>
<key>Store State</key>
<value>Do not store state</value>
</entry>
<entry>
<key>Stateful Variables Initial Value</key>
</entry>
<entry>
<key>canonical-value-lookup-cache-size</key>
<value>100</value>
</entry>
<entry>
<key>path</key>
<value>
${path:startsWith('/'):ifElse('','/')}${path}${path:endsWith('/'):ifElse('','/')}
</value>
</entry>
<entry>
<key>segment.original.filename</key>
<value>${segment.original.filename}</value>
</entry>
</properties>
<runDurationMillis>0</runDurationMillis>
<schedulingPeriod>0 sec</schedulingPeriod>
<schedulingStrategy>TIMER_DRIVEN</schedulingStrategy>
<yieldDuration>1 sec</yieldDuration>
</config>
<executionNodeRestricted>false</executionNodeRestricted>
<name>UpdateAttribute</name>
<relationships>
<autoTerminate>false</autoTerminate>
<name>success</name>
</relationships>
<state>RUNNING</state>
<style/>
<type>
org.apache.nifi.processors.attributes.UpdateAttribute
</type>
</processors>
<processors>
<id>63e0c48e-a6ce-3c2b-0000-000000000000</id>
<parentGroupId>5aa40cac-cc2b-3734-0000-000000000000</parentGroupId>
<position>
<x>1862.0810582938075</x>
<y>393.94052336793914</y>
</position>
<bundle>
<artifact>nifi-standard-nar</artifact>
<group>org.apache.nifi</group>
<version>1.9.0.1.0.1.0-12</version>
</bundle>
<config>
<bulletinLevel>WARN</bulletinLevel>
<comments/>
<concurrentlySchedulableTaskCount>1</concurrentlySchedulableTaskCount>
<descriptors>
<entry>
<key>Routing Strategy</key>
<value>
<name>Routing Strategy</name>
</value>
</entry>
<entry>
<key>zipRoute</key>
<value>
<name>zipRoute</name>
</value>
</entry>
</descriptors>
<executionNode>ALL</executionNode>
<lossTolerant>false</lossTolerant>
<penaltyDuration>30 sec</penaltyDuration>
<properties>
<entry>
<key>Routing Strategy</key>
<value>Route to Property name</value>
</entry>
<entry>
<key>zipRoute</key>
<value>
${mime.extension:equals('.zip'):or(${mime.extension:equals('.gz')})}
</value>
</entry>
</properties>
<runDurationMillis>0</runDurationMillis>
<schedulingPeriod>0 sec</schedulingPeriod>
<schedulingStrategy>TIMER_DRIVEN</schedulingStrategy>
<yieldDuration>1 sec</yieldDuration>
</config>
<executionNodeRestricted>false</executionNodeRestricted>
<name>RouteOnAttribute</name>
<relationships>
<autoTerminate>false</autoTerminate>
<name>unmatched</name>
</relationships>
<relationships>
<autoTerminate>false</autoTerminate>
<name>zipRoute</name>
</relationships>
<state>RUNNING</state>
<style/>
<type>
org.apache.nifi.processors.standard.RouteOnAttribute
</type>
</processors>
<processors>
<id>677ee8fb-02c1-3929-0000-000000000000</id>
<parentGroupId>5aa40cac-cc2b-3734-0000-000000000000</parentGroupId>
<position>
<x>0.0</x>
<y>467.38610237263345</y>
</position>
<bundle>
<artifact>nifi-standard-nar</artifact>
<group>org.apache.nifi</group>
<version>1.9.0.1.0.1.0-12</version>
</bundle>
<config>
<bulletinLevel>WARN</bulletinLevel>
<comments/>
<concurrentlySchedulableTaskCount>1</concurrentlySchedulableTaskCount>
<descriptors>
<entry>
<key>use-filename-in-detection</key>
<value>
<name>use-filename-in-detection</name>
</value>
</entry>
</descriptors>
<executionNode>ALL</executionNode>
<lossTolerant>false</lossTolerant>
<penaltyDuration>30 sec</penaltyDuration>
<properties>
<entry>
<key>use-filename-in-detection</key>
<value>true</value>
</entry>
</properties>
<runDurationMillis>0</runDurationMillis>
<schedulingPeriod>0 sec</schedulingPeriod>
<schedulingStrategy>TIMER_DRIVEN</schedulingStrategy>
<yieldDuration>1 sec</yieldDuration>
</config>
<executionNodeRestricted>false</executionNodeRestricted>
<name>IdentifyMimeType</name>
<relationships>
<autoTerminate>false</autoTerminate>
<name>success</name>
</relationships>
<state>STOPPED</state>
<style/>
<type>
org.apache.nifi.processors.standard.IdentifyMimeType
</type>
</processors>
<processors>
<id>871bb501-b5a6-3b19-0000-000000000000</id>
<parentGroupId>5aa40cac-cc2b-3734-0000-000000000000</parentGroupId>
<position>
<x>1290.3765719661606</x>
<y>603.4789188907798</y>
</position>
<bundle>
<artifact>nifi-standard-nar</artifact>
<group>org.apache.nifi</group>
<version>1.9.0.1.0.1.0-12</version>
</bundle>
<config>
<bulletinLevel>WARN</bulletinLevel>
<comments/>
<concurrentlySchedulableTaskCount>2</concurrentlySchedulableTaskCount>
<descriptors>
<entry>
<key>Packaging Format</key>
<value>
<name>Packaging Format</name>
</value>
</entry>
<entry>
<key>File Filter</key>
<value>
<name>File Filter</name>
</value>
</entry>
</descriptors>
<executionNode>ALL</executionNode>
<lossTolerant>false</lossTolerant>
<penaltyDuration>30 sec</penaltyDuration>
<properties>
<entry>
<key>Packaging Format</key>
<value>use mime.type attribute</value>
</entry>
<entry>
<key>File Filter</key>
<value>.*</value>
</entry>
</properties>
<runDurationMillis>0</runDurationMillis>
<schedulingPeriod>0 sec</schedulingPeriod>
<schedulingStrategy>TIMER_DRIVEN</schedulingStrategy>
<yieldDuration>1 sec</yieldDuration>
</config>
<executionNodeRestricted>false</executionNodeRestricted>
<name>Unzipprocess_02</name>
<relationships>
<autoTerminate>true</autoTerminate>
<name>failure</name>
</relationships>
<relationships>
<autoTerminate>true</autoTerminate>
<name>original</name>
</relationships>
<relationships>
<autoTerminate>false</autoTerminate>
<name>success</name>
</relationships>
<state>RUNNING</state>
<style/>
<type>org.apache.nifi.processors.standard.UnpackContent</type>
</processors>
<processors>
<id>b7deeb0f-9391-3f67-0000-000000000000</id>
<parentGroupId>5aa40cac-cc2b-3734-0000-000000000000</parentGroupId>
<position>
<x>842.2653693897282</x>
<y>341.01892531827303</y>
</position>
<bundle>
<artifact>nifi-standard-nar</artifact>
<group>org.apache.nifi</group>
<version>1.9.0.1.0.1.0-12</version>
</bundle>
<config>
<bulletinLevel>WARN</bulletinLevel>
<comments/>
<concurrentlySchedulableTaskCount>1</concurrentlySchedulableTaskCount>
<descriptors>
<entry>
<key>Routing Strategy</key>
<value>
<name>Routing Strategy</name>
</value>
</entry>
<entry>
<key>tar.gz</key>
<value>
<name>tar.gz</name>
</value>
</entry>
</descriptors>
<executionNode>ALL</executionNode>
<lossTolerant>false</lossTolerant>
<penaltyDuration>30 sec</penaltyDuration>
<properties>
<entry>
<key>Routing Strategy</key>
<value>Route to Property name</value>
</entry>
<entry>
<key>tar.gz</key>
<value>${mime.extension:equals('.gz')}</value>
</entry>
</properties>
<runDurationMillis>0</runDurationMillis>
<schedulingPeriod>0 sec</schedulingPeriod>
<schedulingStrategy>TIMER_DRIVEN</schedulingStrategy>
<yieldDuration>1 sec</yieldDuration>
</config>
<executionNodeRestricted>false</executionNodeRestricted>
<name>RouteOnAttribute</name>
<relationships>
<autoTerminate>false</autoTerminate>
<name>tar.gz</name>
</relationships>
<relationships>
<autoTerminate>false</autoTerminate>
<name>unmatched</name>
</relationships>
<state>RUNNING</state>
<style/>
<type>
org.apache.nifi.processors.standard.RouteOnAttribute
</type>
</processors>
<processors>
<id>c9b6c241-5b41-3c8f-0000-000000000000</id>
<parentGroupId>5aa40cac-cc2b-3734-0000-000000000000</parentGroupId>
<position>
<x>1024.3919230522497</x>
<y>0.0</y>
</position>
<bundle>
<artifact>nifi-update-attribute-nar</artifact>
<group>org.apache.nifi</group>
<version>1.9.0.1.0.1.0-12</version>
</bundle>
<config>
<bulletinLevel>WARN</bulletinLevel>
<comments/>
<concurrentlySchedulableTaskCount>1</concurrentlySchedulableTaskCount>
<descriptors>
<entry>
<key>Delete Attributes Expression</key>
<value>
<name>Delete Attributes Expression</name>
</value>
</entry>
<entry>
<key>Store State</key>
<value>
<name>Store State</name>
</value>
</entry>
<entry>
<key>Stateful Variables Initial Value</key>
<value>
<name>Stateful Variables Initial Value</name>
</value>
</entry>
<entry>
<key>canonical-value-lookup-cache-size</key>
<value>
<name>canonical-value-lookup-cache-size</name>
</value>
</entry>
<entry>
<key>ancestorPath</key>
<value>
<name>ancestorPath</name>
</value>
</entry>
</descriptors>
<executionNode>ALL</executionNode>
<lossTolerant>false</lossTolerant>
<penaltyDuration>30 sec</penaltyDuration>
<properties>
<entry>
<key>Delete Attributes Expression</key>
</entry>
<entry>
<key>Store State</key>
<value>Do not store state</value>
</entry>
<entry>
<key>Stateful Variables Initial Value</key>
</entry>
<entry>
<key>canonical-value-lookup-cache-size</key>
<value>100</value>
</entry>
<entry>
<key>ancestorPath</key>
<value>
${ancestorPath}${segment.original.filename:append(${path})}
</value>
</entry>
</properties>
<runDurationMillis>0</runDurationMillis>
<schedulingPeriod>0 sec</schedulingPeriod>
<schedulingStrategy>TIMER_DRIVEN</schedulingStrategy>
<yieldDuration>1 sec</yieldDuration>
</config>
<executionNodeRestricted>false</executionNodeRestricted>
<name>UpdateAttribute</name>
<relationships>
<autoTerminate>false</autoTerminate>
<name>success</name>
</relationships>
<state>RUNNING</state>
<style/>
<type>
org.apache.nifi.processors.attributes.UpdateAttribute
</type>
</processors>
<processors>
<id>ca8d8e80-7e5a-376a-0000-000000000000</id>
<parentGroupId>5aa40cac-cc2b-3734-0000-000000000000</parentGroupId>
<position>
<x>1883.2117647407667</x>
<y>694.3013261303335</y>
</position>
<bundle>
<artifact>nifi-standard-nar</artifact>
<group>org.apache.nifi</group>
<version>1.9.0.1.0.1.0-12</version>
</bundle>
<config>
<bulletinLevel>WARN</bulletinLevel>
<comments/>
<concurrentlySchedulableTaskCount>1</concurrentlySchedulableTaskCount>
<descriptors>
<entry>
<key>use-filename-in-detection</key>
<value>
<name>use-filename-in-detection</name>
</value>
</entry>
</descriptors>
<executionNode>ALL</executionNode>
<lossTolerant>false</lossTolerant>
<penaltyDuration>30 sec</penaltyDuration>
<properties>
<entry>
<key>use-filename-in-detection</key>
<value>true</value>
</entry>
</properties>
<runDurationMillis>0</runDurationMillis>
<schedulingPeriod>0 sec</schedulingPeriod>
<schedulingStrategy>TIMER_DRIVEN</schedulingStrategy>
<yieldDuration>1 sec</yieldDuration>
</config>
<executionNodeRestricted>false</executionNodeRestricted>
<name>IdentifyMimeType</name>
<relationships>
<autoTerminate>false</autoTerminate>
<name>success</name>
</relationships>
<state>RUNNING</state>
<style/>
<type>
org.apache.nifi.processors.standard.IdentifyMimeType
</type>
</processors>
<processors>
<id>f4ad6284-9dd1-31d8-0000-000000000000</id>
<parentGroupId>5aa40cac-cc2b-3734-0000-000000000000</parentGroupId>
<position>
<x>1230.615754060147</x>
<y>903.2084475119062</y>
</position>
<bundle>
<artifact>nifi-standard-nar</artifact>
<group>org.apache.nifi</group>
<version>1.9.0.1.0.1.0-12</version>
</bundle>
<config>
<bulletinLevel>WARN</bulletinLevel>
<comments/>
<concurrentlySchedulableTaskCount>1</concurrentlySchedulableTaskCount>
<descriptors>
<entry>
<key>use-filename-in-detection</key>
<value>
<name>use-filename-in-detection</name>
</value>
</entry>
</descriptors>
<executionNode>ALL</executionNode>
<lossTolerant>false</lossTolerant>
<penaltyDuration>30 sec</penaltyDuration>
<properties>
<entry>
<key>use-filename-in-detection</key>
<value>true</value>
</entry>
</properties>
<runDurationMillis>0</runDurationMillis>
<schedulingPeriod>0 sec</schedulingPeriod>
<schedulingStrategy>TIMER_DRIVEN</schedulingStrategy>
<yieldDuration>1 sec</yieldDuration>
</config>
<executionNodeRestricted>false</executionNodeRestricted>
<name>IdentifyMimeType</name>
<relationships>
<autoTerminate>false</autoTerminate>
<name>success</name>
</relationships>
<state>RUNNING</state>
<style/>
<type>
org.apache.nifi.processors.standard.IdentifyMimeType
</type>
</processors>
<processors>
<id>fe6b93a7-e674-3703-0000-000000000000</id>
<parentGroupId>5aa40cac-cc2b-3734-0000-000000000000</parentGroupId>
<position>
<x>346.6929383978486</x>
<y>156.97246274523832</y>
</position>
<bundle>
<artifact>nifi-update-attribute-nar</artifact>
<group>org.apache.nifi</group>
<version>1.9.0.1.0.1.0-12</version>
</bundle>
<config>
<bulletinLevel>WARN</bulletinLevel>
<comments/>
<concurrentlySchedulableTaskCount>1</concurrentlySchedulableTaskCount>
<descriptors>
<entry>
<key>Delete Attributes Expression</key>
<value>
<name>Delete Attributes Expression</name>
</value>
</entry>
<entry>
<key>Store State</key>
<value>
<name>Store State</name>
</value>
</entry>
<entry>
<key>Stateful Variables Initial Value</key>
<value>
<name>Stateful Variables Initial Value</name>
</value>
</entry>
<entry>
<key>canonical-value-lookup-cache-size</key>
<value>
<name>canonical-value-lookup-cache-size</name>
</value>
</entry>
</descriptors>
<executionNode>ALL</executionNode>
<lossTolerant>false</lossTolerant>
<penaltyDuration>30 sec</penaltyDuration>
<properties>
<entry>
<key>Delete Attributes Expression</key>
</entry>
<entry>
<key>Store State</key>
<value>Do not store state</value>
</entry>
<entry>
<key>Stateful Variables Initial Value</key>
</entry>
<entry>
<key>canonical-value-lookup-cache-size</key>
<value>100</value>
</entry>
</properties>
<runDurationMillis>0</runDurationMillis>
<schedulingPeriod>0 sec</schedulingPeriod>
<schedulingStrategy>TIMER_DRIVEN</schedulingStrategy>
<yieldDuration>1 sec</yieldDuration>
</config>
<executionNodeRestricted>false</executionNodeRestricted>
<name>UpdateAttribute</name>
<relationships>
<autoTerminate>false</autoTerminate>
<name>success</name>
</relationships>
<state>RUNNING</state>
<style/>
<type>
org.apache.nifi.processors.attributes.UpdateAttribute
</type>
</processors>
</snippet>
<timestamp>08/18/2021 16:14:18 CEST</timestamp>
</template>

Reply via email to