[
https://issues.apache.org/jira/browse/NIFI-15074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18035759#comment-18035759
]
Craig Patrick commented on NIFI-15074:
--------------------------------------
[~mcgilman] any updates or news on this one, it's still happening so wondered
if we could analyse what might be causing the issue, or whether this is
resolved in a more recent version?
> New parameters saved in processors do not get added to the context when being
> deployed via Registry
> ---------------------------------------------------------------------------------------------------
>
> Key: NIFI-15074
> URL: https://issues.apache.org/jira/browse/NIFI-15074
> Project: Apache NiFi
> Issue Type: Bug
> Components: Flow Versioning
> Affects Versions: 2.0.0
> Environment: All
> Reporter: Craig Patrick
> Priority: Major
> Attachments: image-2025-10-08-12-21-06-505.png,
> image-2025-10-28-09-34-24-773.png, image-2025-10-28-09-35-22-013.png
>
>
> When adding a new parameter and referencing it in a processor which is
> committed to Registry, updating this processor in a different environment
> does not update the relevant parameter context.
> *Example Case:*
> * I have multiple parameter contexts which inherit each other, for example:
> ** api-params
> ** global-params (which inherits the api-params)
> ** processor-params (which inherits the global-params)
> * I have created a processor (InvokeHTTP) and I have added 2 parameters to
> the api-params for 'base-url' and 'token'
> * Updated InvokeHTTP processor to use these new parameters
> * Committed to Registry the changes for these parameters (along with others)
> * Changed the versions of the integration on another system to this new one
> *Expected Outcome:*
> * processor group would update and use these new parameter references in the
> api-params context.
> *Actual Outcome:*
> * Processor fails to start stating:
> ** 'Authorization' is invalid because Property references Parameter
> 'api.navsync.token' but the currently selected Parameter Context does not
> have a Parameter with that name
> ** 'HTTP URL' is invalid because Property references Parameter
> 'api.navsync.baseurl' but the currently selected Parameter Context does not
> have a Parameter with that name
> * I have to add the newly created params into the api-params file and then
> everything works as expected (so I would assume inheritance is working as it
> should - but the param is simply not being written into the api-params
> context)
> *Checks:*
> * All relevant parameter contexts inherit as they should in configuration
> * Every processor has the correct `processor-params` context associated with
> it
> * The commit from the initial update in GIT shows the parameters being
> written and updated (see below):
> !image-2025-10-08-12-21-06-505.png!
> I have checked the logs and can't see any errors with regards to the update
> of the processor version, not can I see anything regarding the changing of
> the parameters in the Process Group update Thread:
> {code:java}
> 2025-10-08 12:57:55,172 INFO [Process Group Update Thread-1]
> o.apache.nifi.web.api.FlowUpdateResource Disabling 0 Controller Services
> 2025-10-08 12:57:55,192 INFO [Process Group Update Thread-1]
> o.apache.nifi.web.api.VersionsResource Updating Process Group with ID
> cb9edf99-0198-1000-594b-907159df9bd4 to version 15 of the Versioned Flow
> 2025-10-08 12:57:55,199 INFO [Process Group Update Thread-1]
> o.a.n.f.s.StandardVersionedComponentSynchronizer Updating
> StandardProcessGroup[identifier=cb9edf99-0198-1000-594b-907159df9bd4,name=Dynamics
> to ERP Integration] to org.apache.nifi.flow.VersionedExternalFlow@78cc7999;
> there are 21 differences to take into account:
> Property 'JSLT Transformation' for Processor with ID
> 469e39a4-e27a-3375-1d6d-8d740a85c63f is different
> Processor with ID dcc016c1-10ad-1199-9036-053e04a0f4ce exists in Proposed
> Flow but not in Currently Loaded Flow
> Connection Bend Points Changed for Connection with ID
> 4fd5ecef-a0dc-37bd-fe44-a3ab9221f154; flow 'Currently Loaded Flow' has value
> []; flow 'Proposed Flow' has value [[x=256.0, y=-632.0], [x=536.0, y=-632.0]]
> Property 'HTTP Method' for Processor with ID
> 307ccb7c-7474-3597-6f91-fa30baaad706 is different
> Processor with ID aa8d1f21-10b1-1199-2b2e-3fe49bde9192 exists in Proposed
> Flow but not in Currently Loaded Flow
> Connection with ID aa8d1f25-10b1-1199-f724-1e22078310a6 exists in Proposed
> Flow but not in Currently Loaded Flow
> Processor with ID aa8d1f23-10b1-1199-34ae-c87db0d78abb exists in Proposed
> Flow but not in Currently Loaded Flow
> Property 'HTTP URL' for Processor with ID
> 307ccb7c-7474-3597-6f91-fa30baaad706 is different
> Property 'Transform Result Filter' for Processor with ID
> 469e39a4-e27a-3375-1d6d-8d740a85c63f is different
> Position Changed for Input Port with ID 834e1eac-bd2f-36a1-1709-e76538ac6622;
> flow 'Currently Loaded Flow' has value [x=-848.0, y=-872.0]; flow 'Proposed
> Flow' has value [x=-848.0, y=-1112.0]
> Position Changed for Input Port with ID 5e0b22c9-4b7e-393e-97dc-09b249cb2a99;
> flow 'Currently Loaded Flow' has value [x=-296.0, y=-360.0]; flow 'Proposed
> Flow' has value [x=-304.0, y=-360.0]
> Processor with ID dcc016c0-10ad-1199-db08-7007c43d82d4 exists in Proposed
> Flow but not in Currently Loaded Flow
> Connection with ID aa8d1f24-10b1-1199-8e07-bc165a4b688e exists in Proposed
> Flow but not in Currently Loaded Flow
> Connection with ID aa8d1f29-10b1-1199-5d0a-a14360dd24d6 exists in Proposed
> Flow but not in Currently Loaded Flow
> Position Changed for Output Port with ID
> 110c4819-4fb7-31de-69bb-18a07e4c0457; flow 'Currently Loaded Flow' has value
> [x=-200.0, y=-456.0]; flow 'Proposed Flow' has value [x=416.0, y=-800.0]
> Property 'Authorization' for Processor with ID
> 307ccb7c-7474-3597-6f91-fa30baaad706 is different
> Connection with ID aa8d1f28-10b1-1199-aa25-614de558a85f exists in Proposed
> Flow but not in Currently Loaded Flow
> Connection Destination Changed for Connection with ID
> 6f0a5e09-a40c-3d05-bf3f-9c7375aae15e; flow 'Currently Loaded Flow' has value
> ConnectableComponent{id='022624b6-dea3-3b8b-9270-aa13b2a8c3dc',
> instanceId='null', type=PROCESSOR,
> groupId='6ec6eef7-f41b-3ac7-bb89-1ba8437ce9ce', name='Format JSON for
> Legacy'}; flow 'Proposed Flow' has value
> ConnectableComponent{id='f64aad8d-e7a7-3a66-b676-cc6210945de5',
> instanceId='dcc016c0-10ad-1199-db08-7007c43d82d4', type=PROCESSOR,
> groupId='6ec6eef7-f41b-3ac7-bb89-1ba8437ce9ce', name='Extract Incoming
> Process ID'}
> Component Name Changed for Processor with ID
> 307ccb7c-7474-3597-6f91-fa30baaad706; flow 'Currently Loaded Flow' has value
> Send Request to EDM API; flow 'Proposed Flow' has value Send Request to
> NavSync
> Connection with ID aa8d1f26-10b1-1199-4f9f-a5dc6858f029 exists in Proposed
> Flow but not in Currently Loaded Flow
> Connection with ID aa8d1f27-10b1-1199-0eb7-1d1fa48fc954 exists in Proposed
> Flow but not in Currently Loaded Flow
> 2025-10-08 12:57:55,205 INFO [Process Group Update Thread-1]
> o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
> StandardProcessGroup[identifier=b33ca6f1-b515-3ead-d223-f3c96a7b8431,name=Validate
> Target System]
> 2025-10-08 12:57:55,205 INFO [Process Group Update Thread-1]
> o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
> StandardProcessGroup[identifier=151bb289-5d92-3aaa-3a70-d252cacba259,name=Process
> Failure]
> 2025-10-08 12:57:55,217 INFO [Process Group Update Thread-1]
> o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
> InvokeHTTP[id=307ccb7c-7474-3597-6f91-fa30baaad706]
> 2025-10-08 12:57:55,217 INFO [Process Group Update Thread-1]
> o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
> StandardProcessGroup[identifier=48a0d357-7f30-3097-181a-5aee1b9a8401,name=Send
> Request to External System]
> 2025-10-08 12:57:55,218 INFO [Process Group Update Thread-1]
> o.a.nifi.groups.StandardProcessGroup
> StandardFunnel[id=a8f96fd2-b957-3f89-247c-cd2b12616411-temp-funnel] added to
> StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
> Incoming REQUEST]
> 2025-10-08 12:57:55,219 INFO [Process Group Update Thread-1]
> o.a.n.f.s.StandardVersionedComponentSynchronizer Removing
> StandardFunnel[id=a8f96fd2-b957-3f89-247c-cd2b12616411-temp-funnel] from
> StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
> Incoming REQUEST]
> 2025-10-08 12:57:55,219 INFO [Process Group Update Thread-1]
> o.a.nifi.groups.StandardProcessGroup
> EvaluateJsonPath[id=6f68bb33-f8ad-34e9-d723-30df3b5d0779] added to
> StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
> Incoming REQUEST]
> 2025-10-08 12:57:55,219 INFO [Process Group Update Thread-1]
> o.a.n.f.s.StandardVersionedComponentSynchronizer Added
> EvaluateJsonPath[id=6f68bb33-f8ad-34e9-d723-30df3b5d0779] to
> StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
> Incoming REQUEST]
> 2025-10-08 12:57:55,219 INFO [Process Group Update Thread-1]
> o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
> JSLTTransformJSON[id=469e39a4-e27a-3375-1d6d-8d740a85c63f]
> 2025-10-08 12:57:55,219 INFO [Process Group Update Thread-1]
> o.a.nifi.groups.StandardProcessGroup
> UpdateAttribute[id=e5e64e7f-717c-31eb-3f42-72363e29e6ec] added to
> StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
> Incoming REQUEST]
> 2025-10-08 12:57:55,219 INFO [Process Group Update Thread-1]
> o.a.n.f.s.StandardVersionedComponentSynchronizer Added
> UpdateAttribute[id=e5e64e7f-717c-31eb-3f42-72363e29e6ec] to
> StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
> Incoming REQUEST]
> 2025-10-08 12:57:55,220 INFO [Process Group Update Thread-1]
> o.a.nifi.groups.StandardProcessGroup
> UpdateAttribute[id=7ce09ea8-6f52-34d2-3690-bea4e0e12e3f] added to
> StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
> Incoming REQUEST]
> 2025-10-08 12:57:55,220 INFO [Process Group Update Thread-1]
> o.a.n.f.s.StandardVersionedComponentSynchronizer Added
> UpdateAttribute[id=7ce09ea8-6f52-34d2-3690-bea4e0e12e3f] to
> StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
> Incoming REQUEST]
> 2025-10-08 12:57:55,220 INFO [Process Group Update Thread-1]
> o.a.nifi.groups.StandardProcessGroup
> RouteOnAttribute[id=96cb6169-8a9e-38a7-f9b3-4d8281dc3c71] added to
> StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
> Incoming REQUEST]
> 2025-10-08 12:57:55,220 INFO [Process Group Update Thread-1]
> o.a.n.f.s.StandardVersionedComponentSynchronizer Added
> RouteOnAttribute[id=96cb6169-8a9e-38a7-f9b3-4d8281dc3c71] to
> StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
> Incoming REQUEST]
> 2025-10-08 12:57:55,221 INFO [Process Group Update Thread-1]
> o.a.n.f.s.StandardVersionedComponentSynchronizer Added
> Connection[ID=06186867-adf6-330c-cdb4-27f9867f84c1, Source
> ID=96cb6169-8a9e-38a7-f9b3-4d8281dc3c71, Dest
> ID=7ce09ea8-6f52-34d2-3690-bea4e0e12e3f] to
> StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
> Incoming REQUEST]
> 2025-10-08 12:57:55,221 INFO [Process Group Update Thread-1]
> o.a.n.f.s.StandardVersionedComponentSynchronizer Added
> Connection[ID=d1c28710-387a-3bc8-3487-873dcd50d7fb, Source
> ID=6f68bb33-f8ad-34e9-d723-30df3b5d0779, Dest
> ID=e5e64e7f-717c-31eb-3f42-72363e29e6ec] to
> StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
> Incoming REQUEST]
> 2025-10-08 12:57:55,221 INFO [Process Group Update Thread-1]
> o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
> Connection[ID=4fd5ecef-a0dc-37bd-fe44-a3ab9221f154, Source
> ID=1f04a949-7263-3d07-c94e-1e101bc1c038, Dest
> ID=110c4819-4fb7-31de-69bb-18a07e4c0457]
> 2025-10-08 12:57:55,221 INFO [Process Group Update Thread-1]
> o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
> Connection[ID=6f0a5e09-a40c-3d05-bf3f-9c7375aae15e, Source
> ID=834e1eac-bd2f-36a1-1709-e76538ac6622, Dest
> ID=6f68bb33-f8ad-34e9-d723-30df3b5d0779]
> 2025-10-08 12:57:55,222 INFO [Process Group Update Thread-1]
> o.a.n.f.s.StandardVersionedComponentSynchronizer Added
> Connection[ID=9fcbe6d1-a8c1-3d02-a0cd-95dd3594d655, Source
> ID=7ce09ea8-6f52-34d2-3690-bea4e0e12e3f, Dest
> ID=110c4819-4fb7-31de-69bb-18a07e4c0457] to
> StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
> Incoming REQUEST]
> 2025-10-08 12:57:55,222 INFO [Process Group Update Thread-1]
> o.a.n.f.s.StandardVersionedComponentSynchronizer Added
> Connection[ID=4d8d8896-4439-3d4c-c878-4bb16d30926f, Source
> ID=96cb6169-8a9e-38a7-f9b3-4d8281dc3c71, Dest
> ID=469e39a4-e27a-3375-1d6d-8d740a85c63f] to
> StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
> Incoming REQUEST]
> 2025-10-08 12:57:55,222 INFO [Process Group Update Thread-1]
> o.a.n.f.s.StandardVersionedComponentSynchronizer Added
> Connection[ID=af3deb27-17a7-3442-246d-56c31697f87b, Source
> ID=e5e64e7f-717c-31eb-3f42-72363e29e6ec, Dest
> ID=110c4819-4fb7-31de-69bb-18a07e4c0457] to
> StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
> Incoming REQUEST]
> 2025-10-08 12:57:55,223 INFO [Process Group Update Thread-1]
> o.a.n.f.s.StandardVersionedComponentSynchronizer Added
> Connection[ID=8961e3b5-0c01-356c-2840-f2ab68b1c2cc, Source
> ID=6f68bb33-f8ad-34e9-d723-30df3b5d0779, Dest
> ID=96cb6169-8a9e-38a7-f9b3-4d8281dc3c71] to
> StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
> Incoming REQUEST]
> 2025-10-08 12:57:55,223 INFO [Process Group Update Thread-1]
> o.a.nifi.groups.StandardProcessGroup
> StandardFunnel[id=a8f96fd2-b957-3f89-247c-cd2b12616411-temp-funnel] removed
> from flow
> 2025-10-08 12:57:55,223 INFO [Process Group Update Thread-1]
> o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
> StandardProcessGroup[identifier=a8f96fd2-b957-3f89-247c-cd2b12616411,name=Format
> Incoming REQUEST]
> 2025-10-08 12:57:55,223 INFO [Process Group Update Thread-1]
> o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
> StandardProcessGroup[identifier=b79cbce0-8ec2-3aad-e957-9b8fdb9f5a0c,name=Format
> External RESPONSE]
> 2025-10-08 12:57:55,223 INFO [Process Group Update Thread-1]
> o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
> StandardProcessGroup[identifier=f98a31d3-b3a8-3e00-4fcf-920dd162d466,name=EDM]
> 2025-10-08 12:57:55,224 INFO [Process Group Update Thread-1]
> o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
> StandardProcessGroup[identifier=0cf0126b-33c8-3baa-bfd1-09e10dc65e97,name=Format
> External RESPONSE]
> 2025-10-08 12:57:55,225 INFO [Process Group Update Thread-1]
> o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
> StandardProcessGroup[identifier=1c3b1a89-efd8-3241-db61-f6238810ae57,name=Format
> Incoming REQUEST]
> 2025-10-08 12:57:55,225 INFO [Process Group Update Thread-1]
> o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
> StandardProcessGroup[identifier=8a17fe73-6846-3a9d-fc2c-1de7aa6d9fec,name=Send
> Request to External System]
> 2025-10-08 12:57:55,225 INFO [Process Group Update Thread-1]
> o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
> StandardProcessGroup[identifier=2245cedc-a2ab-346c-601f-13824a732cd1,name=SAM]
> 2025-10-08 12:57:55,225 INFO [Process Group Update Thread-1]
> o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
> StandardProcessGroup[identifier=2f1c1eb5-8996-3fe6-20ee-5f71c9f4eb63,name=Send
> Request To External System]
> 2025-10-08 12:57:55,225 INFO [Process Group Update Thread-1]
> o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
> StandardProcessGroup[identifier=2db0d0bc-2ddd-3f01-a1cd-b0a6f0a9e495,name=Process
> Incoming Data]
> 2025-10-08 12:57:55,226 INFO [Process Group Update Thread-1]
> o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
> StandardProcessGroup[identifier=48b169e6-8acf-3440-b087-7ccddee41af4,name=Incoming
> HTTP Request]
> 2025-10-08 12:57:55,227 INFO [Process Group Update Thread-1]
> o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
> StandardProcessGroup[identifier=208b5da3-59a2-32f3-aaf8-9425320ed868,name=Process
> Failure]
> 2025-10-08 12:57:55,227 INFO [Process Group Update Thread-1]
> o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
> StandardProcessGroup[identifier=f273e9ed-036b-384a-43ef-448d17d63c58,name=Authenticate
> Request]
> 2025-10-08 12:57:55,227 INFO [Process Group Update Thread-1]
> o.a.n.f.s.StandardVersionedComponentSynchronizer Updated
> StandardProcessGroup[identifier=fd31c982-8e2f-3b70-592d-39f9acc5f197,name=Return
> HTTP Response]
> 2025-10-08 12:57:55,237 INFO [Process Group Update Thread-1]
> o.apache.nifi.web.api.FlowUpdateResource Successfully updated flow;
> re-enabling 0 Controller Services
> 2025-10-08 12:57:55,240 INFO [Process Group Update Thread-1]
> o.apache.nifi.web.api.FlowUpdateResource Restarting 5 Processors
> 2025-10-08 12:57:55,256 INFO [Write-Ahead Local State Provider Maintenance]
> o.a.n.wali.SequentialAccessWriteAheadLog Checkpointed Write-Ahead Log with
> 581 Records and 0 Swap Files in 5 milliseconds (Stop-the-world time = 0
> milliseconds), max Transaction ID 304660
> 2025-10-08 12:57:55,263 INFO [Process Group Update Thread-1]
> org.apache.nifi.controller.AbstractPort
> LocalPort[id=834e1eac-bd2f-36a1-1709-e76538ac6622, type=INPUT_PORT, name=IN
> Incoming Request, group=Format Incoming REQUEST] started
> 2025-10-08 12:57:55,264 INFO [Process Group Update Thread-1]
> o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled
> LocalPort[id=834e1eac-bd2f-36a1-1709-e76538ac6622, type=INPUT_PORT, name=IN
> Incoming Request, group=Format Incoming REQUEST] to run with 1 threads
> 2025-10-08 12:57:55,264 INFO [Process Group Update Thread-1]
> o.a.n.c.s.StandardProcessScheduler Starting
> JSLTTransformJSON[id=469e39a4-e27a-3375-1d6d-8d740a85c63f]
> 2025-10-08 12:57:55,264 INFO [Process Group Update Thread-1]
> o.a.n.c.s.StandardProcessScheduler Starting
> UpdateAttribute[id=1f04a949-7263-3d07-c94e-1e101bc1c038]
> 2025-10-08 12:57:55,264 INFO [Process Group Update Thread-1]
> org.apache.nifi.controller.AbstractPort
> LocalPort[id=110c4819-4fb7-31de-69bb-18a07e4c0457, type=OUTPUT_PORT, name=OUT
> Failure Output, group=Format Incoming REQUEST] started
> 2025-10-08 12:57:55,264 INFO [Process Group Update Thread-1]
> o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled
> LocalPort[id=110c4819-4fb7-31de-69bb-18a07e4c0457, type=OUTPUT_PORT, name=OUT
> Failure Output, group=Format Incoming REQUEST] to run with 1 threads
> 2025-10-08 12:57:55,264 INFO [Process Group Update Thread-1]
> o.a.n.c.s.StandardProcessScheduler Starting
> InvokeHTTP[id=307ccb7c-7474-3597-6f91-fa30baaad706] {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
