[jira] [Commented] (NIFI-15468) NPE on startup if unable to create Connector
[ https://issues.apache.org/jira/browse/NIFI-15468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18068698#comment-18068698 ] ASF subversion and git services commented on NIFI-15468: Commit 77caec7c7554d22199bfb0dc652198fd085dcd31 in nifi's branch refs/heads/main from Mark Payne [ https://gitbox.apache.org/repos/asf?p=nifi.git;h=77caec7c755 ] NIFI-15258 Initial implementation of Connectors (#10993) - NIFI-15259 Added REST API for Connectors Introduced comprehensive REST endpoints for managing Connectors through the NiFi web interface and API clients. Key capabilities: - Full lifecycle management (create, read, update, delete) - Start/stop control with run status endpoints - Multi-step configuration with property groups supporting string literals, asset references, and secret references - Asynchronous configuration verification with polling support - Access to connector's managed flow and process group status - Search functionality within connector's encapsulated flow Cluster support: - Request replication across cluster nodes - Response merging for dynamic property allowable values that may differ between nodes - Consistent configuration step and property descriptor handling Infrastructure: - Audit logging for all connector configuration changes - Authorization integration with NiFi's policy framework - UI extension support for connector-specific interfaces - Frontend updates for connector access policy management - NIFI-15323 Adding operate permissions to the ConnectorEntity - NIFI-15322 Require all property descriptors within a PropertyGroup / ConfigurationStep are unique (#10626) - NIFI-15322 Huge refactoring of Connectors to require that tuple is unique. Requiring that is simple, but now that we enforce that, we can greatly simplify much of the code. - NIFI-15322 Added StepConfiguration to simplify API rather than using Map in some places - NIFI-15322 Now that we enforce unique property names per step, introduced StepConfigurationContext to further reduce API complexity - NIFI-15326 Adding support of configuration step documentation. (#10631) - NIFI-15322 Adapting to new connector configuration step model. - NIFI-15330 Allow GhostConnector to be updated (#10632) - NIFI-15312 Implementation of Parameter Provider based Secrets Manager; updated mock framework to support secrets; validation cleanup (#10638) - NIFI-15336 Created AuthorizableSecret and implemented ParameterProviderSecretProvider to provide the Parameter Provider as the associated Authorizable (#10644) - NIFI-15258 Enable Custom UI to retrieve connector with flow contexts (#10652) - NIFI-15352 Added ConnectorClient to toolkit-cli so that it can be used in system tests; created system tests for Connectors; bug fixes found running tests; updated Secret/SecretReference to support fully qualified names - NIFI-15343: Adding an endpoint to return available secrets to the connector configuration wizard. -NIFI-15343: Adding providerId to SecretDTO. - NIFI-15343: Skipping ParameterProviders that are invalid or validating when fetching secrets. - NIFI-15343: Adding fully qualified name to SecretDTO. - NIFI-15315 Add support for assets in connectors (#10647) - Support multiple asset references - Clean up of assets in StandardConnectorDAO after apply and discard - Add endpoint for listing assets for a given connector - Add endpoint for discarding the working config of a connector - Add endpoint for retrieving asset content - Add system test for connectors that uploads an asset - NIFI-15361 Allowing configuration step documentation to be returned independent of any connector instances. - NIFI-15369 Allow ConfigurationStep to depend on another (ConfigurationStep,Property) tuple (#10669) - NIFI-15367 Ensure that Connectors' implicit parameter contexts are not registered with ParameterContextManager; added system test to verify; fixed bug in ConnectorAssetsIT where it did not wait for connector to return to its 'STOPPED' state before attempting to delete - NIFI-15370 Add Connector ID to process groups and do not register create process groups if they have a connector ID. (#10673) - NIFI-15356 Adding authorization to the StandardNiFiConnectorWebContext. (#10660) - NIFI-15353 Adding support for rendering Connector Documentation. (#10683) - NIFI-15429 Adding an optional query parameter for specifying which process group should be returned within the Connectors flow. - NIFI-15430: Ensure that if we fail to initialize a Connector, we create a GhostConnector instead and ensure that we also proivde the extensionMissing flag on ConnectorNode - NIFI-15430: Added extensionMissing flag to Connector DTO - NIFI-15427: Added abiliy to drop flowfiles / drain flowfiles from a Connector; added some system tests to verify existing behavior; fixed existing issue with IT - NIFI-15433: If connector validation throws an Exception kee
[jira] [Commented] (NIFI-15468) NPE on startup if unable to create Connector
[ https://issues.apache.org/jira/browse/NIFI-15468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18064730#comment-18064730 ] ASF subversion and git services commented on NIFI-15468: Commit c5b2bd494edcd087e70a17c8585e1d11b3ec61a5 in nifi's branch refs/heads/NIFI-15258 from Mark Payne [ https://gitbox.apache.org/repos/asf?p=nifi.git;h=c5b2bd494ed ] NIFI-15258: Initial implementation of Connectors NIFI-15258: Fixed vulnerable lz4 dependency NIFI-15258: Fixed checkstyle violations/pmd NIFI-15258: Addressed PMD findings NIFI-15259: Added REST API for Connectors Introduced comprehensive REST endpoints for managing Connectors through the NiFi web interface and API clients. Key capabilities: - Full lifecycle management (create, read, update, delete) - Start/stop control with run status endpoints - Multi-step configuration with property groups supporting string literals, asset references, and secret references - Asynchronous configuration verification with polling support - Access to connector's managed flow and process group status - Search functionality within connector's encapsulated flow Cluster support: - Request replication across cluster nodes - Response merging for dynamic property allowable values that may differ between nodes - Consistent configuration step and property descriptor handling Infrastructure: - Audit logging for all connector configuration changes - Authorization integration with NiFi's policy framework - UI extension support for connector-specific interfaces - Frontend updates for connector access policy management NIFI-15323: Adding operate permissions to the ConnectorEntity. (#10625) This closes #10625 NIFI-15322: Require all property descriptors within a PropertyGroup / ConfigurationStep are unique (#10626) * NIFI-15322: Huge refactoring of Connectors to require that tuple is unique. Requiring that is simple, but now that we enforce that, we can greatly simplify much of the code. * NIFI-15322: Added StepConfiguration to simplify API rather than using Map in some places * NIFI-15322: Now that we enforce unique property names per step, introduced StepConfigurationContext to further reduce API complexity Signed-off-by: Kevin Doran NIFI-15326: Adding support of configuration step documentation. (#10631) NIFI-15322: Adapting to new connector configuration step model. NIFI-15330: Allow GhostConnector to be updated (#10632) NIFI-15312: Implementation of Parameter Provider based Secrets Manager; updated mock framework to support secrets; validation cleanup (#10638) NIFI-15336: Created AuthorizableSecret and implemented ParameterProviderSecretProvider to provide the Parameter Provider as the associated Authorizable (#10644) NIFI-15258: Enable Custom UI to retrieve connector with flow contexts (#10652) NIFI-15352: Added ConnectorClient to toolkit-cli so that it can be us… (#10654) * NIFI-15352: Added ConnectorClient to toolkit-cli so that it can be used in system tests; created system tests for Connectors; bug fixes found running tests; updated Secret/SecretReference to support fully qualified names * NIFI-15352: Addressed review feedback NIFI-15343: Adding an endpoint to return available secrets to the con… (#10645) * NIFI-15343: Adding an endpoint to return available secrets to the connector configuration wizard. * NIFI-15343: Adding providerId to SecretDTO. * NIFI-15343: Skipping ParameterProviders that are invalid or validating when fetching secrets. * NIFI-15343: Adding fully qualified name to SecretDTO. - Fixing rebase issue. This closes #10645 NIFI-15315 Add support for assets in connectors (#10647) - Support multiple asset references - Clean up of assets in StandardConnectorDAO after apply and discard - Add endpoint for listing assets for a given connector - Add endpoint for discarding the working config of a connector - Add endpoint for retrieving asset content - Add system test for connectors that uploads an asset Signed-off-by: Kevin Doran * Fix issues after rebasing, enable ClusteredConnectorAssetsIT NIFI-15361: Allowing configuration step documentation to be returned … (#10667) * NIFI-15361: Allowing configuration step documentation to be returned independent of any connector instances. NIFI-15369: Allow ConfigurationStep to depend on another (ConfigurationStep,Property) tuple (#10669) NIFI-15367: Ensure that Connectors' implicit parameter contexts are n… (#10665) * NIFI-15367: Ensure that Connectors' implicit parameter contexts are not registered with ParameterContextManager; added system test to verify; fixed bug in ConnectorAssetsIT where it did not wait for connector to return to its 'STOPPED' state before attempting to delete * NIFI-15367: Bug fixes; review feedback NIFI-15370: Add Connector ID to process groups and do not register create process groups if they have a connector ID. (#10673) NIFI-15356: Addi
[jira] [Commented] (NIFI-15468) NPE on startup if unable to create Connector
[ https://issues.apache.org/jira/browse/NIFI-15468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18064653#comment-18064653 ] ASF subversion and git services commented on NIFI-15468: Commit 6071ce67df48c94388066da02e86b83486754d55 in nifi's branch refs/heads/NIFI-15258 from Mark Payne [ https://gitbox.apache.org/repos/asf?p=nifi.git;h=6071ce67df4 ] NIFI-15258: Initial implementation of Connectors NIFI-15258: Fixed vulnerable lz4 dependency NIFI-15258: Fixed checkstyle violations/pmd NIFI-15258: Addressed PMD findings NIFI-15259: Added REST API for Connectors Introduced comprehensive REST endpoints for managing Connectors through the NiFi web interface and API clients. Key capabilities: - Full lifecycle management (create, read, update, delete) - Start/stop control with run status endpoints - Multi-step configuration with property groups supporting string literals, asset references, and secret references - Asynchronous configuration verification with polling support - Access to connector's managed flow and process group status - Search functionality within connector's encapsulated flow Cluster support: - Request replication across cluster nodes - Response merging for dynamic property allowable values that may differ between nodes - Consistent configuration step and property descriptor handling Infrastructure: - Audit logging for all connector configuration changes - Authorization integration with NiFi's policy framework - UI extension support for connector-specific interfaces - Frontend updates for connector access policy management NIFI-15323: Adding operate permissions to the ConnectorEntity. (#10625) This closes #10625 NIFI-15322: Require all property descriptors within a PropertyGroup / ConfigurationStep are unique (#10626) * NIFI-15322: Huge refactoring of Connectors to require that tuple is unique. Requiring that is simple, but now that we enforce that, we can greatly simplify much of the code. * NIFI-15322: Added StepConfiguration to simplify API rather than using Map in some places * NIFI-15322: Now that we enforce unique property names per step, introduced StepConfigurationContext to further reduce API complexity Signed-off-by: Kevin Doran NIFI-15326: Adding support of configuration step documentation. (#10631) NIFI-15322: Adapting to new connector configuration step model. NIFI-15330: Allow GhostConnector to be updated (#10632) NIFI-15312: Implementation of Parameter Provider based Secrets Manager; updated mock framework to support secrets; validation cleanup (#10638) NIFI-15336: Created AuthorizableSecret and implemented ParameterProviderSecretProvider to provide the Parameter Provider as the associated Authorizable (#10644) NIFI-15258: Enable Custom UI to retrieve connector with flow contexts (#10652) NIFI-15352: Added ConnectorClient to toolkit-cli so that it can be us… (#10654) * NIFI-15352: Added ConnectorClient to toolkit-cli so that it can be used in system tests; created system tests for Connectors; bug fixes found running tests; updated Secret/SecretReference to support fully qualified names * NIFI-15352: Addressed review feedback NIFI-15343: Adding an endpoint to return available secrets to the con… (#10645) * NIFI-15343: Adding an endpoint to return available secrets to the connector configuration wizard. * NIFI-15343: Adding providerId to SecretDTO. * NIFI-15343: Skipping ParameterProviders that are invalid or validating when fetching secrets. * NIFI-15343: Adding fully qualified name to SecretDTO. - Fixing rebase issue. This closes #10645 NIFI-15315 Add support for assets in connectors (#10647) - Support multiple asset references - Clean up of assets in StandardConnectorDAO after apply and discard - Add endpoint for listing assets for a given connector - Add endpoint for discarding the working config of a connector - Add endpoint for retrieving asset content - Add system test for connectors that uploads an asset Signed-off-by: Kevin Doran * Fix issues after rebasing, enable ClusteredConnectorAssetsIT NIFI-15361: Allowing configuration step documentation to be returned … (#10667) * NIFI-15361: Allowing configuration step documentation to be returned independent of any connector instances. NIFI-15369: Allow ConfigurationStep to depend on another (ConfigurationStep,Property) tuple (#10669) NIFI-15367: Ensure that Connectors' implicit parameter contexts are n… (#10665) * NIFI-15367: Ensure that Connectors' implicit parameter contexts are not registered with ParameterContextManager; added system test to verify; fixed bug in ConnectorAssetsIT where it did not wait for connector to return to its 'STOPPED' state before attempting to delete * NIFI-15367: Bug fixes; review feedback NIFI-15370: Add Connector ID to process groups and do not register create process groups if they have a connector ID. (#10673) NIFI-15356: Addi
[jira] [Commented] (NIFI-15468) NPE on startup if unable to create Connector
[ https://issues.apache.org/jira/browse/NIFI-15468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18053593#comment-18053593 ] ASF subversion and git services commented on NIFI-15468: Commit 8414bc7fcd1c1d951da0ac1d17088cba55fa9202 in nifi's branch refs/heads/NIFI-15258 from Mark Payne [ https://gitbox.apache.org/repos/asf?p=nifi.git;h=8414bc7fcd ] NIFI-15468: Ensure that we properly initialize ConnectorNode even if a Ghost Connector is created (#10775) This closes #10775 > NPE on startup if unable to create Connector > > > Key: NIFI-15468 > URL: https://issues.apache.org/jira/browse/NIFI-15468 > Project: Apache NiFi > Issue Type: Task >Reporter: Mark Payne >Assignee: Mark Payne >Priority: Major > Time Spent: 0.5h > Remaining Estimate: 0h > > On startup, if a connector cannot be created, a Ghost connector is created > but it is not initialized. This then causes an NPE, which results in startup > failing. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (NIFI-15468) NPE on startup if unable to create Connector
[ https://issues.apache.org/jira/browse/NIFI-15468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18052107#comment-18052107 ] ASF subversion and git services commented on NIFI-15468: Commit 00ad24bd47385de206f4de1ccb4fdaaafbbacf86 in nifi's branch refs/heads/NIFI-15258 from Mark Payne [ https://gitbox.apache.org/repos/asf?p=nifi.git;h=00ad24bd47 ] NIFI-15468: Ensure that we properly initialize ConnectorNode even if a Ghost Connector is created (#10775) This closes #10775 > NPE on startup if unable to create Connector > > > Key: NIFI-15468 > URL: https://issues.apache.org/jira/browse/NIFI-15468 > Project: Apache NiFi > Issue Type: Task >Reporter: Mark Payne >Assignee: Mark Payne >Priority: Major > Time Spent: 0.5h > Remaining Estimate: 0h > > On startup, if a connector cannot be created, a Ghost connector is created > but it is not initialized. This then causes an NPE, which results in startup > failing. -- This message was sent by Atlassian Jira (v8.20.10#820010)
