[jira] [Commented] (NIFI-12998) nifi-nar-bundle has improper dependencies - the full source tree needs dependency cleanup and management
[ https://issues.apache.org/jira/browse/NIFI-12998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17843229#comment-17843229 ] ASF subversion and git services commented on NIFI-12998: Commit 52255ee813350700e6a055e055f1a575c929a374 in nifi's branch refs/heads/main from Joe Witt [ https://gitbox.apache.org/repos/asf?p=nifi.git;h=52255ee813 ] NIFI-13108 Updated common and framework dependencies - Fixed logging logic for tests vs runtime scope - Restoring behavior to testProcessUnparsableRecordWithRawOutputWithCheckpoint that changed in NIFI-12998 presumably because of log dependency changes. Now that we have a single provider the test behavior appears to be back to normal. - Upgraded AWS SDK 1 from 1.12.686 to 1.12.710 - Upgraded AWS SDK 2 from 2.25.16 to 2.25.40 - Upgraded Azure SDK BOM from 1.2.21 to 1.2.23 - Upgraded GCP Libraries from 26.34.0 to 26.37.0 - Upgraded Fabric8 Kubernetes Client from 6.10.0 to 6.12.1 - Upgraded Commons CLI from 1.6.0 to 1.7.0 - Upgraded Commons Codec from 1.16.1 to 1.17.0 - Upgraded zstd-jni from 1.5.6-1 to 1.5.6-3 - Upgraded Commons Text from 1.11.0 to 1.12.0 - Upgraded Test Containers from 1.19.4 to 1.19.7 - Upgraded JAXB Runtime from 4.0.4 to 4.0.5 - Upgraded JAXB API from 4.0.1 to 4.0.2 - Upgraded Jersey from 3.1.4 to 3.1.6 - Upgraded Log4j 2 from 2.23.0 to 2.23.1 - Upgraded Logback from 1.5.5 to 1.5.6 - Upgraded Mockito from 5.8.0 to 5.11.0 - Upgraded Swagger Annotations from 2.2.20 to 2.2.21 - Upgraded jsoup from 1.17.1 to 1.17.2 - Upgraded JUnit Platform Commons from 1.10.0 to 1.10.2 - Upgraded Checkstyle from 9.3 to 10.15.0 - Upgraded ASM from 9.6 to 9.7 This closes #8708 Signed-off-by: David Handermann > nifi-nar-bundle has improper dependencies - the full source tree needs > dependency cleanup and management > > > Key: NIFI-12998 > URL: https://issues.apache.org/jira/browse/NIFI-12998 > Project: Apache NiFi > Issue Type: Improvement >Affects Versions: 2.0.0-M2 >Reporter: Joe Witt >Assignee: Joe Witt >Priority: Major > Fix For: 2.0.0-M3 > > Time Spent: 2h 20m > Remaining Estimate: 0h > > found in nifi-nar-bundles pom > > com.maxmind.geoip2 > geoip2 > 4.2.0 > > This should not be here. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (NIFI-12998) nifi-nar-bundle has improper dependencies - the full source tree needs dependency cleanup and management
[ https://issues.apache.org/jira/browse/NIFI-12998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841311#comment-17841311 ] ASF subversion and git services commented on NIFI-12998: Commit 42a4385c82d0bbe1428096fb0b634c9f9747f91b in nifi's branch refs/heads/main from Joe Witt [ https://gitbox.apache.org/repos/asf?p=nifi.git;h=42a4385c82 ] NIFI-12998 Restructured framework and extension modules Simplified dependency management into Bill of Material dependencies as parents that align to classloader structures. - Moved nifi-framework-bundle to root level - Moved nifi-nar-bundle modules to root nifi-extension-bundles - Added nifi-extension-bom for internal and external extensions - Added nifi-framework-nar-bom and nifi-server-nar-bom for managing framework dependencies - Renamed nifi-jetty-bundle to nifi-jetty-nar This closes #8677 Signed-off-by: David Handermann > nifi-nar-bundle has improper dependencies - the full source tree needs > dependency cleanup and management > > > Key: NIFI-12998 > URL: https://issues.apache.org/jira/browse/NIFI-12998 > Project: Apache NiFi > Issue Type: Task >Affects Versions: 2.0.0-M2 >Reporter: Joe Witt >Assignee: Joe Witt >Priority: Major > Time Spent: 2h 20m > Remaining Estimate: 0h > > found in nifi-nar-bundles pom > > com.maxmind.geoip2 > geoip2 > 4.2.0 > > This should not be here. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (NIFI-12998) nifi-nar-bundle has improper dependencies - the full source tree needs dependency cleanup and management
[ https://issues.apache.org/jira/browse/NIFI-12998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839500#comment-17839500 ] Joe Witt commented on NIFI-12998: - All checks are green. Manual tests all looking good. Run on docker w python components all good. > nifi-nar-bundle has improper dependencies - the full source tree needs > dependency cleanup and management > > > Key: NIFI-12998 > URL: https://issues.apache.org/jira/browse/NIFI-12998 > Project: Apache NiFi > Issue Type: Task >Affects Versions: 2.0.0-M2 >Reporter: Joe Witt >Assignee: Joe Witt >Priority: Major > Time Spent: 1.5h > Remaining Estimate: 0h > > found in nifi-nar-bundles pom > > com.maxmind.geoip2 > geoip2 > 4.2.0 > > This should not be here. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (NIFI-12998) nifi-nar-bundle has improper dependencies - the full source tree needs dependency cleanup and management
[
https://issues.apache.org/jira/browse/NIFI-12998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839261#comment-17839261
]
Joe Witt commented on NIFI-12998:
-
integration-tests-ci seems unstable on CI servers. Runs fine locally. This
test is an example
{noformat}
---
Test set: org.apache.nifi.jms.processors.JMSPublisherConsumerIT
---
Tests run: 10, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 3.949 s <<<
FAILURE! -- in org.apache.nifi.jms.processors.JMSPublisherConsumerIT
org.apache.nifi.jms.processors.JMSPublisherConsumerIT.validateNIFI6721 -- Time
elapsed: 0.024 s <<< FAILURE!
org.opentest4j.AssertionFailedError: expected: <1713587661028> but was:
<1713587661029>
at
org.junit.jupiter.api.AssertionFailureBuilder.build(AssertionFailureBuilder.java:151)
at
org.junit.jupiter.api.AssertionFailureBuilder.buildAndThrow(AssertionFailureBuilder.java:132)
at
org.junit.jupiter.api.AssertEquals.failNotEqual(AssertEquals.java:197)
at
org.junit.jupiter.api.AssertEquals.assertEquals(AssertEquals.java:166)
at
org.junit.jupiter.api.AssertEquals.assertEquals(AssertEquals.java:161)
at org.junit.jupiter.api.Assertions.assertEquals(Assertions.java:632)
at
org.apache.nifi.jms.processors.JMSPublisherConsumerIT.validateNIFI6721(JMSPublisherConsumerIT.java:283)
at java.base/java.lang.reflect.Method.invoke(Method.java:580)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1596)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1596)
{noformat}
> nifi-nar-bundle has improper dependencies - the full source tree needs
> dependency cleanup and management
>
>
> Key: NIFI-12998
> URL: https://issues.apache.org/jira/browse/NIFI-12998
> Project: Apache NiFi
> Issue Type: Task
>Affects Versions: 2.0.0-M2
>Reporter: Joe Witt
>Assignee: Joe Witt
>Priority: Major
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> found in nifi-nar-bundles pom
>
> com.maxmind.geoip2
> geoip2
> 4.2.0
>
> This should not be here.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (NIFI-12998) nifi-nar-bundle has improper dependencies - the full source tree needs dependency cleanup and management
[ https://issues.apache.org/jira/browse/NIFI-12998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836665#comment-17836665 ] Joe Witt commented on NIFI-12998: - This started in an effort to remove a couple clearly extraneous entries in the nifi-nar-bundle pom. What I found as I pulled the thread was that our repo holistically has grown very messy and tangled in ways that make adding capabilities and maintenance much harder. Some members of the community have done tremendous work to improve the situation by moving more things to the top level pom dependency management section and introducing BOMs where available for things like Jetty and various others. These all help and are part of the strategy but several challenges remain due to years of technical debt accrual. 1. We have made the 'nifi-nar-bundles' module into a frankenstein of awkward inter dependencies between the framework, actual extensions, etc.. You really can't build components outside of that with the way it works right now without a lot of manual work. 2. We have no clear delineation of what is actually provided in the application of NiFi (or minifi java or stateless for that matter) when build extension nars on top. 3. Related to 2 it isn't clear or obvious to users actually how any of our classloading magic truly works. Which artifacts are you actually having to contend with being in a parent classloader and which ones are you free to take a different version/approach with? 4. If you want to build a new nar or modify one which exists you really don't know and frankly don't have much options what you can use. The parent modules have forced dependencies (not managed dependencies but hard dependencies) which complicate things. You also effectively have to build them within the nifi-nar-bundles module hierarchy to have it work for now. Going forward there should be in effect three patterns we enable. (a) you want to build a nar and you only need base/root dependencies which you cannot ovveride. (b) you want to build a nar and you're going to leverage one or more standard service apis. (c) you want to build a nar and you're going to leverage standard shared libraries and service apis. Nars should be free to choose whichever level of integration/tie in they want and they should be able to live easily wherever they need in the nifi codebase or in anyone elses repo. It was always supposed to be dead simple to build extensions. 5. If you analyze dependency trees POMs are riddled with absurd inclusions that have absolutely nothing to do with the component involved. Lots of copy and paste is clearly a factor but also inclusion of dependencies because you think some upstream user would need those. Dependencies which got left around after various refactorings. Dependencies which are marked as provided but not actually provided/etc.. I envision various devs playing dependency bingo until the build works. We are fighting maven and its great powers instead of letting it do the hard work for us. The PR associated with the above will be very large as it unwinds these various complexities. The result should be far more maintainable and easier to reason over. It heavily leverages the BOM pattern both for external dependencies but also within NiFi. It moves modules to their more logical/independent spot. It goes module by module and does full dependency analysis to eliminate any incorrect dependencies either from things being listed as dependencies which aren't actually used as well as things which override parent managed versions when it should not as well. > nifi-nar-bundle has improper dependencies - the full source tree needs > dependency cleanup and management > > > Key: NIFI-12998 > URL: https://issues.apache.org/jira/browse/NIFI-12998 > Project: Apache NiFi > Issue Type: Task >Affects Versions: 2.0.0-M2 >Reporter: Joe Witt >Assignee: Joe Witt >Priority: Major > Time Spent: 0.5h > Remaining Estimate: 0h > > found in nifi-nar-bundles pom > > com.maxmind.geoip2 > geoip2 > 4.2.0 > > This should not be here. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (NIFI-12998) nifi-nar-bundle has improper dependencies - the full source tree needs dependency cleanup and management
[ https://issues.apache.org/jira/browse/NIFI-12998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834174#comment-17834174 ] Joe Witt commented on NIFI-12998: - Some TODOs: 1. remove the TODO entry by eliminating the nifi-nar-bom and just having the nifi-nar-bundle pom import the nifi-bom instead. 2. Do the entire build with all optional profiles to ensure everything is tidied up. 3. Once the full build is totally good/confirmed to have the right bits. THEN review ways to reduce version declarations without creating new needless coupling. 4. Evaluate whether certain poms could include/import the nifit-standard-services-api-bom to simplify version references or not. 5. review all the remaining things in the new build that were not in the old build. Some look like references we need to clean. API jars for example should not be in the nars/etc.. > nifi-nar-bundle has improper dependencies - the full source tree needs > dependency cleanup and management > > > Key: NIFI-12998 > URL: https://issues.apache.org/jira/browse/NIFI-12998 > Project: Apache NiFi > Issue Type: Task >Affects Versions: 2.0.0-M2 >Reporter: Joe Witt >Assignee: Joe Witt >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > > found in nifi-nar-bundles pom > > com.maxmind.geoip2 > geoip2 > 4.2.0 > > This should not be here. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (NIFI-12998) nifi-nar-bundle has improper dependencies - the full source tree needs dependency cleanup and management
[ https://issues.apache.org/jira/browse/NIFI-12998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834173#comment-17834173 ] Joe Witt commented on NIFI-12998: - As for the nifi-python-framework-api it is properly ONLY in the resulting lib directory and not the other places. So again in the new build the output is more correct. > nifi-nar-bundle has improper dependencies - the full source tree needs > dependency cleanup and management > > > Key: NIFI-12998 > URL: https://issues.apache.org/jira/browse/NIFI-12998 > Project: Apache NiFi > Issue Type: Task >Affects Versions: 2.0.0-M2 >Reporter: Joe Witt >Assignee: Joe Witt >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > > found in nifi-nar-bundles pom > > com.maxmind.geoip2 > geoip2 > 4.2.0 > > This should not be here. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (NIFI-12998) nifi-nar-bundle has improper dependencies - the full source tree needs dependency cleanup and management
[
https://issues.apache.org/jira/browse/NIFI-12998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834171#comment-17834171
]
Joe Witt commented on NIFI-12998:
-
In the new build the nifi-record lib is in the following places only. And the
main one that is important is nifi-standard-services-api-nar which all these
things extend from in a nar sense. So the new one looks a lot more correct.
need to review the ones that include it beyond the standard services api nar
and see if they can go away.
{noformat}
~/Downloads/new-nifi.txt:569:
./work/nar/extensions/nifi-couchbase-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
~/Downloads/new-nifi.txt:610:
./work/nar/extensions/nifi-db-schema-registry-service-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
~/Downloads/new-nifi.txt:627:
./work/nar/extensions/nifi-dbcp-service-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
~/Downloads/new-nifi.txt:1260:
./work/nar/extensions/nifi-prometheus-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
~/Downloads/new-nifi.txt:1693:
./work/nar/extensions/nifi-standard-services-api-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
~/Downloads/new-nifi.txt:1787:
./work/nar/extensions/nifi-workday-processors-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
{noformat}
> nifi-nar-bundle has improper dependencies - the full source tree needs
> dependency cleanup and management
>
>
> Key: NIFI-12998
> URL: https://issues.apache.org/jira/browse/NIFI-12998
> Project: Apache NiFi
> Issue Type: Task
>Affects Versions: 2.0.0-M2
>Reporter: Joe Witt
>Assignee: Joe Witt
>Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> found in nifi-nar-bundles pom
>
> com.maxmind.geoip2
> geoip2
> 4.2.0
>
> This should not be here.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (NIFI-12998) nifi-nar-bundle has improper dependencies - the full source tree needs dependency cleanup and management
[
https://issues.apache.org/jira/browse/NIFI-12998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834167#comment-17834167
]
Joe Witt commented on NIFI-12998:
-
In Old (not new)
{noformat}
./work/nar/extensions/nifi-apicurio-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-aws-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-azure-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-box-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-confluent-platform-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-dropbox-processors-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-elasticsearch-client-service-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-elasticsearch-restapi-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-enrich-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-gcp-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-geohash-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-jms-processors-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-jolt-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-kafka-2-6-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-lookup-services-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-mongodb-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-mongodb-services-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-mqtt-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-poi-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-py4j-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-record-serialization-services-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-record-sink-service-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-redis-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-registry-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-salesforce-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-scripting-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-site-to-site-reporting-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-slack-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-smb-client-api-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-smb-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-smb-smbj-client-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-standard-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-zendesk-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-zendesk-services-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-py4j-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-python-framework-api-2.0.0-SNAPSHOT.jar
./work/nar/framework/nifi-framework-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-python-framework-api-2.0.0-SNAPSHOT.jar
{noformat}
[jira] [Commented] (NIFI-12998) nifi-nar-bundle has improper dependencies - the full source tree needs dependency cleanup and management
[
https://issues.apache.org/jira/browse/NIFI-12998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834166#comment-17834166
]
Joe Witt commented on NIFI-12998:
-
In New (not old)
{noformat}
./work/nar/extensions/nifi-amqp-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-security-utils-api-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-distributed-cache-services-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-security-utils-api-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-email-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-security-utils-api-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-prometheus-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-security-utils-api-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-ssl-context-service-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-security-utils-api-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-websocket-processors-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-security-utils-api-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-websocket-services-api-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-security-utils-api-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-websocket-services-jetty-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-security-utils-api-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-amqp-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-asana-processors-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-asana-services-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-compress-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-couchbase-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-db-schema-registry-service-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-dbcp-service-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-distributed-cache-services-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-email-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-evtx-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-file-resource-service-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-framework-kubernetes-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-hazelcast-services-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-hl7-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-http-context-map-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-kerberos-credentials-service-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-kerberos-user-service-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-prometheus-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-proxy-configuration-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-server-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-single-user-iaa-providers-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-ssl-context-service-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-stateful-analysis-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-websocket-processors-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-websocket-services-jetty-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-windows-event-log-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
[jira] [Commented] (NIFI-12998) nifi-nar-bundle has improper dependencies - the full source tree needs dependency cleanup and management
[
https://issues.apache.org/jira/browse/NIFI-12998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834160#comment-17834160
]
Joe Witt commented on NIFI-12998:
-
to generate comparable output after creating a build start nifi. then in the
nifi bin root directory run
{noformat}
find . -type f | grep jar | sort -u
{noformat}
Do that on both old and new and you can compare the diffs.
> nifi-nar-bundle has improper dependencies - the full source tree needs
> dependency cleanup and management
>
>
> Key: NIFI-12998
> URL: https://issues.apache.org/jira/browse/NIFI-12998
> Project: Apache NiFi
> Issue Type: Task
>Affects Versions: 2.0.0-M2
>Reporter: Joe Witt
>Assignee: Joe Witt
>Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> found in nifi-nar-bundles pom
>
> com.maxmind.geoip2
> geoip2
> 4.2.0
>
> This should not be here.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (NIFI-12998) nifi-nar-bundle has improper dependencies - the full source tree needs dependency cleanup and management
[
https://issues.apache.org/jira/browse/NIFI-12998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834159#comment-17834159
]
Joe Witt commented on NIFI-12998:
-
After latest commit added on the WIP pull request. The build compiles and
runs. But there is some remaining discrepancy between former build and new
build. The size is roughly the same but we need to resolve these differences.
Some look like gaps to solve and some look like improvements.
{noformat}
In New (not old)
./work/nar/extensions/nifi-amqp-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-security-utils-api-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-amqp-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-ssl-context-service-api-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-amqp-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-asana-processors-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-distributed-cache-client-service-api-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-asana-processors-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-asana-services-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-compress-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-couchbase-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-distributed-cache-client-service-api-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-couchbase-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-lookup-service-api-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-couchbase-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-serialization-service-api-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-couchbase-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-db-schema-registry-service-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-dbcp-service-api-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-db-schema-registry-service-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-json-schema-api-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-db-schema-registry-service-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-db-schema-registry-service-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-serialization-service-api-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-db-schema-registry-service-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-schema-registry-service-api-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-db-schema-registry-service-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-dbcp-service-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-dbcp-service-api-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-dbcp-service-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-kerberos-credentials-service-api-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-dbcp-service-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-kerberos-user-service-api-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-dbcp-service-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-serialization-service-api-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-dbcp-service-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-record-sink-api-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-dbcp-service-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-security-kerberos-api-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-dbcp-service-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-distributed-cache-services-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-distributed-cache-client-service-api-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-distributed-cache-services-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-security-utils-api-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-distributed-cache-services-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-ssl-context-service-api-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-distributed-cache-services-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-utils-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-email-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-oauth2-provider-api-2.0.0-SNAPSHOT.jar
./work/nar/extensions/nifi-email-nar-2.0.0-SNAPSHOT.nar-unpacked/NAR-INF/bundled-dependencies/nifi-security-utils-api-2.0.0-SNAPSHOT.jar
