adoroszlai opened a new pull request, #7067: URL: https://github.com/apache/ozone/pull/7067
## What changes were proposed in this pull request? Similar to #7029, for `hadoop-ozone` instead of `hadoop-hdds`. Add direct dependency for modules used in `hadoop-ozone`, instead of relying on transitive dependencies for the same. (Except "test-only" modules `integration-test` and `mini-chaos-test`, to avoid too big patch.) This should get rid of most items under `Used undeclared dependencies` part of dependency analysis. Exceptions: - Test dependencies declared in `hdds-test-utils` and `hdds-hadoop-dependency-test` for convenience. - Hadoop dependencies declared in `hdds-hadoop-dependency-client` and `hdds-hadoop-dependency-server` for convenience. - `commons-lang` (v2) not added, because it will be replaced with v3 (HDDS-11305). https://issues.apache.org/jira/browse/HDDS-11279 ## How was this patch tested? Compared output of `mvn dependency:analyze` before/after the change. (Some dependencies (e.g. `assertj-core`, `junit-jupiter-params`) appear as new under `Used undeclared`, but it's only due to change in order of dependencies in plugin's output. ```diff [INFO] --- maven-dependency-plugin:3.7.1:analyze-only (default-cli) @ ozone-interface-client --- -[WARNING] Used undeclared dependencies found: -[WARNING] io.grpc:grpc-api:jar:1.58.0:compile -[WARNING] org.apache.hadoop.thirdparty:hadoop-shaded-protobuf_3_7:jar:1.1.1:compile -[WARNING] com.google.guava:guava:jar:32.1.3-jre:compile ... [INFO] --- maven-dependency-plugin:3.7.1:analyze-only (default-cli) @ ozone-common --- [WARNING] Used undeclared dependencies found: -[WARNING] io.netty:netty-handler:jar:4.1.109.Final:compile -[WARNING] org.apache.ratis:ratis-thirdparty-misc:jar:1.0.6:compile -[WARNING] io.grpc:grpc-api:jar:1.58.0:compile -[WARNING] io.grpc:grpc-inprocess:jar:1.58.0:test -[WARNING] com.google.protobuf:protobuf-java:jar:2.5.0:compile -[WARNING] org.assertj:assertj-core:jar:3.26.3:test -[WARNING] org.apache.httpcomponents:httpcore:jar:4.4.16:compile -[WARNING] org.apache.ratis:ratis-common:jar:3.1.0:compile -[WARNING] com.fasterxml.jackson.core:jackson-databind:jar:2.16.2:compile -[WARNING] org.junit.jupiter:junit-jupiter-params:jar:5.10.3:test -[WARNING] jakarta.annotation:jakarta.annotation-api:jar:2.1.1:compile -[WARNING] org.apache.ozone:hdds-interface-client:jar:1.5.0-SNAPSHOT:compile [WARNING] org.mockito:mockito-core:jar:4.11.0:test -[WARNING] org.apache.commons:commons-lang3:jar:3.14.0:compile -[WARNING] com.google.guava:guava:jar:32.1.3-jre:compile -[WARNING] io.grpc:grpc-stub:jar:1.58.0:compile -[WARNING] org.apache.httpcomponents:httpclient:jar:4.5.14:compile -[WARNING] io.netty:netty-common:jar:4.1.109.Final:compile +[WARNING] org.assertj:assertj-core:jar:3.26.3:test [WARNING] org.apache.hadoop:hadoop-common:jar:3.3.6:compile [WARNING] org.junit.jupiter:junit-jupiter-api:jar:5.10.3:test -[WARNING] org.apache.ozone:hdds-config:jar:1.5.0-SNAPSHOT:compile -[WARNING] org.apache.ratis:ratis-proto:jar:3.1.0:compile -[WARNING] com.fasterxml.jackson.core:jackson-annotations:jar:2.16.2:compile -[WARNING] org.slf4j:slf4j-api:jar:2.0.13:compile +[WARNING] org.junit.jupiter:junit-jupiter-params:jar:5.10.3:test ... [INFO] --- maven-dependency-plugin:3.7.1:analyze-only (default-cli) @ ozone-interface-storage --- [WARNING] Used undeclared dependencies found: -[WARNING] com.google.guava:guava:jar:32.1.3-jre:compile [WARNING] org.assertj:assertj-core:jar:3.26.3:test -[WARNING] org.apache.ozone:rocksdb-checkpoint-differ:jar:1.5.0-SNAPSHOT:compile [WARNING] org.apache.hadoop:hadoop-common:jar:3.3.6:compile [WARNING] org.junit.jupiter:junit-jupiter-api:jar:5.10.3:test -[WARNING] org.apache.ratis:ratis-common:jar:3.1.0:compile -[WARNING] org.apache.ozone:hdds-common:jar:1.5.0-SNAPSHOT:compile -[WARNING] org.apache.ozone:hdds-interface-client:jar:1.5.0-SNAPSHOT:compile ... [INFO] --- maven-dependency-plugin:3.7.1:analyze-only (default-cli) @ ozone-client --- [WARNING] Used undeclared dependencies found: -[WARNING] org.apache.ratis:ratis-thirdparty-misc:jar:1.0.6:compile -[WARNING] org.apache.ozone:hdds-client:jar:1.5.0-SNAPSHOT:compile -[WARNING] org.apache.ratis:ratis-common:jar:3.1.0:compile -[WARNING] commons-collections:commons-collections:jar:3.2.2:compile -[WARNING] org.junit.jupiter:junit-jupiter-params:jar:5.10.3:test -[WARNING] org.apache.ozone:hdds-interface-client:jar:1.5.0-SNAPSHOT:compile -[WARNING] jakarta.annotation:jakarta.annotation-api:jar:2.1.1:compile [WARNING] org.mockito:mockito-core:jar:4.11.0:test -[WARNING] org.apache.ozone:ozone-interface-client:jar:1.5.0-SNAPSHOT:compile -[WARNING] org.apache.commons:commons-lang3:jar:3.14.0:compile -[WARNING] com.google.guava:guava:jar:32.1.3-jre:compile [WARNING] org.apache.hadoop:hadoop-common:jar:3.3.6:compile [WARNING] org.junit.jupiter:junit-jupiter-api:jar:5.10.3:test -[WARNING] org.apache.ozone:hdds-common:jar:1.5.0-SNAPSHOT:compile -[WARNING] org.apache.ozone:hdds-config:jar:1.5.0-SNAPSHOT:compile -[WARNING] com.fasterxml.jackson.core:jackson-annotations:jar:2.16.2:compile -[WARNING] org.slf4j:slf4j-api:jar:2.0.13:compile +[WARNING] org.junit.jupiter:junit-jupiter-params:jar:5.10.3:test ... [INFO] --- maven-dependency-plugin:3.7.1:analyze-only (default-cli) @ ozone-reconcodegen --- [WARNING] Used undeclared dependencies found: -[WARNING] org.springframework:spring-tx:jar:5.3.37:compile [WARNING] org.apache.hadoop:hadoop-common:jar:3.3.6:compile -[WARNING] org.apache.ozone:hdds-config:jar:1.5.0-SNAPSHOT:compile -[WARNING] commons-io:commons-io:jar:2.16.1:compile -[WARNING] org.slf4j:slf4j-api:jar:2.0.13:compile ... [INFO] --- maven-dependency-plugin:3.7.1:analyze-only (default-cli) @ ozone-recon --- [WARNING] Used undeclared dependencies found: -[WARNING] org.eclipse.jetty:jetty-servlet:jar:9.4.55.v20240627:compile -[WARNING] org.rocksdb:rocksdbjni:jar:7.7.3:compile -[WARNING] info.picocli:picocli:jar:4.7.6:compile -[WARNING] org.reflections:reflections:jar:0.10.2:compile -[WARNING] com.google.protobuf:protobuf-java:jar:2.5.0:compile -[WARNING] org.apache.ozone:hdds-interface-server:jar:1.5.0-SNAPSHOT:compile -[WARNING] aopalliance:aopalliance:jar:1.0:compile -[WARNING] org.apache.ratis:ratis-common:jar:3.1.0:compile -[WARNING] com.fasterxml.jackson.core:jackson-databind:jar:2.16.2:compile -[WARNING] org.junit.jupiter:junit-jupiter-params:jar:5.10.3:test -[WARNING] org.apache.hadoop:hadoop-hdfs-client:jar:3.3.6:compile -[WARNING] jakarta.annotation:jakarta.annotation-api:jar:2.1.1:compile [WARNING] org.mockito:mockito-core:jar:4.11.0:test -[WARNING] org.apache.ozone:hdds-container-service:jar:1.5.0-SNAPSHOT:compile -[WARNING] org.apache.ozone:ozone-interface-client:jar:1.5.0-SNAPSHOT:compile -[WARNING] com.google.guava:guava:jar:32.1.3-jre:compile -[WARNING] org.apache.commons:commons-lang3:jar:3.14.0:compile -[WARNING] org.glassfish.hk2:hk2-api:jar:2.6.1:compile -[WARNING] org.apache.ozone:hdds-server-framework:jar:1.5.0-SNAPSHOT:compile -[WARNING] org.apache.ozone:hdds-common:jar:1.5.0-SNAPSHOT:compile -[WARNING] org.apache.ratis:ratis-proto:jar:3.1.0:compile -[WARNING] jakarta.ws.rs:jakarta.ws.rs-api:jar:2.1.6:compile -[WARNING] javax.inject:javax.inject:jar:1:compile -[WARNING] org.apache.commons:commons-compress:jar:1.27.0:compile -[WARNING] org.apache.ozone:hdds-managed-rocksdb:jar:1.5.0-SNAPSHOT:compile [WARNING] org.assertj:assertj-core:jar:3.26.3:test -[WARNING] javax.servlet:javax.servlet-api:jar:3.1.0:compile -[WARNING] commons-collections:commons-collections:jar:3.2.2:compile -[WARNING] org.apache.ozone:ozone-interface-storage:jar:1.5.0-SNAPSHOT:compile -[WARNING] jakarta.validation:jakarta.validation-api:jar:2.0.2:compile -[WARNING] org.glassfish.jersey.core:jersey-common:jar:2.43:compile -[WARNING] org.apache.ozone:hdds-interface-client:jar:1.5.0-SNAPSHOT:compile -[WARNING] org.springframework:spring-core:jar:5.3.37:compile -[WARNING] org.eclipse.jetty:jetty-util:jar:9.4.55.v20240627:compile -[WARNING] org.springframework:spring-tx:jar:5.3.37:compile -[WARNING] jakarta.xml.bind:jakarta.xml.bind-api:jar:2.3.3:compile [WARNING] org.apache.hadoop:hadoop-auth:jar:3.3.6:compile [WARNING] org.apache.hadoop:hadoop-common:jar:3.3.6:compile [WARNING] org.junit.jupiter:junit-jupiter-api:jar:5.10.3:test -[WARNING] commons-io:commons-io:jar:2.16.1:compile -[WARNING] org.apache.ozone:hdds-config:jar:1.5.0-SNAPSHOT:compile -[WARNING] org.slf4j:slf4j-api:jar:2.0.13:compile -[WARNING] com.fasterxml.jackson.core:jackson-annotations:jar:2.16.2:compile +[WARNING] org.junit.jupiter:junit-jupiter-params:jar:5.10.3:test +[WARNING] org.apache.hadoop:hadoop-hdfs-client:jar:3.3.6:compile ... [INFO] --- maven-dependency-plugin:3.7.1:analyze-only (default-cli) @ ozone-tools --- [WARNING] Used undeclared dependencies found: -[WARNING] com.amazonaws:aws-java-sdk-kms:jar:1.12.661:compile -[WARNING] org.rocksdb:rocksdbjni:jar:7.7.3:compile -[WARNING] info.picocli:picocli:jar:4.7.6:compile -[WARNING] org.apache.ozone:hdds-interface-server:jar:1.5.0-SNAPSHOT:compile -[WARNING] org.apache.ratis:ratis-server-api:jar:3.1.0:compile -[WARNING] org.apache.ratis:ratis-common:jar:3.1.0:compile -[WARNING] org.apache.ozone:hdds-server-scm:jar:1.5.0-SNAPSHOT:compile -[WARNING] com.fasterxml.jackson.core:jackson-databind:jar:2.16.2:compile -[WARNING] org.junit.jupiter:junit-jupiter-params:jar:5.10.3:test -[WARNING] org.apache.hadoop:hadoop-hdfs-client:jar:3.3.6:compile -[WARNING] jakarta.annotation:jakarta.annotation-api:jar:2.1.1:compile [WARNING] org.mockito:mockito-core:jar:4.11.0:test -[WARNING] org.apache.ozone:hdds-container-service:jar:1.5.0-SNAPSHOT:compile -[WARNING] org.apache.ozone:ozone-interface-client:jar:1.5.0-SNAPSHOT:compile -[WARNING] com.google.guava:guava:jar:32.1.3-jre:compile -[WARNING] org.apache.commons:commons-lang3:jar:3.14.0:compile -[WARNING] io.opentracing:opentracing-util:jar:0.33.0:compile -[WARNING] org.jooq:jooq:jar:3.11.10:compile -[WARNING] commons-codec:commons-codec:jar:1.17.0:compile -[WARNING] org.apache.ratis:ratis-tools:jar:3.1.0:compile -[WARNING] org.apache.ratis:ratis-client:jar:3.1.0:compile -[WARNING] org.mockito:mockito-junit-jupiter:jar:4.11.0:test -[WARNING] org.apache.ozone:hdds-common:jar:1.5.0-SNAPSHOT:compile -[WARNING] org.apache.ratis:ratis-proto:jar:3.1.0:compile -[WARNING] org.apache.ozone:hdds-interface-admin:jar:1.5.0-SNAPSHOT:compile -[WARNING] org.apache.ratis:ratis-thirdparty-misc:jar:1.0.6:compile +[WARNING] com.amazonaws:aws-java-sdk-kms:jar:1.12.661:compile [WARNING] ch.qos.reload4j:reload4j:jar:1.2.25:compile -[WARNING] org.apache.ozone:hdds-managed-rocksdb:jar:1.5.0-SNAPSHOT:compile [WARNING] org.assertj:assertj-core:jar:3.26.3:test -[WARNING] org.apache.ozone:hdds-client:jar:1.5.0-SNAPSHOT:compile -[WARNING] org.apache.httpcomponents:httpcore:jar:4.4.16:compile -[WARNING] org.apache.ozone:ozone-filesystem-common:jar:1.5.0-SNAPSHOT:compile -[WARNING] org.apache.ozone:ozone-interface-storage:jar:1.5.0-SNAPSHOT:compile -[WARNING] org.apache.ozone:hdds-interface-client:jar:1.5.0-SNAPSHOT:compile -[WARNING] com.fasterxml.jackson.core:jackson-core:jar:2.16.2:compile -[WARNING] org.apache.httpcomponents:httpclient:jar:4.5.14:compile [WARNING] org.apache.hadoop:hadoop-common:jar:3.3.6:compile [WARNING] org.apache.hadoop:hadoop-hdfs:jar:3.3.6:compile [WARNING] org.junit.jupiter:junit-jupiter-api:jar:5.10.3:test -[WARNING] commons-io:commons-io:jar:2.16.1:compile -[WARNING] org.apache.ozone:hdds-config:jar:1.5.0-SNAPSHOT:compile -[WARNING] com.fasterxml.jackson.datatype:jackson-datatype-jsr310:jar:2.16.2:compile -[WARNING] io.opentracing:opentracing-api:jar:0.33.0:compile -[WARNING] org.slf4j:slf4j-api:jar:2.0.13:compile -[WARNING] com.fasterxml.jackson.core:jackson-annotations:jar:2.16.2:compile +[WARNING] org.mockito:mockito-junit-jupiter:jar:4.11.0:test +[WARNING] org.junit.jupiter:junit-jupiter-params:jar:5.10.3:test +[WARNING] org.apache.hadoop:hadoop-hdfs-client:jar:3.3.6:compile ... [INFO] --- maven-dependency-plugin:3.7.1:analyze-only (default-cli) @ ozone-s3gateway --- [WARNING] Used undeclared dependencies found: -[WARNING] org.eclipse.jetty:jetty-servlet:jar:9.4.55.v20240627:compile -[WARNING] io.opentracing:opentracing-noop:jar:0.33.0:compile -[WARNING] info.picocli:picocli:jar:4.7.6:compile -[WARNING] org.apache.ratis:ratis-common:jar:3.1.0:compile -[WARNING] com.fasterxml.jackson.core:jackson-databind:jar:2.16.2:compile -[WARNING] org.junit.jupiter:junit-jupiter-params:jar:5.10.3:test -[WARNING] jakarta.annotation:jakarta.annotation-api:jar:2.1.1:compile [WARNING] org.mockito:mockito-core:jar:4.11.0:test -[WARNING] org.apache.ozone:ozone-interface-client:jar:1.5.0-SNAPSHOT:compile -[WARNING] com.google.guava:guava:jar:32.1.3-jre:compile -[WARNING] io.opentracing:opentracing-util:jar:0.33.0:compile -[WARNING] commons-codec:commons-codec:jar:1.17.0:compile -[WARNING] org.apache.ozone:hdds-common:jar:1.5.0-SNAPSHOT:compile -[WARNING] org.mockito:mockito-junit-jupiter:jar:4.11.0:test -[WARNING] jakarta.ws.rs:jakarta.ws.rs-api:jar:2.1.6:compile -[WARNING] org.glassfish.jersey.core:jersey-server:jar:2.43:compile -[WARNING] org.apache.kerby:kerby-util:jar:1.0.1:compile -[WARNING] javax.annotation:javax.annotation-api:jar:1.3.2:compile -[WARNING] org.eclipse.jetty:jetty-webapp:jar:9.4.55.v20240627:compile -[WARNING] javax.servlet:javax.servlet-api:jar:3.1.0:compile [WARNING] org.assertj:assertj-core:jar:3.26.3:test -[WARNING] org.apache.ozone:hdds-client:jar:1.5.0-SNAPSHOT:compile -[WARNING] org.apache.httpcomponents:httpcore:jar:4.4.16:compile -[WARNING] org.apache.ozone:hdds-interface-client:jar:1.5.0-SNAPSHOT:compile -[WARNING] org.glassfish.jersey.core:jersey-common:jar:2.43:compile -[WARNING] org.apache.httpcomponents:httpclient:jar:4.5.14:compile [WARNING] org.apache.hadoop:hadoop-auth:jar:3.3.6:compile [WARNING] org.apache.hadoop:hadoop-common:jar:3.3.6:compile [WARNING] org.junit.jupiter:junit-jupiter-api:jar:5.10.3:test -[WARNING] commons-io:commons-io:jar:2.16.1:compile -[WARNING] org.apache.ozone:hdds-config:jar:1.5.0-SNAPSHOT:compile -[WARNING] io.opentracing:opentracing-api:jar:0.33.0:compile -[WARNING] org.slf4j:slf4j-api:jar:2.0.13:compile +[WARNING] org.mockito:mockito-junit-jupiter:jar:4.11.0:test +[WARNING] org.junit.jupiter:junit-jupiter-params:jar:5.10.3:test +[WARNING] org.apache.ozone:hdds-interface-client:jar:1.5.0-SNAPSHOT:compile ... [INFO] --- maven-dependency-plugin:3.7.1:analyze-only (default-cli) @ ozone-csi --- -[WARNING] Used undeclared dependencies found: -[WARNING] io.grpc:grpc-api:jar:1.58.0:compile -[WARNING] info.picocli:picocli:jar:4.7.6:compile -[WARNING] io.netty:netty-transport:jar:4.1.109.Final:compile -[WARNING] io.netty:netty-transport-classes-epoll:jar:4.1.109.Final:compile -[WARNING] org.apache.ozone:ozone-common:jar:1.5.0-SNAPSHOT:compile -[WARNING] org.apache.ozone:hdds-common:jar:1.5.0-SNAPSHOT:compile -[WARNING] commons-io:commons-io:jar:2.16.1:compile -[WARNING] org.slf4j:slf4j-api:jar:2.0.13:compile ... [INFO] --- maven-dependency-plugin:3.7.1:analyze-only (default-cli) @ ozone-insight --- [WARNING] Used undeclared dependencies found: -[WARNING] org.apache.ozone:hdds-container-service:jar:1.5.0-SNAPSHOT:compile -[WARNING] org.apache.ozone:ozone-interface-client:jar:1.5.0-SNAPSHOT:compile -[WARNING] org.apache.httpcomponents:httpclient:jar:4.5.14:compile -[WARNING] info.picocli:picocli:jar:4.7.6:compile [WARNING] org.apache.ozone:hdds-interface-server:jar:1.5.0-SNAPSHOT:compile [WARNING] org.assertj:assertj-core:jar:3.26.3:test -[WARNING] org.apache.httpcomponents:httpcore:jar:4.4.16:compile [WARNING] org.junit.jupiter:junit-jupiter-api:jar:5.10.3:test -[WARNING] org.apache.ozone:hdds-common:jar:1.5.0-SNAPSHOT:compile -[WARNING] org.apache.ozone:hdds-config:jar:1.5.0-SNAPSHOT:compile -[WARNING] org.apache.ozone:hdds-interface-client:jar:1.5.0-SNAPSHOT:compile -[WARNING] org.apache.ozone:hdds-interface-admin:jar:1.5.0-SNAPSHOT:compile ... [INFO] --- maven-dependency-plugin:3.7.1:analyze-only (default-cli) @ ozone-httpfsgateway --- [WARNING] Used undeclared dependencies found: -[WARNING] org.apache.commons:commons-lang3:jar:3.14.0:compile -[WARNING] com.google.guava:guava:jar:32.1.3-jre:compile [WARNING] org.apache.hadoop:hadoop-common:jar:3.3.6:compile [WARNING] org.apache.hadoop:hadoop-auth:jar:3.3.6:compile -[WARNING] com.fasterxml.jackson.core:jackson-databind:jar:2.16.2:compile -[WARNING] org.apache.ozone:hdds-common:jar:1.5.0-SNAPSHOT:compile -[WARNING] org.apache.ozone:hdds-config:jar:1.5.0-SNAPSHOT:compile -[WARNING] jakarta.ws.rs:jakarta.ws.rs-api:jar:2.1.6:compile -[WARNING] org.glassfish.jersey.core:jersey-server:jar:2.43:compile ... (s3-secret-store) [WARNING] org.mockito:mockito-core:jar:4.11.0:test [WARNING] org.junit.jupiter:junit-jupiter-api:jar:5.10.3:test [WARNING] org.apache.hadoop:hadoop-common:jar:3.3.6:compile -[WARNING] jakarta.annotation:jakarta.annotation-api:jar:2.1.1:compile -[WARNING] org.slf4j:slf4j-api:jar:2.0.13:compile ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
