I just tried deleting confluent jars from my .m2 repo and reran "mvn clean package -DskipTests". I am able to download it without problem (See logs below) My mvn version is : Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T11:33:14-07:00) Try manually curling the url (see logs below) within docker to see if this is some network issue. Balaji.V
[INFO] -------------------< org.apache.hudi:hudi-utilities >------------------- [INFO] Building hudi-utilities 0.5.0-incubating-rc6 [8/27] [INFO] --------------------------------[ jar ]--------------------------------- Downloading from confluent: https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.pom Downloaded from confluent: https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.pom (2.4 kB at 7.4 kB/s) Downloading from confluent: https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-parent/3.0.0/kafka-schema-registry-parent-3.0.0.pom Downloaded from confluent: https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-parent/3.0.0/kafka-schema-registry-parent-3.0.0.pom (5.9 kB at 196 kB/s) Downloading from confluent: https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.pom Downloaded from confluent: https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.pom (1.6 kB at 86 kB/s) Downloading from confluent: https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.pom Downloaded from confluent: https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.pom (1.6 kB at 9.1 kB/s) Downloading from confluent: https://packages.confluent.io/maven/io/confluent/common/3.0.0/common-3.0.0.pom Downloaded from confluent: https://packages.confluent.io/maven/io/confluent/common/3.0.0/common-3.0.0.pom (4.8 kB at 21 kB/s) Downloading from confluent: https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.pom Downloaded from confluent: https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.pom (2.1 kB at 8.4 kB/s) Downloading from confluent: https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.jar Downloading from confluent: https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.jar Downloading from confluent: https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.jar Downloading from confluent: https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.jar Downloaded from confluent: https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.jar (36 kB at 426 kB/s) Downloaded from confluent: https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.jar (18 kB at 78 kB/s) Downloaded from confluent: https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.jar (24 kB at 100 kB/s) Downloaded from confluent: https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.jar (19 kB at 51 kB/s) On Friday, October 18, 2019, 06:17:45 AM PDT, Gurudatt Kulkarni <[email protected]> wrote: Hi Balaji / Pratyaksh, I just pulled maven:3.6.2-jdk-8 docker image and cloned the repo in it and ran `mvn clean install -DskipTests -DskipITs` but it has the same issue. On Fri, Oct 18, 2019 at 4:36 PM Pratyaksh Sharma <[email protected]> wrote: > Hi Balaji, > > I do not have custom settings.xml file and faced the same problem. I was > able to fix it by first running the command as mentioned on the page > <https://hudi.apache.org/quickstart.html> - > > mvn clean install -DskipTests -DskipITs > > After running this command, you can run the other commands without any > error. > > On Fri, Oct 18, 2019 at 4:24 PM [email protected] <[email protected]> > wrote: > > > > > I have seen this happens sometimes if you have a custom > ~/.m2/settings.xml > > file. Try removing it and check. > > Balaji.V On Friday, October 18, 2019, 03:31:09 AM PDT, Gurudatt > > Kulkarni <[email protected]> wrote: > > > > Hi All, > > > > I ran `mvn compile` on master, but it fails to build completely because > it > > was unable to find Confluent dependencies. I added > > https://packages.confluent.io/maven2 in repositories in the main pom.xml > > and it built successfully. Just curious, how you guys are compiling? Can > we > > add confluent maven repository to the main pom.xml file? > > > > Here's the error that I got > > > > [ERROR] Failed to execute goal > > org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process > > (process-resource-bundles) on project hudi-cli: Failed to resolve > > dependencies for one or more projects in the reactor. Reason: Missing: > > [ERROR] ---------- > > [ERROR] 1) io.confluent:kafka-avro-serializer:jar:3.0.0 > > [ERROR] > > [ERROR] Try downloading the file manually from the project website. > > [ERROR] > > [ERROR] Then, install it using the command: > > [ERROR] mvn install:install-file -DgroupId=io.confluent > > -DartifactId=kafka-avro-serializer -Dversion=3.0.0 -Dpackaging=jar > > -Dfile=/path/to/file > > [ERROR] > > [ERROR] Alternatively, if you host your own repository you can deploy > the > > file there: > > [ERROR] mvn deploy:deploy-file -DgroupId=io.confluent > > -DartifactId=kafka-avro-serializer -Dversion=3.0.0 -Dpackaging=jar > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id] > > [ERROR] > > [ERROR] Path to dependency: > > [ERROR] 1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT > > [ERROR] 2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT > > [ERROR] 3) io.confluent:kafka-avro-serializer:jar:3.0.0 > > [ERROR] > > [ERROR] 2) io.confluent:common-config:jar:3.0.0 > > [ERROR] > > [ERROR] Try downloading the file manually from the project website. > > [ERROR] > > [ERROR] Then, install it using the command: > > [ERROR] mvn install:install-file -DgroupId=io.confluent > > -DartifactId=common-config -Dversion=3.0.0 -Dpackaging=jar > > -Dfile=/path/to/file > > [ERROR] > > [ERROR] Alternatively, if you host your own repository you can deploy > the > > file there: > > [ERROR] mvn deploy:deploy-file -DgroupId=io.confluent > > -DartifactId=common-config -Dversion=3.0.0 -Dpackaging=jar > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id] > > [ERROR] > > [ERROR] Path to dependency: > > [ERROR] 1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT > > [ERROR] 2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT > > [ERROR] 3) io.confluent:common-config:jar:3.0.0 > > [ERROR] > > [ERROR] 3) io.confluent:kafka-schema-registry-client:jar:3.0.0 > > [ERROR] > > [ERROR] Try downloading the file manually from the project website. > > [ERROR] > > [ERROR] Then, install it using the command: > > [ERROR] mvn install:install-file -DgroupId=io.confluent > > -DartifactId=kafka-schema-registry-client -Dversion=3.0.0 -Dpackaging=jar > > -Dfile=/path/to/file > > [ERROR] > > [ERROR] Alternatively, if you host your own repository you can deploy > the > > file there: > > [ERROR] mvn deploy:deploy-file -DgroupId=io.confluent > > -DartifactId=kafka-schema-registry-client -Dversion=3.0.0 -Dpackaging=jar > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id] > > [ERROR] > > [ERROR] Path to dependency: > > [ERROR] 1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT > > [ERROR] 2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT > > [ERROR] 3) io.confluent:kafka-schema-registry-client:jar:3.0.0 > > [ERROR] > > [ERROR] 4) io.confluent:common-utils:jar:3.0.0 > > [ERROR] > > [ERROR] Try downloading the file manually from the project website. > > [ERROR] > > [ERROR] Then, install it using the command: > > [ERROR] mvn install:install-file -DgroupId=io.confluent > > -DartifactId=common-utils -Dversion=3.0.0 -Dpackaging=jar > > -Dfile=/path/to/file > > [ERROR] > > [ERROR] Alternatively, if you host your own repository you can deploy > the > > file there: > > [ERROR] mvn deploy:deploy-file -DgroupId=io.confluent > > -DartifactId=common-utils -Dversion=3.0.0 -Dpackaging=jar > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id] > > [ERROR] > > [ERROR] Path to dependency: > > [ERROR] 1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT > > [ERROR] 2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT > > [ERROR] 3) io.confluent:common-utils:jar:3.0.0 > > [ERROR] > > [ERROR] ---------- > > [ERROR] 4 required artifacts are missing. > > [ERROR] > > [ERROR] for artifact: > > [ERROR] org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT > > [ERROR] > > [ERROR] from the specified remote repositories: > > [ERROR] libs-milestone (https://repo.spring.io/libs-milestone/, > > releases=true, snapshots=true), > > [ERROR] libs-release (https://repo.spring.io/libs-release/, > > releases=true, snapshots=true), > > [ERROR] Maven Central (https://repo.maven.apache.org/maven2, > > releases=true, snapshots=false), > > [ERROR] cloudera-repo-releases ( > > https://repository.cloudera.com/artifactory/public/, releases=true, > > snapshots=false), > > [ERROR] apache.snapshots (https://repository.apache.org/snapshots, > > releases=false, snapshots=true), > > [ERROR] central (https://repo.maven.apache.org/maven2, releases=true, > > snapshots=false) > > [ERROR] > > [ERROR] -> [Help 1] > > [ERROR] > > [ERROR] To see the full stack trace of the errors, re-run Maven with the > -e > > switch. > > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > > [ERROR] > > [ERROR] For more information about the errors and possible solutions, > > please read the following articles: > > [ERROR] [Help 1] > > http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException > > [ERROR] > > [ERROR] After correcting the problems, you can resume the build with the > > command > > [ERROR] mvn <args> -rf :hudi-cli > > >
