Hi Gurudatt, I was able to reproduce this with maven 3.6.2. Moving the confluent repository from hudi-utilities pom to parent pom helped unblock this issue. Can you check if that works for you?
Thanks, Sudha On Sat, Oct 19, 2019 at 11:50 AM Vinoth Chandar <[email protected]> wrote: > Not sure why the maven version would matter. FWIW I am on 3.6.1 and I can > build > > [incubator-hudi]$ mvn -version > Apache Maven 3.6.1 > > > > > On Fri, Oct 18, 2019 at 11:43 AM Gurudatt Kulkarni <[email protected]> > wrote: > > > Hi Balaji, > > > > I think I figured out why it was failing for me. I was on the latest > maven > > version(3.6.2). I built it using the 3.5 version that you are using and > it > > worked. > > > > I forked and built it on Circle CI, to reproduce the behavior > > Build on 3.5.2 ( > > > > > https://circleci.com/gh/Guru107/incubator-hudi/2?utm_campaign=vcs-integration-link&utm_medium=referral&utm_source=github-build-link > > ) > > > > Built on 3.6.2 ( > > > > > https://circleci.com/gh/Guru107/incubator-hudi/3?utm_campaign=vcs-integration-link&utm_medium=referral&utm_source=github-build-link > > ) > > > > Regards, > > Gurudatt > > > > On Fri, Oct 18, 2019 at 8:22 PM [email protected] <[email protected]> > > wrote: > > > > > I just tried deleting confluent jars from my .m2 repo and reran "mvn > > > clean package -DskipTests". I am able to download it without problem > (See > > > logs below) > > > My mvn version is : Apache Maven 3.5.4 > > > (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T11:33:14-07:00) > > > Try manually curling the url (see logs below) within docker to see if > > this > > > is some network issue. > > > Balaji.V > > > > > > [INFO] -------------------< org.apache.hudi:hudi-utilities > > > >------------------- > > > > > > [INFO] Building hudi-utilities 0.5.0-incubating-rc6 > > > [8/27] > > > > > > [INFO] --------------------------------[ jar > > > ]--------------------------------- > > > > > > Downloading from confluent: > > > > > > https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.pom > > > > > > Downloaded from confluent: > > > > > > https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.pom > > > (2.4 kB at 7.4 kB/s) > > > > > > Downloading from confluent: > > > > > > https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-parent/3.0.0/kafka-schema-registry-parent-3.0.0.pom > > > > > > Downloaded from confluent: > > > > > > https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-parent/3.0.0/kafka-schema-registry-parent-3.0.0.pom > > > (5.9 kB at 196 kB/s) > > > > > > Downloading from confluent: > > > > > > https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.pom > > > > > > Downloaded from confluent: > > > > > > https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.pom > > > (1.6 kB at 86 kB/s) > > > > > > Downloading from confluent: > > > > > > https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.pom > > > > > > Downloaded from confluent: > > > > > > https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.pom > > > (1.6 kB at 9.1 kB/s) > > > > > > Downloading from confluent: > > > > > > https://packages.confluent.io/maven/io/confluent/common/3.0.0/common-3.0.0.pom > > > > > > Downloaded from confluent: > > > > > > https://packages.confluent.io/maven/io/confluent/common/3.0.0/common-3.0.0.pom > > > (4.8 kB at 21 kB/s) > > > > > > Downloading from confluent: > > > > > > https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.pom > > > > > > Downloaded from confluent: > > > > > > https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.pom > > > (2.1 kB at 8.4 kB/s) > > > > > > Downloading from confluent: > > > > > > https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.jar > > > > > > Downloading from confluent: > > > > > > https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.jar > > > > > > Downloading from confluent: > > > > > > https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.jar > > > > > > Downloading from confluent: > > > > > > https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.jar > > > > > > Downloaded from confluent: > > > > > > https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.jar > > > (36 kB at 426 kB/s) > > > > > > Downloaded from confluent: > > > > > > https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.jar > > > (18 kB at 78 kB/s) > > > > > > Downloaded from confluent: > > > > > > https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.jar > > > (24 kB at 100 kB/s) > > > > > > Downloaded from confluent: > > > > > > https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.jar > > > (19 kB at 51 kB/s) > > > On Friday, October 18, 2019, 06:17:45 AM PDT, Gurudatt Kulkarni < > > > [email protected]> wrote: > > > > > > Hi Balaji / Pratyaksh, > > > > > > I just pulled maven:3.6.2-jdk-8 docker image and cloned the repo in it > > and > > > ran `mvn clean install -DskipTests -DskipITs` but it has the same > issue. > > > > > > > > > On Fri, Oct 18, 2019 at 4:36 PM Pratyaksh Sharma < > [email protected]> > > > wrote: > > > > > > > Hi Balaji, > > > > > > > > I do not have custom settings.xml file and faced the same problem. I > > was > > > > able to fix it by first running the command as mentioned on the page > > > > <https://hudi.apache.org/quickstart.html> - > > > > > > > > mvn clean install -DskipTests -DskipITs > > > > > > > > After running this command, you can run the other commands without > any > > > > error. > > > > > > > > On Fri, Oct 18, 2019 at 4:24 PM [email protected] < > [email protected] > > > > > > > wrote: > > > > > > > > > > > > > > I have seen this happens sometimes if you have a custom > > > > ~/.m2/settings.xml > > > > > file. Try removing it and check. > > > > > Balaji.V On Friday, October 18, 2019, 03:31:09 AM PDT, Gurudatt > > > > > Kulkarni <[email protected]> wrote: > > > > > > > > > > Hi All, > > > > > > > > > > I ran `mvn compile` on master, but it fails to build completely > > because > > > > it > > > > > was unable to find Confluent dependencies. I added > > > > > https://packages.confluent.io/maven2 in repositories in the main > > > pom.xml > > > > > and it built successfully. Just curious, how you guys are > compiling? > > > Can > > > > we > > > > > add confluent maven repository to the main pom.xml file? > > > > > > > > > > Here's the error that I got > > > > > > > > > > [ERROR] Failed to execute goal > > > > > org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process > > > > > (process-resource-bundles) on project hudi-cli: Failed to resolve > > > > > dependencies for one or more projects in the reactor. Reason: > > Missing: > > > > > [ERROR] ---------- > > > > > [ERROR] 1) io.confluent:kafka-avro-serializer:jar:3.0.0 > > > > > [ERROR] > > > > > [ERROR] Try downloading the file manually from the project > website. > > > > > [ERROR] > > > > > [ERROR] Then, install it using the command: > > > > > [ERROR] mvn install:install-file -DgroupId=io.confluent > > > > > -DartifactId=kafka-avro-serializer -Dversion=3.0.0 -Dpackaging=jar > > > > > -Dfile=/path/to/file > > > > > [ERROR] > > > > > [ERROR] Alternatively, if you host your own repository you can > > deploy > > > > the > > > > > file there: > > > > > [ERROR] mvn deploy:deploy-file -DgroupId=io.confluent > > > > > -DartifactId=kafka-avro-serializer -Dversion=3.0.0 -Dpackaging=jar > > > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id] > > > > > [ERROR] > > > > > [ERROR] Path to dependency: > > > > > [ERROR] 1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT > > > > > [ERROR] 2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT > > > > > [ERROR] 3) io.confluent:kafka-avro-serializer:jar:3.0.0 > > > > > [ERROR] > > > > > [ERROR] 2) io.confluent:common-config:jar:3.0.0 > > > > > [ERROR] > > > > > [ERROR] Try downloading the file manually from the project > website. > > > > > [ERROR] > > > > > [ERROR] Then, install it using the command: > > > > > [ERROR] mvn install:install-file -DgroupId=io.confluent > > > > > -DartifactId=common-config -Dversion=3.0.0 -Dpackaging=jar > > > > > -Dfile=/path/to/file > > > > > [ERROR] > > > > > [ERROR] Alternatively, if you host your own repository you can > > deploy > > > > the > > > > > file there: > > > > > [ERROR] mvn deploy:deploy-file -DgroupId=io.confluent > > > > > -DartifactId=common-config -Dversion=3.0.0 -Dpackaging=jar > > > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id] > > > > > [ERROR] > > > > > [ERROR] Path to dependency: > > > > > [ERROR] 1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT > > > > > [ERROR] 2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT > > > > > [ERROR] 3) io.confluent:common-config:jar:3.0.0 > > > > > [ERROR] > > > > > [ERROR] 3) io.confluent:kafka-schema-registry-client:jar:3.0.0 > > > > > [ERROR] > > > > > [ERROR] Try downloading the file manually from the project > website. > > > > > [ERROR] > > > > > [ERROR] Then, install it using the command: > > > > > [ERROR] mvn install:install-file -DgroupId=io.confluent > > > > > -DartifactId=kafka-schema-registry-client -Dversion=3.0.0 > > > -Dpackaging=jar > > > > > -Dfile=/path/to/file > > > > > [ERROR] > > > > > [ERROR] Alternatively, if you host your own repository you can > > deploy > > > > the > > > > > file there: > > > > > [ERROR] mvn deploy:deploy-file -DgroupId=io.confluent > > > > > -DartifactId=kafka-schema-registry-client -Dversion=3.0.0 > > > -Dpackaging=jar > > > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id] > > > > > [ERROR] > > > > > [ERROR] Path to dependency: > > > > > [ERROR] 1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT > > > > > [ERROR] 2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT > > > > > [ERROR] 3) io.confluent:kafka-schema-registry-client:jar:3.0.0 > > > > > [ERROR] > > > > > [ERROR] 4) io.confluent:common-utils:jar:3.0.0 > > > > > [ERROR] > > > > > [ERROR] Try downloading the file manually from the project > website. > > > > > [ERROR] > > > > > [ERROR] Then, install it using the command: > > > > > [ERROR] mvn install:install-file -DgroupId=io.confluent > > > > > -DartifactId=common-utils -Dversion=3.0.0 -Dpackaging=jar > > > > > -Dfile=/path/to/file > > > > > [ERROR] > > > > > [ERROR] Alternatively, if you host your own repository you can > > deploy > > > > the > > > > > file there: > > > > > [ERROR] mvn deploy:deploy-file -DgroupId=io.confluent > > > > > -DartifactId=common-utils -Dversion=3.0.0 -Dpackaging=jar > > > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id] > > > > > [ERROR] > > > > > [ERROR] Path to dependency: > > > > > [ERROR] 1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT > > > > > [ERROR] 2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT > > > > > [ERROR] 3) io.confluent:common-utils:jar:3.0.0 > > > > > [ERROR] > > > > > [ERROR] ---------- > > > > > [ERROR] 4 required artifacts are missing. > > > > > [ERROR] > > > > > [ERROR] for artifact: > > > > > [ERROR] org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT > > > > > [ERROR] > > > > > [ERROR] from the specified remote repositories: > > > > > [ERROR] libs-milestone (https://repo.spring.io/libs-milestone/, > > > > > releases=true, snapshots=true), > > > > > [ERROR] libs-release (https://repo.spring.io/libs-release/, > > > > > releases=true, snapshots=true), > > > > > [ERROR] Maven Central (https://repo.maven.apache.org/maven2, > > > > > releases=true, snapshots=false), > > > > > [ERROR] cloudera-repo-releases ( > > > > > https://repository.cloudera.com/artifactory/public/, > releases=true, > > > > > snapshots=false), > > > > > [ERROR] apache.snapshots (https://repository.apache.org/snapshots > , > > > > > releases=false, snapshots=true), > > > > > [ERROR] central (https://repo.maven.apache.org/maven2, > > releases=true, > > > > > snapshots=false) > > > > > [ERROR] > > > > > [ERROR] -> [Help 1] > > > > > [ERROR] > > > > > [ERROR] To see the full stack trace of the errors, re-run Maven > with > > > the > > > > -e > > > > > switch. > > > > > [ERROR] Re-run Maven using the -X switch to enable full debug > > logging. > > > > > [ERROR] > > > > > [ERROR] For more information about the errors and possible > solutions, > > > > > please read the following articles: > > > > > [ERROR] [Help 1] > > > > > > > > > http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException > > > > > [ERROR] > > > > > [ERROR] After correcting the problems, you can resume the build > with > > > the > > > > > command > > > > > [ERROR] mvn <args> -rf :hudi-cli > > > > > > > > > > > > > > >
