Hi Bhavani, Yes it worked for me after moving repositories to parent pom. Thanks
Regards, Gurudatt On Monday, October 21, 2019, Bhavani Sudha <[email protected]> wrote: > Hi Gurudatt, > > I was able to reproduce this with maven 3.6.2. Moving the confluent > repository from hudi-utilities pom to parent pom helped unblock this > issue. Can you check if that works for you? > > Thanks, > Sudha > > On Sat, Oct 19, 2019 at 11:50 AM Vinoth Chandar <[email protected]> wrote: > >> Not sure why the maven version would matter. FWIW I am on 3.6.1 and I can >> build >> >> [incubator-hudi]$ mvn -version >> Apache Maven 3.6.1 >> >> >> >> >> On Fri, Oct 18, 2019 at 11:43 AM Gurudatt Kulkarni <[email protected]> >> wrote: >> >> > Hi Balaji, >> > >> > I think I figured out why it was failing for me. I was on the latest >> maven >> > version(3.6.2). I built it using the 3.5 version that you are using and >> it >> > worked. >> > >> > I forked and built it on Circle CI, to reproduce the behavior >> > Build on 3.5.2 ( >> > >> > >> https://circleci.com/gh/Guru107/incubator-hudi/2?utm_campaign=vcs-integration-link&utm_medium=referral&utm_source=github-build-link >> > ) >> > >> > Built on 3.6.2 ( >> > >> > >> https://circleci.com/gh/Guru107/incubator-hudi/3?utm_campaign=vcs-integration-link&utm_medium=referral&utm_source=github-build-link >> > ) >> > >> > Regards, >> > Gurudatt >> > >> > On Fri, Oct 18, 2019 at 8:22 PM [email protected] <[email protected]> >> > wrote: >> > >> > > I just tried deleting confluent jars from my .m2 repo and reran "mvn >> > > clean package -DskipTests". I am able to download it without problem >> (See >> > > logs below) >> > > My mvn version is : Apache Maven 3.5.4 >> > > (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T11:33:14-07:00) >> > > Try manually curling the url (see logs below) within docker to see if >> > this >> > > is some network issue. >> > > Balaji.V >> > > >> > > [INFO] -------------------< org.apache.hudi:hudi-utilities >> > > >------------------- >> > > >> > > [INFO] Building hudi-utilities 0.5.0-incubating-rc6 >> > > [8/27] >> > > >> > > [INFO] --------------------------------[ jar >> > > ]--------------------------------- >> > > >> > > Downloading from confluent: >> > > >> > >> https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.pom >> > > >> > > Downloaded from confluent: >> > > >> > >> https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.pom >> > > (2.4 kB at 7.4 kB/s) >> > > >> > > Downloading from confluent: >> > > >> > >> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-parent/3.0.0/kafka-schema-registry-parent-3.0.0.pom >> > > >> > > Downloaded from confluent: >> > > >> > >> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-parent/3.0.0/kafka-schema-registry-parent-3.0.0.pom >> > > (5.9 kB at 196 kB/s) >> > > >> > > Downloading from confluent: >> > > >> > >> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.pom >> > > >> > > Downloaded from confluent: >> > > >> > >> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.pom >> > > (1.6 kB at 86 kB/s) >> > > >> > > Downloading from confluent: >> > > >> > >> https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.pom >> > > >> > > Downloaded from confluent: >> > > >> > >> https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.pom >> > > (1.6 kB at 9.1 kB/s) >> > > >> > > Downloading from confluent: >> > > >> > >> https://packages.confluent.io/maven/io/confluent/common/3.0.0/common-3.0.0.pom >> > > >> > > Downloaded from confluent: >> > > >> > >> https://packages.confluent.io/maven/io/confluent/common/3.0.0/common-3.0.0.pom >> > > (4.8 kB at 21 kB/s) >> > > >> > > Downloading from confluent: >> > > >> > >> https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.pom >> > > >> > > Downloaded from confluent: >> > > >> > >> https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.pom >> > > (2.1 kB at 8.4 kB/s) >> > > >> > > Downloading from confluent: >> > > >> > >> https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.jar >> > > >> > > Downloading from confluent: >> > > >> > >> https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.jar >> > > >> > > Downloading from confluent: >> > > >> > >> https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.jar >> > > >> > > Downloading from confluent: >> > > >> > >> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.jar >> > > >> > > Downloaded from confluent: >> > > >> > >> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.jar >> > > (36 kB at 426 kB/s) >> > > >> > > Downloaded from confluent: >> > > >> > >> https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.jar >> > > (18 kB at 78 kB/s) >> > > >> > > Downloaded from confluent: >> > > >> > >> https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.jar >> > > (24 kB at 100 kB/s) >> > > >> > > Downloaded from confluent: >> > > >> > >> https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.jar >> > > (19 kB at 51 kB/s) >> > > On Friday, October 18, 2019, 06:17:45 AM PDT, Gurudatt Kulkarni < >> > > [email protected]> wrote: >> > > >> > > Hi Balaji / Pratyaksh, >> > > >> > > I just pulled maven:3.6.2-jdk-8 docker image and cloned the repo in it >> > and >> > > ran `mvn clean install -DskipTests -DskipITs` but it has the same >> issue. >> > > >> > > >> > > On Fri, Oct 18, 2019 at 4:36 PM Pratyaksh Sharma < >> [email protected]> >> > > wrote: >> > > >> > > > Hi Balaji, >> > > > >> > > > I do not have custom settings.xml file and faced the same problem. I >> > was >> > > > able to fix it by first running the command as mentioned on the page >> > > > <https://hudi.apache.org/quickstart.html> - >> > > > >> > > > mvn clean install -DskipTests -DskipITs >> > > > >> > > > After running this command, you can run the other commands without >> any >> > > > error. >> > > > >> > > > On Fri, Oct 18, 2019 at 4:24 PM [email protected] < >> [email protected] >> > > >> > > > wrote: >> > > > >> > > > > >> > > > > I have seen this happens sometimes if you have a custom >> > > > ~/.m2/settings.xml >> > > > > file. Try removing it and check. >> > > > > Balaji.V On Friday, October 18, 2019, 03:31:09 AM PDT, Gurudatt >> > > > > Kulkarni <[email protected]> wrote: >> > > > > >> > > > > Hi All, >> > > > > >> > > > > I ran `mvn compile` on master, but it fails to build completely >> > because >> > > > it >> > > > > was unable to find Confluent dependencies. I added >> > > > > https://packages.confluent.io/maven2 in repositories in the main >> > > pom.xml >> > > > > and it built successfully. Just curious, how you guys are >> compiling? >> > > Can >> > > > we >> > > > > add confluent maven repository to the main pom.xml file? >> > > > > >> > > > > Here's the error that I got >> > > > > >> > > > > [ERROR] Failed to execute goal >> > > > > org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process >> > > > > (process-resource-bundles) on project hudi-cli: Failed to resolve >> > > > > dependencies for one or more projects in the reactor. Reason: >> > Missing: >> > > > > [ERROR] ---------- >> > > > > [ERROR] 1) io.confluent:kafka-avro-serializer:jar:3.0.0 >> > > > > [ERROR] >> > > > > [ERROR] Try downloading the file manually from the project >> website. >> > > > > [ERROR] >> > > > > [ERROR] Then, install it using the command: >> > > > > [ERROR] mvn install:install-file -DgroupId=io.confluent >> > > > > -DartifactId=kafka-avro-serializer -Dversion=3.0.0 -Dpackaging=jar >> > > > > -Dfile=/path/to/file >> > > > > [ERROR] >> > > > > [ERROR] Alternatively, if you host your own repository you can >> > deploy >> > > > the >> > > > > file there: >> > > > > [ERROR] mvn deploy:deploy-file -DgroupId=io.confluent >> > > > > -DartifactId=kafka-avro-serializer -Dversion=3.0.0 -Dpackaging=jar >> > > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id] >> > > > > [ERROR] >> > > > > [ERROR] Path to dependency: >> > > > > [ERROR] 1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT >> > > > > [ERROR] 2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT >> > > > > [ERROR] 3) io.confluent:kafka-avro-serializer:jar:3.0.0 >> > > > > [ERROR] >> > > > > [ERROR] 2) io.confluent:common-config:jar:3.0.0 >> > > > > [ERROR] >> > > > > [ERROR] Try downloading the file manually from the project >> website. >> > > > > [ERROR] >> > > > > [ERROR] Then, install it using the command: >> > > > > [ERROR] mvn install:install-file -DgroupId=io.confluent >> > > > > -DartifactId=common-config -Dversion=3.0.0 -Dpackaging=jar >> > > > > -Dfile=/path/to/file >> > > > > [ERROR] >> > > > > [ERROR] Alternatively, if you host your own repository you can >> > deploy >> > > > the >> > > > > file there: >> > > > > [ERROR] mvn deploy:deploy-file -DgroupId=io.confluent >> > > > > -DartifactId=common-config -Dversion=3.0.0 -Dpackaging=jar >> > > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id] >> > > > > [ERROR] >> > > > > [ERROR] Path to dependency: >> > > > > [ERROR] 1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT >> > > > > [ERROR] 2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT >> > > > > [ERROR] 3) io.confluent:common-config:jar:3.0.0 >> > > > > [ERROR] >> > > > > [ERROR] 3) io.confluent:kafka-schema-registry-client:jar:3.0.0 >> > > > > [ERROR] >> > > > > [ERROR] Try downloading the file manually from the project >> website. >> > > > > [ERROR] >> > > > > [ERROR] Then, install it using the command: >> > > > > [ERROR] mvn install:install-file -DgroupId=io.confluent >> > > > > -DartifactId=kafka-schema-registry-client -Dversion=3.0.0 >> > > -Dpackaging=jar >> > > > > -Dfile=/path/to/file >> > > > > [ERROR] >> > > > > [ERROR] Alternatively, if you host your own repository you can >> > deploy >> > > > the >> > > > > file there: >> > > > > [ERROR] mvn deploy:deploy-file -DgroupId=io.confluent >> > > > > -DartifactId=kafka-schema-registry-client -Dversion=3.0.0 >> > > -Dpackaging=jar >> > > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id] >> > > > > [ERROR] >> > > > > [ERROR] Path to dependency: >> > > > > [ERROR] 1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT >> > > > > [ERROR] 2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT >> > > > > [ERROR] 3) io.confluent:kafka-schema-registry-client:jar:3.0.0 >> > > > > [ERROR] >> > > > > [ERROR] 4) io.confluent:common-utils:jar:3.0.0 >> > > > > [ERROR] >> > > > > [ERROR] Try downloading the file manually from the project >> website. >> > > > > [ERROR] >> > > > > [ERROR] Then, install it using the command: >> > > > > [ERROR] mvn install:install-file -DgroupId=io.confluent >> > > > > -DartifactId=common-utils -Dversion=3.0.0 -Dpackaging=jar >> > > > > -Dfile=/path/to/file >> > > > > [ERROR] >> > > > > [ERROR] Alternatively, if you host your own repository you can >> > deploy >> > > > the >> > > > > file there: >> > > > > [ERROR] mvn deploy:deploy-file -DgroupId=io.confluent >> > > > > -DartifactId=common-utils -Dversion=3.0.0 -Dpackaging=jar >> > > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id] >> > > > > [ERROR] >> > > > > [ERROR] Path to dependency: >> > > > > [ERROR] 1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT >> > > > > [ERROR] 2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT >> > > > > [ERROR] 3) io.confluent:common-utils:jar:3.0.0 >> > > > > [ERROR] >> > > > > [ERROR] ---------- >> > > > > [ERROR] 4 required artifacts are missing. >> > > > > [ERROR] >> > > > > [ERROR] for artifact: >> > > > > [ERROR] org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT >> > > > > [ERROR] >> > > > > [ERROR] from the specified remote repositories: >> > > > > [ERROR] libs-milestone (https://repo.spring.io/libs-milestone/, >> > > > > releases=true, snapshots=true), >> > > > > [ERROR] libs-release (https://repo.spring.io/libs-release/, >> > > > > releases=true, snapshots=true), >> > > > > [ERROR] Maven Central (https://repo.maven.apache.org/maven2, >> > > > > releases=true, snapshots=false), >> > > > > [ERROR] cloudera-repo-releases ( >> > > > > https://repository.cloudera.com/artifactory/public/, >> releases=true, >> > > > > snapshots=false), >> > > > > [ERROR] apache.snapshots ( https://repository.apache.org/snapshots >> , >> > > > > releases=false, snapshots=true), >> > > > > [ERROR] central (https://repo.maven.apache.org/maven2, >> > releases=true, >> > > > > snapshots=false) >> > > > > [ERROR] >> > > > > [ERROR] -> [Help 1] >> > > > > [ERROR] >> > > > > [ERROR] To see the full stack trace of the errors, re-run Maven >> with >> > > the >> > > > -e >> > > > > switch. >> > > > > [ERROR] Re-run Maven using the -X switch to enable full debug >> > logging. >> > > > > [ERROR] >> > > > > [ERROR] For more information about the errors and possible >> solutions, >> > > > > please read the following articles: >> > > > > [ERROR] [Help 1] >> > > > > >> > > >> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException >> > > > > [ERROR] >> > > > > [ERROR] After correcting the problems, you can resume the build >> with >> > > the >> > > > > command >> > > > > [ERROR] mvn <args> -rf :hudi-cli >> > > > > >> > > > >> > > >> > >> >
