Ya sure will do it.
On Monday, October 21, 2019, Bhavani Sudha <[email protected]> wrote: > Great. Thanks for testing that. Can you send a PR with that change ? > > > On Mon, Oct 21, 2019 at 8:51 AM Gurudatt Kulkarni <[email protected]> > wrote: > >> Hi Bhavani, >> >> Yes it worked for me after moving repositories to parent pom. Thanks >> >> Regards, >> Gurudatt >> On Monday, October 21, 2019, Bhavani Sudha <[email protected]> >> wrote: >> > Hi Gurudatt, >> > >> > I was able to reproduce this with maven 3.6.2. Moving the confluent >> > repository from hudi-utilities pom to parent pom helped unblock this >> > issue. Can you check if that works for you? >> > >> > Thanks, >> > Sudha >> > >> > On Sat, Oct 19, 2019 at 11:50 AM Vinoth Chandar <[email protected]> >> wrote: >> > >> >> Not sure why the maven version would matter. FWIW I am on 3.6.1 and I >> can >> >> build >> >> >> >> [incubator-hudi]$ mvn -version >> >> Apache Maven 3.6.1 >> >> >> >> >> >> >> >> >> >> On Fri, Oct 18, 2019 at 11:43 AM Gurudatt Kulkarni < [email protected] >> > >> >> wrote: >> >> >> >> > Hi Balaji, >> >> > >> >> > I think I figured out why it was failing for me. I was on the latest >> >> maven >> >> > version(3.6.2). I built it using the 3.5 version that you are using >> and >> >> it >> >> > worked. >> >> > >> >> > I forked and built it on Circle CI, to reproduce the behavior >> >> > Build on 3.5.2 ( >> >> > >> >> > >> >> >> >> https://circleci.com/gh/Guru107/incubator-hudi/2?utm_campaign=vcs-integration-link&utm_medium=referral&utm_source=github-build-link >> >> > ) >> >> > >> >> > Built on 3.6.2 ( >> >> > >> >> > >> >> >> >> https://circleci.com/gh/Guru107/incubator-hudi/3?utm_campaign=vcs-integration-link&utm_medium=referral&utm_source=github-build-link >> >> > ) >> >> > >> >> > Regards, >> >> > Gurudatt >> >> > >> >> > On Fri, Oct 18, 2019 at 8:22 PM [email protected] < >> [email protected]> >> >> > wrote: >> >> > >> >> > > I just tried deleting confluent jars from my .m2 repo and reran >> "mvn >> >> > > clean package -DskipTests". I am able to download it without problem >> >> (See >> >> > > logs below) >> >> > > My mvn version is : Apache Maven 3.5.4 >> >> > > (1edded0938998edf8bf061f1ceb3cfdeccf443fe; >> 2018-06-17T11:33:14-07:00) >> >> > > Try manually curling the url (see logs below) within docker to see >> if >> >> > this >> >> > > is some network issue. >> >> > > Balaji.V >> >> > > >> >> > > [INFO] -------------------< org.apache.hudi:hudi-utilities >> >> > > >------------------- >> >> > > >> >> > > [INFO] Building hudi-utilities 0.5.0-incubating-rc6 >> >> > > [8/27] >> >> > > >> >> > > [INFO] --------------------------------[ jar >> >> > > ]--------------------------------- >> >> > > >> >> > > Downloading from confluent: >> >> > > >> >> > >> >> >> >> https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.pom >> >> > > >> >> > > Downloaded from confluent: >> >> > > >> >> > >> >> >> >> https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.pom >> >> > > (2.4 kB at 7.4 kB/s) >> >> > > >> >> > > Downloading from confluent: >> >> > > >> >> > >> >> >> >> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-parent/3.0.0/kafka-schema-registry-parent-3.0.0.pom >> >> > > >> >> > > Downloaded from confluent: >> >> > > >> >> > >> >> >> >> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-parent/3.0.0/kafka-schema-registry-parent-3.0.0.pom >> >> > > (5.9 kB at 196 kB/s) >> >> > > >> >> > > Downloading from confluent: >> >> > > >> >> > >> >> >> >> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.pom >> >> > > >> >> > > Downloaded from confluent: >> >> > > >> >> > >> >> >> >> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.pom >> >> > > (1.6 kB at 86 kB/s) >> >> > > >> >> > > Downloading from confluent: >> >> > > >> >> > >> >> >> >> https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.pom >> >> > > >> >> > > Downloaded from confluent: >> >> > > >> >> > >> >> >> >> https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.pom >> >> > > (1.6 kB at 9.1 kB/s) >> >> > > >> >> > > Downloading from confluent: >> >> > > >> >> > >> >> >> >> https://packages.confluent.io/maven/io/confluent/common/3.0.0/common-3.0.0.pom >> >> > > >> >> > > Downloaded from confluent: >> >> > > >> >> > >> >> >> >> https://packages.confluent.io/maven/io/confluent/common/3.0.0/common-3.0.0.pom >> >> > > (4.8 kB at 21 kB/s) >> >> > > >> >> > > Downloading from confluent: >> >> > > >> >> > >> >> >> >> https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.pom >> >> > > >> >> > > Downloaded from confluent: >> >> > > >> >> > >> >> >> >> https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.pom >> >> > > (2.1 kB at 8.4 kB/s) >> >> > > >> >> > > Downloading from confluent: >> >> > > >> >> > >> >> >> >> https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.jar >> >> > > >> >> > > Downloading from confluent: >> >> > > >> >> > >> >> >> >> https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.jar >> >> > > >> >> > > Downloading from confluent: >> >> > > >> >> > >> >> >> >> https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.jar >> >> > > >> >> > > Downloading from confluent: >> >> > > >> >> > >> >> >> >> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.jar >> >> > > >> >> > > Downloaded from confluent: >> >> > > >> >> > >> >> >> >> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.jar >> >> > > (36 kB at 426 kB/s) >> >> > > >> >> > > Downloaded from confluent: >> >> > > >> >> > >> >> >> >> https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.jar >> >> > > (18 kB at 78 kB/s) >> >> > > >> >> > > Downloaded from confluent: >> >> > > >> >> > >> >> >> >> https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.jar >> >> > > (24 kB at 100 kB/s) >> >> > > >> >> > > Downloaded from confluent: >> >> > > >> >> > >> >> >> >> https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.jar >> >> > > (19 kB at 51 kB/s) >> >> > > On Friday, October 18, 2019, 06:17:45 AM PDT, Gurudatt Kulkarni >> < >> >> > > [email protected]> wrote: >> >> > > >> >> > > Hi Balaji / Pratyaksh, >> >> > > >> >> > > I just pulled maven:3.6.2-jdk-8 docker image and cloned the repo in >> it >> >> > and >> >> > > ran `mvn clean install -DskipTests -DskipITs` but it has the same >> >> issue. >> >> > > >> >> > > >> >> > > On Fri, Oct 18, 2019 at 4:36 PM Pratyaksh Sharma < >> >> [email protected]> >> >> > > wrote: >> >> > > >> >> > > > Hi Balaji, >> >> > > > >> >> > > > I do not have custom settings.xml file and faced the same problem. >> I >> >> > was >> >> > > > able to fix it by first running the command as mentioned on the >> page >> >> > > > <https://hudi.apache.org/quickstart.html> - >> >> > > > >> >> > > > mvn clean install -DskipTests -DskipITs >> >> > > > >> >> > > > After running this command, you can run the other commands without >> >> any >> >> > > > error. >> >> > > > >> >> > > > On Fri, Oct 18, 2019 at 4:24 PM [email protected] < >> >> [email protected] >> >> > > >> >> > > > wrote: >> >> > > > >> >> > > > > >> >> > > > > I have seen this happens sometimes if you have a custom >> >> > > > ~/.m2/settings.xml >> >> > > > > file. Try removing it and check. >> >> > > > > Balaji.V On Friday, October 18, 2019, 03:31:09 AM PDT, >> Gurudatt >> >> > > > > Kulkarni <[email protected]> wrote: >> >> > > > > >> >> > > > > Hi All, >> >> > > > > >> >> > > > > I ran `mvn compile` on master, but it fails to build completely >> >> > because >> >> > > > it >> >> > > > > was unable to find Confluent dependencies. I added >> >> > > > > https://packages.confluent.io/maven2 in repositories in the >> main >> >> > > pom.xml >> >> > > > > and it built successfully. Just curious, how you guys are >> >> compiling? >> >> > > Can >> >> > > > we >> >> > > > > add confluent maven repository to the main pom.xml file? >> >> > > > > >> >> > > > > Here's the error that I got >> >> > > > > >> >> > > > > [ERROR] Failed to execute goal >> >> > > > > >> org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process >> >> > > > > (process-resource-bundles) on project hudi-cli: Failed to >> resolve >> >> > > > > dependencies for one or more projects in the reactor. Reason: >> >> > Missing: >> >> > > > > [ERROR] ---------- >> >> > > > > [ERROR] 1) io.confluent:kafka-avro-serializer:jar:3.0.0 >> >> > > > > [ERROR] >> >> > > > > [ERROR] Try downloading the file manually from the project >> >> website. >> >> > > > > [ERROR] >> >> > > > > [ERROR] Then, install it using the command: >> >> > > > > [ERROR] mvn install:install-file -DgroupId=io.confluent >> >> > > > > -DartifactId=kafka-avro-serializer -Dversion=3.0.0 >> -Dpackaging=jar >> >> > > > > -Dfile=/path/to/file >> >> > > > > [ERROR] >> >> > > > > [ERROR] Alternatively, if you host your own repository you can >> >> > deploy >> >> > > > the >> >> > > > > file there: >> >> > > > > [ERROR] mvn deploy:deploy-file -DgroupId=io.confluent >> >> > > > > -DartifactId=kafka-avro-serializer -Dversion=3.0.0 >> -Dpackaging=jar >> >> > > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id] >> >> > > > > [ERROR] >> >> > > > > [ERROR] Path to dependency: >> >> > > > > [ERROR] 1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT >> >> > > > > [ERROR] 2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT >> >> > > > > [ERROR] 3) io.confluent:kafka-avro-serializer:jar:3.0.0 >> >> > > > > [ERROR] >> >> > > > > [ERROR] 2) io.confluent:common-config:jar:3.0.0 >> >> > > > > [ERROR] >> >> > > > > [ERROR] Try downloading the file manually from the project >> >> website. >> >> > > > > [ERROR] >> >> > > > > [ERROR] Then, install it using the command: >> >> > > > > [ERROR] mvn install:install-file -DgroupId=io.confluent >> >> > > > > -DartifactId=common-config -Dversion=3.0.0 -Dpackaging=jar >> >> > > > > -Dfile=/path/to/file >> >> > > > > [ERROR] >> >> > > > > [ERROR] Alternatively, if you host your own repository you can >> >> > deploy >> >> > > > the >> >> > > > > file there: >> >> > > > > [ERROR] mvn deploy:deploy-file -DgroupId=io.confluent >> >> > > > > -DartifactId=common-config -Dversion=3.0.0 -Dpackaging=jar >> >> > > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id] >> >> > > > > [ERROR] >> >> > > > > [ERROR] Path to dependency: >> >> > > > > [ERROR] 1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT >> >> > > > > [ERROR] 2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT >> >> > > > > [ERROR] 3) io.confluent:common-config:jar:3.0.0 >> >> > > > > [ERROR] >> >> > > > > [ERROR] 3) io.confluent:kafka-schema-registry-client:jar:3.0.0 >> >> > > > > [ERROR] >> >> > > > > [ERROR] Try downloading the file manually from the project >> >> website. >> >> > > > > [ERROR] >> >> > > > > [ERROR] Then, install it using the command: >> >> > > > > [ERROR] mvn install:install-file -DgroupId=io.confluent >> >> > > > > -DartifactId=kafka-schema-registry-client -Dversion=3.0.0 >> >> > > -Dpackaging=jar >> >> > > > > -Dfile=/path/to/file >> >> > > > > [ERROR] >> >> > > > > [ERROR] Alternatively, if you host your own repository you can >> >> > deploy >> >> > > > the >> >> > > > > file there: >> >> > > > > [ERROR] mvn deploy:deploy-file -DgroupId=io.confluent >> >> > > > > -DartifactId=kafka-schema-registry-client -Dversion=3.0.0 >> >> > > -Dpackaging=jar >> >> > > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id] >> >> > > > > [ERROR] >> >> > > > > [ERROR] Path to dependency: >> >> > > > > [ERROR] 1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT >> >> > > > > [ERROR] 2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT >> >> > > > > [ERROR] 3) io.confluent:kafka-schema-registry-client:jar:3.0.0 >> >> > > > > [ERROR] >> >> > > > > [ERROR] 4) io.confluent:common-utils:jar:3.0.0 >> >> > > > > [ERROR] >> >> > > > > [ERROR] Try downloading the file manually from the project >> >> website. >> >> > > > > [ERROR] >> >> > > > > [ERROR] Then, install it using the command: >> >> > > > > [ERROR] mvn install:install-file -DgroupId=io.confluent >> >> > > > > -DartifactId=common-utils -Dversion=3.0.0 -Dpackaging=jar >> >> > > > > -Dfile=/path/to/file >> >> > > > > [ERROR] >> >> > > > > [ERROR] Alternatively, if you host your own repository you can >> >> > deploy >> >> > > > the >> >> > > > > file there: >> >> > > > > [ERROR] mvn deploy:deploy-file -DgroupId=io.confluent >> >> > > > > -DartifactId=common-utils -Dversion=3.0.0 -Dpackaging=jar >> >> > > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id] >> >> > > > > [ERROR] >> >> > > > > [ERROR] Path to dependency: >> >> > > > > [ERROR] 1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT >> >> > > > > [ERROR] 2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT >> >> > > > > [ERROR] 3) io.confluent:common-utils:jar:3.0.0 >> >> > > > > [ERROR] >> >> > > > > [ERROR] ---------- >> >> > > > > [ERROR] 4 required artifacts are missing. >> >> > > > > [ERROR] >> >> > > > > [ERROR] for artifact: >> >> > > > > [ERROR] org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT >> >> > > > > [ERROR] >> >> > > > > [ERROR] from the specified remote repositories: >> >> > > > > [ERROR] libs-milestone ( https://repo.spring.io/libs-milestone/ >> , >> >> > > > > releases=true, snapshots=true), >> >> > > > > [ERROR] libs-release (https://repo.spring.io/libs-release/, >> >> > > > > releases=true, snapshots=true), >> >> > > > > [ERROR] Maven Central (https://repo.maven.apache.org/maven2, >> >> > > > > releases=true, snapshots=false), >> >> > > > > [ERROR] cloudera-repo-releases ( >> >> > > > > https://repository.cloudera.com/artifactory/public/, >> >> releases=true, >> >> > > > > snapshots=false), >> >> > > > > [ERROR] apache.snapshots ( >> https://repository.apache.org/snapshots >> >> , >> >> > > > > releases=false, snapshots=true), >> >> > > > > [ERROR] central (https://repo.maven.apache.org/maven2, >> >> > releases=true, >> >> > > > > snapshots=false) >> >> > > > > [ERROR] >> >> > > > > [ERROR] -> [Help 1] >> >> > > > > [ERROR] >> >> > > > > [ERROR] To see the full stack trace of the errors, re-run Maven >> >> with >> >> > > the >> >> > > > -e >> >> > > > > switch. >> >> > > > > [ERROR] Re-run Maven using the -X switch to enable full debug >> >> > logging. >> >> > > > > [ERROR] >> >> > > > > [ERROR] For more information about the errors and possible >> >> solutions, >> >> > > > > please read the following articles: >> >> > > > > [ERROR] [Help 1] >> >> > > > > >> >> > > >> >> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException >> >> > > > > [ERROR] >> >> > > > > [ERROR] After correcting the problems, you can resume the build >> >> with >> >> > > the >> >> > > > > command >> >> > > > > [ERROR] mvn <args> -rf :hudi-cli >> >> > > > > >> >> > > > >> >> > > >> >> > >> >> >> > >> >
