Great. Thanks for testing that. Can you send a PR with that change ?
On Mon, Oct 21, 2019 at 8:51 AM Gurudatt Kulkarni <[email protected]> wrote: > Hi Bhavani, > > Yes it worked for me after moving repositories to parent pom. Thanks > > Regards, > Gurudatt > On Monday, October 21, 2019, Bhavani Sudha <[email protected]> > wrote: > > Hi Gurudatt, > > > > I was able to reproduce this with maven 3.6.2. Moving the confluent > > repository from hudi-utilities pom to parent pom helped unblock this > > issue. Can you check if that works for you? > > > > Thanks, > > Sudha > > > > On Sat, Oct 19, 2019 at 11:50 AM Vinoth Chandar <[email protected]> > wrote: > > > >> Not sure why the maven version would matter. FWIW I am on 3.6.1 and I > can > >> build > >> > >> [incubator-hudi]$ mvn -version > >> Apache Maven 3.6.1 > >> > >> > >> > >> > >> On Fri, Oct 18, 2019 at 11:43 AM Gurudatt Kulkarni <[email protected] > > > >> wrote: > >> > >> > Hi Balaji, > >> > > >> > I think I figured out why it was failing for me. I was on the latest > >> maven > >> > version(3.6.2). I built it using the 3.5 version that you are using > and > >> it > >> > worked. > >> > > >> > I forked and built it on Circle CI, to reproduce the behavior > >> > Build on 3.5.2 ( > >> > > >> > > >> > > https://circleci.com/gh/Guru107/incubator-hudi/2?utm_campaign=vcs-integration-link&utm_medium=referral&utm_source=github-build-link > >> > ) > >> > > >> > Built on 3.6.2 ( > >> > > >> > > >> > > https://circleci.com/gh/Guru107/incubator-hudi/3?utm_campaign=vcs-integration-link&utm_medium=referral&utm_source=github-build-link > >> > ) > >> > > >> > Regards, > >> > Gurudatt > >> > > >> > On Fri, Oct 18, 2019 at 8:22 PM [email protected] < > [email protected]> > >> > wrote: > >> > > >> > > I just tried deleting confluent jars from my .m2 repo and reran > "mvn > >> > > clean package -DskipTests". I am able to download it without problem > >> (See > >> > > logs below) > >> > > My mvn version is : Apache Maven 3.5.4 > >> > > (1edded0938998edf8bf061f1ceb3cfdeccf443fe; > 2018-06-17T11:33:14-07:00) > >> > > Try manually curling the url (see logs below) within docker to see > if > >> > this > >> > > is some network issue. > >> > > Balaji.V > >> > > > >> > > [INFO] -------------------< org.apache.hudi:hudi-utilities > >> > > >------------------- > >> > > > >> > > [INFO] Building hudi-utilities 0.5.0-incubating-rc6 > >> > > [8/27] > >> > > > >> > > [INFO] --------------------------------[ jar > >> > > ]--------------------------------- > >> > > > >> > > Downloading from confluent: > >> > > > >> > > >> > > https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.pom > >> > > > >> > > Downloaded from confluent: > >> > > > >> > > >> > > https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.pom > >> > > (2.4 kB at 7.4 kB/s) > >> > > > >> > > Downloading from confluent: > >> > > > >> > > >> > > https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-parent/3.0.0/kafka-schema-registry-parent-3.0.0.pom > >> > > > >> > > Downloaded from confluent: > >> > > > >> > > >> > > https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-parent/3.0.0/kafka-schema-registry-parent-3.0.0.pom > >> > > (5.9 kB at 196 kB/s) > >> > > > >> > > Downloading from confluent: > >> > > > >> > > >> > > https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.pom > >> > > > >> > > Downloaded from confluent: > >> > > > >> > > >> > > https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.pom > >> > > (1.6 kB at 86 kB/s) > >> > > > >> > > Downloading from confluent: > >> > > > >> > > >> > > https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.pom > >> > > > >> > > Downloaded from confluent: > >> > > > >> > > >> > > https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.pom > >> > > (1.6 kB at 9.1 kB/s) > >> > > > >> > > Downloading from confluent: > >> > > > >> > > >> > > https://packages.confluent.io/maven/io/confluent/common/3.0.0/common-3.0.0.pom > >> > > > >> > > Downloaded from confluent: > >> > > > >> > > >> > > https://packages.confluent.io/maven/io/confluent/common/3.0.0/common-3.0.0.pom > >> > > (4.8 kB at 21 kB/s) > >> > > > >> > > Downloading from confluent: > >> > > > >> > > >> > > https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.pom > >> > > > >> > > Downloaded from confluent: > >> > > > >> > > >> > > https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.pom > >> > > (2.1 kB at 8.4 kB/s) > >> > > > >> > > Downloading from confluent: > >> > > > >> > > >> > > https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.jar > >> > > > >> > > Downloading from confluent: > >> > > > >> > > >> > > https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.jar > >> > > > >> > > Downloading from confluent: > >> > > > >> > > >> > > https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.jar > >> > > > >> > > Downloading from confluent: > >> > > > >> > > >> > > https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.jar > >> > > > >> > > Downloaded from confluent: > >> > > > >> > > >> > > https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.jar > >> > > (36 kB at 426 kB/s) > >> > > > >> > > Downloaded from confluent: > >> > > > >> > > >> > > https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.jar > >> > > (18 kB at 78 kB/s) > >> > > > >> > > Downloaded from confluent: > >> > > > >> > > >> > > https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.jar > >> > > (24 kB at 100 kB/s) > >> > > > >> > > Downloaded from confluent: > >> > > > >> > > >> > > https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.jar > >> > > (19 kB at 51 kB/s) > >> > > On Friday, October 18, 2019, 06:17:45 AM PDT, Gurudatt Kulkarni > < > >> > > [email protected]> wrote: > >> > > > >> > > Hi Balaji / Pratyaksh, > >> > > > >> > > I just pulled maven:3.6.2-jdk-8 docker image and cloned the repo in > it > >> > and > >> > > ran `mvn clean install -DskipTests -DskipITs` but it has the same > >> issue. > >> > > > >> > > > >> > > On Fri, Oct 18, 2019 at 4:36 PM Pratyaksh Sharma < > >> [email protected]> > >> > > wrote: > >> > > > >> > > > Hi Balaji, > >> > > > > >> > > > I do not have custom settings.xml file and faced the same problem. > I > >> > was > >> > > > able to fix it by first running the command as mentioned on the > page > >> > > > <https://hudi.apache.org/quickstart.html> - > >> > > > > >> > > > mvn clean install -DskipTests -DskipITs > >> > > > > >> > > > After running this command, you can run the other commands without > >> any > >> > > > error. > >> > > > > >> > > > On Fri, Oct 18, 2019 at 4:24 PM [email protected] < > >> [email protected] > >> > > > >> > > > wrote: > >> > > > > >> > > > > > >> > > > > I have seen this happens sometimes if you have a custom > >> > > > ~/.m2/settings.xml > >> > > > > file. Try removing it and check. > >> > > > > Balaji.V On Friday, October 18, 2019, 03:31:09 AM PDT, > Gurudatt > >> > > > > Kulkarni <[email protected]> wrote: > >> > > > > > >> > > > > Hi All, > >> > > > > > >> > > > > I ran `mvn compile` on master, but it fails to build completely > >> > because > >> > > > it > >> > > > > was unable to find Confluent dependencies. I added > >> > > > > https://packages.confluent.io/maven2 in repositories in the > main > >> > > pom.xml > >> > > > > and it built successfully. Just curious, how you guys are > >> compiling? > >> > > Can > >> > > > we > >> > > > > add confluent maven repository to the main pom.xml file? > >> > > > > > >> > > > > Here's the error that I got > >> > > > > > >> > > > > [ERROR] Failed to execute goal > >> > > > > > org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process > >> > > > > (process-resource-bundles) on project hudi-cli: Failed to > resolve > >> > > > > dependencies for one or more projects in the reactor. Reason: > >> > Missing: > >> > > > > [ERROR] ---------- > >> > > > > [ERROR] 1) io.confluent:kafka-avro-serializer:jar:3.0.0 > >> > > > > [ERROR] > >> > > > > [ERROR] Try downloading the file manually from the project > >> website. > >> > > > > [ERROR] > >> > > > > [ERROR] Then, install it using the command: > >> > > > > [ERROR] mvn install:install-file -DgroupId=io.confluent > >> > > > > -DartifactId=kafka-avro-serializer -Dversion=3.0.0 > -Dpackaging=jar > >> > > > > -Dfile=/path/to/file > >> > > > > [ERROR] > >> > > > > [ERROR] Alternatively, if you host your own repository you can > >> > deploy > >> > > > the > >> > > > > file there: > >> > > > > [ERROR] mvn deploy:deploy-file -DgroupId=io.confluent > >> > > > > -DartifactId=kafka-avro-serializer -Dversion=3.0.0 > -Dpackaging=jar > >> > > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id] > >> > > > > [ERROR] > >> > > > > [ERROR] Path to dependency: > >> > > > > [ERROR] 1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT > >> > > > > [ERROR] 2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT > >> > > > > [ERROR] 3) io.confluent:kafka-avro-serializer:jar:3.0.0 > >> > > > > [ERROR] > >> > > > > [ERROR] 2) io.confluent:common-config:jar:3.0.0 > >> > > > > [ERROR] > >> > > > > [ERROR] Try downloading the file manually from the project > >> website. > >> > > > > [ERROR] > >> > > > > [ERROR] Then, install it using the command: > >> > > > > [ERROR] mvn install:install-file -DgroupId=io.confluent > >> > > > > -DartifactId=common-config -Dversion=3.0.0 -Dpackaging=jar > >> > > > > -Dfile=/path/to/file > >> > > > > [ERROR] > >> > > > > [ERROR] Alternatively, if you host your own repository you can > >> > deploy > >> > > > the > >> > > > > file there: > >> > > > > [ERROR] mvn deploy:deploy-file -DgroupId=io.confluent > >> > > > > -DartifactId=common-config -Dversion=3.0.0 -Dpackaging=jar > >> > > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id] > >> > > > > [ERROR] > >> > > > > [ERROR] Path to dependency: > >> > > > > [ERROR] 1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT > >> > > > > [ERROR] 2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT > >> > > > > [ERROR] 3) io.confluent:common-config:jar:3.0.0 > >> > > > > [ERROR] > >> > > > > [ERROR] 3) io.confluent:kafka-schema-registry-client:jar:3.0.0 > >> > > > > [ERROR] > >> > > > > [ERROR] Try downloading the file manually from the project > >> website. > >> > > > > [ERROR] > >> > > > > [ERROR] Then, install it using the command: > >> > > > > [ERROR] mvn install:install-file -DgroupId=io.confluent > >> > > > > -DartifactId=kafka-schema-registry-client -Dversion=3.0.0 > >> > > -Dpackaging=jar > >> > > > > -Dfile=/path/to/file > >> > > > > [ERROR] > >> > > > > [ERROR] Alternatively, if you host your own repository you can > >> > deploy > >> > > > the > >> > > > > file there: > >> > > > > [ERROR] mvn deploy:deploy-file -DgroupId=io.confluent > >> > > > > -DartifactId=kafka-schema-registry-client -Dversion=3.0.0 > >> > > -Dpackaging=jar > >> > > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id] > >> > > > > [ERROR] > >> > > > > [ERROR] Path to dependency: > >> > > > > [ERROR] 1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT > >> > > > > [ERROR] 2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT > >> > > > > [ERROR] 3) io.confluent:kafka-schema-registry-client:jar:3.0.0 > >> > > > > [ERROR] > >> > > > > [ERROR] 4) io.confluent:common-utils:jar:3.0.0 > >> > > > > [ERROR] > >> > > > > [ERROR] Try downloading the file manually from the project > >> website. > >> > > > > [ERROR] > >> > > > > [ERROR] Then, install it using the command: > >> > > > > [ERROR] mvn install:install-file -DgroupId=io.confluent > >> > > > > -DartifactId=common-utils -Dversion=3.0.0 -Dpackaging=jar > >> > > > > -Dfile=/path/to/file > >> > > > > [ERROR] > >> > > > > [ERROR] Alternatively, if you host your own repository you can > >> > deploy > >> > > > the > >> > > > > file there: > >> > > > > [ERROR] mvn deploy:deploy-file -DgroupId=io.confluent > >> > > > > -DartifactId=common-utils -Dversion=3.0.0 -Dpackaging=jar > >> > > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id] > >> > > > > [ERROR] > >> > > > > [ERROR] Path to dependency: > >> > > > > [ERROR] 1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT > >> > > > > [ERROR] 2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT > >> > > > > [ERROR] 3) io.confluent:common-utils:jar:3.0.0 > >> > > > > [ERROR] > >> > > > > [ERROR] ---------- > >> > > > > [ERROR] 4 required artifacts are missing. > >> > > > > [ERROR] > >> > > > > [ERROR] for artifact: > >> > > > > [ERROR] org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT > >> > > > > [ERROR] > >> > > > > [ERROR] from the specified remote repositories: > >> > > > > [ERROR] libs-milestone (https://repo.spring.io/libs-milestone/ > , > >> > > > > releases=true, snapshots=true), > >> > > > > [ERROR] libs-release (https://repo.spring.io/libs-release/, > >> > > > > releases=true, snapshots=true), > >> > > > > [ERROR] Maven Central (https://repo.maven.apache.org/maven2, > >> > > > > releases=true, snapshots=false), > >> > > > > [ERROR] cloudera-repo-releases ( > >> > > > > https://repository.cloudera.com/artifactory/public/, > >> releases=true, > >> > > > > snapshots=false), > >> > > > > [ERROR] apache.snapshots ( > https://repository.apache.org/snapshots > >> , > >> > > > > releases=false, snapshots=true), > >> > > > > [ERROR] central (https://repo.maven.apache.org/maven2, > >> > releases=true, > >> > > > > snapshots=false) > >> > > > > [ERROR] > >> > > > > [ERROR] -> [Help 1] > >> > > > > [ERROR] > >> > > > > [ERROR] To see the full stack trace of the errors, re-run Maven > >> with > >> > > the > >> > > > -e > >> > > > > switch. > >> > > > > [ERROR] Re-run Maven using the -X switch to enable full debug > >> > logging. > >> > > > > [ERROR] > >> > > > > [ERROR] For more information about the errors and possible > >> solutions, > >> > > > > please read the following articles: > >> > > > > [ERROR] [Help 1] > >> > > > > > >> > > > >> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException > >> > > > > [ERROR] > >> > > > > [ERROR] After correcting the problems, you can resume the build > >> with > >> > > the > >> > > > > command > >> > > > > [ERROR] mvn <args> -rf :hudi-cli > >> > > > > > >> > > > > >> > > > >> > > >> > > >
