Hi Pratyaksh, I have the same setup as yours. I would normally tend to clean up my local deps
mvn dependency:purge-local-repository mvn clean install -DskipTests -DskipITs mvn -Dtest=ITTestRepairsCommand#testDeduplicateWithReal -DfailIfNoTests=false test Though I was able to run the test, it failed to pass... sharing this to check if I'm not alone :) [ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 6.822 s <<< FAILURE! - in org.apache.hudi.cli.integ.ITTestRepairsCommand [ERROR] org.apache.hudi.cli.integ.ITTestRepairsCommand.testDeduplicateWithReal Time elapsed: 6.014 s <<< FAILURE! org.opentest4j.AssertionFailedError: expected: <Deduplicated files placed in: 2016/03/15> but was: <Deduplication failed!> at org.apache.hudi.cli.integ.ITTestRepairsCommand.testDeduplicateWithReal(ITTestRepairsCommand.java:171) If it's the same for others, we'd need to investigate why CI is passing. (hope it's just my setup) My local setup ➜ mvn -v Apache Maven 3.6.3 (cecedd343002696d0abb50b32b541b8a6ba2883f) Maven home: /usr/local/Cellar/maven/3.6.3_1/libexec Java version: 1.8.0_242, vendor: AdoptOpenJDK, runtime: /Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre Default locale: en_US, platform encoding: UTF-8 OS name: "mac os x", version: "10.15.4", arch: "x86_64", family: "mac" ➜ scala -version Scala code runner version 2.11.12 -- Copyright 2002-2017, LAMP/EPFL On Sun, May 17, 2020 at 5:42 AM Pratyaksh Sharma <[email protected]> wrote: > Hi hddong, > > Strange but nothing seems to work for me. I tried doing mvn clean and then > run travis tests. Also I tried running the command `mvn clean package > -DskipTests -DskipITs -Pspark-shade-unbundle-avro` first and then run the > test using `mvn -Dtest=ITTestRepairsCommand#testDeduplicateWithReal > -DfailIfNoTests=false test`. But both of them did not work. I have spark > installation and I am setting the SPARK_HOME to > /usr/local/Cellar/apache-spark/2.4.5. > > On Sun, May 17, 2020 at 9:00 AM hddong <[email protected]> wrote: > > > Hi Pratyaksh, > > > > run_travis_tests,sh not run `mvn clean`, You can try to run `mvn > > clean` manually > > before integration test. > > > > BTW, if you use IDEA, you can do > > `mvn clean package -DskipTests -DskipITs -Pspark-shade-unbundle-avro` > > first, > > then just run integration test in IDEA like unit test does. > > > > But, there are something to notice here: you need a runnable spark and > > SPARK_HOME should in env. > > > > Regards > > hddong > > >
