It gets stuck forever while running the following - Container : /adhoc-1, Running command :spark-submit --class org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer /var/hoodie/ws/docker/hoodie/hadoop/hive_base/target/hoodie-utilities.jar --storage-type MERGE_ON_READ --source-class org.apache.hudi.utilities.sources.JsonDFSSource --source-ordering-field ts --target-base-path /user/hive/warehouse/stock_ticks_mor --target-table stock_ticks_mor --props /var/demo/config/dfs-source.properties --schemaprovider-class org.apache.hudi.utilities.schema.FilebasedSchemaProvider --disable-compaction --enable-hive-sync --hoodie-conf hoodie.datasource.hive_sync.jdbcurl=jdbc:hive2://hiveserver:10000 --hoodie-conf hoodie.datasource.hive_sync.username=hive --hoodie-conf hoodie.datasource.hive_sync.password=hive --hoodie-conf hoodie.datasource.hive_sync.partition_fields=dt --hoodie-conf hoodie.datasource.hive_sync.database=default --hoodie-conf hoodie.datasource.hive_sync.table=stock_ticks_mor
On Wed, Oct 23, 2019 at 7:02 PM Pratyaksh Sharma <[email protected]> wrote: > Hi, > > I am facing errors when trying to run integration tests using the script > travis_run_tests.sh and also it takes a lot of time or rather gets stuck. > If I run them like normal junit tests, they work fine. > > Sometimes random transient errors also come, but these are the most > frequent ones - > > [ERROR] Tests run: 3, Failures: 3, Errors: 0, Skipped: 0, Time elapsed: > 345.207 s <<< FAILURE! - in org.apache.hudi.integ.ITTestHoodieSanity > [ERROR] > testRunHoodieJavaAppOnSinglePartitionKeyCOWTable(org.apache.hudi.integ.ITTestHoodieSanity) > Time elapsed: 129.227 s <<< FAILURE! > java.lang.AssertionError: Expecting 100 rows to be present in the new > table expected:<100> but was:<200> > at > org.apache.hudi.integ.ITTestHoodieSanity.testRunHoodieJavaAppOnCOWTable(ITTestHoodieSanity.java:115) > at > org.apache.hudi.integ.ITTestHoodieSanity.testRunHoodieJavaAppOnSinglePartitionKeyCOWTable(ITTestHoodieSanity.java:42) > > [ERROR] > testRunHoodieJavaAppOnMultiPartitionKeysCOWTable(org.apache.hudi.integ.ITTestHoodieSanity) > Time elapsed: 108.146 s <<< FAILURE! > java.lang.AssertionError: Expecting 100 rows to be present in the new > table expected:<100> but was:<200> > at > org.apache.hudi.integ.ITTestHoodieSanity.testRunHoodieJavaAppOnCOWTable(ITTestHoodieSanity.java:115) > at > org.apache.hudi.integ.ITTestHoodieSanity.testRunHoodieJavaAppOnMultiPartitionKeysCOWTable(ITTestHoodieSanity.java:54) > > [ERROR] > testRunHoodieJavaAppOnNonPartitionedCOWTable(org.apache.hudi.integ.ITTestHoodieSanity) > Time elapsed: 107.63 s <<< FAILURE! > java.lang.AssertionError: Expecting 100 rows to be present in the new > table expected:<100> but was:<200> > at > org.apache.hudi.integ.ITTestHoodieSanity.testRunHoodieJavaAppOnCOWTable(ITTestHoodieSanity.java:115) > at > org.apache.hudi.integ.ITTestHoodieSanity.testRunHoodieJavaAppOnNonPartitionedCOWTable(ITTestHoodieSanity.java:66) > > Has anybody else faced similar issues? > > >
