I saw someone else share the same experience. Can't think of anything that could have caused this to become flaky recently. I already created https://issues.apache.org/jira/browse/HUDI-312 <https://issues.apache.org/jira/browse/HUDI-312?filter=12347468&jql=project%20%3D%20HUDI%20AND%20fixVersion%20%3D%200.5.1%20AND%20(status%20%3D%20Open%20OR%20status%20%3D%20%22In%20Progress%22)%20ORDER%20BY%20assignee%20ASC> to look into some flakiness on travis.
any volunteers to drive this? (I am in the middle of fleshing out an RFC) On Wed, Oct 23, 2019 at 6:43 AM Pratyaksh Sharma <[email protected]> wrote: > It gets stuck forever while running the following - > > Container : /adhoc-1, Running command :spark-submit --class > org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer > /var/hoodie/ws/docker/hoodie/hadoop/hive_base/target/hoodie-utilities.jar > --storage-type MERGE_ON_READ --source-class > org.apache.hudi.utilities.sources.JsonDFSSource --source-ordering-field ts > --target-base-path /user/hive/warehouse/stock_ticks_mor --target-table > stock_ticks_mor --props /var/demo/config/dfs-source.properties > --schemaprovider-class > org.apache.hudi.utilities.schema.FilebasedSchemaProvider > --disable-compaction --enable-hive-sync --hoodie-conf > hoodie.datasource.hive_sync.jdbcurl=jdbc:hive2://hiveserver:10000 > --hoodie-conf hoodie.datasource.hive_sync.username=hive --hoodie-conf > hoodie.datasource.hive_sync.password=hive --hoodie-conf > hoodie.datasource.hive_sync.partition_fields=dt --hoodie-conf > hoodie.datasource.hive_sync.database=default --hoodie-conf > hoodie.datasource.hive_sync.table=stock_ticks_mor > > On Wed, Oct 23, 2019 at 7:02 PM Pratyaksh Sharma <[email protected]> > wrote: > > > Hi, > > > > I am facing errors when trying to run integration tests using the script > > travis_run_tests.sh and also it takes a lot of time or rather gets stuck. > > If I run them like normal junit tests, they work fine. > > > > Sometimes random transient errors also come, but these are the most > > frequent ones - > > > > [ERROR] Tests run: 3, Failures: 3, Errors: 0, Skipped: 0, Time elapsed: > > 345.207 s <<< FAILURE! - in org.apache.hudi.integ.ITTestHoodieSanity > > [ERROR] > > > testRunHoodieJavaAppOnSinglePartitionKeyCOWTable(org.apache.hudi.integ.ITTestHoodieSanity) > > Time elapsed: 129.227 s <<< FAILURE! > > java.lang.AssertionError: Expecting 100 rows to be present in the new > > table expected:<100> but was:<200> > > at > > > org.apache.hudi.integ.ITTestHoodieSanity.testRunHoodieJavaAppOnCOWTable(ITTestHoodieSanity.java:115) > > at > > > org.apache.hudi.integ.ITTestHoodieSanity.testRunHoodieJavaAppOnSinglePartitionKeyCOWTable(ITTestHoodieSanity.java:42) > > > > [ERROR] > > > testRunHoodieJavaAppOnMultiPartitionKeysCOWTable(org.apache.hudi.integ.ITTestHoodieSanity) > > Time elapsed: 108.146 s <<< FAILURE! > > java.lang.AssertionError: Expecting 100 rows to be present in the new > > table expected:<100> but was:<200> > > at > > > org.apache.hudi.integ.ITTestHoodieSanity.testRunHoodieJavaAppOnCOWTable(ITTestHoodieSanity.java:115) > > at > > > org.apache.hudi.integ.ITTestHoodieSanity.testRunHoodieJavaAppOnMultiPartitionKeysCOWTable(ITTestHoodieSanity.java:54) > > > > [ERROR] > > > testRunHoodieJavaAppOnNonPartitionedCOWTable(org.apache.hudi.integ.ITTestHoodieSanity) > > Time elapsed: 107.63 s <<< FAILURE! > > java.lang.AssertionError: Expecting 100 rows to be present in the new > > table expected:<100> but was:<200> > > at > > > org.apache.hudi.integ.ITTestHoodieSanity.testRunHoodieJavaAppOnCOWTable(ITTestHoodieSanity.java:115) > > at > > > org.apache.hudi.integ.ITTestHoodieSanity.testRunHoodieJavaAppOnNonPartitionedCOWTable(ITTestHoodieSanity.java:66) > > > > Has anybody else faced similar issues? > > > > > > >
