[
https://issues.apache.org/jira/browse/GOBBLIN-1494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
William Lo updated GOBBLIN-1494:
--------------------------------
Description:
On Github Actions, test returns this
{code:bash}
Gradle suite > Gradle test >
org.apache.gobblin.data.management.conversion.hive.HiveSourceTest >
testGetWorkunitsAfterWatermark FAILED
java.lang.AssertionError: expected [1] but found [2]
at org.testng.Assert.fail(Assert.java:96)
at org.testng.Assert.failNotEquals(Assert.java:776)
at org.testng.Assert.assertEqualsImpl(Assert.java:137)
at org.testng.Assert.assertEquals(Assert.java:118)
at org.testng.Assert.assertEquals(Assert.java:652)
at org.testng.Assert.assertEquals(Assert.java:662)
at
org.apache.gobblin.data.management.conversion.hive.HiveSourceTest.testGetWorkunitsAfterWatermark(HiveSourceTest.java:144)
Thu Jul 22 00:28:30 UTC 2021 STARTED :
org.apache.gobblin.data.management.conversion.hive.HiveSourceTest
{code}
was:
HiveSourceTest returns 2 watermarks for testGetWorkunitsAfterWatermark instead
of 1.
This is due to System.getCurrentTime.millis() returning a different value when
comparing against the filesystem last updated filetime. To guard against this,
change the test to incorporate the workunit within the watermark by assigning
it an earlier creation time, thus implying that the file was modified so it
needs to be ingested again.
> HiveSourceTest broken on CI
> ---------------------------
>
> Key: GOBBLIN-1494
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1494
> Project: Apache Gobblin
> Issue Type: Bug
> Reporter: William Lo
> Priority: Major
>
> On Github Actions, test returns this
> {code:bash}
> Gradle suite > Gradle test >
> org.apache.gobblin.data.management.conversion.hive.HiveSourceTest >
> testGetWorkunitsAfterWatermark FAILED
> java.lang.AssertionError: expected [1] but found [2]
> at org.testng.Assert.fail(Assert.java:96)
> at org.testng.Assert.failNotEquals(Assert.java:776)
> at org.testng.Assert.assertEqualsImpl(Assert.java:137)
> at org.testng.Assert.assertEquals(Assert.java:118)
> at org.testng.Assert.assertEquals(Assert.java:652)
> at org.testng.Assert.assertEquals(Assert.java:662)
> at
> org.apache.gobblin.data.management.conversion.hive.HiveSourceTest.testGetWorkunitsAfterWatermark(HiveSourceTest.java:144)
> Thu Jul 22 00:28:30 UTC 2021 STARTED :
> org.apache.gobblin.data.management.conversion.hive.HiveSourceTest
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
