sivabalan narayanan created HUDI-4712:
-----------------------------------------
Summary: Flaky Tests w/ azure CI
Key: HUDI-4712
URL: https://issues.apache.org/jira/browse/HUDI-4712
Project: Apache Hudi
Issue Type: Test
Reporter: sivabalan narayanan
In our azure CI runs, last 4 to 5 runs have failed. Mostly its related to Flink
It tests.
Tracking the failures here.
[https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_apis/build/builds/10911/logs/24]
{code:java}
2022-08-24T02:57:19.7513911Z [INFO] Running
org.apache.hudi.table.ITTestHoodieDataSource
2022-08-24T03:13:47.5967799Z [INFO] Tests run: 96, Failures: 0, Errors: 0,
Skipped: 0, Time elapsed: 987.826 s - in
org.apache.hudi.table.ITTestHoodieDataSource
2022-08-24T03:13:47.5997817Z [INFO] Running
org.apache.hudi.sink.compact.ITTestHoodieFlinkCompactor
2022-08-24T03:15:01.9378742Z [ERROR] Tests run: 7, Failures: 0, Errors: 1,
Skipped: 0, Time elapsed: 74.337 s <<< FAILURE! - in
org.apache.hudi.sink.compact.ITTestHoodieFlinkCompactor
2022-08-24T03:15:01.9381479Z [ERROR]
testHoodieFlinkCompactorWithPlanSelectStrategy{boolean}[1] Time elapsed: 7.976
s <<< ERROR!
2022-08-24T03:15:01.9382198Z
org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
2022-08-24T03:15:01.9383171Z Caused by: org.apache.flink.runtime.JobException:
Recovery is suppressed by NoRestartBackoffTimeStrategy
2022-08-24T03:15:01.9383730Z Caused by:
org.apache.hudi.exception.HoodieIOException: IOException when reading log file
2022-08-24T03:15:01.9384878Z Caused by: java.io.FileNotFoundException: File
file:/tmp/junit4630651021120836419/par4/.d6675c02-f0f4-40ba-9f5e-986b84f73cb6_20220824031447463.log.1_0-4-0
does not exist
2022-08-24T03:15:01.9650641Z
2022-08-24T03:15:01.9651540Z [INFO] Running
org.apache.hudi.sink.cluster.ITTestHoodieFlinkClustering
2022-08-24T03:15:21.1311853Z [INFO] Tests run: 2, Failures: 0, Errors: 0,
Skipped: 0, Time elapsed: 19.189 s - in
org.apache.hudi.sink.cluster.ITTestHoodieFlinkClustering
2022-08-24T03:15:21.1324486Z [INFO] Running
org.apache.hudi.sink.ITTestDataStreamWrite
2022-08-24T03:17:40.5148801Z [ERROR] Tests run: 9, Failures: 1, Errors: 0,
Skipped: 0, Time elapsed: 139.379 s <<< FAILURE! - in
org.apache.hudi.sink.ITTestDataStreamWrite
2022-08-24T03:17:40.5149895Z [ERROR]
testWriteMergeOnReadWithCompaction{String}[1] Time elapsed: 21.725 s <<<
FAILURE!
2022-08-24T03:17:40.5150555Z org.opentest4j.AssertionFailedError: expected:
<true> but was: <false>
2022-08-24T03:17:40.5151262Z at
org.apache.hudi.sink.ITTestDataStreamWrite.testWriteToHoodie(ITTestDataStreamWrite.java:252)
2022-08-24T03:17:40.5152067Z at
org.apache.hudi.sink.ITTestDataStreamWrite.testWriteToHoodie(ITTestDataStreamWrite.java:182)
2022-08-24T03:17:40.5153086Z at
org.apache.hudi.sink.ITTestDataStreamWrite.testWriteMergeOnReadWithCompaction(ITTestDataStreamWrite.java:156)
2022-08-24T03:17:40.5153593Z
2022-08-24T03:17:41.0381772Z [INFO]
2022-08-24T03:17:41.0382573Z [INFO] Results:
2022-08-24T03:17:41.0383977Z [INFO]
2022-08-24T03:17:41.0384447Z [ERROR] Failures:
2022-08-24T03:17:41.0385833Z [ERROR]
ITTestDataStreamWrite.testWriteMergeOnReadWithCompaction:156->testWriteToHoodie:182->testWriteToHoodie:252
expected: <true> but was: <false>
2022-08-24T03:17:41.0386560Z [ERROR] Errors:
2022-08-24T03:17:41.0387330Z [ERROR]
ITTestHoodieFlinkCompactor.testHoodieFlinkCompactorWithPlanSelectStrategy »
JobExecution
2022-08-24T03:17:41.0387896Z [INFO] {code}
[https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_apis/build/builds/10911/logs/24]
{code:java}
2022-08-24T02:57:18.8817403Z [INFO]
-------------------------------------------------------
2022-08-24T02:57:19.7513911Z [INFO] Running
org.apache.hudi.table.ITTestHoodieDataSource
2022-08-24T03:13:47.5967799Z [INFO] Tests run: 96, Failures: 0, Errors: 0,
Skipped: 0, Time elapsed: 987.826 s - in
org.apache.hudi.table.ITTestHoodieDataSource
2022-08-24T03:13:47.5997817Z [INFO] Running
org.apache.hudi.sink.compact.ITTestHoodieFlinkCompactor
2022-08-24T03:15:01.9378742Z [ERROR] Tests run: 7, Failures: 0, Errors: 1,
Skipped: 0, Time elapsed: 74.337 s <<< FAILURE! - in
org.apache.hudi.sink.compact.ITTestHoodieFlinkCompactor
2022-08-24T03:15:01.9381479Z [ERROR]
testHoodieFlinkCompactorWithPlanSelectStrategy{boolean}[1] Time elapsed: 7.976
s <<< ERROR!
2022-08-24T03:15:01.9382198Z
org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
2022-08-24T03:15:01.9383171Z Caused by: org.apache.flink.runtime.JobException:
Recovery is suppressed by NoRestartBackoffTimeStrategy
2022-08-24T03:15:01.9383730Z Caused by:
org.apache.hudi.exception.HoodieIOException: IOException when reading log file
2022-08-24T03:15:01.9384878Z Caused by: java.io.FileNotFoundException: File
file:/tmp/junit4630651021120836419/par4/.d6675c02-f0f4-40ba-9f5e-986b84f73cb6_20220824031447463.log.1_0-4-0
does not exist
2022-08-24T03:15:01.9650641Z
2022-08-24T03:15:01.9651540Z [INFO] Running
org.apache.hudi.sink.cluster.ITTestHoodieFlinkClustering
2022-08-24T03:15:21.1311853Z [INFO] Tests run: 2, Failures: 0, Errors: 0,
Skipped: 0, Time elapsed: 19.189 s - in
org.apache.hudi.sink.cluster.ITTestHoodieFlinkClustering
2022-08-24T03:15:21.1324486Z [INFO] Running
org.apache.hudi.sink.ITTestDataStreamWrite
2022-08-24T03:17:40.5148801Z [ERROR] Tests run: 9, Failures: 1, Errors: 0,
Skipped: 0, Time elapsed: 139.379 s <<< FAILURE! - in
org.apache.hudi.sink.ITTestDataStreamWrite
2022-08-24T03:17:40.5149895Z [ERROR]
testWriteMergeOnReadWithCompaction{String}[1] Time elapsed: 21.725 s <<<
FAILURE!
2022-08-24T03:17:40.5150555Z org.opentest4j.AssertionFailedError: expected:
<true> but was: <false>
2022-08-24T03:17:40.5151262Z at
org.apache.hudi.sink.ITTestDataStreamWrite.testWriteToHoodie(ITTestDataStreamWrite.java:252)
2022-08-24T03:17:40.5152067Z at
org.apache.hudi.sink.ITTestDataStreamWrite.testWriteToHoodie(ITTestDataStreamWrite.java:182)
2022-08-24T03:17:40.5153086Z at
org.apache.hudi.sink.ITTestDataStreamWrite.testWriteMergeOnReadWithCompaction(ITTestDataStreamWrite.java:156)
2022-08-24T03:17:40.5153593Z
2022-08-24T03:17:41.0381772Z [INFO]
2022-08-24T03:17:41.0382573Z [INFO] Results:
2022-08-24T03:17:41.0383977Z [INFO]
2022-08-24T03:17:41.0384447Z [ERROR] Failures:
2022-08-24T03:17:41.0385833Z [ERROR]
ITTestDataStreamWrite.testWriteMergeOnReadWithCompaction:156->testWriteToHoodie:182->testWriteToHoodie:252
expected: <true> but was: <false>
2022-08-24T03:17:41.0386560Z [ERROR] Errors:
2022-08-24T03:17:41.0387330Z [ERROR]
ITTestHoodieFlinkCompactor.testHoodieFlinkCompactorWithPlanSelectStrategy »
JobExecution
2022-08-24T03:17:41.0387896Z [INFO]
2022-08-24T03:17:41.0388373Z [ERROR] Tests run: 114, Failures: 1, Errors: 1,
Skipped: 0 {code}
[https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_apis/build/builds/10913/logs/20]
{code:java}
2022-08-24T04:51:05.8959163Z [INFO] Running
org.apache.hudi.table.ITTestHoodieDataSource
2022-08-24T05:20:11.1939423Z [ERROR] Tests run: 96, Failures: 1, Errors: 0,
Skipped: 0, Time elapsed: 1,745.281 s <<< FAILURE! - in
org.apache.hudi.table.ITTestHoodieDataSource
2022-08-24T05:20:11.1940879Z [ERROR] testAppendWrite{boolean}[2] Time elapsed:
604.772 s <<< FAILURE!
2022-08-24T05:20:11.1941983Z java.lang.AssertionError:
2022-08-24T05:20:11.1942251Z
2022-08-24T05:20:11.1944589Z Expected: is "[+I[id1, Danny, 23,
1970-01-01T00:00:01, par1], +I[id2, Stephen, 33, 1970-01-01T00:00:02, par1],
+I[id3, Julian, 53, 1970-01-01T00:00:03, par2], +I[id4, Fabian, 31,
1970-01-01T00:00:04, par2], +I[id5, Sophia, 18, 1970-01-01T00:00:05, par3],
+I[id6, Emma, 20, 1970-01-01T00:00:06, par3], +I[id7, Bob, 44,
1970-01-01T00:00:07, par4], +I[id8, Han, 56, 1970-01-01T00:00:08, par4]]"
2022-08-24T05:20:11.1947930Z but: was "[+I[id1, Danny, 23,
1970-01-01T00:00:01, par1], +I[id3, Julian, 53, 1970-01-01T00:00:03, par2],
+I[id4, Fabian, 31, 1970-01-01T00:00:04, par2], +I[id5, Sophia, 18,
1970-01-01T00:00:05, par3], +I[id7, Bob, 44, 1970-01-01T00:00:07, par4]]"
2022-08-24T05:20:11.1949317Z at
org.apache.hudi.table.ITTestHoodieDataSource.testAppendWrite(ITTestHoodieDataSource.java:1033)
2022-08-24T05:20:11.1949822Z
2022-08-24T05:20:11.1953270Z [INFO] Running
org.apache.hudi.sink.compact.ITTestHoodieFlinkCompactor
2022-08-24T05:21:36.0648031Z [INFO] Tests run: 7, Failures: 0, Errors: 0,
Skipped: 0, Time elapsed: 84.861 s - in
org.apache.hudi.sink.compact.ITTestHoodieFlinkCompactor
2022-08-24T05:21:36.0672984Z [INFO] Running
org.apache.hudi.sink.cluster.ITTestHoodieFlinkClustering
2022-08-24T05:21:56.3854807Z [INFO] Tests run: 2, Failures: 0, Errors: 0,
Skipped: 0, Time elapsed: 20.316 s - in
org.apache.hudi.sink.cluster.ITTestHoodieFlinkClustering
2022-08-24T05:21:56.3866237Z [INFO] Running
org.apache.hudi.sink.ITTestDataStreamWrite
2022-08-24T05:24:00.3020250Z [INFO] Tests run: 9, Failures: 0, Errors: 0,
Skipped: 0, Time elapsed: 123.911 s - in
org.apache.hudi.sink.ITTestDataStreamWrite
2022-08-24T05:24:00.8793547Z [INFO]
2022-08-24T05:24:00.8794538Z [INFO] Results:
2022-08-24T05:24:00.8795085Z [INFO]
2022-08-24T05:24:00.8795634Z [ERROR] Failures:
2022-08-24T05:24:00.8796324Z [ERROR]
ITTestHoodieDataSource.testAppendWrite:1033
2022-08-24T05:24:00.8799073Z Expected: is "[+I[id1, Danny, 23,
1970-01-01T00:00:01, par1], +I[id2, Stephen, 33, 1970-01-01T00:00:02, par1],
+I[id3, Julian, 53, 1970-01-01T00:00:03, par2], +I[id4, Fabian, 31,
1970-01-01T00:00:04, par2], +I[id5, Sophia, 18, 1970-01-01T00:00:05, par3],
+I[id6, Emma, 20, 1970-01-01T00:00:06, par3], +I[id7, Bob, 44,
1970-01-01T00:00:07, par4], +I[id8, Han, 56, 1970-01-01T00:00:08, par4]]"
2022-08-24T05:24:00.8802066Z but: was "[+I[id1, Danny, 23,
1970-01-01T00:00:01, par1], +I[id3, Julian, 53, 1970-01-01T00:00:03, par2],
+I[id4, Fabian, 31, 1970-01-01T00:00:04, par2], +I[id5, Sophia, 18,
1970-01-01T00:00:05, par3], +I[id7, Bob, 44, 1970-01-01T00:00:07, par4]]"
2022-08-24T05:24:00.8803231Z [INFO]
2022-08-24T05:24:00.8803856Z [ERROR] Tests run: 114, Failures: 1, Errors: 0,
Skipped: 0 {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)