[jira] (FLINK-27555) Performance regression in schedulingDownstreamTasks on 02.05.2022

2022-05-09 Thread Guowei Ma (Jira)


[ https://issues.apache.org/jira/browse/FLINK-27555 ]


Guowei Ma deleted comment on FLINK-27555:
---

was (Author: maguowei):
Thanks [~roman] for letting this. I notice that [~zhuzh]  have make some 
changed recently. So would you like to have a look!

> Performance regression in schedulingDownstreamTasks on 02.05.2022
> -
>
> Key: FLINK-27555
> URL: https://issues.apache.org/jira/browse/FLINK-27555
> Project: Flink
>  Issue Type: Bug
>  Components: Benchmarks, Runtime / Coordination
>Affects Versions: 1.16.0
>Reporter: Roman Khachatryan
>Priority: Major
> Attachments: Screenshot_2022-05-09_10-33-11.png
>
>
> http://codespeed.dak8s.net:8000/timeline/#/?exe=5=schedulingDownstreamTasks.BATCH=on=on=off=2=200



--
This message was sent by Atlassian Jira
(v8.20.7#820007)


[jira] [Commented] (FLINK-27555) Performance regression in schedulingDownstreamTasks on 02.05.2022

2022-05-09 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-27555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17534120#comment-17534120
 ] 

Guowei Ma commented on FLINK-27555:
---

Thanks [~roman] for letting this. I notice that [~zhuzh]  have make some 
changed recently. So would you like to have a look!

> Performance regression in schedulingDownstreamTasks on 02.05.2022
> -
>
> Key: FLINK-27555
> URL: https://issues.apache.org/jira/browse/FLINK-27555
> Project: Flink
>  Issue Type: Bug
>  Components: Benchmarks, Runtime / Coordination
>Affects Versions: 1.16.0
>Reporter: Roman Khachatryan
>Priority: Major
> Attachments: Screenshot_2022-05-09_10-33-11.png
>
>
> http://codespeed.dak8s.net:8000/timeline/#/?exe=5=schedulingDownstreamTasks.BATCH=on=on=off=2=200



--
This message was sent by Atlassian Jira
(v8.20.7#820007)


[jira] [Commented] (FLINK-27424) StreamExecutionEnvironment.readFile() api monitor file directory errors

2022-04-27 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-27424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528704#comment-17528704
 ] 

Guowei Ma commented on FLINK-27424:
---

Would you like to enable the debug log and share more information? 

I want to see why the file does not filter by the modification time.
{code:java}
LOG.debug(
"Ignoring "
+ filePath
+ ", with mod time= "
+ modificationTime
+ " and global mod time= "
+ globalModificationTime); {code}

> StreamExecutionEnvironment.readFile()  api monitor file directory errors
> 
>
> Key: FLINK-27424
> URL: https://issues.apache.org/jira/browse/FLINK-27424
> Project: Flink
>  Issue Type: Bug
>Affects Versions: 1.14.3
>Reporter: zhangqw152
>Priority: Major
> Attachments: image-2022-04-27-14-27-33-320.png
>
>
> I use StreamExecutionEnvironment.readFile()  api  to monitor file 
> directory,when a file in the directory is deleted, the program will report an 
> error(FileNofoundException)
> !image-2022-04-27-14-27-33-320.png!



--
This message was sent by Atlassian Jira
(v8.20.7#820007)


[jira] [Commented] (FLINK-27424) StreamExecutionEnvironment.readFile() api monitor file directory errors

2022-04-27 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-27424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528692#comment-17528692
 ] 

Guowei Ma commented on FLINK-27424:
---

Thanks for your information.

But are you sure that the file is processed already? For example is there  any 
log about this?  

BTW the source would filter the processed file by the modified time of the 
file. Is that possible the file's modified time is changed by some reason.

> StreamExecutionEnvironment.readFile()  api monitor file directory errors
> 
>
> Key: FLINK-27424
> URL: https://issues.apache.org/jira/browse/FLINK-27424
> Project: Flink
>  Issue Type: Bug
>Affects Versions: 1.14.3
>Reporter: zhangqw152
>Priority: Major
> Attachments: image-2022-04-27-14-27-33-320.png
>
>
> I use StreamExecutionEnvironment.readFile()  api  to monitor file 
> directory,when a file in the directory is deleted, the program will report an 
> error(FileNofoundException)
> !image-2022-04-27-14-27-33-320.png!



--
This message was sent by Atlassian Jira
(v8.20.7#820007)


[jira] [Comment Edited] (FLINK-27424) StreamExecutionEnvironment.readFile() api monitor file directory errors

2022-04-27 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-27424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528604#comment-17528604
 ] 

Guowei Ma edited comment on FLINK-27424 at 4/27/22 7:34 AM:


Hi, [~zhangqw152] 

IMHO I do not think this is a bug. The source finds the  `io_wcdma_mobile_` 
file  is deleted when it begins to create the split of the 
`io_wcdma_mobile_` file. So the source want to tell `Hey! there is 
something wrong and somebody need to take a look!`

Or would you like to enlighten me a little about what the behavior you expect? 

Thanks


was (Author: maguowei):
Hi, [~zhangqw152] 

IMHO I do not think this is a bug. The source finds the  `io_wcdma_mobile_` 
file  is deleted for reason when it begins to create the split of the 
`io_wcdma_mobile_` file. So the source want to tell `Hey! there is 
something wrong and somebody need to take a look!`

Or would you like to enlighten me a little about what the behavior you expect? 

Thanks

> StreamExecutionEnvironment.readFile()  api monitor file directory errors
> 
>
> Key: FLINK-27424
> URL: https://issues.apache.org/jira/browse/FLINK-27424
> Project: Flink
>  Issue Type: Bug
>Affects Versions: 1.14.3
>Reporter: zhangqw152
>Priority: Major
> Attachments: image-2022-04-27-14-27-33-320.png
>
>
> I use StreamExecutionEnvironment.readFile()  api  to monitor file 
> directory,when a file in the directory is deleted, the program will report an 
> error(FileNofoundException)
> !image-2022-04-27-14-27-33-320.png!



--
This message was sent by Atlassian Jira
(v8.20.7#820007)


[jira] [Comment Edited] (FLINK-27424) StreamExecutionEnvironment.readFile() api monitor file directory errors

2022-04-27 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-27424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528604#comment-17528604
 ] 

Guowei Ma edited comment on FLINK-27424 at 4/27/22 7:34 AM:


Hi, [~zhangqw152] 

IMHO I do not think this is a bug. The source finds the  `io_wcdma_mobile_` 
file  is deleted when it begins to create the split of the 
`io_wcdma_mobile_` file. So the source wants to tell `Hey! there is 
something wrong and somebody need to take a look!`

Or would you like to enlighten me a little about what the behavior you expect? 

Thanks


was (Author: maguowei):
Hi, [~zhangqw152] 

IMHO I do not think this is a bug. The source finds the  `io_wcdma_mobile_` 
file  is deleted when it begins to create the split of the 
`io_wcdma_mobile_` file. So the source want to tell `Hey! there is 
something wrong and somebody need to take a look!`

Or would you like to enlighten me a little about what the behavior you expect? 

Thanks

> StreamExecutionEnvironment.readFile()  api monitor file directory errors
> 
>
> Key: FLINK-27424
> URL: https://issues.apache.org/jira/browse/FLINK-27424
> Project: Flink
>  Issue Type: Bug
>Affects Versions: 1.14.3
>Reporter: zhangqw152
>Priority: Major
> Attachments: image-2022-04-27-14-27-33-320.png
>
>
> I use StreamExecutionEnvironment.readFile()  api  to monitor file 
> directory,when a file in the directory is deleted, the program will report an 
> error(FileNofoundException)
> !image-2022-04-27-14-27-33-320.png!



--
This message was sent by Atlassian Jira
(v8.20.7#820007)


[jira] [Commented] (FLINK-27424) StreamExecutionEnvironment.readFile() api monitor file directory errors

2022-04-27 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-27424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528604#comment-17528604
 ] 

Guowei Ma commented on FLINK-27424:
---

Hi, [~zhangqw152] 

IMHO I do not think this is a bug. The source finds the  `io_wcdma_mobile_` 
file  is deleted for reason when it begins to create the split of the 
`io_wcdma_mobile_` file. So the source want to tell `Hey! there is 
something wrong and somebody need to take a look!`

Or would you like to enlighten me a little about what the behavior you expect? 

Thanks

> StreamExecutionEnvironment.readFile()  api monitor file directory errors
> 
>
> Key: FLINK-27424
> URL: https://issues.apache.org/jira/browse/FLINK-27424
> Project: Flink
>  Issue Type: Bug
>Affects Versions: 1.14.3
>Reporter: zhangqw152
>Priority: Major
> Attachments: image-2022-04-27-14-27-33-320.png
>
>
> I use StreamExecutionEnvironment.readFile()  api  to monitor file 
> directory,when a file in the directory is deleted, the program will report an 
> error(FileNofoundException)
> !image-2022-04-27-14-27-33-320.png!



--
This message was sent by Atlassian Jira
(v8.20.7#820007)


[jira] [Commented] (FLINK-27420) Suspended SlotManager fail to reregister metrics when started again

2022-04-26 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-27420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528478#comment-17528478
 ] 

Guowei Ma commented on FLINK-27420:
---

Thanks [~baugarten] for reporting this. cc [~xtsong] 

> Suspended SlotManager fail to reregister metrics when started again
> ---
>
> Key: FLINK-27420
> URL: https://issues.apache.org/jira/browse/FLINK-27420
> Project: Flink
>  Issue Type: Bug
>  Components: Runtime / Coordination, Runtime / Metrics
>Affects Versions: 1.13.5
>Reporter: Ben Augarten
>Priority: Major
>
> The symptom is that SlotManager metrics are missing (taskslotsavailable and 
> taskslotstotal) when a SlotManager is suspended and then restarted. We 
> noticed this issue when running 1.13.5, but I believe this impacts 1.14.x, 
> 1.15.x, and master.
>  
> When a SlotManager is suspended, the [metrics group is 
> closed|https://github.com/apache/flink/blob/master/flink-runtime/src/main/java/org/apache/flink/runtime/resourcemanager/slotmanager/DeclarativeSlotManager.java#L214].
>  When the SlotManager is [started 
> again|https://github.com/apache/flink/blob/master/flink-runtime/src/main/java/org/apache/flink/runtime/resourcemanager/slotmanager/DeclarativeSlotManager.java#L181],
>  it makes an attempt to [reregister 
> metrics|[https://github.com/apache/flink/blob/master/flink-runtime/src/main/java/org/apache/flink/runtime/resourcemanager/slotmanager/DeclarativeSlotManager.java#L199-L202],]
>  but that fails because the underlying metrics group [is still 
> closed|https://github.com/apache/flink/blob/master/flink-runtime/src/main/java/org/apache/flink/runtime/metrics/groups/AbstractMetricGroup.java#L393]
>  
>  
> I was able to trace through this issue by restarting zookeeper nodes in a 
> staging environment and watching the JM with a debugger. 
>  
> A concise test, which currently fails, shows the expected behavior – 
> [https://github.com/apache/flink/compare/master...baugarten:baugarten/slot-manager-missing-metrics?expand=1]
>  
> I am happy to provide a PR to fix this issue, but first would like to verify 
> that this is not intended.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)


[jira] [Updated] (FLINK-27420) Suspended SlotManager fail to reregister metrics when started again

2022-04-26 Thread Guowei Ma (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-27420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Guowei Ma updated FLINK-27420:
--
Component/s: Runtime / Coordination

> Suspended SlotManager fail to reregister metrics when started again
> ---
>
> Key: FLINK-27420
> URL: https://issues.apache.org/jira/browse/FLINK-27420
> Project: Flink
>  Issue Type: Bug
>  Components: Runtime / Coordination, Runtime / Metrics
>Affects Versions: 1.13.5
>Reporter: Ben Augarten
>Priority: Major
>
> The symptom is that SlotManager metrics are missing (taskslotsavailable and 
> taskslotstotal) when a SlotManager is suspended and then restarted. We 
> noticed this issue when running 1.13.5, but I believe this impacts 1.14.x, 
> 1.15.x, and master.
>  
> When a SlotManager is suspended, the [metrics group is 
> closed|https://github.com/apache/flink/blob/master/flink-runtime/src/main/java/org/apache/flink/runtime/resourcemanager/slotmanager/DeclarativeSlotManager.java#L214].
>  When the SlotManager is [started 
> again|https://github.com/apache/flink/blob/master/flink-runtime/src/main/java/org/apache/flink/runtime/resourcemanager/slotmanager/DeclarativeSlotManager.java#L181],
>  it makes an attempt to [reregister 
> metrics|[https://github.com/apache/flink/blob/master/flink-runtime/src/main/java/org/apache/flink/runtime/resourcemanager/slotmanager/DeclarativeSlotManager.java#L199-L202],]
>  but that fails because the underlying metrics group [is still 
> closed|https://github.com/apache/flink/blob/master/flink-runtime/src/main/java/org/apache/flink/runtime/metrics/groups/AbstractMetricGroup.java#L393]
>  
>  
> I was able to trace through this issue by restarting zookeeper nodes in a 
> staging environment and watching the JM with a debugger. 
>  
> A concise test, which currently fails, shows the expected behavior – 
> [https://github.com/apache/flink/compare/master...baugarten:baugarten/slot-manager-missing-metrics?expand=1]
>  
> I am happy to provide a PR to fix this issue, but first would like to verify 
> that this is not intended.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)


[jira] [Commented] (FLINK-27377) Job master blocks on marking vertex finished

2022-04-26 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-27377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528052#comment-17528052
 ] 

Guowei Ma commented on FLINK-27377:
---

# Thanks [~yittg]  for your detailed explanation and investigation !
 # You also could try the partition commit, which might only write a _Success 
file [1].

BTW IMHO, we should move forward first. It means that we should update table 
file sink to the new sink mechanism.

[1] 
https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/connectors/table/filesystem/#partition-commit

 

> Job master blocks on marking vertex finished
> 
>
> Key: FLINK-27377
> URL: https://issues.apache.org/jira/browse/FLINK-27377
> Project: Flink
>  Issue Type: Improvement
>  Components: Connectors / FileSystem, Runtime / Coordination
>Reporter: Yi Tang
>Priority: Minor
>  Labels: pull-request-available
>
> I have a case using FileSystem as batch sink, it will commit files by 
> {{FinalizeOnMaster#finalizeGlobal}} while updating state from Running to 
> Finished.
> When {{FinalizeOnMaster#finalizeGlobal}} method is blocked, the 
> {{JobMaster#updateTaskExecutionState}} will also be blocked. Then the job 
> master can not respond any new requests until 
> {{JobMaster#updateTaskExecutionState}} is complete.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)


[jira] [Updated] (FLINK-27377) Job master blocks on marking vertex finished

2022-04-26 Thread Guowei Ma (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-27377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Guowei Ma updated FLINK-27377:
--
Component/s: Connectors / FileSystem
 Runtime / Coordination

> Job master blocks on marking vertex finished
> 
>
> Key: FLINK-27377
> URL: https://issues.apache.org/jira/browse/FLINK-27377
> Project: Flink
>  Issue Type: Improvement
>  Components: Connectors / FileSystem, Runtime / Coordination
>Reporter: Yi Tang
>Priority: Minor
>  Labels: pull-request-available
>
> I have a case using FileSystem as batch sink, it will commit files by 
> {{FinalizeOnMaster#finalizeGlobal}} while updating state from Running to 
> Finished.
> When {{FinalizeOnMaster#finalizeGlobal}} method is blocked, the 
> {{JobMaster#updateTaskExecutionState}} will also be blocked. Then the job 
> master can not respond any new requests until 
> {{JobMaster#updateTaskExecutionState}} is complete.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)


[jira] [Updated] (FLINK-27377) Job master blocks on marking vertex finished

2022-04-26 Thread Guowei Ma (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-27377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Guowei Ma updated FLINK-27377:
--
Issue Type: Improvement  (was: Bug)

> Job master blocks on marking vertex finished
> 
>
> Key: FLINK-27377
> URL: https://issues.apache.org/jira/browse/FLINK-27377
> Project: Flink
>  Issue Type: Improvement
>Reporter: Yi Tang
>Priority: Minor
>  Labels: pull-request-available
>
> I have a case using FileSystem as batch sink, it will commit files by 
> {{FinalizeOnMaster#finalizeGlobal}} while updating state from Running to 
> Finished.
> When {{FinalizeOnMaster#finalizeGlobal}} method is blocked, the 
> {{JobMaster#updateTaskExecutionState}} will also be blocked. Then the job 
> master can not respond any new requests until 
> {{JobMaster#updateTaskExecutionState}} is complete.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)


[jira] [Updated] (FLINK-27406) After canceling the job, it is falsely reported as a job failure.

2022-04-26 Thread Guowei Ma (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-27406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Guowei Ma updated FLINK-27406:
--
Labels: usability  (was: )

> After canceling the job, it is falsely reported as a job failure.
> -
>
> Key: FLINK-27406
> URL: https://issues.apache.org/jira/browse/FLINK-27406
> Project: Flink
>  Issue Type: Improvement
>  Components: Client / Job Submission
>Affects Versions: 1.15.0
>Reporter: Guowei Ma
>Priority: Minor
>  Labels: usability
>
> Submit a streaming job in application mode and I cancel it in the web ui. 
> However the command give the job failed exception.  I think it would 
> misleading the user. IMO we should tell the user the job is cancelled.
> {code:java}
> org.apache.flink.client.program.ProgramInvocationException: The main method 
> caused an error: org.apache.flink.client.program.ProgramInvocationException: 
> Job failed (JobID: c816efb84b476b67cc4934e79a0694cf)
>     at 
> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:372)
>     at 
> org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222)
>     at 
> org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114)
>     at 
> org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:836)
>     at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:247)
>     at 
> org.apache.flink.client.cli.CliFrontend.parseAndRun(CliFrontend.java:1078)
>     at 
> org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1156)
>     at 
> org.apache.flink.runtime.security.contexts.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:28)
>     at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1156)
> Caused by: java.util.concurrent.ExecutionException: 
> org.apache.flink.client.program.ProgramInvocationException: Job failed 
> (JobID: c816efb84b476b67cc4934e79a0694cf)
>     at 
> java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
>     at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
>     at 
> org.apache.flink.client.program.StreamContextEnvironment.getJobExecutionResult(StreamContextEnvironment.java:173)
>     at 
> org.apache.flink.client.program.StreamContextEnvironment.execute(StreamContextEnvironment.java:123)
>     at 
> org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1969)
>     at 
> org.apache.flink.streaming.examples.windowing.TopSpeedWindowing.main(TopSpeedWindowing.java:154)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>     at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke(Method.java:498)
>     at 
> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355)
>     ... 8 more
> Caused by: org.apache.flink.client.program.ProgramInvocationException: Job 
> failed (JobID: c816efb84b476b67cc4934e79a0694cf)
>     at 
> org.apache.flink.client.deployment.ClusterClientJobClientAdapter.lambda$null$6(ClusterClientJobClientAdapter.java:130)
>     at 
> java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:616)
>     at 
> java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591)
>     at 
> java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
>     at 
> java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
>     at 
> org.apache.flink.util.concurrent.FutureUtils.lambda$retryOperationWithDelay$9(FutureUtils.java:403)
>     at 
> java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
>     at 
> java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
>     at 
> java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
>     at 
> java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
>     at 
> org.apache.flink.client.program.rest.RestClusterClient.lambda$pollResourceAsync$26(RestClusterClient.java:708)
>     at 
> java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
>     at 
> java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
>     at 
> java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
>     at 
> java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
>     at 
> org.apache.flink.util.concurrent.FutureUtils.lambda$retryOperationWithDelay$9(FutureUtils.java:403)
>     at 
> 

[jira] [Commented] (FLINK-27377) Job master blocks on marking vertex finished

2022-04-26 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-27377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17527925#comment-17527925
 ] 

Guowei Ma commented on FLINK-27377:
---

Hi, [~yittg]

Thanks for your detail explanation. 

Do you have already some investigation about why the `finalizeGlobal` block?  
And would you like to share the sql about how you use/configure the Table File 
sink. AFAIK the table file sink only write a _SUCCESS file, which should not 
block very long time.  If we could find the root cause of the block and resolve 
it I think it might be the most easy way. 

> Job master blocks on marking vertex finished
> 
>
> Key: FLINK-27377
> URL: https://issues.apache.org/jira/browse/FLINK-27377
> Project: Flink
>  Issue Type: Bug
>Reporter: Yi Tang
>Priority: Minor
>  Labels: pull-request-available
>
> I have a case using FileSystem as batch sink, it will commit files by 
> {{FinalizeOnMaster#finalizeGlobal}} while updating state from Running to 
> Finished.
> When {{FinalizeOnMaster#finalizeGlobal}} method is blocked, the 
> {{JobMaster#updateTaskExecutionState}} will also be blocked. Then the job 
> master can not respond any new requests until 
> {{JobMaster#updateTaskExecutionState}} is complete.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)


[jira] [Created] (FLINK-27406) After canceling the job, it is falsely reported as a job failure.

2022-04-25 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-27406:
-

 Summary: After canceling the job, it is falsely reported as a job 
failure.
 Key: FLINK-27406
 URL: https://issues.apache.org/jira/browse/FLINK-27406
 Project: Flink
  Issue Type: Improvement
  Components: Client / Job Submission
Affects Versions: 1.15.0
Reporter: Guowei Ma


Submit a streaming job in application mode and I cancel it in the web ui. 

However the command give the job failed exception.  I think it would misleading 
the user. IMO we should tell the user the job is cancelled.
{code:java}
org.apache.flink.client.program.ProgramInvocationException: The main method 
caused an error: org.apache.flink.client.program.ProgramInvocationException: 
Job failed (JobID: c816efb84b476b67cc4934e79a0694cf)
    at 
org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:372)
    at 
org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222)
    at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114)
    at 
org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:836)
    at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:247)
    at 
org.apache.flink.client.cli.CliFrontend.parseAndRun(CliFrontend.java:1078)
    at 
org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1156)
    at 
org.apache.flink.runtime.security.contexts.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:28)
    at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1156)
Caused by: java.util.concurrent.ExecutionException: 
org.apache.flink.client.program.ProgramInvocationException: Job failed (JobID: 
c816efb84b476b67cc4934e79a0694cf)
    at 
java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
    at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
    at 
org.apache.flink.client.program.StreamContextEnvironment.getJobExecutionResult(StreamContextEnvironment.java:173)
    at 
org.apache.flink.client.program.StreamContextEnvironment.execute(StreamContextEnvironment.java:123)
    at 
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1969)
    at 
org.apache.flink.streaming.examples.windowing.TopSpeedWindowing.main(TopSpeedWindowing.java:154)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at 
org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355)
    ... 8 more
Caused by: org.apache.flink.client.program.ProgramInvocationException: Job 
failed (JobID: c816efb84b476b67cc4934e79a0694cf)
    at 
org.apache.flink.client.deployment.ClusterClientJobClientAdapter.lambda$null$6(ClusterClientJobClientAdapter.java:130)
    at 
java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:616)
    at 
java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591)
    at 
java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
    at 
java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
    at 
org.apache.flink.util.concurrent.FutureUtils.lambda$retryOperationWithDelay$9(FutureUtils.java:403)
    at 
java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
    at 
java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
    at 
java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
    at 
java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
    at 
org.apache.flink.client.program.rest.RestClusterClient.lambda$pollResourceAsync$26(RestClusterClient.java:708)
    at 
java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
    at 
java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
    at 
java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
    at 
java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
    at 
org.apache.flink.util.concurrent.FutureUtils.lambda$retryOperationWithDelay$9(FutureUtils.java:403)
    at 
java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
    at 
java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
    at 
java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
    at 
java.util.concurrent.CompletableFuture.postFire(CompletableFuture.java:575)
    at 
java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:943)
 

[jira] [Commented] (FLINK-27377) Job manager blocks on marking vertex finished

2022-04-25 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-27377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17527324#comment-17527324
 ] 

Guowei Ma commented on FLINK-27377:
---

Hi [~yittg] thanks for your reporting.

Afaik the commit files action happens at the committer operator instead of the 
JM size after the new sink api [1].

It means this would not happen if you use the new `FlinkSink`.[2]

[1] 
[https://cwiki.apache.org/confluence/display/FLINK/FLIP-143%3A+Unified+Sink+API]

[2] 
[https://github.com/apache/flink/blob/master/flink-connectors/flink-connector-files/src/main/java/org/apache/flink/connector/file/sink/FileSink.java]

 

> Job manager blocks on marking vertex finished
> -
>
> Key: FLINK-27377
> URL: https://issues.apache.org/jira/browse/FLINK-27377
> Project: Flink
>  Issue Type: Bug
>Reporter: Yi Tang
>Priority: Major
>
> I have a case using FileSystem as batch sink, it will commit files by 
> {{FinalizeOnMaster#finalizeGlobal}} while updating state from Running to 
> Finished.
> When {{FinalizeOnMaster#finalizeGlobal}} method is blocked, the 
> {{JobMaster#updateTaskExecutionState}} will also be blocked. Then the job 
> manager can not respond any new requests until 
> {{JobMaster#updateTaskExecutionState}} is complete.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)


[jira] [Assigned] (FLINK-25697) Support HTTPS for Prometheus Push Gateway

2022-01-18 Thread Guowei Ma (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-25697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Guowei Ma reassigned FLINK-25697:
-

Assignee: Mason Chen

> Support HTTPS for Prometheus Push Gateway
> -
>
> Key: FLINK-25697
> URL: https://issues.apache.org/jira/browse/FLINK-25697
> Project: Flink
>  Issue Type: Improvement
>  Components: Runtime / Metrics
>Affects Versions: 1.13.5, 1.14.3
>Reporter: Mason Chen
>Assignee: Mason Chen
>Priority: Major
>
> Currently prometheus push gateway only supports http endpoints. I am 
> proposing a configuration similar to the influxdb reporter 
> (https://issues.apache.org/jira/browse/FLINK-12336) that would allow users to 
> configure a https endpoint.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Assigned] (FLINK-25053) Document how to use the usrlib to load code in the user code class loader

2021-11-28 Thread Guowei Ma (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-25053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Guowei Ma reassigned FLINK-25053:
-

Assignee: Lijie Wang

> Document how to use the usrlib to load code in the user code class loader
> -
>
> Key: FLINK-25053
> URL: https://issues.apache.org/jira/browse/FLINK-25053
> Project: Flink
>  Issue Type: Bug
>  Components: Documentation, Runtime / Coordination
>Affects Versions: 1.14.0, 1.12.5, 1.13.3, 1.15.0
>Reporter: Till Rohrmann
>Assignee: Lijie Wang
>Priority: Major
> Fix For: 1.15.0, 1.14.1, 1.13.4
>
>
> With FLINK-13993 we introduced the {{usrlib}} directory that can be used to 
> load code in the user code class loader. This functionality has not been 
> properly documented so that it is very hard to use. I would suggest to change 
> this so that our users can benefit from this cool feature.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Comment Edited] (FLINK-24767) A keyBy following countWindow does not preserve order within the same partition

2021-11-16 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-24767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1785#comment-1785
 ] 

Guowei Ma edited comment on FLINK-24767 at 11/16/21, 11:27 AM:
---

I think following code could also reproduce this problem.
{code:java}
env.setRuntimeMode(RuntimeExecutionMode.BATCH);

Collection> s = new ArrayList<>();
for (int i = 0; i < 10; i++) {
s.add(Tuple2.of(4, i));
s.add(Tuple2.of(5, i));
}

env.setParallelism(1);
env.fromCollection(s)
.keyBy((KeySelector, Integer>) value -> 
value.f0)
.print();
env.execute("test"); {code}
 


was (Author: maguowei):
{code:java}
env.setRuntimeMode(RuntimeExecutionMode.BATCH);

Collection> s = new ArrayList<>();
for (int i = 0; i < 10; i++) {
s.add(Tuple2.of(4, i));
s.add(Tuple2.of(5, i));
}

env.setParallelism(1);
env.fromCollection(s)
.keyBy((KeySelector, Integer>) value -> 
value.f0)
.print();
env.execute("test"); {code}
I think following code could also reproduce this problem.

> A keyBy following countWindow does not preserve order within the same 
> partition
> ---
>
> Key: FLINK-24767
> URL: https://issues.apache.org/jira/browse/FLINK-24767
> Project: Flink
>  Issue Type: Bug
>  Components: Runtime / Network
>Affects Versions: 1.13.3
>Reporter: Lee Y S
>Priority: Major
>
> I wrote a simple test of the countWindow method (in Kotlin) as below
> {code:java}
> import org.apache.flink.api.common.RuntimeExecutionMode
> import org.apache.flink.api.common.eventtime.WatermarkStrategy
> import org.apache.flink.streaming.api.environment.StreamExecutionEnvironment
> import kotlin.random.Randomobject
> CountWindowTest {
>   @JvmStatic
>   fun main(args: Array) {
>     val env = StreamExecutionEnvironment.getExecutionEnvironment()
>     env.setRuntimeMode(RuntimeExecutionMode.BATCH)
>     val rand = Random(0)
>     val data = (0..1000).map { Pair(rand.nextInt(10), it) }
>     env.fromCollection(data).assignTimestampsAndWatermarks(
>       WatermarkStrategy.forMonotonousTimestamps>()
>         .withTimestampAssigner { e, _ -> e.second.toLong() })
>   .keyBy { it.first }
>       .countWindow(3L, 1)
>   .reduce { a, b -> b }
>   .keyBy { it.first }
>   .filter { it.first == 5 }
>   .print()
> env.execute()
>   }
> }
> {code}
> The beginning of the output is as below
> 12> (5, 184)
>  12> (5, 18)
>  12> (5, 29)
>  12> (5, 37)
>  12> (5, 38)
>  12> (5, 112)
>  12> (5, 131)
> The first line (5, 184) is not in order from the rest.
> The problem disappears if I remove the keyBy after the reduce or use stream 
> mode instead of batch mode.
>   



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Commented] (FLINK-24767) A keyBy following countWindow does not preserve order within the same partition

2021-11-16 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-24767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1785#comment-1785
 ] 

Guowei Ma commented on FLINK-24767:
---

{code:java}
env.setRuntimeMode(RuntimeExecutionMode.BATCH);

Collection> s = new ArrayList<>();
for (int i = 0; i < 10; i++) {
s.add(Tuple2.of(4, i));
s.add(Tuple2.of(5, i));
}

env.setParallelism(1);
env.fromCollection(s)
.keyBy((KeySelector, Integer>) value -> 
value.f0)
.print();
env.execute("test"); {code}
I think following code could also reproduce this problem.

> A keyBy following countWindow does not preserve order within the same 
> partition
> ---
>
> Key: FLINK-24767
> URL: https://issues.apache.org/jira/browse/FLINK-24767
> Project: Flink
>  Issue Type: Bug
>  Components: Runtime / Network
>Affects Versions: 1.13.3
>Reporter: Lee Y S
>Priority: Major
>
> I wrote a simple test of the countWindow method (in Kotlin) as below
> {code:java}
> import org.apache.flink.api.common.RuntimeExecutionMode
> import org.apache.flink.api.common.eventtime.WatermarkStrategy
> import org.apache.flink.streaming.api.environment.StreamExecutionEnvironment
> import kotlin.random.Randomobject
> CountWindowTest {
>   @JvmStatic
>   fun main(args: Array) {
>     val env = StreamExecutionEnvironment.getExecutionEnvironment()
>     env.setRuntimeMode(RuntimeExecutionMode.BATCH)
>     val rand = Random(0)
>     val data = (0..1000).map { Pair(rand.nextInt(10), it) }
>     env.fromCollection(data).assignTimestampsAndWatermarks(
>       WatermarkStrategy.forMonotonousTimestamps>()
>         .withTimestampAssigner { e, _ -> e.second.toLong() })
>   .keyBy { it.first }
>       .countWindow(3L, 1)
>   .reduce { a, b -> b }
>   .keyBy { it.first }
>   .filter { it.first == 5 }
>   .print()
> env.execute()
>   }
> }
> {code}
> The beginning of the output is as below
> 12> (5, 184)
>  12> (5, 18)
>  12> (5, 29)
>  12> (5, 37)
>  12> (5, 38)
>  12> (5, 112)
>  12> (5, 131)
> The first line (5, 184) is not in order from the rest.
> The problem disappears if I remove the keyBy after the reduce or use stream 
> mode instead of batch mode.
>   



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Commented] (FLINK-24767) A keyBy following countWindow does not preserve order within the same partition

2021-11-15 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-24767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17444280#comment-17444280
 ] 

Guowei Ma commented on FLINK-24767:
---

I think it might be that in the Batch execution mode FLINK will "sort" the Key 
and this might be an unstable sort.

> A keyBy following countWindow does not preserve order within the same 
> partition
> ---
>
> Key: FLINK-24767
> URL: https://issues.apache.org/jira/browse/FLINK-24767
> Project: Flink
>  Issue Type: Bug
>  Components: Runtime / Network
>Affects Versions: 1.13.3
>Reporter: Lee Y S
>Priority: Major
>
> I wrote a simple test of the countWindow method (in Kotlin) as below
> {code:java}
> import org.apache.flink.api.common.RuntimeExecutionMode
> import org.apache.flink.api.common.eventtime.WatermarkStrategy
> import org.apache.flink.streaming.api.environment.StreamExecutionEnvironment
> import kotlin.random.Randomobject
> CountWindowTest {
>   @JvmStatic
>   fun main(args: Array) {
>     val env = StreamExecutionEnvironment.getExecutionEnvironment()
>     env.setRuntimeMode(RuntimeExecutionMode.BATCH)
>     val rand = Random(0)
>     val data = (0..1000).map { Pair(rand.nextInt(10), it) }
>     env.fromCollection(data).assignTimestampsAndWatermarks(
>       WatermarkStrategy.forMonotonousTimestamps>()
>         .withTimestampAssigner { e, _ -> e.second.toLong() })
>   .keyBy { it.first }
>       .countWindow(3L, 1)
>   .reduce { a, b -> b }
>   .keyBy { it.first }
>   .filter { it.first == 5 }
>   .print()
> env.execute()
>   }
> }
> {code}
> The beginning of the output is as below
> 12> (5, 184)
>  12> (5, 18)
>  12> (5, 29)
>  12> (5, 37)
>  12> (5, 38)
>  12> (5, 112)
>  12> (5, 131)
> The first line (5, 184) is not in order from the rest.
> The problem disappears if I remove the keyBy after the reduce or use stream 
> mode instead of batch mode.
>   



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Comment Edited] (FLINK-22096) ServerTransportErrorHandlingTest.testRemoteClose fail

2021-10-08 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-22096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17426451#comment-17426451
 ] 

Guowei Ma edited comment on FLINK-22096 at 10/9/21, 4:46 AM:
-

Thank [~tanyuxin] for your attention. I assign this jira to you, please feel 
free to contact me if you have any questions


was (Author: maguowei):
Thank [~tanyuxin] for your attention. I will assign this jira to you, please 
feel free to contact me if you have any questions

> ServerTransportErrorHandlingTest.testRemoteClose fail 
> --
>
> Key: FLINK-22096
> URL: https://issues.apache.org/jira/browse/FLINK-22096
> Project: Flink
>  Issue Type: Bug
>  Components: Runtime / Network
>Affects Versions: 1.13.0, 1.14.0, 1.15.0
>Reporter: Guowei Ma
>Assignee: Yuxin Tan
>Priority: Major
>  Labels: test-stability
> Fix For: 1.13.3, 1.15.0, 1.14.1
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=15966=logs=0da23115-68bb-5dcd-192c-bd4c8adebde1=05b74a19-4ee4-5036-c46f-ada307df6cf0=6580
> {code:java}
> [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.415 
> s <<< FAILURE! - in 
> org.apache.flink.runtime.io.network.netty.ServerTransportErrorHandlingTest
> [ERROR] 
> testRemoteClose(org.apache.flink.runtime.io.network.netty.ServerTransportErrorHandlingTest)
>   Time elapsed: 1.338 s  <<< ERROR!
> org.apache.flink.shaded.netty4.io.netty.channel.unix.Errors$NativeIoException:
>  bind(..) failed: Address already in use
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Assigned] (FLINK-22096) ServerTransportErrorHandlingTest.testRemoteClose fail

2021-10-08 Thread Guowei Ma (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-22096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Guowei Ma reassigned FLINK-22096:
-

Assignee: Yuxin Tan

> ServerTransportErrorHandlingTest.testRemoteClose fail 
> --
>
> Key: FLINK-22096
> URL: https://issues.apache.org/jira/browse/FLINK-22096
> Project: Flink
>  Issue Type: Bug
>  Components: Runtime / Network
>Affects Versions: 1.13.0, 1.14.0, 1.15.0
>Reporter: Guowei Ma
>Assignee: Yuxin Tan
>Priority: Major
>  Labels: test-stability
> Fix For: 1.13.3, 1.15.0, 1.14.1
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=15966=logs=0da23115-68bb-5dcd-192c-bd4c8adebde1=05b74a19-4ee4-5036-c46f-ada307df6cf0=6580
> {code:java}
> [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.415 
> s <<< FAILURE! - in 
> org.apache.flink.runtime.io.network.netty.ServerTransportErrorHandlingTest
> [ERROR] 
> testRemoteClose(org.apache.flink.runtime.io.network.netty.ServerTransportErrorHandlingTest)
>   Time elapsed: 1.338 s  <<< ERROR!
> org.apache.flink.shaded.netty4.io.netty.channel.unix.Errors$NativeIoException:
>  bind(..) failed: Address already in use
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (FLINK-22096) ServerTransportErrorHandlingTest.testRemoteClose fail

2021-10-08 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-22096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17426451#comment-17426451
 ] 

Guowei Ma commented on FLINK-22096:
---

Thank [~tanyuxin] for your attention. I will assign this jira to you, please 
feel free to contact me if you have any questions

> ServerTransportErrorHandlingTest.testRemoteClose fail 
> --
>
> Key: FLINK-22096
> URL: https://issues.apache.org/jira/browse/FLINK-22096
> Project: Flink
>  Issue Type: Bug
>  Components: Runtime / Network
>Affects Versions: 1.13.0, 1.14.0, 1.15.0
>Reporter: Guowei Ma
>Priority: Major
>  Labels: test-stability
> Fix For: 1.13.3, 1.15.0, 1.14.1
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=15966=logs=0da23115-68bb-5dcd-192c-bd4c8adebde1=05b74a19-4ee4-5036-c46f-ada307df6cf0=6580
> {code:java}
> [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.415 
> s <<< FAILURE! - in 
> org.apache.flink.runtime.io.network.netty.ServerTransportErrorHandlingTest
> [ERROR] 
> testRemoteClose(org.apache.flink.runtime.io.network.netty.ServerTransportErrorHandlingTest)
>   Time elapsed: 1.338 s  <<< ERROR!
> org.apache.flink.shaded.netty4.io.netty.channel.unix.Errors$NativeIoException:
>  bind(..) failed: Address already in use
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (FLINK-13247) Implement external shuffle service for YARN

2021-09-30 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-13247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422627#comment-17422627
 ] 

Guowei Ma commented on FLINK-13247:
---

Hi [~dangshazi] 

I am glad you are interested in the this topic. Currently there is no public 
doc yet.

But we are plan to open source our  remote shuffle service in mid-to-late 
October.

 

> Implement external shuffle service for YARN
> ---
>
> Key: FLINK-13247
> URL: https://issues.apache.org/jira/browse/FLINK-13247
> Project: Flink
>  Issue Type: New Feature
>  Components: Runtime / Network
>Reporter: MalcolmSanders
>Priority: Minor
>  Labels: auto-deprioritized-major
>
> Flink batch job users could achieve better cluster utilization and job 
> throughput throught external shuffle service because the producers of 
> intermedia result partitions can be released once intermedia result 
> partitions have been persisted on disks. In 
> [FLINK-10653|https://issues.apache.org/jira/browse/FLINK-10653], [~zjwang] 
> has introduced pluggable shuffle manager architecture which abstracts the 
> process of data transfer between stages from flink runtime as shuffle 
> service. I propose to YARN implementation for flink external shuffle service 
> since YARN is widely used in various companies.
> The basic idea is as follows:
> (1) Producers write intermedia result partitions to local disks assigned by 
> NodeManager;
> (2) Yarn shuffle servers, deployed on each NodeManager as an auxiliary 
> service, are acknowledged of intermedia result partition descriptions by 
> producers;
> (3) Consumers fetch intermedia result partition from yarn shuffle servers;



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Resolved] (FLINK-23235) SinkITCase.writerAndCommitterAndGlobalCommitterExecuteInStreamingMode fails on azure

2021-07-12 Thread Guowei Ma (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-23235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Guowei Ma resolved FLINK-23235.
---
  Assignee: Guowei Ma
Resolution: Fixed

> SinkITCase.writerAndCommitterAndGlobalCommitterExecuteInStreamingMode fails 
> on azure
> 
>
> Key: FLINK-23235
> URL: https://issues.apache.org/jira/browse/FLINK-23235
> Project: Flink
>  Issue Type: Bug
>  Components: API / DataStream
>Affects Versions: 1.13.1
>Reporter: Xintong Song
>Assignee: Guowei Ma
>Priority: Major
>  Labels: pull-request-available, test-stability
> Fix For: 1.14.0, 1.13.2
>
> Attachments: screenshot-1.png
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=19867=logs=02c4e775-43bf-5625-d1cc-542b5209e072=e5961b24-88d9-5c77-efd3-955422674c25=9972
> {code}
> Jul 03 23:57:29 [ERROR] Tests run: 6, Failures: 1, Errors: 0, Skipped: 0, 
> Time elapsed: 5.53 s <<< FAILURE! - in 
> org.apache.flink.test.streaming.runtime.SinkITCase
> Jul 03 23:57:29 [ERROR] 
> writerAndCommitterAndGlobalCommitterExecuteInStreamingMode(org.apache.flink.test.streaming.runtime.SinkITCase)
>   Time elapsed: 0.68 s  <<< FAILURE!
> Jul 03 23:57:29 java.lang.AssertionError: 
> Jul 03 23:57:29 
> Jul 03 23:57:29 Expected: iterable over ["(895,null,-9223372036854775808)", 
> "(895,null,-9223372036854775808)", "(127,null,-9223372036854775808)", 
> "(127,null,-9223372036854775808)", "(148,null,-9223372036854775808)", 
> "(148,null,-9223372036854775808)", "(161,null,-9223372036854775808)", 
> "(161,null,-9223372036854775808)", "(148,null,-9223372036854775808)", 
> "(148,null,-9223372036854775808)", "(662,null,-9223372036854775808)", 
> "(662,null,-9223372036854775808)", "(822,null,-9223372036854775808)", 
> "(822,null,-9223372036854775808)", "(491,null,-9223372036854775808)", 
> "(491,null,-9223372036854775808)", "(275,null,-9223372036854775808)", 
> "(275,null,-9223372036854775808)", "(122,null,-9223372036854775808)", 
> "(122,null,-9223372036854775808)", "(850,null,-9223372036854775808)", 
> "(850,null,-9223372036854775808)", "(630,null,-9223372036854775808)", 
> "(630,null,-9223372036854775808)", "(682,null,-9223372036854775808)", 
> "(682,null,-9223372036854775808)", "(765,null,-9223372036854775808)", 
> "(765,null,-9223372036854775808)", "(434,null,-9223372036854775808)", 
> "(434,null,-9223372036854775808)", "(970,null,-9223372036854775808)", 
> "(970,null,-9223372036854775808)", "(714,null,-9223372036854775808)", 
> "(714,null,-9223372036854775808)", "(795,null,-9223372036854775808)", 
> "(795,null,-9223372036854775808)", "(288,null,-9223372036854775808)", 
> "(288,null,-9223372036854775808)", "(422,null,-9223372036854775808)", 
> "(422,null,-9223372036854775808)"] in any order
> Jul 03 23:57:29  but: Not matched: "end of input"
> Jul 03 23:57:29   at 
> org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
> Jul 03 23:57:29   at 
> org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:8)
> Jul 03 23:57:29   at 
> org.apache.flink.test.streaming.runtime.SinkITCase.writerAndCommitterAndGlobalCommitterExecuteInStreamingMode(SinkITCase.java:139)
> Jul 03 23:57:29   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
> Method)
> Jul 03 23:57:29   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> Jul 03 23:57:29   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> Jul 03 23:57:29   at java.lang.reflect.Method.invoke(Method.java:498)
> Jul 03 23:57:29   at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> Jul 03 23:57:29   at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> Jul 03 23:57:29   at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> Jul 03 23:57:29   at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> Jul 03 23:57:29   at 
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> Jul 03 23:57:29   at 
> org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
> Jul 03 23:57:29   at 
> org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
> Jul 03 23:57:29   at 
> org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
> Jul 03 23:57:29   at org.junit.rules.RunRules.evaluate(RunRules.java:20)
> Jul 03 23:57:29   at 
> org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> Jul 03 23:57:29   at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> Jul 03 23:57:29   at 
> 

[jira] [Comment Edited] (FLINK-23235) SinkITCase.writerAndCommitterAndGlobalCommitterExecuteInStreamingMode fails on azure

2021-07-12 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-23235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17379068#comment-17379068
 ] 

Guowei Ma edited comment on FLINK-23235 at 7/13/21, 2:58 AM:
-

Fix in release-1.13: 92398d42498e61554566ab2dcfd8a5fa8f2a64a2
Fix in master: 2268baf211f1b367e56c8f8d7cd8ee8dee355cab


was (Author: maguowei):
Fix in release-1.13: 92398d42498e61554566ab2dcfd8a5fa8f2a64a2

> SinkITCase.writerAndCommitterAndGlobalCommitterExecuteInStreamingMode fails 
> on azure
> 
>
> Key: FLINK-23235
> URL: https://issues.apache.org/jira/browse/FLINK-23235
> Project: Flink
>  Issue Type: Bug
>  Components: API / DataStream
>Affects Versions: 1.13.1
>Reporter: Xintong Song
>Priority: Major
>  Labels: pull-request-available, test-stability
> Fix For: 1.13.2
>
> Attachments: screenshot-1.png
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=19867=logs=02c4e775-43bf-5625-d1cc-542b5209e072=e5961b24-88d9-5c77-efd3-955422674c25=9972
> {code}
> Jul 03 23:57:29 [ERROR] Tests run: 6, Failures: 1, Errors: 0, Skipped: 0, 
> Time elapsed: 5.53 s <<< FAILURE! - in 
> org.apache.flink.test.streaming.runtime.SinkITCase
> Jul 03 23:57:29 [ERROR] 
> writerAndCommitterAndGlobalCommitterExecuteInStreamingMode(org.apache.flink.test.streaming.runtime.SinkITCase)
>   Time elapsed: 0.68 s  <<< FAILURE!
> Jul 03 23:57:29 java.lang.AssertionError: 
> Jul 03 23:57:29 
> Jul 03 23:57:29 Expected: iterable over ["(895,null,-9223372036854775808)", 
> "(895,null,-9223372036854775808)", "(127,null,-9223372036854775808)", 
> "(127,null,-9223372036854775808)", "(148,null,-9223372036854775808)", 
> "(148,null,-9223372036854775808)", "(161,null,-9223372036854775808)", 
> "(161,null,-9223372036854775808)", "(148,null,-9223372036854775808)", 
> "(148,null,-9223372036854775808)", "(662,null,-9223372036854775808)", 
> "(662,null,-9223372036854775808)", "(822,null,-9223372036854775808)", 
> "(822,null,-9223372036854775808)", "(491,null,-9223372036854775808)", 
> "(491,null,-9223372036854775808)", "(275,null,-9223372036854775808)", 
> "(275,null,-9223372036854775808)", "(122,null,-9223372036854775808)", 
> "(122,null,-9223372036854775808)", "(850,null,-9223372036854775808)", 
> "(850,null,-9223372036854775808)", "(630,null,-9223372036854775808)", 
> "(630,null,-9223372036854775808)", "(682,null,-9223372036854775808)", 
> "(682,null,-9223372036854775808)", "(765,null,-9223372036854775808)", 
> "(765,null,-9223372036854775808)", "(434,null,-9223372036854775808)", 
> "(434,null,-9223372036854775808)", "(970,null,-9223372036854775808)", 
> "(970,null,-9223372036854775808)", "(714,null,-9223372036854775808)", 
> "(714,null,-9223372036854775808)", "(795,null,-9223372036854775808)", 
> "(795,null,-9223372036854775808)", "(288,null,-9223372036854775808)", 
> "(288,null,-9223372036854775808)", "(422,null,-9223372036854775808)", 
> "(422,null,-9223372036854775808)"] in any order
> Jul 03 23:57:29  but: Not matched: "end of input"
> Jul 03 23:57:29   at 
> org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
> Jul 03 23:57:29   at 
> org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:8)
> Jul 03 23:57:29   at 
> org.apache.flink.test.streaming.runtime.SinkITCase.writerAndCommitterAndGlobalCommitterExecuteInStreamingMode(SinkITCase.java:139)
> Jul 03 23:57:29   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
> Method)
> Jul 03 23:57:29   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> Jul 03 23:57:29   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> Jul 03 23:57:29   at java.lang.reflect.Method.invoke(Method.java:498)
> Jul 03 23:57:29   at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> Jul 03 23:57:29   at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> Jul 03 23:57:29   at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> Jul 03 23:57:29   at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> Jul 03 23:57:29   at 
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> Jul 03 23:57:29   at 
> org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
> Jul 03 23:57:29   at 
> org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
> Jul 03 23:57:29   at 
> org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
> Jul 03 23:57:29   at org.junit.rules.RunRules.evaluate(RunRules.java:20)
> Jul 03 23:57:29   at 
> 

[jira] [Updated] (FLINK-23235) SinkITCase.writerAndCommitterAndGlobalCommitterExecuteInStreamingMode fails on azure

2021-07-12 Thread Guowei Ma (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-23235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Guowei Ma updated FLINK-23235:
--
Fix Version/s: 1.14.0

> SinkITCase.writerAndCommitterAndGlobalCommitterExecuteInStreamingMode fails 
> on azure
> 
>
> Key: FLINK-23235
> URL: https://issues.apache.org/jira/browse/FLINK-23235
> Project: Flink
>  Issue Type: Bug
>  Components: API / DataStream
>Affects Versions: 1.13.1
>Reporter: Xintong Song
>Priority: Major
>  Labels: pull-request-available, test-stability
> Fix For: 1.14.0, 1.13.2
>
> Attachments: screenshot-1.png
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=19867=logs=02c4e775-43bf-5625-d1cc-542b5209e072=e5961b24-88d9-5c77-efd3-955422674c25=9972
> {code}
> Jul 03 23:57:29 [ERROR] Tests run: 6, Failures: 1, Errors: 0, Skipped: 0, 
> Time elapsed: 5.53 s <<< FAILURE! - in 
> org.apache.flink.test.streaming.runtime.SinkITCase
> Jul 03 23:57:29 [ERROR] 
> writerAndCommitterAndGlobalCommitterExecuteInStreamingMode(org.apache.flink.test.streaming.runtime.SinkITCase)
>   Time elapsed: 0.68 s  <<< FAILURE!
> Jul 03 23:57:29 java.lang.AssertionError: 
> Jul 03 23:57:29 
> Jul 03 23:57:29 Expected: iterable over ["(895,null,-9223372036854775808)", 
> "(895,null,-9223372036854775808)", "(127,null,-9223372036854775808)", 
> "(127,null,-9223372036854775808)", "(148,null,-9223372036854775808)", 
> "(148,null,-9223372036854775808)", "(161,null,-9223372036854775808)", 
> "(161,null,-9223372036854775808)", "(148,null,-9223372036854775808)", 
> "(148,null,-9223372036854775808)", "(662,null,-9223372036854775808)", 
> "(662,null,-9223372036854775808)", "(822,null,-9223372036854775808)", 
> "(822,null,-9223372036854775808)", "(491,null,-9223372036854775808)", 
> "(491,null,-9223372036854775808)", "(275,null,-9223372036854775808)", 
> "(275,null,-9223372036854775808)", "(122,null,-9223372036854775808)", 
> "(122,null,-9223372036854775808)", "(850,null,-9223372036854775808)", 
> "(850,null,-9223372036854775808)", "(630,null,-9223372036854775808)", 
> "(630,null,-9223372036854775808)", "(682,null,-9223372036854775808)", 
> "(682,null,-9223372036854775808)", "(765,null,-9223372036854775808)", 
> "(765,null,-9223372036854775808)", "(434,null,-9223372036854775808)", 
> "(434,null,-9223372036854775808)", "(970,null,-9223372036854775808)", 
> "(970,null,-9223372036854775808)", "(714,null,-9223372036854775808)", 
> "(714,null,-9223372036854775808)", "(795,null,-9223372036854775808)", 
> "(795,null,-9223372036854775808)", "(288,null,-9223372036854775808)", 
> "(288,null,-9223372036854775808)", "(422,null,-9223372036854775808)", 
> "(422,null,-9223372036854775808)"] in any order
> Jul 03 23:57:29  but: Not matched: "end of input"
> Jul 03 23:57:29   at 
> org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
> Jul 03 23:57:29   at 
> org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:8)
> Jul 03 23:57:29   at 
> org.apache.flink.test.streaming.runtime.SinkITCase.writerAndCommitterAndGlobalCommitterExecuteInStreamingMode(SinkITCase.java:139)
> Jul 03 23:57:29   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
> Method)
> Jul 03 23:57:29   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> Jul 03 23:57:29   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> Jul 03 23:57:29   at java.lang.reflect.Method.invoke(Method.java:498)
> Jul 03 23:57:29   at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> Jul 03 23:57:29   at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> Jul 03 23:57:29   at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> Jul 03 23:57:29   at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> Jul 03 23:57:29   at 
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> Jul 03 23:57:29   at 
> org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
> Jul 03 23:57:29   at 
> org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
> Jul 03 23:57:29   at 
> org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
> Jul 03 23:57:29   at org.junit.rules.RunRules.evaluate(RunRules.java:20)
> Jul 03 23:57:29   at 
> org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> Jul 03 23:57:29   at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> Jul 03 23:57:29   at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> Jul 

[jira] [Commented] (FLINK-23235) SinkITCase.writerAndCommitterAndGlobalCommitterExecuteInStreamingMode fails on azure

2021-07-12 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-23235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17379068#comment-17379068
 ] 

Guowei Ma commented on FLINK-23235:
---

Fix in release-1.13: 92398d42498e61554566ab2dcfd8a5fa8f2a64a2

> SinkITCase.writerAndCommitterAndGlobalCommitterExecuteInStreamingMode fails 
> on azure
> 
>
> Key: FLINK-23235
> URL: https://issues.apache.org/jira/browse/FLINK-23235
> Project: Flink
>  Issue Type: Bug
>  Components: API / DataStream
>Affects Versions: 1.13.1
>Reporter: Xintong Song
>Priority: Major
>  Labels: pull-request-available, test-stability
> Fix For: 1.13.2
>
> Attachments: screenshot-1.png
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=19867=logs=02c4e775-43bf-5625-d1cc-542b5209e072=e5961b24-88d9-5c77-efd3-955422674c25=9972
> {code}
> Jul 03 23:57:29 [ERROR] Tests run: 6, Failures: 1, Errors: 0, Skipped: 0, 
> Time elapsed: 5.53 s <<< FAILURE! - in 
> org.apache.flink.test.streaming.runtime.SinkITCase
> Jul 03 23:57:29 [ERROR] 
> writerAndCommitterAndGlobalCommitterExecuteInStreamingMode(org.apache.flink.test.streaming.runtime.SinkITCase)
>   Time elapsed: 0.68 s  <<< FAILURE!
> Jul 03 23:57:29 java.lang.AssertionError: 
> Jul 03 23:57:29 
> Jul 03 23:57:29 Expected: iterable over ["(895,null,-9223372036854775808)", 
> "(895,null,-9223372036854775808)", "(127,null,-9223372036854775808)", 
> "(127,null,-9223372036854775808)", "(148,null,-9223372036854775808)", 
> "(148,null,-9223372036854775808)", "(161,null,-9223372036854775808)", 
> "(161,null,-9223372036854775808)", "(148,null,-9223372036854775808)", 
> "(148,null,-9223372036854775808)", "(662,null,-9223372036854775808)", 
> "(662,null,-9223372036854775808)", "(822,null,-9223372036854775808)", 
> "(822,null,-9223372036854775808)", "(491,null,-9223372036854775808)", 
> "(491,null,-9223372036854775808)", "(275,null,-9223372036854775808)", 
> "(275,null,-9223372036854775808)", "(122,null,-9223372036854775808)", 
> "(122,null,-9223372036854775808)", "(850,null,-9223372036854775808)", 
> "(850,null,-9223372036854775808)", "(630,null,-9223372036854775808)", 
> "(630,null,-9223372036854775808)", "(682,null,-9223372036854775808)", 
> "(682,null,-9223372036854775808)", "(765,null,-9223372036854775808)", 
> "(765,null,-9223372036854775808)", "(434,null,-9223372036854775808)", 
> "(434,null,-9223372036854775808)", "(970,null,-9223372036854775808)", 
> "(970,null,-9223372036854775808)", "(714,null,-9223372036854775808)", 
> "(714,null,-9223372036854775808)", "(795,null,-9223372036854775808)", 
> "(795,null,-9223372036854775808)", "(288,null,-9223372036854775808)", 
> "(288,null,-9223372036854775808)", "(422,null,-9223372036854775808)", 
> "(422,null,-9223372036854775808)"] in any order
> Jul 03 23:57:29  but: Not matched: "end of input"
> Jul 03 23:57:29   at 
> org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
> Jul 03 23:57:29   at 
> org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:8)
> Jul 03 23:57:29   at 
> org.apache.flink.test.streaming.runtime.SinkITCase.writerAndCommitterAndGlobalCommitterExecuteInStreamingMode(SinkITCase.java:139)
> Jul 03 23:57:29   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
> Method)
> Jul 03 23:57:29   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> Jul 03 23:57:29   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> Jul 03 23:57:29   at java.lang.reflect.Method.invoke(Method.java:498)
> Jul 03 23:57:29   at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> Jul 03 23:57:29   at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> Jul 03 23:57:29   at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> Jul 03 23:57:29   at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> Jul 03 23:57:29   at 
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> Jul 03 23:57:29   at 
> org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
> Jul 03 23:57:29   at 
> org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
> Jul 03 23:57:29   at 
> org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
> Jul 03 23:57:29   at org.junit.rules.RunRules.evaluate(RunRules.java:20)
> Jul 03 23:57:29   at 
> org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> Jul 03 23:57:29   at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> Jul 03 23:57:29   at 
> 

[jira] [Commented] (FLINK-22672) Some enhancements for pluggable shuffle service framework

2021-07-11 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-22672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17378836#comment-17378836
 ] 

Guowei Ma commented on FLINK-22672:
---

Thanks [~jinxing6...@126.com]and [~kevin.cyj] for opening this jira.
I would like to suggest to merge all following three jiras to FLINK-23214:
1. FLINK-23249 Introduce ShuffleMasterContext to ShuffleMaster
2. FLINK-22674 Provide JobID when apply shuffle resource by ShuffleMaster
3. FLINK-22675 Add an interface method ShuffleMaster#close
It is because all these targets are for making the `ShuffleMaster` cluster 
level. It would be good for the other guys to understand when they looks the 
code directly.
WDYT?
Thanks



> Some enhancements for pluggable shuffle service framework
> -
>
> Key: FLINK-22672
> URL: https://issues.apache.org/jira/browse/FLINK-22672
> Project: Flink
>  Issue Type: Improvement
>  Components: Runtime / Network
>Reporter: Jin Xing
>Priority: Major
> Fix For: 1.14.0
>
>
> "Pluggable shuffle service" in Flink provides an architecture which are 
> unified for both streaming and batch jobs, allowing user to customize the 
> process of data transfer between shuffle stages according to scenarios.
> There are already a number of implementations of "remote shuffle service" on 
> Spark like [1][2][3]. Remote shuffle enables to shuffle data from/to a remote 
> cluster and achieves benefits like :
>  # The lifecycle of computing resource can be decoupled with shuffle data, 
> once computing task is finished, idle computing nodes can be released with 
> its completed shuffle data accommodated on remote shuffle cluster.
>  # There is no need to reserve disk capacity for shuffle on computing nodes. 
> Remote shuffle cluster serves shuffling request with better scaling ability 
> and alleviates the local disk pressure on computing nodes when data skew.
> Based on "pluggable shuffle service", we build our own "remote shuffle 
> service" on Flink –- Lattice, which targets to provide functionalities and 
> improve performance for batch processing jobs. Basically it works as below:
>  # Lattice cluster works as an independent service for shuffling request;
>  # LatticeShuffleMaster extends ShuffleMaster, works inside JM and talks with 
> remote Lattice cluster for shuffle resource application and shuffle data 
> lifecycle management;
>  # LatticeShuffleEnvironment extends ShuffleEnvironment, works inside TM and 
> provides an environment for shuffling data from/to remote Lattice cluster;
> During the process of building Lattice we find some potential enhancements on 
> "pluggable shuffle service". I will enumerate and create some sub JIRAs under 
> this umbrella
>  
> [1] 
> [https://www.alibabacloud.com/blog/emr-remote-shuffle-service-a-powerful-elastic-tool-of-serverless-spark_597728]
> [2] [https://bestoreo.github.io/post/cosco/cosco/]
> [3] [https://github.com/uber/RemoteShuffleService]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Closed] (FLINK-20950) SinkITCase.writerAndGlobalCommitterExecuteInStreamingMode test failed with "AssertionError"

2021-07-09 Thread Guowei Ma (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-20950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Guowei Ma closed FLINK-20950.
-

> SinkITCase.writerAndGlobalCommitterExecuteInStreamingMode test failed with 
> "AssertionError"
> ---
>
> Key: FLINK-20950
> URL: https://issues.apache.org/jira/browse/FLINK-20950
> Project: Flink
>  Issue Type: Bug
>  Components: API / DataStream
>Affects Versions: 1.12.2, 1.13.0, 1.14.0
>Reporter: Huang Xingbo
>Priority: Major
>  Labels: auto-deprioritized-critical, auto-unassigned, 
> test-stability
>
> [https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=11940=logs=34f41360-6c0d-54d3-11a1-0292a2def1d9=2d56e022-1ace-542f-bf1a-b37dd63243f2]
> {code:java}
> 2021-01-12T16:47:00.7579536Z [ERROR] Failures: 
> 2021-01-12T16:47:00.7580061Z [ERROR]   
> SinkITCase.writerAndGlobalCommitterExecuteInStreamingMode:218 
> 2021-01-12T16:47:00.7587186Z Expected: iterable over 
> ["(895,null,-9223372036854775808)", "(895,null,-9223372036854775808)", 
> "(127,null,-9223372036854775808)", "(127,null,-9223372036854775808)", 
> "(148,null,-9223372036854775808)", "(148,null,-9223372036854775808)", 
> "(161,null,-9223372036854775808)", "(161,null,-9223372036854775808)", 
> "(148,null,-9223372036854775808)", "(148,null,-9223372036854775808)", 
> "(662,null,-9223372036854775808)", "(662,null,-9223372036854775808)", 
> "(822,null,-9223372036854775808)", "(822,null,-9223372036854775808)", 
> "(491,null,-9223372036854775808)", "(491,null,-9223372036854775808)", 
> "(275,null,-9223372036854775808)", "(275,null,-9223372036854775808)", 
> "(122,null,-9223372036854775808)", "(122,null,-9223372036854775808)", 
> "(850,null,-9223372036854775808)", "(850,null,-9223372036854775808)", 
> "(630,null,-9223372036854775808)", "(630,null,-9223372036854775808)", 
> "(682,null,-9223372036854775808)", "(682,null,-9223372036854775808)", 
> "(765,null,-9223372036854775808)", "(765,null,-9223372036854775808)", 
> "(434,null,-9223372036854775808)", "(434,null,-9223372036854775808)", 
> "(970,null,-9223372036854775808)", "(970,null,-9223372036854775808)", 
> "(714,null,-9223372036854775808)", "(714,null,-9223372036854775808)", 
> "(795,null,-9223372036854775808)", "(795,null,-9223372036854775808)", 
> "(288,null,-9223372036854775808)", "(288,null,-9223372036854775808)", 
> "(422,null,-9223372036854775808)", "(422,null,-9223372036854775808)"] in any 
> order
> 2021-01-12T16:47:00.7591663Z  but: Not matched: "end of input"
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Resolved] (FLINK-20950) SinkITCase.writerAndGlobalCommitterExecuteInStreamingMode test failed with "AssertionError"

2021-07-09 Thread Guowei Ma (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-20950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Guowei Ma resolved FLINK-20950.
---
Resolution: Fixed

> SinkITCase.writerAndGlobalCommitterExecuteInStreamingMode test failed with 
> "AssertionError"
> ---
>
> Key: FLINK-20950
> URL: https://issues.apache.org/jira/browse/FLINK-20950
> Project: Flink
>  Issue Type: Bug
>  Components: API / DataStream
>Affects Versions: 1.12.2, 1.13.0, 1.14.0
>Reporter: Huang Xingbo
>Priority: Major
>  Labels: auto-deprioritized-critical, auto-unassigned, 
> test-stability
>
> [https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=11940=logs=34f41360-6c0d-54d3-11a1-0292a2def1d9=2d56e022-1ace-542f-bf1a-b37dd63243f2]
> {code:java}
> 2021-01-12T16:47:00.7579536Z [ERROR] Failures: 
> 2021-01-12T16:47:00.7580061Z [ERROR]   
> SinkITCase.writerAndGlobalCommitterExecuteInStreamingMode:218 
> 2021-01-12T16:47:00.7587186Z Expected: iterable over 
> ["(895,null,-9223372036854775808)", "(895,null,-9223372036854775808)", 
> "(127,null,-9223372036854775808)", "(127,null,-9223372036854775808)", 
> "(148,null,-9223372036854775808)", "(148,null,-9223372036854775808)", 
> "(161,null,-9223372036854775808)", "(161,null,-9223372036854775808)", 
> "(148,null,-9223372036854775808)", "(148,null,-9223372036854775808)", 
> "(662,null,-9223372036854775808)", "(662,null,-9223372036854775808)", 
> "(822,null,-9223372036854775808)", "(822,null,-9223372036854775808)", 
> "(491,null,-9223372036854775808)", "(491,null,-9223372036854775808)", 
> "(275,null,-9223372036854775808)", "(275,null,-9223372036854775808)", 
> "(122,null,-9223372036854775808)", "(122,null,-9223372036854775808)", 
> "(850,null,-9223372036854775808)", "(850,null,-9223372036854775808)", 
> "(630,null,-9223372036854775808)", "(630,null,-9223372036854775808)", 
> "(682,null,-9223372036854775808)", "(682,null,-9223372036854775808)", 
> "(765,null,-9223372036854775808)", "(765,null,-9223372036854775808)", 
> "(434,null,-9223372036854775808)", "(434,null,-9223372036854775808)", 
> "(970,null,-9223372036854775808)", "(970,null,-9223372036854775808)", 
> "(714,null,-9223372036854775808)", "(714,null,-9223372036854775808)", 
> "(795,null,-9223372036854775808)", "(795,null,-9223372036854775808)", 
> "(288,null,-9223372036854775808)", "(288,null,-9223372036854775808)", 
> "(422,null,-9223372036854775808)", "(422,null,-9223372036854775808)"] in any 
> order
> 2021-01-12T16:47:00.7591663Z  but: Not matched: "end of input"
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (FLINK-23235) SinkITCase.writerAndCommitterAndGlobalCommitterExecuteInStreamingMode fails on azure

2021-07-08 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-23235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377791#comment-17377791
 ] 

Guowei Ma commented on FLINK-23235:
---

I thought about it again. In fact, we only need to exclude the "end of input" 
contained in GLOBAL_COMMIT_QUEUE. Such modification will be simpler than 
modifying TestSink. After the Final Checkpoint is over in the future, it will 
be very convenient to resume the detection of "end of input".

> SinkITCase.writerAndCommitterAndGlobalCommitterExecuteInStreamingMode fails 
> on azure
> 
>
> Key: FLINK-23235
> URL: https://issues.apache.org/jira/browse/FLINK-23235
> Project: Flink
>  Issue Type: Bug
>  Components: API / DataStream
>Affects Versions: 1.13.1
>Reporter: Xintong Song
>Priority: Major
>  Labels: test-stability
> Fix For: 1.13.2
>
> Attachments: screenshot-1.png
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=19867=logs=02c4e775-43bf-5625-d1cc-542b5209e072=e5961b24-88d9-5c77-efd3-955422674c25=9972
> {code}
> Jul 03 23:57:29 [ERROR] Tests run: 6, Failures: 1, Errors: 0, Skipped: 0, 
> Time elapsed: 5.53 s <<< FAILURE! - in 
> org.apache.flink.test.streaming.runtime.SinkITCase
> Jul 03 23:57:29 [ERROR] 
> writerAndCommitterAndGlobalCommitterExecuteInStreamingMode(org.apache.flink.test.streaming.runtime.SinkITCase)
>   Time elapsed: 0.68 s  <<< FAILURE!
> Jul 03 23:57:29 java.lang.AssertionError: 
> Jul 03 23:57:29 
> Jul 03 23:57:29 Expected: iterable over ["(895,null,-9223372036854775808)", 
> "(895,null,-9223372036854775808)", "(127,null,-9223372036854775808)", 
> "(127,null,-9223372036854775808)", "(148,null,-9223372036854775808)", 
> "(148,null,-9223372036854775808)", "(161,null,-9223372036854775808)", 
> "(161,null,-9223372036854775808)", "(148,null,-9223372036854775808)", 
> "(148,null,-9223372036854775808)", "(662,null,-9223372036854775808)", 
> "(662,null,-9223372036854775808)", "(822,null,-9223372036854775808)", 
> "(822,null,-9223372036854775808)", "(491,null,-9223372036854775808)", 
> "(491,null,-9223372036854775808)", "(275,null,-9223372036854775808)", 
> "(275,null,-9223372036854775808)", "(122,null,-9223372036854775808)", 
> "(122,null,-9223372036854775808)", "(850,null,-9223372036854775808)", 
> "(850,null,-9223372036854775808)", "(630,null,-9223372036854775808)", 
> "(630,null,-9223372036854775808)", "(682,null,-9223372036854775808)", 
> "(682,null,-9223372036854775808)", "(765,null,-9223372036854775808)", 
> "(765,null,-9223372036854775808)", "(434,null,-9223372036854775808)", 
> "(434,null,-9223372036854775808)", "(970,null,-9223372036854775808)", 
> "(970,null,-9223372036854775808)", "(714,null,-9223372036854775808)", 
> "(714,null,-9223372036854775808)", "(795,null,-9223372036854775808)", 
> "(795,null,-9223372036854775808)", "(288,null,-9223372036854775808)", 
> "(288,null,-9223372036854775808)", "(422,null,-9223372036854775808)", 
> "(422,null,-9223372036854775808)"] in any order
> Jul 03 23:57:29  but: Not matched: "end of input"
> Jul 03 23:57:29   at 
> org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
> Jul 03 23:57:29   at 
> org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:8)
> Jul 03 23:57:29   at 
> org.apache.flink.test.streaming.runtime.SinkITCase.writerAndCommitterAndGlobalCommitterExecuteInStreamingMode(SinkITCase.java:139)
> Jul 03 23:57:29   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
> Method)
> Jul 03 23:57:29   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> Jul 03 23:57:29   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> Jul 03 23:57:29   at java.lang.reflect.Method.invoke(Method.java:498)
> Jul 03 23:57:29   at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> Jul 03 23:57:29   at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> Jul 03 23:57:29   at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> Jul 03 23:57:29   at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> Jul 03 23:57:29   at 
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> Jul 03 23:57:29   at 
> org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
> Jul 03 23:57:29   at 
> org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
> Jul 03 23:57:29   at 
> org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
> Jul 03 23:57:29   at org.junit.rules.RunRules.evaluate(RunRules.java:20)
> Jul 03 23:57:29   at 
> 

[jira] [Commented] (FLINK-23235) SinkITCase.writerAndCommitterAndGlobalCommitterExecuteInStreamingMode fails on azure

2021-07-08 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-23235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377240#comment-17377240
 ] 

Guowei Ma commented on FLINK-23235:
---

Investigated the reason for this problem: At present, an operator may still 
complete the checkpoint after receiving "EndOfInput". Leading to GlobalCommit 
will submit an "end of input".Specifically, when Checkpoint4 is successful, the 
source node has sent the end-of-input message
 !screenshot-1.png! 
Because at present, it is not certain that an operator can complete a 
checkpoint after receiving "EndOfInput". Therefore, in Streaming mode, I will 
tell the test sink not to output the string "end of input" in endOfInput.

In the future, this will be restored when Final-CP becomes a certainty.


> SinkITCase.writerAndCommitterAndGlobalCommitterExecuteInStreamingMode fails 
> on azure
> 
>
> Key: FLINK-23235
> URL: https://issues.apache.org/jira/browse/FLINK-23235
> Project: Flink
>  Issue Type: Bug
>  Components: API / DataStream
>Affects Versions: 1.13.1
>Reporter: Xintong Song
>Priority: Major
>  Labels: test-stability
> Fix For: 1.13.2
>
> Attachments: screenshot-1.png
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=19867=logs=02c4e775-43bf-5625-d1cc-542b5209e072=e5961b24-88d9-5c77-efd3-955422674c25=9972
> {code}
> Jul 03 23:57:29 [ERROR] Tests run: 6, Failures: 1, Errors: 0, Skipped: 0, 
> Time elapsed: 5.53 s <<< FAILURE! - in 
> org.apache.flink.test.streaming.runtime.SinkITCase
> Jul 03 23:57:29 [ERROR] 
> writerAndCommitterAndGlobalCommitterExecuteInStreamingMode(org.apache.flink.test.streaming.runtime.SinkITCase)
>   Time elapsed: 0.68 s  <<< FAILURE!
> Jul 03 23:57:29 java.lang.AssertionError: 
> Jul 03 23:57:29 
> Jul 03 23:57:29 Expected: iterable over ["(895,null,-9223372036854775808)", 
> "(895,null,-9223372036854775808)", "(127,null,-9223372036854775808)", 
> "(127,null,-9223372036854775808)", "(148,null,-9223372036854775808)", 
> "(148,null,-9223372036854775808)", "(161,null,-9223372036854775808)", 
> "(161,null,-9223372036854775808)", "(148,null,-9223372036854775808)", 
> "(148,null,-9223372036854775808)", "(662,null,-9223372036854775808)", 
> "(662,null,-9223372036854775808)", "(822,null,-9223372036854775808)", 
> "(822,null,-9223372036854775808)", "(491,null,-9223372036854775808)", 
> "(491,null,-9223372036854775808)", "(275,null,-9223372036854775808)", 
> "(275,null,-9223372036854775808)", "(122,null,-9223372036854775808)", 
> "(122,null,-9223372036854775808)", "(850,null,-9223372036854775808)", 
> "(850,null,-9223372036854775808)", "(630,null,-9223372036854775808)", 
> "(630,null,-9223372036854775808)", "(682,null,-9223372036854775808)", 
> "(682,null,-9223372036854775808)", "(765,null,-9223372036854775808)", 
> "(765,null,-9223372036854775808)", "(434,null,-9223372036854775808)", 
> "(434,null,-9223372036854775808)", "(970,null,-9223372036854775808)", 
> "(970,null,-9223372036854775808)", "(714,null,-9223372036854775808)", 
> "(714,null,-9223372036854775808)", "(795,null,-9223372036854775808)", 
> "(795,null,-9223372036854775808)", "(288,null,-9223372036854775808)", 
> "(288,null,-9223372036854775808)", "(422,null,-9223372036854775808)", 
> "(422,null,-9223372036854775808)"] in any order
> Jul 03 23:57:29  but: Not matched: "end of input"
> Jul 03 23:57:29   at 
> org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
> Jul 03 23:57:29   at 
> org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:8)
> Jul 03 23:57:29   at 
> org.apache.flink.test.streaming.runtime.SinkITCase.writerAndCommitterAndGlobalCommitterExecuteInStreamingMode(SinkITCase.java:139)
> Jul 03 23:57:29   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
> Method)
> Jul 03 23:57:29   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> Jul 03 23:57:29   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> Jul 03 23:57:29   at java.lang.reflect.Method.invoke(Method.java:498)
> Jul 03 23:57:29   at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> Jul 03 23:57:29   at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> Jul 03 23:57:29   at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> Jul 03 23:57:29   at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> Jul 03 23:57:29   at 
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> Jul 03 23:57:29   at 
> org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
> Jul 03 

[jira] [Updated] (FLINK-23235) SinkITCase.writerAndCommitterAndGlobalCommitterExecuteInStreamingMode fails on azure

2021-07-08 Thread Guowei Ma (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-23235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Guowei Ma updated FLINK-23235:
--
Attachment: screenshot-1.png

> SinkITCase.writerAndCommitterAndGlobalCommitterExecuteInStreamingMode fails 
> on azure
> 
>
> Key: FLINK-23235
> URL: https://issues.apache.org/jira/browse/FLINK-23235
> Project: Flink
>  Issue Type: Bug
>  Components: API / DataStream
>Affects Versions: 1.13.1
>Reporter: Xintong Song
>Priority: Major
>  Labels: test-stability
> Fix For: 1.13.2
>
> Attachments: screenshot-1.png
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=19867=logs=02c4e775-43bf-5625-d1cc-542b5209e072=e5961b24-88d9-5c77-efd3-955422674c25=9972
> {code}
> Jul 03 23:57:29 [ERROR] Tests run: 6, Failures: 1, Errors: 0, Skipped: 0, 
> Time elapsed: 5.53 s <<< FAILURE! - in 
> org.apache.flink.test.streaming.runtime.SinkITCase
> Jul 03 23:57:29 [ERROR] 
> writerAndCommitterAndGlobalCommitterExecuteInStreamingMode(org.apache.flink.test.streaming.runtime.SinkITCase)
>   Time elapsed: 0.68 s  <<< FAILURE!
> Jul 03 23:57:29 java.lang.AssertionError: 
> Jul 03 23:57:29 
> Jul 03 23:57:29 Expected: iterable over ["(895,null,-9223372036854775808)", 
> "(895,null,-9223372036854775808)", "(127,null,-9223372036854775808)", 
> "(127,null,-9223372036854775808)", "(148,null,-9223372036854775808)", 
> "(148,null,-9223372036854775808)", "(161,null,-9223372036854775808)", 
> "(161,null,-9223372036854775808)", "(148,null,-9223372036854775808)", 
> "(148,null,-9223372036854775808)", "(662,null,-9223372036854775808)", 
> "(662,null,-9223372036854775808)", "(822,null,-9223372036854775808)", 
> "(822,null,-9223372036854775808)", "(491,null,-9223372036854775808)", 
> "(491,null,-9223372036854775808)", "(275,null,-9223372036854775808)", 
> "(275,null,-9223372036854775808)", "(122,null,-9223372036854775808)", 
> "(122,null,-9223372036854775808)", "(850,null,-9223372036854775808)", 
> "(850,null,-9223372036854775808)", "(630,null,-9223372036854775808)", 
> "(630,null,-9223372036854775808)", "(682,null,-9223372036854775808)", 
> "(682,null,-9223372036854775808)", "(765,null,-9223372036854775808)", 
> "(765,null,-9223372036854775808)", "(434,null,-9223372036854775808)", 
> "(434,null,-9223372036854775808)", "(970,null,-9223372036854775808)", 
> "(970,null,-9223372036854775808)", "(714,null,-9223372036854775808)", 
> "(714,null,-9223372036854775808)", "(795,null,-9223372036854775808)", 
> "(795,null,-9223372036854775808)", "(288,null,-9223372036854775808)", 
> "(288,null,-9223372036854775808)", "(422,null,-9223372036854775808)", 
> "(422,null,-9223372036854775808)"] in any order
> Jul 03 23:57:29  but: Not matched: "end of input"
> Jul 03 23:57:29   at 
> org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
> Jul 03 23:57:29   at 
> org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:8)
> Jul 03 23:57:29   at 
> org.apache.flink.test.streaming.runtime.SinkITCase.writerAndCommitterAndGlobalCommitterExecuteInStreamingMode(SinkITCase.java:139)
> Jul 03 23:57:29   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
> Method)
> Jul 03 23:57:29   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> Jul 03 23:57:29   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> Jul 03 23:57:29   at java.lang.reflect.Method.invoke(Method.java:498)
> Jul 03 23:57:29   at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> Jul 03 23:57:29   at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> Jul 03 23:57:29   at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> Jul 03 23:57:29   at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> Jul 03 23:57:29   at 
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> Jul 03 23:57:29   at 
> org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
> Jul 03 23:57:29   at 
> org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
> Jul 03 23:57:29   at 
> org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
> Jul 03 23:57:29   at org.junit.rules.RunRules.evaluate(RunRules.java:20)
> Jul 03 23:57:29   at 
> org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> Jul 03 23:57:29   at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> Jul 03 23:57:29   at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> Jul 03 23:57:29   at 
> 

[jira] [Commented] (FLINK-22613) FlinkKinesisITCase.testStopWithSavepoint fails

2021-05-25 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-22613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17351476#comment-17351476
 ] 

Guowei Ma commented on FLINK-22613:
---

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18330=logs=e1276d0f-df12-55ec-86b5-c0ad597d83c9=906e9244-f3be-5604-1979-e767c8a6f6d9=14059

> FlinkKinesisITCase.testStopWithSavepoint fails
> --
>
> Key: FLINK-22613
> URL: https://issues.apache.org/jira/browse/FLINK-22613
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / Kinesis
>Affects Versions: 1.13.0, 1.14.0, 1.12.3
>Reporter: Guowei Ma
>Assignee: Arvid Heise
>Priority: Blocker
>  Labels: pull-request-available, test-stability
>
> {code:java}
> 2021-05-10T03:09:18.4601182Z May 10 03:09:18 [ERROR] 
> testStopWithSavepoint(org.apache.flink.streaming.connectors.kinesis.FlinkKinesisITCase)
>   Time elapsed: 3.526 s  <<< FAILURE!
> 2021-05-10T03:09:18.4601884Z May 10 03:09:18 java.lang.AssertionError: 
> 2021-05-10T03:09:18.4605902Z May 10 03:09:18 
> 2021-05-10T03:09:18.4616154Z May 10 03:09:18 Expected: a collection with size 
> a value less than <10>
> 2021-05-10T03:09:18.4616818Z May 10 03:09:18  but: collection size <10> 
> was equal to <10>
> 2021-05-10T03:09:18.4618087Z May 10 03:09:18  at 
> org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
> 2021-05-10T03:09:18.4618702Z May 10 03:09:18  at 
> org.junit.Assert.assertThat(Assert.java:956)
> 2021-05-10T03:09:18.4619467Z May 10 03:09:18  at 
> org.junit.Assert.assertThat(Assert.java:923)
> 2021-05-10T03:09:18.4620391Z May 10 03:09:18  at 
> org.apache.flink.streaming.connectors.kinesis.FlinkKinesisITCase.testStopWithSavepoint(FlinkKinesisITCase.java:126)
> 2021-05-10T03:09:18.4621115Z May 10 03:09:18  at 
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 2021-05-10T03:09:18.4621751Z May 10 03:09:18  at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 2021-05-10T03:09:18.4622475Z May 10 03:09:18  at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 2021-05-10T03:09:18.4623142Z May 10 03:09:18  at 
> java.lang.reflect.Method.invoke(Method.java:498)
> 2021-05-10T03:09:18.4623783Z May 10 03:09:18  at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> 2021-05-10T03:09:18.4624514Z May 10 03:09:18  at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 2021-05-10T03:09:18.4625246Z May 10 03:09:18  at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> 2021-05-10T03:09:18.4625967Z May 10 03:09:18  at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> 2021-05-10T03:09:18.4626671Z May 10 03:09:18  at 
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> 2021-05-10T03:09:18.4627349Z May 10 03:09:18  at 
> org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
> 2021-05-10T03:09:18.4627979Z May 10 03:09:18  at 
> org.junit.rules.RunRules.evaluate(RunRules.java:20)
> 2021-05-10T03:09:18.4628582Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> 2021-05-10T03:09:18.4629251Z May 10 03:09:18  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> 2021-05-10T03:09:18.4629950Z May 10 03:09:18  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> 2021-05-10T03:09:18.4630616Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> 2021-05-10T03:09:18.4631339Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> 2021-05-10T03:09:18.4631986Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> 2021-05-10T03:09:18.4632630Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> 2021-05-10T03:09:18.4633269Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> 2021-05-10T03:09:18.4634016Z May 10 03:09:18  at 
> org.testcontainers.containers.FailureDetectingExternalResource$1.evaluate(FailureDetectingExternalResource.java:30)
> 2021-05-10T03:09:18.4634786Z May 10 03:09:18  at 
> org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
> 2021-05-10T03:09:18.4635412Z May 10 03:09:18  at 
> org.junit.rules.RunRules.evaluate(RunRules.java:20)
> 2021-05-10T03:09:18.4635995Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.run(ParentRunner.java:363)
> 2021-05-10T03:09:18.4636656Z May 10 03:09:18  at 
> org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
> 2021-05-10T03:09:18.4637398Z May 10 03:09:18  at 

[jira] [Created] (FLINK-22779) KafkaChangelogTableITCase.testKafkaDebeziumChangelogSource fail due to ConcurrentModificationException

2021-05-25 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-22779:
-

 Summary: 
KafkaChangelogTableITCase.testKafkaDebeziumChangelogSource fail due to 
ConcurrentModificationException
 Key: FLINK-22779
 URL: https://issues.apache.org/jira/browse/FLINK-22779
 Project: Flink
  Issue Type: Bug
  Components: Connectors / Kafka
Affects Versions: 1.13.0
Reporter: Guowei Ma


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18330=logs=c5f0071e-1851-543e-9a45-9ac140befc32=1fb1a56f-e8b5-5a82-00a0-a2db7757b4f5=6608





--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (FLINK-22545) JVM crashes when runing OperatorEventSendingCheckpointITCase.testOperatorEventAckLost

2021-05-25 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-22545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17351455#comment-17351455
 ] 

Guowei Ma commented on FLINK-22545:
---

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18329=logs=baf26b34-3c6a-54e8-f93f-cf269b32f802=6dff16b1-bf54-58f3-23c6-76282f49a185=4346

> JVM crashes when runing 
> OperatorEventSendingCheckpointITCase.testOperatorEventAckLost
> -
>
> Key: FLINK-22545
> URL: https://issues.apache.org/jira/browse/FLINK-22545
> Project: Flink
>  Issue Type: Bug
>  Components: Runtime / Coordination, Tests
>Affects Versions: 1.12.3
>Reporter: Guowei Ma
>Priority: Critical
>  Labels: stale-critical, test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=17501=logs=39d5b1d5-3b41-54dc-6458-1e2ddd1cdcf3=a99e99c7-21cd-5a1f-7274-585e62b72f56=4287



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (FLINK-22756) DispatcherTest.testJobStatusIsShownDuringTermination fail

2021-05-25 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-22756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17351453#comment-17351453
 ] 

Guowei Ma commented on FLINK-22756:
---

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18329=logs=0da23115-68bb-5dcd-192c-bd4c8adebde1=05b74a19-4ee4-5036-c46f-ada307df6cf0=7890

> DispatcherTest.testJobStatusIsShownDuringTermination fail
> -
>
> Key: FLINK-22756
> URL: https://issues.apache.org/jira/browse/FLINK-22756
> Project: Flink
>  Issue Type: Bug
>  Components: Runtime / Coordination
>Affects Versions: 1.12.4
>Reporter: Guowei Ma
>Priority: Major
>  Labels: test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18255=logs=0da23115-68bb-5dcd-192c-bd4c8adebde1=05b74a19-4ee4-5036-c46f-ada307df6cf0=7871
> {code:java}
> 2021-05-21T21:11:09.4635978Z java.util.concurrent.ExecutionException: 
> org.apache.flink.util.FlinkException: JobMaster has been shut down.
> 2021-05-21T21:11:09.4637019Z  at 
> java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
> 2021-05-21T21:11:09.4637464Z  at 
> java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
> 2021-05-21T21:11:09.4637981Z  at 
> org.apache.flink.runtime.dispatcher.DispatcherTest.lambda$testJobStatusIsShownDuringTermination$4(DispatcherTest.java:883)
> 2021-05-21T21:11:09.4638553Z  at 
> org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:145)
> 2021-05-21T21:11:09.4639055Z  at 
> org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:129)
> 2021-05-21T21:11:09.4639610Z  at 
> org.apache.flink.runtime.dispatcher.DispatcherTest.testJobStatusIsShownDuringTermination(DispatcherTest.java:878)
> 2021-05-21T21:11:09.4640216Z  at 
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 2021-05-21T21:11:09.4640602Z  at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 2021-05-21T21:11:09.4641247Z  at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 2021-05-21T21:11:09.4641741Z  at 
> java.lang.reflect.Method.invoke(Method.java:498)
> 2021-05-21T21:11:09.4642140Z  at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> 2021-05-21T21:11:09.4642614Z  at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 2021-05-21T21:11:09.4643071Z  at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> 2021-05-21T21:11:09.4643542Z  at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> 2021-05-21T21:11:09.4644005Z  at 
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> 2021-05-21T21:11:09.4644439Z  at 
> org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
> 2021-05-21T21:11:09.4644856Z  at 
> org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
> 2021-05-21T21:11:09.4645262Z  at 
> org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
> 2021-05-21T21:11:09.4645791Z  at 
> org.apache.flink.runtime.util.TestingFatalErrorHandlerResource$CloseableStatement.evaluate(TestingFatalErrorHandlerResource.java:91)
> 2021-05-21T21:11:09.4646462Z  at 
> org.apache.flink.runtime.util.TestingFatalErrorHandlerResource$CloseableStatement.access$200(TestingFatalErrorHandlerResource.java:83)
> 2021-05-21T21:11:09.4647082Z  at 
> org.apache.flink.runtime.util.TestingFatalErrorHandlerResource$1.evaluate(TestingFatalErrorHandlerResource.java:55)
> 2021-05-21T21:11:09.4647575Z  at 
> org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
> 2021-05-21T21:11:09.4654167Z  at 
> org.junit.rules.RunRules.evaluate(RunRules.java:20)
> 2021-05-21T21:11:09.4654899Z  at 
> org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> 2021-05-21T21:11:09.4655596Z  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> 2021-05-21T21:11:09.4656331Z  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> 2021-05-21T21:11:09.4657027Z  at 
> org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> 2021-05-21T21:11:09.4657627Z  at 
> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> 2021-05-21T21:11:09.4658233Z  at 
> org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> 2021-05-21T21:11:09.4658829Z  at 
> org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> 2021-05-21T21:11:09.4659467Z  at 
> org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> 2021-05-21T21:11:09.4660188Z  at 
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> 

[jira] [Created] (FLINK-22775) CassandraConnectorITCase.testCassandraTableSink Fail

2021-05-25 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-22775:
-

 Summary: CassandraConnectorITCase.testCassandraTableSink Fail
 Key: FLINK-22775
 URL: https://issues.apache.org/jira/browse/FLINK-22775
 Project: Flink
  Issue Type: Bug
  Components: Connectors / Cassandra
Affects Versions: 1.14.0
Reporter: Guowei Ma


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18328=logs=ba53eb01-1462-56a3-8e98-0dd97fbcaab5=bfbc6239-57a0-5db0-63f3-41551b4f7d51=14105


{code:java}
 2021-05-25T23:03:44.0756266Z May 25 23:03:44 [ERROR] 
testCassandraTableSink(org.apache.flink.streaming.connectors.cassandra.CassandraConnectorITCase)
  Time elapsed: 13.673 s  <<< ERROR!
2021-05-25T23:03:44.0757635Z May 25 23:03:44 
java.util.concurrent.ExecutionException: 
org.apache.flink.table.api.TableException: Failed to wait job finish
2021-05-25T23:03:44.0760262Z May 25 23:03:44at 
java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
2021-05-25T23:03:44.0761504Z May 25 23:03:44at 
java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
2021-05-25T23:03:44.0762906Z May 25 23:03:44at 
org.apache.flink.table.api.internal.TableResultImpl.awaitInternal(TableResultImpl.java:129)
2021-05-25T23:03:44.0763878Z May 25 23:03:44at 
org.apache.flink.table.api.internal.TableResultImpl.await(TableResultImpl.java:92)
2021-05-25T23:03:44.0764918Z May 25 23:03:44at 
org.apache.flink.streaming.connectors.cassandra.CassandraConnectorITCase.testCassandraTableSink(CassandraConnectorITCase.java:520)
2021-05-25T23:03:44.0768225Z May 25 23:03:44at 
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2021-05-25T23:03:44.0769100Z May 25 23:03:44at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2021-05-25T23:03:44.0769917Z May 25 23:03:44at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2021-05-25T23:03:44.0770645Z May 25 23:03:44at 
java.lang.reflect.Method.invoke(Method.java:498)
2021-05-25T23:03:44.0771387Z May 25 23:03:44at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
2021-05-25T23:03:44.0772228Z May 25 23:03:44at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
2021-05-25T23:03:44.0773541Z May 25 23:03:44at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
2021-05-25T23:03:44.0774367Z May 25 23:03:44at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
2021-05-25T23:03:44.0775246Z May 25 23:03:44at 
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
2021-05-25T23:03:44.0776088Z May 25 23:03:44at 
org.apache.flink.testutils.junit.RetryRule$RetryOnExceptionStatement.evaluate(RetryRule.java:192)
2021-05-25T23:03:44.0776946Z May 25 23:03:44at 
org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
2021-05-25T23:03:44.0777685Z May 25 23:03:44at 
org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
2021-05-25T23:03:44.0778447Z May 25 23:03:44at 
org.junit.rules.RunRules.evaluate(RunRules.java:20)
2021-05-25T23:03:44.0779110Z May 25 23:03:44at 
org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
2021-05-25T23:03:44.0779893Z May 25 23:03:44at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
2021-05-25T23:03:44.0780744Z May 25 23:03:44at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
2021-05-25T23:03:44.0781493Z May 25 23:03:44at 
org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
2021-05-25T23:03:44.0782154Z May 25 23:03:44at 
org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
2021-05-25T23:03:44.0782899Z May 25 23:03:44at 
org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
2021-05-25T23:03:44.0783576Z May 25 23:03:44at 
org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
2021-05-25T23:03:44.0784312Z May 25 23:03:44at 
org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
2021-05-25T23:03:44.0785020Z May 25 23:03:44at 
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
2021-05-25T23:03:44.0785815Z May 25 23:03:44at 
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
2021-05-25T23:03:44.0786619Z May 25 23:03:44at 
org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
2021-05-25T23:03:44.0787343Z May 25 23:03:44at 
org.junit.rules.RunRules.evaluate(RunRules.java:20)
2021-05-25T23:03:44.0788202Z May 25 23:03:44at 
org.junit.runners.ParentRunner.run(ParentRunner.java:363)
2021-05-25T23:03:44.0789018Z May 25 23:03:44at 
org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)

[jira] [Issue Comment Deleted] (FLINK-22593) SavepointITCase.testShouldAddEntropyToSavepointPath unstable

2021-05-25 Thread Guowei Ma (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-22593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Guowei Ma updated FLINK-22593:
--
Comment: was deleted

(was: 
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18328=logs=4d4a0d10-fca2-5507-8eed-c07f0bdf4887=c2734c79-73b6-521c-e85a-67c7ecae9107=9855)

> SavepointITCase.testShouldAddEntropyToSavepointPath unstable
> 
>
> Key: FLINK-22593
> URL: https://issues.apache.org/jira/browse/FLINK-22593
> Project: Flink
>  Issue Type: Bug
>  Components: Runtime / Checkpointing
>Affects Versions: 1.14.0
>Reporter: Robert Metzger
>Priority: Critical
>  Labels: test-stability
>
> https://dev.azure.com/rmetzger/Flink/_build/results?buildId=9072=logs=cc649950-03e9-5fae-8326-2f1ad744b536=51cab6ca-669f-5dc0-221d-1e4f7dc4fc85
> {code}
> 2021-05-07T10:56:20.9429367Z May 07 10:56:20 [ERROR] Tests run: 13, Failures: 
> 0, Errors: 1, Skipped: 0, Time elapsed: 33.441 s <<< FAILURE! - in 
> org.apache.flink.test.checkpointing.SavepointITCase
> 2021-05-07T10:56:20.9445862Z May 07 10:56:20 [ERROR] 
> testShouldAddEntropyToSavepointPath(org.apache.flink.test.checkpointing.SavepointITCase)
>   Time elapsed: 2.083 s  <<< ERROR!
> 2021-05-07T10:56:20.9447106Z May 07 10:56:20 
> java.util.concurrent.ExecutionException: 
> java.util.concurrent.CompletionException: 
> org.apache.flink.runtime.checkpoint.CheckpointException: Checkpoint 
> triggering task Sink: Unnamed (3/4) of job 4e155a20f0a7895043661a6446caf1cb 
> has not being executed at the moment. Aborting checkpoint. Failure reason: 
> Not all required tasks are currently running.
> 2021-05-07T10:56:20.9448194Z May 07 10:56:20  at 
> java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
> 2021-05-07T10:56:20.9448797Z May 07 10:56:20  at 
> java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
> 2021-05-07T10:56:20.9449428Z May 07 10:56:20  at 
> org.apache.flink.test.checkpointing.SavepointITCase.submitJobAndTakeSavepoint(SavepointITCase.java:305)
> 2021-05-07T10:56:20.9450160Z May 07 10:56:20  at 
> org.apache.flink.test.checkpointing.SavepointITCase.testShouldAddEntropyToSavepointPath(SavepointITCase.java:273)
> 2021-05-07T10:56:20.9450785Z May 07 10:56:20  at 
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 2021-05-07T10:56:20.9451331Z May 07 10:56:20  at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 2021-05-07T10:56:20.9451940Z May 07 10:56:20  at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 2021-05-07T10:56:20.9452498Z May 07 10:56:20  at 
> java.lang.reflect.Method.invoke(Method.java:498)
> 2021-05-07T10:56:20.9453247Z May 07 10:56:20  at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> 2021-05-07T10:56:20.9454007Z May 07 10:56:20  at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 2021-05-07T10:56:20.9454687Z May 07 10:56:20  at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> 2021-05-07T10:56:20.9455302Z May 07 10:56:20  at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> 2021-05-07T10:56:20.9455909Z May 07 10:56:20  at 
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> 2021-05-07T10:56:20.9456493Z May 07 10:56:20  at 
> org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
> 2021-05-07T10:56:20.9457074Z May 07 10:56:20  at 
> org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
> 2021-05-07T10:56:20.9457636Z May 07 10:56:20  at 
> org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
> 2021-05-07T10:56:20.9458157Z May 07 10:56:20  at 
> org.junit.rules.RunRules.evaluate(RunRules.java:20)
> 2021-05-07T10:56:20.9458678Z May 07 10:56:20  at 
> org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> 2021-05-07T10:56:20.9459252Z May 07 10:56:20  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> 2021-05-07T10:56:20.9459865Z May 07 10:56:20  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> 2021-05-07T10:56:20.9460433Z May 07 10:56:20  at 
> org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> 2021-05-07T10:56:20.9461058Z May 07 10:56:20  at 
> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> 2021-05-07T10:56:20.9461607Z May 07 10:56:20  at 
> org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> 2021-05-07T10:56:20.9462159Z May 07 10:56:20  at 
> org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> 2021-05-07T10:56:20.9462705Z May 07 10:56:20  at 
> 

[jira] [Commented] (FLINK-22593) SavepointITCase.testShouldAddEntropyToSavepointPath unstable

2021-05-25 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-22593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17351443#comment-17351443
 ] 

Guowei Ma commented on FLINK-22593:
---

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18328=logs=4d4a0d10-fca2-5507-8eed-c07f0bdf4887=c2734c79-73b6-521c-e85a-67c7ecae9107=9855

> SavepointITCase.testShouldAddEntropyToSavepointPath unstable
> 
>
> Key: FLINK-22593
> URL: https://issues.apache.org/jira/browse/FLINK-22593
> Project: Flink
>  Issue Type: Bug
>  Components: Runtime / Checkpointing
>Affects Versions: 1.14.0
>Reporter: Robert Metzger
>Priority: Critical
>  Labels: test-stability
>
> https://dev.azure.com/rmetzger/Flink/_build/results?buildId=9072=logs=cc649950-03e9-5fae-8326-2f1ad744b536=51cab6ca-669f-5dc0-221d-1e4f7dc4fc85
> {code}
> 2021-05-07T10:56:20.9429367Z May 07 10:56:20 [ERROR] Tests run: 13, Failures: 
> 0, Errors: 1, Skipped: 0, Time elapsed: 33.441 s <<< FAILURE! - in 
> org.apache.flink.test.checkpointing.SavepointITCase
> 2021-05-07T10:56:20.9445862Z May 07 10:56:20 [ERROR] 
> testShouldAddEntropyToSavepointPath(org.apache.flink.test.checkpointing.SavepointITCase)
>   Time elapsed: 2.083 s  <<< ERROR!
> 2021-05-07T10:56:20.9447106Z May 07 10:56:20 
> java.util.concurrent.ExecutionException: 
> java.util.concurrent.CompletionException: 
> org.apache.flink.runtime.checkpoint.CheckpointException: Checkpoint 
> triggering task Sink: Unnamed (3/4) of job 4e155a20f0a7895043661a6446caf1cb 
> has not being executed at the moment. Aborting checkpoint. Failure reason: 
> Not all required tasks are currently running.
> 2021-05-07T10:56:20.9448194Z May 07 10:56:20  at 
> java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
> 2021-05-07T10:56:20.9448797Z May 07 10:56:20  at 
> java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
> 2021-05-07T10:56:20.9449428Z May 07 10:56:20  at 
> org.apache.flink.test.checkpointing.SavepointITCase.submitJobAndTakeSavepoint(SavepointITCase.java:305)
> 2021-05-07T10:56:20.9450160Z May 07 10:56:20  at 
> org.apache.flink.test.checkpointing.SavepointITCase.testShouldAddEntropyToSavepointPath(SavepointITCase.java:273)
> 2021-05-07T10:56:20.9450785Z May 07 10:56:20  at 
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 2021-05-07T10:56:20.9451331Z May 07 10:56:20  at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 2021-05-07T10:56:20.9451940Z May 07 10:56:20  at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 2021-05-07T10:56:20.9452498Z May 07 10:56:20  at 
> java.lang.reflect.Method.invoke(Method.java:498)
> 2021-05-07T10:56:20.9453247Z May 07 10:56:20  at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> 2021-05-07T10:56:20.9454007Z May 07 10:56:20  at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 2021-05-07T10:56:20.9454687Z May 07 10:56:20  at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> 2021-05-07T10:56:20.9455302Z May 07 10:56:20  at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> 2021-05-07T10:56:20.9455909Z May 07 10:56:20  at 
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> 2021-05-07T10:56:20.9456493Z May 07 10:56:20  at 
> org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
> 2021-05-07T10:56:20.9457074Z May 07 10:56:20  at 
> org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
> 2021-05-07T10:56:20.9457636Z May 07 10:56:20  at 
> org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
> 2021-05-07T10:56:20.9458157Z May 07 10:56:20  at 
> org.junit.rules.RunRules.evaluate(RunRules.java:20)
> 2021-05-07T10:56:20.9458678Z May 07 10:56:20  at 
> org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> 2021-05-07T10:56:20.9459252Z May 07 10:56:20  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> 2021-05-07T10:56:20.9459865Z May 07 10:56:20  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> 2021-05-07T10:56:20.9460433Z May 07 10:56:20  at 
> org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> 2021-05-07T10:56:20.9461058Z May 07 10:56:20  at 
> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> 2021-05-07T10:56:20.9461607Z May 07 10:56:20  at 
> org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> 2021-05-07T10:56:20.9462159Z May 07 10:56:20  at 
> org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> 2021-05-07T10:56:20.9462705Z May 07 10:56:20  at 
> 

[jira] [Commented] (FLINK-22593) SavepointITCase.testShouldAddEntropyToSavepointPath unstable

2021-05-25 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-22593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17351442#comment-17351442
 ] 

Guowei Ma commented on FLINK-22593:
---

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18328=logs=39d5b1d5-3b41-54dc-6458-1e2ddd1cdcf3=a99e99c7-21cd-5a1f-7274-585e62b72f56=4481

> SavepointITCase.testShouldAddEntropyToSavepointPath unstable
> 
>
> Key: FLINK-22593
> URL: https://issues.apache.org/jira/browse/FLINK-22593
> Project: Flink
>  Issue Type: Bug
>  Components: Runtime / Checkpointing
>Affects Versions: 1.14.0
>Reporter: Robert Metzger
>Priority: Critical
>  Labels: test-stability
>
> https://dev.azure.com/rmetzger/Flink/_build/results?buildId=9072=logs=cc649950-03e9-5fae-8326-2f1ad744b536=51cab6ca-669f-5dc0-221d-1e4f7dc4fc85
> {code}
> 2021-05-07T10:56:20.9429367Z May 07 10:56:20 [ERROR] Tests run: 13, Failures: 
> 0, Errors: 1, Skipped: 0, Time elapsed: 33.441 s <<< FAILURE! - in 
> org.apache.flink.test.checkpointing.SavepointITCase
> 2021-05-07T10:56:20.9445862Z May 07 10:56:20 [ERROR] 
> testShouldAddEntropyToSavepointPath(org.apache.flink.test.checkpointing.SavepointITCase)
>   Time elapsed: 2.083 s  <<< ERROR!
> 2021-05-07T10:56:20.9447106Z May 07 10:56:20 
> java.util.concurrent.ExecutionException: 
> java.util.concurrent.CompletionException: 
> org.apache.flink.runtime.checkpoint.CheckpointException: Checkpoint 
> triggering task Sink: Unnamed (3/4) of job 4e155a20f0a7895043661a6446caf1cb 
> has not being executed at the moment. Aborting checkpoint. Failure reason: 
> Not all required tasks are currently running.
> 2021-05-07T10:56:20.9448194Z May 07 10:56:20  at 
> java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
> 2021-05-07T10:56:20.9448797Z May 07 10:56:20  at 
> java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
> 2021-05-07T10:56:20.9449428Z May 07 10:56:20  at 
> org.apache.flink.test.checkpointing.SavepointITCase.submitJobAndTakeSavepoint(SavepointITCase.java:305)
> 2021-05-07T10:56:20.9450160Z May 07 10:56:20  at 
> org.apache.flink.test.checkpointing.SavepointITCase.testShouldAddEntropyToSavepointPath(SavepointITCase.java:273)
> 2021-05-07T10:56:20.9450785Z May 07 10:56:20  at 
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 2021-05-07T10:56:20.9451331Z May 07 10:56:20  at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 2021-05-07T10:56:20.9451940Z May 07 10:56:20  at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 2021-05-07T10:56:20.9452498Z May 07 10:56:20  at 
> java.lang.reflect.Method.invoke(Method.java:498)
> 2021-05-07T10:56:20.9453247Z May 07 10:56:20  at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> 2021-05-07T10:56:20.9454007Z May 07 10:56:20  at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 2021-05-07T10:56:20.9454687Z May 07 10:56:20  at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> 2021-05-07T10:56:20.9455302Z May 07 10:56:20  at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> 2021-05-07T10:56:20.9455909Z May 07 10:56:20  at 
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> 2021-05-07T10:56:20.9456493Z May 07 10:56:20  at 
> org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
> 2021-05-07T10:56:20.9457074Z May 07 10:56:20  at 
> org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
> 2021-05-07T10:56:20.9457636Z May 07 10:56:20  at 
> org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
> 2021-05-07T10:56:20.9458157Z May 07 10:56:20  at 
> org.junit.rules.RunRules.evaluate(RunRules.java:20)
> 2021-05-07T10:56:20.9458678Z May 07 10:56:20  at 
> org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> 2021-05-07T10:56:20.9459252Z May 07 10:56:20  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> 2021-05-07T10:56:20.9459865Z May 07 10:56:20  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> 2021-05-07T10:56:20.9460433Z May 07 10:56:20  at 
> org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> 2021-05-07T10:56:20.9461058Z May 07 10:56:20  at 
> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> 2021-05-07T10:56:20.9461607Z May 07 10:56:20  at 
> org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> 2021-05-07T10:56:20.9462159Z May 07 10:56:20  at 
> org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> 2021-05-07T10:56:20.9462705Z May 07 10:56:20  at 
> 

[jira] [Updated] (FLINK-20420) ES6 ElasticsearchSinkITCase failed due to no output for 900 seconds

2021-05-25 Thread Guowei Ma (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-20420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Guowei Ma updated FLINK-20420:
--
Affects Version/s: 1.14.0

> ES6 ElasticsearchSinkITCase failed due to no output for 900 seconds
> ---
>
> Key: FLINK-20420
> URL: https://issues.apache.org/jira/browse/FLINK-20420
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / ElasticSearch
>Affects Versions: 1.12.0, 1.13.0, 1.14.0
>Reporter: Yun Tang
>Priority: Major
>  Labels: test-stability
>
> Instance:
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=10249=logs=d44f43ce-542c-597d-bf94-b0718c71e5e8=03dca39c-73e8-5aaf-601d-328ae5c35f20=18821
> {code:java}
> Process produced no output for 900 seconds.
> ==
> ==
> The following Java processes are running (JPS)
> ==
> Picked up JAVA_TOOL_OPTIONS: -XX:+HeapDumpOnOutOfMemoryError
> 2274 Launcher
> 18260 Jps
> 15916 surefirebooter3434370240444055571.jar
> ==
> "main" #1 prio=5 os_prio=0 tid=0x7feec000b800 nid=0x3e2d runnable 
> [0x7feec8541000]
>java.lang.Thread.State: RUNNABLE
>   at org.testcontainers.shaded.okio.Buffer.indexOf(Buffer.java:1463)
>   at 
> org.testcontainers.shaded.okio.RealBufferedSource.indexOf(RealBufferedSource.java:352)
>   at 
> org.testcontainers.shaded.okio.RealBufferedSource.readUtf8LineStrict(RealBufferedSource.java:230)
>   at 
> org.testcontainers.shaded.okio.RealBufferedSource.readUtf8LineStrict(RealBufferedSource.java:224)
>   at 
> org.testcontainers.shaded.okhttp3.internal.http1.Http1ExchangeCodec$ChunkedSource.readChunkSize(Http1ExchangeCodec.java:489)
>   at 
> org.testcontainers.shaded.okhttp3.internal.http1.Http1ExchangeCodec$ChunkedSource.read(Http1ExchangeCodec.java:471)
>   at 
> org.testcontainers.shaded.okhttp3.internal.Util.skipAll(Util.java:204)
>   at 
> org.testcontainers.shaded.okhttp3.internal.Util.discard(Util.java:186)
>   at 
> org.testcontainers.shaded.okhttp3.internal.http1.Http1ExchangeCodec$ChunkedSource.close(Http1ExchangeCodec.java:511)
>   at 
> org.testcontainers.shaded.okio.ForwardingSource.close(ForwardingSource.java:43)
>   at 
> org.testcontainers.shaded.okhttp3.internal.connection.Exchange$ResponseBodySource.close(Exchange.java:313)
>   at 
> org.testcontainers.shaded.okio.RealBufferedSource.close(RealBufferedSource.java:476)
>   at 
> org.testcontainers.shaded.okhttp3.internal.Util.closeQuietly(Util.java:139)
>   at 
> org.testcontainers.shaded.okhttp3.ResponseBody.close(ResponseBody.java:192)
>   at org.testcontainers.shaded.okhttp3.Response.close(Response.java:290)
>   at 
> org.testcontainers.shaded.com.github.dockerjava.okhttp.OkDockerHttpClient$OkResponse.close(OkDockerHttpClient.java:280)
>   at 
> org.testcontainers.shaded.com.github.dockerjava.core.DefaultInvocationBuilder.lambda$null$0(DefaultInvocationBuilder.java:272)
>   at 
> org.testcontainers.shaded.com.github.dockerjava.core.DefaultInvocationBuilder$$Lambda$87/1112018050.close(Unknown
>  Source)
>   at 
> com.github.dockerjava.api.async.ResultCallbackTemplate.close(ResultCallbackTemplate.java:77)
>   at 
> org.testcontainers.utility.ResourceReaper.start(ResourceReaper.java:177)
>   at 
> org.testcontainers.DockerClientFactory.client(DockerClientFactory.java:203)
>   - locked <0x88fcbbf0> (a [Ljava.lang.Object;)
>   at 
> org.testcontainers.LazyDockerClient.getDockerClient(LazyDockerClient.java:14)
>   at 
> org.testcontainers.LazyDockerClient.listImagesCmd(LazyDockerClient.java:12)
>   at 
> org.testcontainers.images.LocalImagesCache.maybeInitCache(LocalImagesCache.java:68)
>   - locked <0x88fcb940> (a 
> org.testcontainers.images.LocalImagesCache)
>   at 
> org.testcontainers.images.LocalImagesCache.get(LocalImagesCache.java:32)
>   at 
> org.testcontainers.images.AbstractImagePullPolicy.shouldPull(AbstractImagePullPolicy.java:18)
>   at 
> org.testcontainers.images.RemoteDockerImage.resolve(RemoteDockerImage.java:66)
>   at 
> org.testcontainers.images.RemoteDockerImage.resolve(RemoteDockerImage.java:27)
>   at 
> org.testcontainers.utility.LazyFuture.getResolvedValue(LazyFuture.java:17)
>   - locked <0x890763d0> (a 
> java.util.concurrent.atomic.AtomicReference)
>   at org.testcontainers.utility.LazyFuture.get(LazyFuture.java:39)
>   at 
> 

[jira] [Commented] (FLINK-20420) ES6 ElasticsearchSinkITCase failed due to no output for 900 seconds

2021-05-25 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-20420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17351441#comment-17351441
 ] 

Guowei Ma commented on FLINK-20420:
---

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18328=logs=d44f43ce-542c-597d-bf94-b0718c71e5e8=03dca39c-73e8-5aaf-601d-328ae5c35f20=12249

> ES6 ElasticsearchSinkITCase failed due to no output for 900 seconds
> ---
>
> Key: FLINK-20420
> URL: https://issues.apache.org/jira/browse/FLINK-20420
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / ElasticSearch
>Affects Versions: 1.12.0, 1.13.0
>Reporter: Yun Tang
>Priority: Major
>  Labels: test-stability
>
> Instance:
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=10249=logs=d44f43ce-542c-597d-bf94-b0718c71e5e8=03dca39c-73e8-5aaf-601d-328ae5c35f20=18821
> {code:java}
> Process produced no output for 900 seconds.
> ==
> ==
> The following Java processes are running (JPS)
> ==
> Picked up JAVA_TOOL_OPTIONS: -XX:+HeapDumpOnOutOfMemoryError
> 2274 Launcher
> 18260 Jps
> 15916 surefirebooter3434370240444055571.jar
> ==
> "main" #1 prio=5 os_prio=0 tid=0x7feec000b800 nid=0x3e2d runnable 
> [0x7feec8541000]
>java.lang.Thread.State: RUNNABLE
>   at org.testcontainers.shaded.okio.Buffer.indexOf(Buffer.java:1463)
>   at 
> org.testcontainers.shaded.okio.RealBufferedSource.indexOf(RealBufferedSource.java:352)
>   at 
> org.testcontainers.shaded.okio.RealBufferedSource.readUtf8LineStrict(RealBufferedSource.java:230)
>   at 
> org.testcontainers.shaded.okio.RealBufferedSource.readUtf8LineStrict(RealBufferedSource.java:224)
>   at 
> org.testcontainers.shaded.okhttp3.internal.http1.Http1ExchangeCodec$ChunkedSource.readChunkSize(Http1ExchangeCodec.java:489)
>   at 
> org.testcontainers.shaded.okhttp3.internal.http1.Http1ExchangeCodec$ChunkedSource.read(Http1ExchangeCodec.java:471)
>   at 
> org.testcontainers.shaded.okhttp3.internal.Util.skipAll(Util.java:204)
>   at 
> org.testcontainers.shaded.okhttp3.internal.Util.discard(Util.java:186)
>   at 
> org.testcontainers.shaded.okhttp3.internal.http1.Http1ExchangeCodec$ChunkedSource.close(Http1ExchangeCodec.java:511)
>   at 
> org.testcontainers.shaded.okio.ForwardingSource.close(ForwardingSource.java:43)
>   at 
> org.testcontainers.shaded.okhttp3.internal.connection.Exchange$ResponseBodySource.close(Exchange.java:313)
>   at 
> org.testcontainers.shaded.okio.RealBufferedSource.close(RealBufferedSource.java:476)
>   at 
> org.testcontainers.shaded.okhttp3.internal.Util.closeQuietly(Util.java:139)
>   at 
> org.testcontainers.shaded.okhttp3.ResponseBody.close(ResponseBody.java:192)
>   at org.testcontainers.shaded.okhttp3.Response.close(Response.java:290)
>   at 
> org.testcontainers.shaded.com.github.dockerjava.okhttp.OkDockerHttpClient$OkResponse.close(OkDockerHttpClient.java:280)
>   at 
> org.testcontainers.shaded.com.github.dockerjava.core.DefaultInvocationBuilder.lambda$null$0(DefaultInvocationBuilder.java:272)
>   at 
> org.testcontainers.shaded.com.github.dockerjava.core.DefaultInvocationBuilder$$Lambda$87/1112018050.close(Unknown
>  Source)
>   at 
> com.github.dockerjava.api.async.ResultCallbackTemplate.close(ResultCallbackTemplate.java:77)
>   at 
> org.testcontainers.utility.ResourceReaper.start(ResourceReaper.java:177)
>   at 
> org.testcontainers.DockerClientFactory.client(DockerClientFactory.java:203)
>   - locked <0x88fcbbf0> (a [Ljava.lang.Object;)
>   at 
> org.testcontainers.LazyDockerClient.getDockerClient(LazyDockerClient.java:14)
>   at 
> org.testcontainers.LazyDockerClient.listImagesCmd(LazyDockerClient.java:12)
>   at 
> org.testcontainers.images.LocalImagesCache.maybeInitCache(LocalImagesCache.java:68)
>   - locked <0x88fcb940> (a 
> org.testcontainers.images.LocalImagesCache)
>   at 
> org.testcontainers.images.LocalImagesCache.get(LocalImagesCache.java:32)
>   at 
> org.testcontainers.images.AbstractImagePullPolicy.shouldPull(AbstractImagePullPolicy.java:18)
>   at 
> org.testcontainers.images.RemoteDockerImage.resolve(RemoteDockerImage.java:66)
>   at 
> org.testcontainers.images.RemoteDockerImage.resolve(RemoteDockerImage.java:27)
>   at 
> org.testcontainers.utility.LazyFuture.getResolvedValue(LazyFuture.java:17)
>   - locked <0x890763d0> (a 
> 

[jira] [Commented] (FLINK-22613) FlinkKinesisITCase.testStopWithSavepoint fails

2021-05-22 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-22613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17349764#comment-17349764
 ] 

Guowei Ma commented on FLINK-22613:
---

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18255=logs=e1276d0f-df12-55ec-86b5-c0ad597d83c9=906e9244-f3be-5604-1979-e767c8a6f6d9=13978

> FlinkKinesisITCase.testStopWithSavepoint fails
> --
>
> Key: FLINK-22613
> URL: https://issues.apache.org/jira/browse/FLINK-22613
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / Kinesis
>Affects Versions: 1.13.0, 1.14.0, 1.12.3
>Reporter: Guowei Ma
>Priority: Blocker
>  Labels: test-stability
>
> {code:java}
> 2021-05-10T03:09:18.4601182Z May 10 03:09:18 [ERROR] 
> testStopWithSavepoint(org.apache.flink.streaming.connectors.kinesis.FlinkKinesisITCase)
>   Time elapsed: 3.526 s  <<< FAILURE!
> 2021-05-10T03:09:18.4601884Z May 10 03:09:18 java.lang.AssertionError: 
> 2021-05-10T03:09:18.4605902Z May 10 03:09:18 
> 2021-05-10T03:09:18.4616154Z May 10 03:09:18 Expected: a collection with size 
> a value less than <10>
> 2021-05-10T03:09:18.4616818Z May 10 03:09:18  but: collection size <10> 
> was equal to <10>
> 2021-05-10T03:09:18.4618087Z May 10 03:09:18  at 
> org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
> 2021-05-10T03:09:18.4618702Z May 10 03:09:18  at 
> org.junit.Assert.assertThat(Assert.java:956)
> 2021-05-10T03:09:18.4619467Z May 10 03:09:18  at 
> org.junit.Assert.assertThat(Assert.java:923)
> 2021-05-10T03:09:18.4620391Z May 10 03:09:18  at 
> org.apache.flink.streaming.connectors.kinesis.FlinkKinesisITCase.testStopWithSavepoint(FlinkKinesisITCase.java:126)
> 2021-05-10T03:09:18.4621115Z May 10 03:09:18  at 
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 2021-05-10T03:09:18.4621751Z May 10 03:09:18  at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 2021-05-10T03:09:18.4622475Z May 10 03:09:18  at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 2021-05-10T03:09:18.4623142Z May 10 03:09:18  at 
> java.lang.reflect.Method.invoke(Method.java:498)
> 2021-05-10T03:09:18.4623783Z May 10 03:09:18  at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> 2021-05-10T03:09:18.4624514Z May 10 03:09:18  at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 2021-05-10T03:09:18.4625246Z May 10 03:09:18  at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> 2021-05-10T03:09:18.4625967Z May 10 03:09:18  at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> 2021-05-10T03:09:18.4626671Z May 10 03:09:18  at 
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> 2021-05-10T03:09:18.4627349Z May 10 03:09:18  at 
> org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
> 2021-05-10T03:09:18.4627979Z May 10 03:09:18  at 
> org.junit.rules.RunRules.evaluate(RunRules.java:20)
> 2021-05-10T03:09:18.4628582Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> 2021-05-10T03:09:18.4629251Z May 10 03:09:18  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> 2021-05-10T03:09:18.4629950Z May 10 03:09:18  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> 2021-05-10T03:09:18.4630616Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> 2021-05-10T03:09:18.4631339Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> 2021-05-10T03:09:18.4631986Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> 2021-05-10T03:09:18.4632630Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> 2021-05-10T03:09:18.4633269Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> 2021-05-10T03:09:18.4634016Z May 10 03:09:18  at 
> org.testcontainers.containers.FailureDetectingExternalResource$1.evaluate(FailureDetectingExternalResource.java:30)
> 2021-05-10T03:09:18.4634786Z May 10 03:09:18  at 
> org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
> 2021-05-10T03:09:18.4635412Z May 10 03:09:18  at 
> org.junit.rules.RunRules.evaluate(RunRules.java:20)
> 2021-05-10T03:09:18.4635995Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.run(ParentRunner.java:363)
> 2021-05-10T03:09:18.4636656Z May 10 03:09:18  at 
> org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
> 2021-05-10T03:09:18.4637398Z May 10 03:09:18  at 
> 

[jira] [Created] (FLINK-22756) DispatcherTest.testJobStatusIsShownDuringTermination fail

2021-05-22 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-22756:
-

 Summary: DispatcherTest.testJobStatusIsShownDuringTermination fail
 Key: FLINK-22756
 URL: https://issues.apache.org/jira/browse/FLINK-22756
 Project: Flink
  Issue Type: Bug
  Components: Runtime / Coordination
Affects Versions: 1.12.4
Reporter: Guowei Ma


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18255=logs=0da23115-68bb-5dcd-192c-bd4c8adebde1=05b74a19-4ee4-5036-c46f-ada307df6cf0=7871


{code:java}
2021-05-21T21:11:09.4635978Z java.util.concurrent.ExecutionException: 
org.apache.flink.util.FlinkException: JobMaster has been shut down.
2021-05-21T21:11:09.4637019Zat 
java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
2021-05-21T21:11:09.4637464Zat 
java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
2021-05-21T21:11:09.4637981Zat 
org.apache.flink.runtime.dispatcher.DispatcherTest.lambda$testJobStatusIsShownDuringTermination$4(DispatcherTest.java:883)
2021-05-21T21:11:09.4638553Zat 
org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:145)
2021-05-21T21:11:09.4639055Zat 
org.apache.flink.runtime.testutils.CommonTestUtils.waitUntilCondition(CommonTestUtils.java:129)
2021-05-21T21:11:09.4639610Zat 
org.apache.flink.runtime.dispatcher.DispatcherTest.testJobStatusIsShownDuringTermination(DispatcherTest.java:878)
2021-05-21T21:11:09.4640216Zat 
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2021-05-21T21:11:09.4640602Zat 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2021-05-21T21:11:09.4641247Zat 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2021-05-21T21:11:09.4641741Zat 
java.lang.reflect.Method.invoke(Method.java:498)
2021-05-21T21:11:09.4642140Zat 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
2021-05-21T21:11:09.4642614Zat 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
2021-05-21T21:11:09.4643071Zat 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
2021-05-21T21:11:09.4643542Zat 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
2021-05-21T21:11:09.4644005Zat 
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
2021-05-21T21:11:09.4644439Zat 
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
2021-05-21T21:11:09.4644856Zat 
org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
2021-05-21T21:11:09.4645262Zat 
org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
2021-05-21T21:11:09.4645791Zat 
org.apache.flink.runtime.util.TestingFatalErrorHandlerResource$CloseableStatement.evaluate(TestingFatalErrorHandlerResource.java:91)
2021-05-21T21:11:09.4646462Zat 
org.apache.flink.runtime.util.TestingFatalErrorHandlerResource$CloseableStatement.access$200(TestingFatalErrorHandlerResource.java:83)
2021-05-21T21:11:09.4647082Zat 
org.apache.flink.runtime.util.TestingFatalErrorHandlerResource$1.evaluate(TestingFatalErrorHandlerResource.java:55)
2021-05-21T21:11:09.4647575Zat 
org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
2021-05-21T21:11:09.4654167Zat 
org.junit.rules.RunRules.evaluate(RunRules.java:20)
2021-05-21T21:11:09.4654899Zat 
org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
2021-05-21T21:11:09.4655596Zat 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
2021-05-21T21:11:09.4656331Zat 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
2021-05-21T21:11:09.4657027Zat 
org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
2021-05-21T21:11:09.4657627Zat 
org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
2021-05-21T21:11:09.4658233Zat 
org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
2021-05-21T21:11:09.4658829Zat 
org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
2021-05-21T21:11:09.4659467Zat 
org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
2021-05-21T21:11:09.4660188Zat 
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
2021-05-21T21:11:09.4660863Zat 
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
2021-05-21T21:11:09.4661874Zat 
org.junit.runners.ParentRunner.run(ParentRunner.java:363)
2021-05-21T21:11:09.4662519Zat 
org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
2021-05-21T21:11:09.4663240Zat 
org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
2021-05-21T21:11:09.4664297Zat 

[jira] [Commented] (FLINK-22382) ProcessFailureCancelingITCase.testCancelingOnProcessFailure

2021-05-22 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-22382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17349760#comment-17349760
 ] 

Guowei Ma commented on FLINK-22382:
---

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18254=logs=a549b384-c55a-52c0-c451-00e0477ab6db=81f2da51-a161-54c7-5b84-6001fed26530=9730

> ProcessFailureCancelingITCase.testCancelingOnProcessFailure
> ---
>
> Key: FLINK-22382
> URL: https://issues.apache.org/jira/browse/FLINK-22382
> Project: Flink
>  Issue Type: Bug
>  Components: Runtime / Coordination, Runtime / Task
>Affects Versions: 1.13.0
>Reporter: Dawid Wysakowicz
>Priority: Major
>  Labels: test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=16896=logs=a57e0635-3fad-5b08-57c7-a4142d7d6fa9=5360d54c-8d94-5d85-304e-a89267eb785a=9756
> {code}
> Apr 20 18:05:14   Suppressed: java.util.concurrent.TimeoutException
> Apr 20 18:05:14   at 
> org.apache.flink.core.testutils.CommonTestUtils.waitUtil(CommonTestUtils.java:210)
> Apr 20 18:05:14   at 
> org.apache.flink.test.recovery.ProcessFailureCancelingITCase.waitUntilAtLeastOneTaskHasBeenDeployed(ProcessFailureCancelingITCase.java:236)
> Apr 20 18:05:14   at 
> org.apache.flink.test.recovery.ProcessFailureCancelingITCase.testCancelingOnProcessFailure(ProcessFailureCancelingITCase.java:193)
> Apr 20 18:05:14   at 
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> Apr 20 18:05:14   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> Apr 20 18:05:14   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> Apr 20 18:05:14   at 
> java.lang.reflect.Method.invoke(Method.java:498)
> Apr 20 18:05:14   at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> Apr 20 18:05:14   at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> Apr 20 18:05:14   at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> Apr 20 18:05:14   at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> Apr 20 18:05:14   at 
> org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
> Apr 20 18:05:14   at 
> org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
> Apr 20 18:05:14   at 
> org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
> Apr 20 18:05:14   at 
> org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
> Apr 20 18:05:14   at 
> org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
> Apr 20 18:05:14   at 
> org.junit.rules.RunRules.evaluate(RunRules.java:20)
> Apr 20 18:05:14   at 
> org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> Apr 20 18:05:14   at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> Apr 20 18:05:14   at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> Apr 20 18:05:14   at 
> org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> Apr 20 18:05:14   at 
> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> Apr 20 18:05:14   at 
> org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> Apr 20 18:05:14   at 
> org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> Apr 20 18:05:14   at 
> org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> Apr 20 18:05:14   at 
> org.junit.runners.ParentRunner.run(ParentRunner.java:363)
> Apr 20 18:05:14   at 
> org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
> Apr 20 18:05:14   at 
> org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
> Apr 20 18:05:14   at 
> org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
> Apr 20 18:05:14   at 
> org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
> Apr 20 18:05:14   at 
> org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
> Apr 20 18:05:14   at 
> org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
> Apr 20 18:05:14   at 
> org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
> Apr 20 18:05:14   at 
> 

[jira] [Commented] (FLINK-22593) SavepointITCase.testShouldAddEntropyToSavepointPath unstable

2021-05-22 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-22593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17349747#comment-17349747
 ] 

Guowei Ma commented on FLINK-22593:
---

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18224=logs=d44f43ce-542c-597d-bf94-b0718c71e5e8=03dca39c-73e8-5aaf-601d-328ae5c35f20=14321

> SavepointITCase.testShouldAddEntropyToSavepointPath unstable
> 
>
> Key: FLINK-22593
> URL: https://issues.apache.org/jira/browse/FLINK-22593
> Project: Flink
>  Issue Type: Bug
>  Components: Runtime / Checkpointing
>Affects Versions: 1.14.0
>Reporter: Robert Metzger
>Priority: Critical
>  Labels: test-stability
>
> https://dev.azure.com/rmetzger/Flink/_build/results?buildId=9072=logs=cc649950-03e9-5fae-8326-2f1ad744b536=51cab6ca-669f-5dc0-221d-1e4f7dc4fc85
> {code}
> 2021-05-07T10:56:20.9429367Z May 07 10:56:20 [ERROR] Tests run: 13, Failures: 
> 0, Errors: 1, Skipped: 0, Time elapsed: 33.441 s <<< FAILURE! - in 
> org.apache.flink.test.checkpointing.SavepointITCase
> 2021-05-07T10:56:20.9445862Z May 07 10:56:20 [ERROR] 
> testShouldAddEntropyToSavepointPath(org.apache.flink.test.checkpointing.SavepointITCase)
>   Time elapsed: 2.083 s  <<< ERROR!
> 2021-05-07T10:56:20.9447106Z May 07 10:56:20 
> java.util.concurrent.ExecutionException: 
> java.util.concurrent.CompletionException: 
> org.apache.flink.runtime.checkpoint.CheckpointException: Checkpoint 
> triggering task Sink: Unnamed (3/4) of job 4e155a20f0a7895043661a6446caf1cb 
> has not being executed at the moment. Aborting checkpoint. Failure reason: 
> Not all required tasks are currently running.
> 2021-05-07T10:56:20.9448194Z May 07 10:56:20  at 
> java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
> 2021-05-07T10:56:20.9448797Z May 07 10:56:20  at 
> java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
> 2021-05-07T10:56:20.9449428Z May 07 10:56:20  at 
> org.apache.flink.test.checkpointing.SavepointITCase.submitJobAndTakeSavepoint(SavepointITCase.java:305)
> 2021-05-07T10:56:20.9450160Z May 07 10:56:20  at 
> org.apache.flink.test.checkpointing.SavepointITCase.testShouldAddEntropyToSavepointPath(SavepointITCase.java:273)
> 2021-05-07T10:56:20.9450785Z May 07 10:56:20  at 
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 2021-05-07T10:56:20.9451331Z May 07 10:56:20  at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 2021-05-07T10:56:20.9451940Z May 07 10:56:20  at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 2021-05-07T10:56:20.9452498Z May 07 10:56:20  at 
> java.lang.reflect.Method.invoke(Method.java:498)
> 2021-05-07T10:56:20.9453247Z May 07 10:56:20  at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> 2021-05-07T10:56:20.9454007Z May 07 10:56:20  at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 2021-05-07T10:56:20.9454687Z May 07 10:56:20  at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> 2021-05-07T10:56:20.9455302Z May 07 10:56:20  at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> 2021-05-07T10:56:20.9455909Z May 07 10:56:20  at 
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> 2021-05-07T10:56:20.9456493Z May 07 10:56:20  at 
> org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
> 2021-05-07T10:56:20.9457074Z May 07 10:56:20  at 
> org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
> 2021-05-07T10:56:20.9457636Z May 07 10:56:20  at 
> org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
> 2021-05-07T10:56:20.9458157Z May 07 10:56:20  at 
> org.junit.rules.RunRules.evaluate(RunRules.java:20)
> 2021-05-07T10:56:20.9458678Z May 07 10:56:20  at 
> org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> 2021-05-07T10:56:20.9459252Z May 07 10:56:20  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> 2021-05-07T10:56:20.9459865Z May 07 10:56:20  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> 2021-05-07T10:56:20.9460433Z May 07 10:56:20  at 
> org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> 2021-05-07T10:56:20.9461058Z May 07 10:56:20  at 
> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> 2021-05-07T10:56:20.9461607Z May 07 10:56:20  at 
> org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> 2021-05-07T10:56:20.9462159Z May 07 10:56:20  at 
> org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> 2021-05-07T10:56:20.9462705Z May 07 10:56:20  at 
> 

[jira] [Commented] (FLINK-20928) KafkaSourceReaderTest.testOffsetCommitOnCheckpointComplete:189->pollUntil:270 » Timeout

2021-05-22 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-20928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17349746#comment-17349746
 ] 

Guowei Ma commented on FLINK-20928:
---

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18254=logs=c5f0071e-1851-543e-9a45-9ac140befc32=1fb1a56f-e8b5-5a82-00a0-a2db7757b4f5=6913

> KafkaSourceReaderTest.testOffsetCommitOnCheckpointComplete:189->pollUntil:270 
> » Timeout
> ---
>
> Key: FLINK-20928
> URL: https://issues.apache.org/jira/browse/FLINK-20928
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / Kafka
>Affects Versions: 1.13.0
>Reporter: Robert Metzger
>Priority: Major
>  Labels: auto-deprioritized-critical, test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=11861=logs=c5f0071e-1851-543e-9a45-9ac140befc32=1fb1a56f-e8b5-5a82-00a0-a2db7757b4f5
> {code}
> [ERROR] Tests run: 8, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 
> 93.992 s <<< FAILURE! - in 
> org.apache.flink.connector.kafka.source.reader.KafkaSourceReaderTest
> [ERROR] 
> testOffsetCommitOnCheckpointComplete(org.apache.flink.connector.kafka.source.reader.KafkaSourceReaderTest)
>   Time elapsed: 60.086 s  <<< ERROR!
> java.util.concurrent.TimeoutException: The offset commit did not finish 
> before timeout.
>   at 
> org.apache.flink.core.testutils.CommonTestUtils.waitUtil(CommonTestUtils.java:210)
>   at 
> org.apache.flink.connector.kafka.source.reader.KafkaSourceReaderTest.pollUntil(KafkaSourceReaderTest.java:270)
>   at 
> org.apache.flink.connector.kafka.source.reader.KafkaSourceReaderTest.testOffsetCommitOnCheckpointComplete(KafkaSourceReaderTest.java:189)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-22755) SequenceStreamingFileSinkITCase.testWriteSequenceFile fail

2021-05-22 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-22755:
-

 Summary: SequenceStreamingFileSinkITCase.testWriteSequenceFile fail
 Key: FLINK-22755
 URL: https://issues.apache.org/jira/browse/FLINK-22755
 Project: Flink
  Issue Type: Bug
  Components: Connectors / FileSystem
Affects Versions: 1.14.0
Reporter: Guowei Ma


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18224=logs=d44f43ce-542c-597d-bf94-b0718c71e5e8=03dca39c-73e8-5aaf-601d-328ae5c35f20=14321


{code:java}
May 21 09:00:00 [ERROR] Failures: 
May 21 09:00:00 [ERROR]   
SequenceStreamingFileSinkITCase.testWriteSequenceFile:97->validateResults:119 
expected:<1> but was:<2>
May 21 09:00:00 [INFO] 

{code}




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (FLINK-22738) org.apache.flink.connector.jdbc.xa.JdbcExactlyOnceSinkE2eTest no output for 900 seconds due to block on docker container removal

2021-05-22 Thread Guowei Ma (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-22738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Guowei Ma updated FLINK-22738:
--
Affects Version/s: 1.14.0

> org.apache.flink.connector.jdbc.xa.JdbcExactlyOnceSinkE2eTest no output for 
> 900 seconds due to block on docker container removal
> 
>
> Key: FLINK-22738
> URL: https://issues.apache.org/jira/browse/FLINK-22738
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / JDBC
>Affects Versions: 1.13.0, 1.14.0
>Reporter: Guowei Ma
>Priority: Major
>  Labels: test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18207=logs=d44f43ce-542c-597d-bf94-b0718c71e5e8=03dca39c-73e8-5aaf-601d-328ae5c35f20=13626
> {code:java}
> 2021-05-20T23:12:33.7620808Z May 20 23:12:33 "main" #1 prio=5 os_prio=0 
> tid=0x7fa6c400b800 nid=0x45f3 runnable [0x7fa6cb1cd000]
> 2021-05-20T23:12:33.7621514Z May 20 23:12:33java.lang.Thread.State: 
> RUNNABLE
> 2021-05-20T23:12:33.7622205Z May 20 23:12:33  at 
> org.testcontainers.shaded.okio.Buffer.indexOf(Buffer.java:1463)
> 2021-05-20T23:12:33.7623070Z May 20 23:12:33  at 
> org.testcontainers.shaded.okio.RealBufferedSource.indexOf(RealBufferedSource.java:352)
> 2021-05-20T23:12:33.7624186Z May 20 23:12:33  at 
> org.testcontainers.shaded.okio.RealBufferedSource.readUtf8LineStrict(RealBufferedSource.java:230)
> 2021-05-20T23:12:33.7625161Z May 20 23:12:33  at 
> org.testcontainers.shaded.okio.RealBufferedSource.readUtf8LineStrict(RealBufferedSource.java:224)
> 2021-05-20T23:12:33.7626488Z May 20 23:12:33  at 
> org.testcontainers.shaded.okhttp3.internal.http1.Http1ExchangeCodec$ChunkedSource.readChunkSize(Http1ExchangeCodec.java:489)
> 2021-05-20T23:12:33.7627762Z May 20 23:12:33  at 
> org.testcontainers.shaded.okhttp3.internal.http1.Http1ExchangeCodec$ChunkedSource.read(Http1ExchangeCodec.java:471)
> 2021-05-20T23:12:33.7628864Z May 20 23:12:33  at 
> org.testcontainers.shaded.okhttp3.internal.Util.skipAll(Util.java:204)
> 2021-05-20T23:12:33.7629713Z May 20 23:12:33  at 
> org.testcontainers.shaded.okhttp3.internal.Util.discard(Util.java:186)
> 2021-05-20T23:12:33.7630720Z May 20 23:12:33  at 
> org.testcontainers.shaded.okhttp3.internal.http1.Http1ExchangeCodec$ChunkedSource.close(Http1ExchangeCodec.java:511)
> 2021-05-20T23:12:33.7631677Z May 20 23:12:33  at 
> org.testcontainers.shaded.okio.ForwardingSource.close(ForwardingSource.java:43)
> 2021-05-20T23:12:33.7632685Z May 20 23:12:33  at 
> org.testcontainers.shaded.okhttp3.internal.connection.Exchange$ResponseBodySource.close(Exchange.java:313)
> 2021-05-20T23:12:33.7633800Z May 20 23:12:33  at 
> org.testcontainers.shaded.okio.RealBufferedSource.close(RealBufferedSource.java:476)
> 2021-05-20T23:12:33.7634690Z May 20 23:12:33  at 
> org.testcontainers.shaded.okhttp3.internal.Util.closeQuietly(Util.java:139)
> 2021-05-20T23:12:33.763Z May 20 23:12:33  at 
> org.testcontainers.shaded.okhttp3.ResponseBody.close(ResponseBody.java:192)
> 2021-05-20T23:12:33.7636403Z May 20 23:12:33  at 
> org.testcontainers.shaded.okhttp3.Response.close(Response.java:290)
> 2021-05-20T23:12:33.7637381Z May 20 23:12:33  at 
> org.testcontainers.shaded.com.github.dockerjava.okhttp.OkDockerHttpClient$OkResponse.close(OkDockerHttpClient.java:285)
> 2021-05-20T23:12:33.7638608Z May 20 23:12:33  at 
> org.testcontainers.shaded.com.github.dockerjava.core.DefaultInvocationBuilder.lambda$null$0(DefaultInvocationBuilder.java:272)
> 2021-05-20T23:12:33.7639473Z May 20 23:12:33  at 
> org.testcontainers.shaded.com.github.dockerjava.core.DefaultInvocationBuilder$$Lambda$83/733374718.close(Unknown
>  Source)
> 2021-05-20T23:12:33.7640236Z May 20 23:12:33  at 
> com.github.dockerjava.api.async.ResultCallbackTemplate.close(ResultCallbackTemplate.java:77)
> 2021-05-20T23:12:33.7641079Z May 20 23:12:33  at 
> org.testcontainers.utility.ResourceReaper.start(ResourceReaper.java:202)
> 2021-05-20T23:12:33.7641912Z May 20 23:12:33  at 
> org.testcontainers.DockerClientFactory.client(DockerClientFactory.java:205)
> 2021-05-20T23:12:33.7643123Z May 20 23:12:33  - locked <0x991ac238> 
> (a [Ljava.lang.Object;)
> 2021-05-20T23:12:33.7644023Z May 20 23:12:33  at 
> org.testcontainers.LazyDockerClient.getDockerClient(LazyDockerClient.java:14)
> 2021-05-20T23:12:33.7644880Z May 20 23:12:33  at 
> org.testcontainers.LazyDockerClient.authConfig(LazyDockerClient.java:12)
> 2021-05-20T23:12:33.7645712Z May 20 23:12:33  at 
> org.testcontainers.containers.GenericContainer.start(GenericContainer.java:310)
> 2021-05-20T23:12:33.7646636Z May 20 23:12:33  at 
> org.testcontainers.containers.GenericContainer.starting(GenericContainer.java:1029)
> 2021-05-20T23:12:33.7647619Z May 

[jira] [Updated] (FLINK-22738) org.apache.flink.connector.jdbc.xa.JdbcExactlyOnceSinkE2eTest no output for 900 seconds due to block on docker container removal

2021-05-22 Thread Guowei Ma (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-22738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Guowei Ma updated FLINK-22738:
--
Summary: org.apache.flink.connector.jdbc.xa.JdbcExactlyOnceSinkE2eTest no 
output for 900 seconds due to block on docker container removal  (was: 
org.apache.flink.connector.jdbc.xa.JdbcExactlyOnceSinkE2eTest no output for 900 
seconds due to block on downloading  docker image )

> org.apache.flink.connector.jdbc.xa.JdbcExactlyOnceSinkE2eTest no output for 
> 900 seconds due to block on docker container removal
> 
>
> Key: FLINK-22738
> URL: https://issues.apache.org/jira/browse/FLINK-22738
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / JDBC
>Affects Versions: 1.13.0
>Reporter: Guowei Ma
>Priority: Major
>  Labels: test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18207=logs=d44f43ce-542c-597d-bf94-b0718c71e5e8=03dca39c-73e8-5aaf-601d-328ae5c35f20=13626
> {code:java}
> 2021-05-20T23:12:33.7620808Z May 20 23:12:33 "main" #1 prio=5 os_prio=0 
> tid=0x7fa6c400b800 nid=0x45f3 runnable [0x7fa6cb1cd000]
> 2021-05-20T23:12:33.7621514Z May 20 23:12:33java.lang.Thread.State: 
> RUNNABLE
> 2021-05-20T23:12:33.7622205Z May 20 23:12:33  at 
> org.testcontainers.shaded.okio.Buffer.indexOf(Buffer.java:1463)
> 2021-05-20T23:12:33.7623070Z May 20 23:12:33  at 
> org.testcontainers.shaded.okio.RealBufferedSource.indexOf(RealBufferedSource.java:352)
> 2021-05-20T23:12:33.7624186Z May 20 23:12:33  at 
> org.testcontainers.shaded.okio.RealBufferedSource.readUtf8LineStrict(RealBufferedSource.java:230)
> 2021-05-20T23:12:33.7625161Z May 20 23:12:33  at 
> org.testcontainers.shaded.okio.RealBufferedSource.readUtf8LineStrict(RealBufferedSource.java:224)
> 2021-05-20T23:12:33.7626488Z May 20 23:12:33  at 
> org.testcontainers.shaded.okhttp3.internal.http1.Http1ExchangeCodec$ChunkedSource.readChunkSize(Http1ExchangeCodec.java:489)
> 2021-05-20T23:12:33.7627762Z May 20 23:12:33  at 
> org.testcontainers.shaded.okhttp3.internal.http1.Http1ExchangeCodec$ChunkedSource.read(Http1ExchangeCodec.java:471)
> 2021-05-20T23:12:33.7628864Z May 20 23:12:33  at 
> org.testcontainers.shaded.okhttp3.internal.Util.skipAll(Util.java:204)
> 2021-05-20T23:12:33.7629713Z May 20 23:12:33  at 
> org.testcontainers.shaded.okhttp3.internal.Util.discard(Util.java:186)
> 2021-05-20T23:12:33.7630720Z May 20 23:12:33  at 
> org.testcontainers.shaded.okhttp3.internal.http1.Http1ExchangeCodec$ChunkedSource.close(Http1ExchangeCodec.java:511)
> 2021-05-20T23:12:33.7631677Z May 20 23:12:33  at 
> org.testcontainers.shaded.okio.ForwardingSource.close(ForwardingSource.java:43)
> 2021-05-20T23:12:33.7632685Z May 20 23:12:33  at 
> org.testcontainers.shaded.okhttp3.internal.connection.Exchange$ResponseBodySource.close(Exchange.java:313)
> 2021-05-20T23:12:33.7633800Z May 20 23:12:33  at 
> org.testcontainers.shaded.okio.RealBufferedSource.close(RealBufferedSource.java:476)
> 2021-05-20T23:12:33.7634690Z May 20 23:12:33  at 
> org.testcontainers.shaded.okhttp3.internal.Util.closeQuietly(Util.java:139)
> 2021-05-20T23:12:33.763Z May 20 23:12:33  at 
> org.testcontainers.shaded.okhttp3.ResponseBody.close(ResponseBody.java:192)
> 2021-05-20T23:12:33.7636403Z May 20 23:12:33  at 
> org.testcontainers.shaded.okhttp3.Response.close(Response.java:290)
> 2021-05-20T23:12:33.7637381Z May 20 23:12:33  at 
> org.testcontainers.shaded.com.github.dockerjava.okhttp.OkDockerHttpClient$OkResponse.close(OkDockerHttpClient.java:285)
> 2021-05-20T23:12:33.7638608Z May 20 23:12:33  at 
> org.testcontainers.shaded.com.github.dockerjava.core.DefaultInvocationBuilder.lambda$null$0(DefaultInvocationBuilder.java:272)
> 2021-05-20T23:12:33.7639473Z May 20 23:12:33  at 
> org.testcontainers.shaded.com.github.dockerjava.core.DefaultInvocationBuilder$$Lambda$83/733374718.close(Unknown
>  Source)
> 2021-05-20T23:12:33.7640236Z May 20 23:12:33  at 
> com.github.dockerjava.api.async.ResultCallbackTemplate.close(ResultCallbackTemplate.java:77)
> 2021-05-20T23:12:33.7641079Z May 20 23:12:33  at 
> org.testcontainers.utility.ResourceReaper.start(ResourceReaper.java:202)
> 2021-05-20T23:12:33.7641912Z May 20 23:12:33  at 
> org.testcontainers.DockerClientFactory.client(DockerClientFactory.java:205)
> 2021-05-20T23:12:33.7643123Z May 20 23:12:33  - locked <0x991ac238> 
> (a [Ljava.lang.Object;)
> 2021-05-20T23:12:33.7644023Z May 20 23:12:33  at 
> org.testcontainers.LazyDockerClient.getDockerClient(LazyDockerClient.java:14)
> 2021-05-20T23:12:33.7644880Z May 20 23:12:33  at 
> org.testcontainers.LazyDockerClient.authConfig(LazyDockerClient.java:12)
> 2021-05-20T23:12:33.7645712Z May 20 23:12:33  at 
> 

[jira] [Commented] (FLINK-22738) org.apache.flink.connector.jdbc.xa.JdbcExactlyOnceSinkE2eTest no output for 900 seconds due to block on docker container removal

2021-05-22 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-22738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17349745#comment-17349745
 ] 

Guowei Ma commented on FLINK-22738:
---

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18215=logs=d44f43ce-542c-597d-bf94-b0718c71e5e8=03dca39c-73e8-5aaf-601d-328ae5c35f20=13584

> org.apache.flink.connector.jdbc.xa.JdbcExactlyOnceSinkE2eTest no output for 
> 900 seconds due to block on docker container removal
> 
>
> Key: FLINK-22738
> URL: https://issues.apache.org/jira/browse/FLINK-22738
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / JDBC
>Affects Versions: 1.13.0
>Reporter: Guowei Ma
>Priority: Major
>  Labels: test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18207=logs=d44f43ce-542c-597d-bf94-b0718c71e5e8=03dca39c-73e8-5aaf-601d-328ae5c35f20=13626
> {code:java}
> 2021-05-20T23:12:33.7620808Z May 20 23:12:33 "main" #1 prio=5 os_prio=0 
> tid=0x7fa6c400b800 nid=0x45f3 runnable [0x7fa6cb1cd000]
> 2021-05-20T23:12:33.7621514Z May 20 23:12:33java.lang.Thread.State: 
> RUNNABLE
> 2021-05-20T23:12:33.7622205Z May 20 23:12:33  at 
> org.testcontainers.shaded.okio.Buffer.indexOf(Buffer.java:1463)
> 2021-05-20T23:12:33.7623070Z May 20 23:12:33  at 
> org.testcontainers.shaded.okio.RealBufferedSource.indexOf(RealBufferedSource.java:352)
> 2021-05-20T23:12:33.7624186Z May 20 23:12:33  at 
> org.testcontainers.shaded.okio.RealBufferedSource.readUtf8LineStrict(RealBufferedSource.java:230)
> 2021-05-20T23:12:33.7625161Z May 20 23:12:33  at 
> org.testcontainers.shaded.okio.RealBufferedSource.readUtf8LineStrict(RealBufferedSource.java:224)
> 2021-05-20T23:12:33.7626488Z May 20 23:12:33  at 
> org.testcontainers.shaded.okhttp3.internal.http1.Http1ExchangeCodec$ChunkedSource.readChunkSize(Http1ExchangeCodec.java:489)
> 2021-05-20T23:12:33.7627762Z May 20 23:12:33  at 
> org.testcontainers.shaded.okhttp3.internal.http1.Http1ExchangeCodec$ChunkedSource.read(Http1ExchangeCodec.java:471)
> 2021-05-20T23:12:33.7628864Z May 20 23:12:33  at 
> org.testcontainers.shaded.okhttp3.internal.Util.skipAll(Util.java:204)
> 2021-05-20T23:12:33.7629713Z May 20 23:12:33  at 
> org.testcontainers.shaded.okhttp3.internal.Util.discard(Util.java:186)
> 2021-05-20T23:12:33.7630720Z May 20 23:12:33  at 
> org.testcontainers.shaded.okhttp3.internal.http1.Http1ExchangeCodec$ChunkedSource.close(Http1ExchangeCodec.java:511)
> 2021-05-20T23:12:33.7631677Z May 20 23:12:33  at 
> org.testcontainers.shaded.okio.ForwardingSource.close(ForwardingSource.java:43)
> 2021-05-20T23:12:33.7632685Z May 20 23:12:33  at 
> org.testcontainers.shaded.okhttp3.internal.connection.Exchange$ResponseBodySource.close(Exchange.java:313)
> 2021-05-20T23:12:33.7633800Z May 20 23:12:33  at 
> org.testcontainers.shaded.okio.RealBufferedSource.close(RealBufferedSource.java:476)
> 2021-05-20T23:12:33.7634690Z May 20 23:12:33  at 
> org.testcontainers.shaded.okhttp3.internal.Util.closeQuietly(Util.java:139)
> 2021-05-20T23:12:33.763Z May 20 23:12:33  at 
> org.testcontainers.shaded.okhttp3.ResponseBody.close(ResponseBody.java:192)
> 2021-05-20T23:12:33.7636403Z May 20 23:12:33  at 
> org.testcontainers.shaded.okhttp3.Response.close(Response.java:290)
> 2021-05-20T23:12:33.7637381Z May 20 23:12:33  at 
> org.testcontainers.shaded.com.github.dockerjava.okhttp.OkDockerHttpClient$OkResponse.close(OkDockerHttpClient.java:285)
> 2021-05-20T23:12:33.7638608Z May 20 23:12:33  at 
> org.testcontainers.shaded.com.github.dockerjava.core.DefaultInvocationBuilder.lambda$null$0(DefaultInvocationBuilder.java:272)
> 2021-05-20T23:12:33.7639473Z May 20 23:12:33  at 
> org.testcontainers.shaded.com.github.dockerjava.core.DefaultInvocationBuilder$$Lambda$83/733374718.close(Unknown
>  Source)
> 2021-05-20T23:12:33.7640236Z May 20 23:12:33  at 
> com.github.dockerjava.api.async.ResultCallbackTemplate.close(ResultCallbackTemplate.java:77)
> 2021-05-20T23:12:33.7641079Z May 20 23:12:33  at 
> org.testcontainers.utility.ResourceReaper.start(ResourceReaper.java:202)
> 2021-05-20T23:12:33.7641912Z May 20 23:12:33  at 
> org.testcontainers.DockerClientFactory.client(DockerClientFactory.java:205)
> 2021-05-20T23:12:33.7643123Z May 20 23:12:33  - locked <0x991ac238> 
> (a [Ljava.lang.Object;)
> 2021-05-20T23:12:33.7644023Z May 20 23:12:33  at 
> org.testcontainers.LazyDockerClient.getDockerClient(LazyDockerClient.java:14)
> 2021-05-20T23:12:33.7644880Z May 20 23:12:33  at 
> org.testcontainers.LazyDockerClient.authConfig(LazyDockerClient.java:12)
> 2021-05-20T23:12:33.7645712Z May 20 23:12:33  at 
> org.testcontainers.containers.GenericContainer.start(GenericContainer.java:310)
> 

[jira] [Commented] (FLINK-22194) KafkaSourceReaderTest.testCommitOffsetsWithoutAliveFetchers fail due to commit timeout

2021-05-21 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-22194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17349062#comment-17349062
 ] 

Guowei Ma commented on FLINK-22194:
---

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18207=logs=c5612577-f1f7-5977-6ff6-7432788526f7=53f6305f-55e6-561c-8f1e-3a1dde2c77df=6817

> KafkaSourceReaderTest.testCommitOffsetsWithoutAliveFetchers fail due to 
> commit timeout
> --
>
> Key: FLINK-22194
> URL: https://issues.apache.org/jira/browse/FLINK-22194
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / Kafka
>Affects Versions: 1.13.0
>Reporter: Guowei Ma
>Priority: Major
>  Labels: stale-major, test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=16308=logs=b0097207-033c-5d9a-b48c-6d4796fbe60d=e8fcc430-213e-5cce-59d4-6942acf09121=6535
> {code:java}
> [ERROR] 
> testCommitOffsetsWithoutAliveFetchers(org.apache.flink.connector.kafka.source.reader.KafkaSourceReaderTest)
>   Time elapsed: 60.123 s  <<< ERROR!
> java.util.concurrent.TimeoutException: The offset commit did not finish 
> before timeout.
>   at 
> org.apache.flink.core.testutils.CommonTestUtils.waitUtil(CommonTestUtils.java:210)
>   at 
> org.apache.flink.connector.kafka.source.reader.KafkaSourceReaderTest.pollUntil(KafkaSourceReaderTest.java:285)
>   at 
> org.apache.flink.connector.kafka.source.reader.KafkaSourceReaderTest.testCommitOffsetsWithoutAliveFetchers(KafkaSourceReaderTest.java:129)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:498)
>   at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
>   at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
>   at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
>   at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
>   at 
> org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
>   at 
> org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:239)
>   at 
> org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
>   at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
>   at org.junit.rules.RunRules.evaluate(RunRules.java:20)
>   at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
>   at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
>   at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
>   at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
>   at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
>   at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
>   at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
>   at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
>   at 
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
>   at 
> org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
>   at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
>   at 
> org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
>   at 
> org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
>   at 
> org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-22739) CassandraSinkBaseTest.testTimeoutExceptionOnInvoke fail due to TestTimedOutException

2021-05-21 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-22739:
-

 Summary: CassandraSinkBaseTest.testTimeoutExceptionOnInvoke fail 
due to TestTimedOutException
 Key: FLINK-22739
 URL: https://issues.apache.org/jira/browse/FLINK-22739
 Project: Flink
  Issue Type: Bug
  Components: Connectors / Cassandra
Affects Versions: 1.13.0
Reporter: Guowei Ma


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18207=logs=e9af9cde-9a65-5281-a58e-2c8511d36983=b6c4efed-9c7d-55ea-03a9-9bd7d5b08e4c=13438


{code:java}
2021-05-20T22:21:49.9790943Z May 20 22:21:49 [ERROR] 
testTimeoutExceptionOnInvoke(org.apache.flink.streaming.connectors.cassandra.CassandraSinkBaseTest)
  Time elapsed: 5.742 s  <<< ERROR!
2021-05-20T22:21:49.9791886Z May 20 22:21:49 
org.junit.runners.model.TestTimedOutException: test timed out after 5000 
milliseconds
2021-05-20T22:21:49.9792584Z May 20 22:21:49at 
java.base@11.0.10/java.io.RandomAccessFile.readBytes(Native Method)
2021-05-20T22:21:49.9793258Z May 20 22:21:49at 
java.base@11.0.10/java.io.RandomAccessFile.read(RandomAccessFile.java:406)
2021-05-20T22:21:49.9794205Z May 20 22:21:49at 
java.base@11.0.10/java.util.zip.ZipFile$Source.readAt(ZipFile.java:1331)
2021-05-20T22:21:49.9794931Z May 20 22:21:49at 
java.base@11.0.10/java.util.zip.ZipFile$ZipFileInputStream.read(ZipFile.java:1028)
2021-05-20T22:21:49.9795769Z May 20 22:21:49at 
java.base@11.0.10/java.util.zip.ZipFile$ZipFileInflaterInputStream.fill(ZipFile.java:468)
2021-05-20T22:21:49.9796538Z May 20 22:21:49at 
java.base@11.0.10/java.util.zip.InflaterInputStream.read(InflaterInputStream.java:159)
2021-05-20T22:21:49.9797988Z May 20 22:21:49at 
java.base@11.0.10/jdk.internal.loader.Resource.getBytes(Resource.java:124)
2021-05-20T22:21:49.9798766Z May 20 22:21:49at 
java.base@11.0.10/jdk.internal.loader.BuiltinClassLoader.defineClass(BuiltinClassLoader.java:797)
2021-05-20T22:21:49.9799605Z May 20 22:21:49at 
java.base@11.0.10/jdk.internal.loader.BuiltinClassLoader.findClassOnClassPathOrNull(BuiltinClassLoader.java:698)
2021-05-20T22:21:49.9800472Z May 20 22:21:49at 
java.base@11.0.10/jdk.internal.loader.BuiltinClassLoader.loadClassOrNull(BuiltinClassLoader.java:621)
2021-05-20T22:21:49.9801568Z May 20 22:21:49at 
java.base@11.0.10/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:579)
2021-05-20T22:21:49.9802449Z May 20 22:21:49at 
java.base@11.0.10/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178)
2021-05-20T22:21:49.9803167Z May 20 22:21:49at 
java.base@11.0.10/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
2021-05-20T22:21:49.9803984Z May 20 22:21:49at 
app//com.google.common.collect.ImmutableMap.of(ImmutableMap.java:70)
2021-05-20T22:21:49.9804648Z May 20 22:21:49at 
app//com.google.common.reflect.TypeResolver$TypeTable.(TypeResolver.java:218)
2021-05-20T22:21:49.9805331Z May 20 22:21:49at 
app//com.google.common.reflect.TypeResolver.(TypeResolver.java:60)
2021-05-20T22:21:49.9805972Z May 20 22:21:49at 
app//com.google.common.reflect.TypeToken.where(TypeToken.java:215)
2021-05-20T22:21:49.9806669Z May 20 22:21:49at 
app//com.google.common.reflect.TypeToken.where(TypeToken.java:239)
2021-05-20T22:21:49.9807514Z May 20 22:21:49at 
app//com.datastax.driver.core.TypeTokens.mapOf(TypeTokens.java:106)
2021-05-20T22:21:49.9808329Z May 20 22:21:49at 
app//com.datastax.driver.core.SanityChecks.checkGuava(SanityChecks.java:50)
2021-05-20T22:21:49.9809035Z May 20 22:21:49at 
app//com.datastax.driver.core.SanityChecks.check(SanityChecks.java:36)
2021-05-20T22:21:49.9809696Z May 20 22:21:49at 
app//com.datastax.driver.core.Cluster.(Cluster.java:67)
2021-05-20T22:21:49.9810253Z May 20 22:21:49at 
jdk.internal.reflect.GeneratedSerializationConstructorAccessor2.newInstance(Unknown
 Source)
2021-05-20T22:21:49.9810930Z May 20 22:21:49at 
java.base@11.0.10/java.lang.reflect.Constructor.newInstance(Constructor.java:490)
2021-05-20T22:21:49.9811707Z May 20 22:21:49at 
app//org.objenesis.instantiator.sun.SunReflectionFactoryInstantiator.newInstance(SunReflectionFactoryInstantiator.java:45)
2021-05-20T22:21:49.9812475Z May 20 22:21:49at 
app//org.objenesis.ObjenesisBase.newInstance(ObjenesisBase.java:73)
2021-05-20T22:21:49.9813232Z May 20 22:21:49at 
app//org.mockito.internal.creation.instance.ObjenesisInstantiator.newInstance(ObjenesisInstantiator.java:19)
2021-05-20T22:21:49.9814154Z May 20 22:21:49at 
app//org.mockito.internal.creation.bytebuddy.SubclassByteBuddyMockMaker.createMock(SubclassByteBuddyMockMaker.java:47)
2021-05-20T22:21:49.9814990Z May 20 22:21:49at 
app//org.mockito.internal.creation.bytebuddy.ByteBuddyMockMaker.createMock(ByteBuddyMockMaker.java:25)
2021-05-20T22:21:49.9815814Z May 20 22:21:49at 

[jira] [Comment Edited] (FLINK-22613) FlinkKinesisITCase.testStopWithSavepoint fails

2021-05-21 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-22613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17349026#comment-17349026
 ] 

Guowei Ma edited comment on FLINK-22613 at 5/21/21, 7:56 AM:
-

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18206=logs=e1276d0f-df12-55ec-86b5-c0ad597d83c9=906e9244-f3be-5604-1979-e767c8a6f6d9=13977

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18207=logs=e1276d0f-df12-55ec-86b5-c0ad597d83c9=906e9244-f3be-5604-1979-e767c8a6f6d9=14057


was (Author: maguowei):
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18206=logs=e1276d0f-df12-55ec-86b5-c0ad597d83c9=906e9244-f3be-5604-1979-e767c8a6f6d9=13977

> FlinkKinesisITCase.testStopWithSavepoint fails
> --
>
> Key: FLINK-22613
> URL: https://issues.apache.org/jira/browse/FLINK-22613
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / Kinesis
>Affects Versions: 1.13.0, 1.14.0, 1.12.3
>Reporter: Guowei Ma
>Priority: Blocker
>  Labels: test-stability
>
> {code:java}
> 2021-05-10T03:09:18.4601182Z May 10 03:09:18 [ERROR] 
> testStopWithSavepoint(org.apache.flink.streaming.connectors.kinesis.FlinkKinesisITCase)
>   Time elapsed: 3.526 s  <<< FAILURE!
> 2021-05-10T03:09:18.4601884Z May 10 03:09:18 java.lang.AssertionError: 
> 2021-05-10T03:09:18.4605902Z May 10 03:09:18 
> 2021-05-10T03:09:18.4616154Z May 10 03:09:18 Expected: a collection with size 
> a value less than <10>
> 2021-05-10T03:09:18.4616818Z May 10 03:09:18  but: collection size <10> 
> was equal to <10>
> 2021-05-10T03:09:18.4618087Z May 10 03:09:18  at 
> org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
> 2021-05-10T03:09:18.4618702Z May 10 03:09:18  at 
> org.junit.Assert.assertThat(Assert.java:956)
> 2021-05-10T03:09:18.4619467Z May 10 03:09:18  at 
> org.junit.Assert.assertThat(Assert.java:923)
> 2021-05-10T03:09:18.4620391Z May 10 03:09:18  at 
> org.apache.flink.streaming.connectors.kinesis.FlinkKinesisITCase.testStopWithSavepoint(FlinkKinesisITCase.java:126)
> 2021-05-10T03:09:18.4621115Z May 10 03:09:18  at 
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 2021-05-10T03:09:18.4621751Z May 10 03:09:18  at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 2021-05-10T03:09:18.4622475Z May 10 03:09:18  at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 2021-05-10T03:09:18.4623142Z May 10 03:09:18  at 
> java.lang.reflect.Method.invoke(Method.java:498)
> 2021-05-10T03:09:18.4623783Z May 10 03:09:18  at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> 2021-05-10T03:09:18.4624514Z May 10 03:09:18  at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 2021-05-10T03:09:18.4625246Z May 10 03:09:18  at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> 2021-05-10T03:09:18.4625967Z May 10 03:09:18  at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> 2021-05-10T03:09:18.4626671Z May 10 03:09:18  at 
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> 2021-05-10T03:09:18.4627349Z May 10 03:09:18  at 
> org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
> 2021-05-10T03:09:18.4627979Z May 10 03:09:18  at 
> org.junit.rules.RunRules.evaluate(RunRules.java:20)
> 2021-05-10T03:09:18.4628582Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> 2021-05-10T03:09:18.4629251Z May 10 03:09:18  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> 2021-05-10T03:09:18.4629950Z May 10 03:09:18  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> 2021-05-10T03:09:18.4630616Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> 2021-05-10T03:09:18.4631339Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> 2021-05-10T03:09:18.4631986Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> 2021-05-10T03:09:18.4632630Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> 2021-05-10T03:09:18.4633269Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> 2021-05-10T03:09:18.4634016Z May 10 03:09:18  at 
> org.testcontainers.containers.FailureDetectingExternalResource$1.evaluate(FailureDetectingExternalResource.java:30)
> 2021-05-10T03:09:18.4634786Z May 10 03:09:18  at 
> org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
> 2021-05-10T03:09:18.4635412Z May 10 03:09:18  at 
> 

[jira] [Created] (FLINK-22738) org.apache.flink.connector.jdbc.xa.JdbcExactlyOnceSinkE2eTest no output for 900 seconds due to block on downloading docker image

2021-05-21 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-22738:
-

 Summary: 
org.apache.flink.connector.jdbc.xa.JdbcExactlyOnceSinkE2eTest no output for 900 
seconds due to block on downloading  docker image 
 Key: FLINK-22738
 URL: https://issues.apache.org/jira/browse/FLINK-22738
 Project: Flink
  Issue Type: Bug
  Components: Connectors / JDBC
Affects Versions: 1.13.0
Reporter: Guowei Ma


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18207=logs=d44f43ce-542c-597d-bf94-b0718c71e5e8=03dca39c-73e8-5aaf-601d-328ae5c35f20=13626

{code:java}
2021-05-20T23:12:33.7620808Z May 20 23:12:33 "main" #1 prio=5 os_prio=0 
tid=0x7fa6c400b800 nid=0x45f3 runnable [0x7fa6cb1cd000]
2021-05-20T23:12:33.7621514Z May 20 23:12:33java.lang.Thread.State: RUNNABLE
2021-05-20T23:12:33.7622205Z May 20 23:12:33at 
org.testcontainers.shaded.okio.Buffer.indexOf(Buffer.java:1463)
2021-05-20T23:12:33.7623070Z May 20 23:12:33at 
org.testcontainers.shaded.okio.RealBufferedSource.indexOf(RealBufferedSource.java:352)
2021-05-20T23:12:33.7624186Z May 20 23:12:33at 
org.testcontainers.shaded.okio.RealBufferedSource.readUtf8LineStrict(RealBufferedSource.java:230)
2021-05-20T23:12:33.7625161Z May 20 23:12:33at 
org.testcontainers.shaded.okio.RealBufferedSource.readUtf8LineStrict(RealBufferedSource.java:224)
2021-05-20T23:12:33.7626488Z May 20 23:12:33at 
org.testcontainers.shaded.okhttp3.internal.http1.Http1ExchangeCodec$ChunkedSource.readChunkSize(Http1ExchangeCodec.java:489)
2021-05-20T23:12:33.7627762Z May 20 23:12:33at 
org.testcontainers.shaded.okhttp3.internal.http1.Http1ExchangeCodec$ChunkedSource.read(Http1ExchangeCodec.java:471)
2021-05-20T23:12:33.7628864Z May 20 23:12:33at 
org.testcontainers.shaded.okhttp3.internal.Util.skipAll(Util.java:204)
2021-05-20T23:12:33.7629713Z May 20 23:12:33at 
org.testcontainers.shaded.okhttp3.internal.Util.discard(Util.java:186)
2021-05-20T23:12:33.7630720Z May 20 23:12:33at 
org.testcontainers.shaded.okhttp3.internal.http1.Http1ExchangeCodec$ChunkedSource.close(Http1ExchangeCodec.java:511)
2021-05-20T23:12:33.7631677Z May 20 23:12:33at 
org.testcontainers.shaded.okio.ForwardingSource.close(ForwardingSource.java:43)
2021-05-20T23:12:33.7632685Z May 20 23:12:33at 
org.testcontainers.shaded.okhttp3.internal.connection.Exchange$ResponseBodySource.close(Exchange.java:313)
2021-05-20T23:12:33.7633800Z May 20 23:12:33at 
org.testcontainers.shaded.okio.RealBufferedSource.close(RealBufferedSource.java:476)
2021-05-20T23:12:33.7634690Z May 20 23:12:33at 
org.testcontainers.shaded.okhttp3.internal.Util.closeQuietly(Util.java:139)
2021-05-20T23:12:33.763Z May 20 23:12:33at 
org.testcontainers.shaded.okhttp3.ResponseBody.close(ResponseBody.java:192)
2021-05-20T23:12:33.7636403Z May 20 23:12:33at 
org.testcontainers.shaded.okhttp3.Response.close(Response.java:290)
2021-05-20T23:12:33.7637381Z May 20 23:12:33at 
org.testcontainers.shaded.com.github.dockerjava.okhttp.OkDockerHttpClient$OkResponse.close(OkDockerHttpClient.java:285)
2021-05-20T23:12:33.7638608Z May 20 23:12:33at 
org.testcontainers.shaded.com.github.dockerjava.core.DefaultInvocationBuilder.lambda$null$0(DefaultInvocationBuilder.java:272)
2021-05-20T23:12:33.7639473Z May 20 23:12:33at 
org.testcontainers.shaded.com.github.dockerjava.core.DefaultInvocationBuilder$$Lambda$83/733374718.close(Unknown
 Source)
2021-05-20T23:12:33.7640236Z May 20 23:12:33at 
com.github.dockerjava.api.async.ResultCallbackTemplate.close(ResultCallbackTemplate.java:77)
2021-05-20T23:12:33.7641079Z May 20 23:12:33at 
org.testcontainers.utility.ResourceReaper.start(ResourceReaper.java:202)
2021-05-20T23:12:33.7641912Z May 20 23:12:33at 
org.testcontainers.DockerClientFactory.client(DockerClientFactory.java:205)
2021-05-20T23:12:33.7643123Z May 20 23:12:33- locked <0x991ac238> 
(a [Ljava.lang.Object;)
2021-05-20T23:12:33.7644023Z May 20 23:12:33at 
org.testcontainers.LazyDockerClient.getDockerClient(LazyDockerClient.java:14)
2021-05-20T23:12:33.7644880Z May 20 23:12:33at 
org.testcontainers.LazyDockerClient.authConfig(LazyDockerClient.java:12)
2021-05-20T23:12:33.7645712Z May 20 23:12:33at 
org.testcontainers.containers.GenericContainer.start(GenericContainer.java:310)
2021-05-20T23:12:33.7646636Z May 20 23:12:33at 
org.testcontainers.containers.GenericContainer.starting(GenericContainer.java:1029)
2021-05-20T23:12:33.7647619Z May 20 23:12:33at 
org.testcontainers.containers.FailureDetectingExternalResource$1.evaluate(FailureDetectingExternalResource.java:29)
2021-05-20T23:12:33.7648654Z May 20 23:12:33at 
org.junit.rules.RunRules.evaluate(RunRules.java:20)
2021-05-20T23:12:33.7649382Z May 20 23:12:33at 
org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
2021-05-20T23:12:33.7650202Z May 20 23:12:33at 

[jira] [Commented] (FLINK-22613) FlinkKinesisITCase.testStopWithSavepoint fails

2021-05-21 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-22613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17349026#comment-17349026
 ] 

Guowei Ma commented on FLINK-22613:
---

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18206=logs=e1276d0f-df12-55ec-86b5-c0ad597d83c9=906e9244-f3be-5604-1979-e767c8a6f6d9=13977

> FlinkKinesisITCase.testStopWithSavepoint fails
> --
>
> Key: FLINK-22613
> URL: https://issues.apache.org/jira/browse/FLINK-22613
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / Kinesis
>Affects Versions: 1.13.0, 1.14.0, 1.12.3
>Reporter: Guowei Ma
>Priority: Blocker
>  Labels: test-stability
>
> {code:java}
> 2021-05-10T03:09:18.4601182Z May 10 03:09:18 [ERROR] 
> testStopWithSavepoint(org.apache.flink.streaming.connectors.kinesis.FlinkKinesisITCase)
>   Time elapsed: 3.526 s  <<< FAILURE!
> 2021-05-10T03:09:18.4601884Z May 10 03:09:18 java.lang.AssertionError: 
> 2021-05-10T03:09:18.4605902Z May 10 03:09:18 
> 2021-05-10T03:09:18.4616154Z May 10 03:09:18 Expected: a collection with size 
> a value less than <10>
> 2021-05-10T03:09:18.4616818Z May 10 03:09:18  but: collection size <10> 
> was equal to <10>
> 2021-05-10T03:09:18.4618087Z May 10 03:09:18  at 
> org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
> 2021-05-10T03:09:18.4618702Z May 10 03:09:18  at 
> org.junit.Assert.assertThat(Assert.java:956)
> 2021-05-10T03:09:18.4619467Z May 10 03:09:18  at 
> org.junit.Assert.assertThat(Assert.java:923)
> 2021-05-10T03:09:18.4620391Z May 10 03:09:18  at 
> org.apache.flink.streaming.connectors.kinesis.FlinkKinesisITCase.testStopWithSavepoint(FlinkKinesisITCase.java:126)
> 2021-05-10T03:09:18.4621115Z May 10 03:09:18  at 
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 2021-05-10T03:09:18.4621751Z May 10 03:09:18  at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 2021-05-10T03:09:18.4622475Z May 10 03:09:18  at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 2021-05-10T03:09:18.4623142Z May 10 03:09:18  at 
> java.lang.reflect.Method.invoke(Method.java:498)
> 2021-05-10T03:09:18.4623783Z May 10 03:09:18  at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> 2021-05-10T03:09:18.4624514Z May 10 03:09:18  at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 2021-05-10T03:09:18.4625246Z May 10 03:09:18  at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> 2021-05-10T03:09:18.4625967Z May 10 03:09:18  at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> 2021-05-10T03:09:18.4626671Z May 10 03:09:18  at 
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> 2021-05-10T03:09:18.4627349Z May 10 03:09:18  at 
> org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
> 2021-05-10T03:09:18.4627979Z May 10 03:09:18  at 
> org.junit.rules.RunRules.evaluate(RunRules.java:20)
> 2021-05-10T03:09:18.4628582Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> 2021-05-10T03:09:18.4629251Z May 10 03:09:18  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> 2021-05-10T03:09:18.4629950Z May 10 03:09:18  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> 2021-05-10T03:09:18.4630616Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> 2021-05-10T03:09:18.4631339Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> 2021-05-10T03:09:18.4631986Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> 2021-05-10T03:09:18.4632630Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> 2021-05-10T03:09:18.4633269Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> 2021-05-10T03:09:18.4634016Z May 10 03:09:18  at 
> org.testcontainers.containers.FailureDetectingExternalResource$1.evaluate(FailureDetectingExternalResource.java:30)
> 2021-05-10T03:09:18.4634786Z May 10 03:09:18  at 
> org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
> 2021-05-10T03:09:18.4635412Z May 10 03:09:18  at 
> org.junit.rules.RunRules.evaluate(RunRules.java:20)
> 2021-05-10T03:09:18.4635995Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.run(ParentRunner.java:363)
> 2021-05-10T03:09:18.4636656Z May 10 03:09:18  at 
> org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
> 2021-05-10T03:09:18.4637398Z May 10 03:09:18  at 
> 

[jira] [Updated] (FLINK-20950) SinkITCase.writerAndGlobalCommitterExecuteInStreamingMode test failed with "AssertionError"

2021-05-21 Thread Guowei Ma (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-20950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Guowei Ma updated FLINK-20950:
--
Labels: test-stability  (was: stale-assigned test-stability)

> SinkITCase.writerAndGlobalCommitterExecuteInStreamingMode test failed with 
> "AssertionError"
> ---
>
> Key: FLINK-20950
> URL: https://issues.apache.org/jira/browse/FLINK-20950
> Project: Flink
>  Issue Type: Bug
>  Components: API / DataStream
>Affects Versions: 1.12.2, 1.13.0, 1.14.0
>Reporter: Huang Xingbo
>Assignee: Guowei Ma
>Priority: Critical
>  Labels: test-stability
>
> [https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=11940=logs=34f41360-6c0d-54d3-11a1-0292a2def1d9=2d56e022-1ace-542f-bf1a-b37dd63243f2]
> {code:java}
> 2021-01-12T16:47:00.7579536Z [ERROR] Failures: 
> 2021-01-12T16:47:00.7580061Z [ERROR]   
> SinkITCase.writerAndGlobalCommitterExecuteInStreamingMode:218 
> 2021-01-12T16:47:00.7587186Z Expected: iterable over 
> ["(895,null,-9223372036854775808)", "(895,null,-9223372036854775808)", 
> "(127,null,-9223372036854775808)", "(127,null,-9223372036854775808)", 
> "(148,null,-9223372036854775808)", "(148,null,-9223372036854775808)", 
> "(161,null,-9223372036854775808)", "(161,null,-9223372036854775808)", 
> "(148,null,-9223372036854775808)", "(148,null,-9223372036854775808)", 
> "(662,null,-9223372036854775808)", "(662,null,-9223372036854775808)", 
> "(822,null,-9223372036854775808)", "(822,null,-9223372036854775808)", 
> "(491,null,-9223372036854775808)", "(491,null,-9223372036854775808)", 
> "(275,null,-9223372036854775808)", "(275,null,-9223372036854775808)", 
> "(122,null,-9223372036854775808)", "(122,null,-9223372036854775808)", 
> "(850,null,-9223372036854775808)", "(850,null,-9223372036854775808)", 
> "(630,null,-9223372036854775808)", "(630,null,-9223372036854775808)", 
> "(682,null,-9223372036854775808)", "(682,null,-9223372036854775808)", 
> "(765,null,-9223372036854775808)", "(765,null,-9223372036854775808)", 
> "(434,null,-9223372036854775808)", "(434,null,-9223372036854775808)", 
> "(970,null,-9223372036854775808)", "(970,null,-9223372036854775808)", 
> "(714,null,-9223372036854775808)", "(714,null,-9223372036854775808)", 
> "(795,null,-9223372036854775808)", "(795,null,-9223372036854775808)", 
> "(288,null,-9223372036854775808)", "(288,null,-9223372036854775808)", 
> "(422,null,-9223372036854775808)", "(422,null,-9223372036854775808)"] in any 
> order
> 2021-01-12T16:47:00.7591663Z  but: Not matched: "end of input"
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (FLINK-20950) SinkITCase.writerAndGlobalCommitterExecuteInStreamingMode test failed with "AssertionError"

2021-05-21 Thread Guowei Ma (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-20950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Guowei Ma updated FLINK-20950:
--
Affects Version/s: 1.14.0

> SinkITCase.writerAndGlobalCommitterExecuteInStreamingMode test failed with 
> "AssertionError"
> ---
>
> Key: FLINK-20950
> URL: https://issues.apache.org/jira/browse/FLINK-20950
> Project: Flink
>  Issue Type: Bug
>  Components: API / DataStream
>Affects Versions: 1.12.2, 1.13.0, 1.14.0
>Reporter: Huang Xingbo
>Assignee: Guowei Ma
>Priority: Critical
>  Labels: stale-assigned, test-stability
>
> [https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=11940=logs=34f41360-6c0d-54d3-11a1-0292a2def1d9=2d56e022-1ace-542f-bf1a-b37dd63243f2]
> {code:java}
> 2021-01-12T16:47:00.7579536Z [ERROR] Failures: 
> 2021-01-12T16:47:00.7580061Z [ERROR]   
> SinkITCase.writerAndGlobalCommitterExecuteInStreamingMode:218 
> 2021-01-12T16:47:00.7587186Z Expected: iterable over 
> ["(895,null,-9223372036854775808)", "(895,null,-9223372036854775808)", 
> "(127,null,-9223372036854775808)", "(127,null,-9223372036854775808)", 
> "(148,null,-9223372036854775808)", "(148,null,-9223372036854775808)", 
> "(161,null,-9223372036854775808)", "(161,null,-9223372036854775808)", 
> "(148,null,-9223372036854775808)", "(148,null,-9223372036854775808)", 
> "(662,null,-9223372036854775808)", "(662,null,-9223372036854775808)", 
> "(822,null,-9223372036854775808)", "(822,null,-9223372036854775808)", 
> "(491,null,-9223372036854775808)", "(491,null,-9223372036854775808)", 
> "(275,null,-9223372036854775808)", "(275,null,-9223372036854775808)", 
> "(122,null,-9223372036854775808)", "(122,null,-9223372036854775808)", 
> "(850,null,-9223372036854775808)", "(850,null,-9223372036854775808)", 
> "(630,null,-9223372036854775808)", "(630,null,-9223372036854775808)", 
> "(682,null,-9223372036854775808)", "(682,null,-9223372036854775808)", 
> "(765,null,-9223372036854775808)", "(765,null,-9223372036854775808)", 
> "(434,null,-9223372036854775808)", "(434,null,-9223372036854775808)", 
> "(970,null,-9223372036854775808)", "(970,null,-9223372036854775808)", 
> "(714,null,-9223372036854775808)", "(714,null,-9223372036854775808)", 
> "(795,null,-9223372036854775808)", "(795,null,-9223372036854775808)", 
> "(288,null,-9223372036854775808)", "(288,null,-9223372036854775808)", 
> "(422,null,-9223372036854775808)", "(422,null,-9223372036854775808)"] in any 
> order
> 2021-01-12T16:47:00.7591663Z  but: Not matched: "end of input"
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (FLINK-20950) SinkITCase.writerAndGlobalCommitterExecuteInStreamingMode test failed with "AssertionError"

2021-05-21 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-20950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17349024#comment-17349024
 ] 

Guowei Ma commented on FLINK-20950:
---

I would find the time to fix this next week.

> SinkITCase.writerAndGlobalCommitterExecuteInStreamingMode test failed with 
> "AssertionError"
> ---
>
> Key: FLINK-20950
> URL: https://issues.apache.org/jira/browse/FLINK-20950
> Project: Flink
>  Issue Type: Bug
>  Components: API / DataStream
>Affects Versions: 1.12.2, 1.13.0
>Reporter: Huang Xingbo
>Assignee: Guowei Ma
>Priority: Critical
>  Labels: stale-assigned, test-stability
>
> [https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=11940=logs=34f41360-6c0d-54d3-11a1-0292a2def1d9=2d56e022-1ace-542f-bf1a-b37dd63243f2]
> {code:java}
> 2021-01-12T16:47:00.7579536Z [ERROR] Failures: 
> 2021-01-12T16:47:00.7580061Z [ERROR]   
> SinkITCase.writerAndGlobalCommitterExecuteInStreamingMode:218 
> 2021-01-12T16:47:00.7587186Z Expected: iterable over 
> ["(895,null,-9223372036854775808)", "(895,null,-9223372036854775808)", 
> "(127,null,-9223372036854775808)", "(127,null,-9223372036854775808)", 
> "(148,null,-9223372036854775808)", "(148,null,-9223372036854775808)", 
> "(161,null,-9223372036854775808)", "(161,null,-9223372036854775808)", 
> "(148,null,-9223372036854775808)", "(148,null,-9223372036854775808)", 
> "(662,null,-9223372036854775808)", "(662,null,-9223372036854775808)", 
> "(822,null,-9223372036854775808)", "(822,null,-9223372036854775808)", 
> "(491,null,-9223372036854775808)", "(491,null,-9223372036854775808)", 
> "(275,null,-9223372036854775808)", "(275,null,-9223372036854775808)", 
> "(122,null,-9223372036854775808)", "(122,null,-9223372036854775808)", 
> "(850,null,-9223372036854775808)", "(850,null,-9223372036854775808)", 
> "(630,null,-9223372036854775808)", "(630,null,-9223372036854775808)", 
> "(682,null,-9223372036854775808)", "(682,null,-9223372036854775808)", 
> "(765,null,-9223372036854775808)", "(765,null,-9223372036854775808)", 
> "(434,null,-9223372036854775808)", "(434,null,-9223372036854775808)", 
> "(970,null,-9223372036854775808)", "(970,null,-9223372036854775808)", 
> "(714,null,-9223372036854775808)", "(714,null,-9223372036854775808)", 
> "(795,null,-9223372036854775808)", "(795,null,-9223372036854775808)", 
> "(288,null,-9223372036854775808)", "(288,null,-9223372036854775808)", 
> "(422,null,-9223372036854775808)", "(422,null,-9223372036854775808)"] in any 
> order
> 2021-01-12T16:47:00.7591663Z  but: Not matched: "end of input"
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (FLINK-20950) SinkITCase.writerAndGlobalCommitterExecuteInStreamingMode test failed with "AssertionError"

2021-05-21 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-20950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17349022#comment-17349022
 ] 

Guowei Ma commented on FLINK-20950:
---

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18205=logs=f2b08047-82c3-520f-51ee-a30fd6254285=601c4a98-b94a-54db-dc38-ae78131029dc=10654

> SinkITCase.writerAndGlobalCommitterExecuteInStreamingMode test failed with 
> "AssertionError"
> ---
>
> Key: FLINK-20950
> URL: https://issues.apache.org/jira/browse/FLINK-20950
> Project: Flink
>  Issue Type: Bug
>  Components: API / DataStream
>Affects Versions: 1.12.2, 1.13.0
>Reporter: Huang Xingbo
>Assignee: Guowei Ma
>Priority: Critical
>  Labels: stale-assigned, test-stability
>
> [https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=11940=logs=34f41360-6c0d-54d3-11a1-0292a2def1d9=2d56e022-1ace-542f-bf1a-b37dd63243f2]
> {code:java}
> 2021-01-12T16:47:00.7579536Z [ERROR] Failures: 
> 2021-01-12T16:47:00.7580061Z [ERROR]   
> SinkITCase.writerAndGlobalCommitterExecuteInStreamingMode:218 
> 2021-01-12T16:47:00.7587186Z Expected: iterable over 
> ["(895,null,-9223372036854775808)", "(895,null,-9223372036854775808)", 
> "(127,null,-9223372036854775808)", "(127,null,-9223372036854775808)", 
> "(148,null,-9223372036854775808)", "(148,null,-9223372036854775808)", 
> "(161,null,-9223372036854775808)", "(161,null,-9223372036854775808)", 
> "(148,null,-9223372036854775808)", "(148,null,-9223372036854775808)", 
> "(662,null,-9223372036854775808)", "(662,null,-9223372036854775808)", 
> "(822,null,-9223372036854775808)", "(822,null,-9223372036854775808)", 
> "(491,null,-9223372036854775808)", "(491,null,-9223372036854775808)", 
> "(275,null,-9223372036854775808)", "(275,null,-9223372036854775808)", 
> "(122,null,-9223372036854775808)", "(122,null,-9223372036854775808)", 
> "(850,null,-9223372036854775808)", "(850,null,-9223372036854775808)", 
> "(630,null,-9223372036854775808)", "(630,null,-9223372036854775808)", 
> "(682,null,-9223372036854775808)", "(682,null,-9223372036854775808)", 
> "(765,null,-9223372036854775808)", "(765,null,-9223372036854775808)", 
> "(434,null,-9223372036854775808)", "(434,null,-9223372036854775808)", 
> "(970,null,-9223372036854775808)", "(970,null,-9223372036854775808)", 
> "(714,null,-9223372036854775808)", "(714,null,-9223372036854775808)", 
> "(795,null,-9223372036854775808)", "(795,null,-9223372036854775808)", 
> "(288,null,-9223372036854775808)", "(288,null,-9223372036854775808)", 
> "(422,null,-9223372036854775808)", "(422,null,-9223372036854775808)"] in any 
> order
> 2021-01-12T16:47:00.7591663Z  but: Not matched: "end of input"
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-22735) HiveTableSourceITCase.testStreamPartitionReadByCreateTime failed because of times out

2021-05-21 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-22735:
-

 Summary: HiveTableSourceITCase.testStreamPartitionReadByCreateTime 
failed because of times out 
 Key: FLINK-22735
 URL: https://issues.apache.org/jira/browse/FLINK-22735
 Project: Flink
  Issue Type: Bug
  Components: Connectors / Hive
Affects Versions: 1.14.0
Reporter: Guowei Ma


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18205=logs=245e1f2e-ba5b-5570-d689-25ae21e5302f=e7f339b2-a7c3-57d9-00af-3712d4b15354=23726


{code:java}
May 20 22:22:26 [ERROR] Tests run: 19, Failures: 0, Errors: 1, Skipped: 0, Time 
elapsed: 225.004 s <<< FAILURE! - in 
org.apache.flink.connectors.hive.HiveTableSourceITCase
May 20 22:22:26 [ERROR] 
testStreamPartitionReadByCreateTime(org.apache.flink.connectors.hive.HiveTableSourceITCase)
  Time elapsed: 120.182 s  <<< ERROR!
May 20 22:22:26 org.junit.runners.model.TestTimedOutException: test timed out 
after 12 milliseconds
May 20 22:22:26 at java.lang.Thread.sleep(Native Method)
May 20 22:22:26 at 
org.apache.flink.streaming.api.operators.collect.CollectResultFetcher.sleepBeforeRetry(CollectResultFetcher.java:237)
May 20 22:22:26 at 
org.apache.flink.streaming.api.operators.collect.CollectResultFetcher.next(CollectResultFetcher.java:113)
May 20 22:22:26 at 
org.apache.flink.streaming.api.operators.collect.CollectResultIterator.nextResultFromFetcher(CollectResultIterator.java:106)
May 20 22:22:26 at 
org.apache.flink.streaming.api.operators.collect.CollectResultIterator.hasNext(CollectResultIterator.java:80)
May 20 22:22:26 at 
org.apache.flink.table.api.internal.TableResultImpl$CloseableRowIteratorWrapper.hasNext(TableResultImpl.java:370)
May 20 22:22:26 at 
org.apache.flink.connectors.hive.HiveTableSourceITCase.fetchRows(HiveTableSourceITCase.java:712)
May 20 22:22:26 at 
org.apache.flink.connectors.hive.HiveTableSourceITCase.testStreamPartitionReadByCreateTime(HiveTableSourceITCase.java:652)
May 20 22:22:26 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
May 20 22:22:26 at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
May 20 22:22:26 at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
May 20 22:22:26 at java.lang.reflect.Method.invoke(Method.java:498)
May 20 22:22:26 at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
May 20 22:22:26 at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
May 20 22:22:26 at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
May 20 22:22:26 at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
May 20 22:22:26 at 
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
May 20 22:22:26 at 
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
May 20 22:22:26 at 
java.util.concurrent.FutureTask.run(FutureTask.java:266)
May 20 22:22:26 at java.lang.Thread.run(Thread.java:748)

{code}




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (FLINK-22520) KafkaSourceLegacyITCase.testMultipleSourcesOnePartition hangs

2021-05-21 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-22520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17349019#comment-17349019
 ] 

Guowei Ma commented on FLINK-22520:
---

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18205=logs=72d4811f-9f0d-5fd0-014a-0bc26b72b642=c1d93a6a-ba91-515d-3196-2ee8019fbda7=41703

> KafkaSourceLegacyITCase.testMultipleSourcesOnePartition hangs
> -
>
> Key: FLINK-22520
> URL: https://issues.apache.org/jira/browse/FLINK-22520
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / Kafka
>Affects Versions: 1.14.0
>Reporter: Guowei Ma
>Priority: Major
>  Labels: test-stability
>
> There is no any error messages.
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=17363=logs=c5f0071e-1851-543e-9a45-9ac140befc32=1fb1a56f-e8b5-5a82-00a0-a2db7757b4f5=42023
> {code:java}
> "main" #1 prio=5 os_prio=0 tid=0x7f4d3400b000 nid=0x203f waiting on 
> condition [0x7f4d3be2e000]
>java.lang.Thread.State: WAITING (parking)
>   at sun.misc.Unsafe.park(Native Method)
>   - parking to wait for  <0xa68f3b68> (a 
> java.util.concurrent.CompletableFuture$Signaller)
>   at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
>   at 
> java.util.concurrent.CompletableFuture$Signaller.block(CompletableFuture.java:1707)
>   at 
> java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3323)
>   at 
> java.util.concurrent.CompletableFuture.waitingGet(CompletableFuture.java:1742)
>   at 
> java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
>   at org.apache.flink.test.util.TestUtils.tryExecute(TestUtils.java:49)
>   at 
> org.apache.flink.streaming.connectors.kafka.KafkaConsumerTestBase.runMultipleSourcesOnePartitionExactlyOnceTest(KafkaConsumerTestBase.java:1112)
>   at 
> org.apache.flink.connector.kafka.source.KafkaSourceLegacyITCase.testMultipleSourcesOnePartition(KafkaSourceLegacyITCase.java:87)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:498)
>   at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
>   at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
>   at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
>   at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
>   at 
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
>   at 
> org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
>   at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
>   at org.junit.rules.RunRules.evaluate(RunRules.java:20)
>   at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
>   at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (FLINK-22366) HiveSinkCompactionITCase fails on azure

2021-05-19 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17348054#comment-17348054
 ] 

Guowei Ma commented on FLINK-22366:
---

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18153=logs=245e1f2e-ba5b-5570-d689-25ae21e5302f=e7f339b2-a7c3-57d9-00af-3712d4b15354=23742

> HiveSinkCompactionITCase fails on azure
> ---
>
> Key: FLINK-22366
> URL: https://issues.apache.org/jira/browse/FLINK-22366
> Project: Flink
>  Issue Type: Bug
>  Components: Table SQL / Ecosystem
>Affects Versions: 1.13.0
>Reporter: Dawid Wysakowicz
>Priority: Major
>  Labels: auto-deprioritized-critical, test-stability
> Fix For: 1.14.0
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=16818=logs=245e1f2e-ba5b-5570-d689-25ae21e5302f=e7f339b2-a7c3-57d9-00af-3712d4b15354=23420
> {code}
>  [ERROR] testNonPartition[format = 
> sequencefile](org.apache.flink.connectors.hive.HiveSinkCompactionITCase)  
> Time elapsed: 4.999 s  <<< FAILURE!
> Apr 19 22:25:10 java.lang.AssertionError: expected:<[+I[0, 0, 0], +I[0, 0, 
> 0], +I[1, 1, 1], +I[1, 1, 1], +I[2, 2, 2], +I[2, 2, 2], +I[3, 3, 3], +I[3, 3, 
> 3], +I[4, 4, 4], +I[4, 4, 4], +I[5, 5, 5], +I[5, 5, 5], +I[6, 6, 6], +I[6, 6, 
> 6], +I[7, 7, 7], +I[7, 7, 7], +I[8, 8, 8], +I[8, 8, 8], +I[9, 9, 9], +I[9, 9, 
> 9], +I[10, 0, 0], +I[10, 0, 0], +I[11, 1, 1], +I[11, 1, 1], +I[12, 2, 2], 
> +I[12, 2, 2], +I[13, 3, 3], +I[13, 3, 3], +I[14, 4, 4], +I[14, 4, 4], +I[15, 
> 5, 5], +I[15, 5, 5], +I[16, 6, 6], +I[16, 6, 6], +I[17, 7, 7], +I[17, 7, 7], 
> +I[18, 8, 8], +I[18, 8, 8], +I[19, 9, 9], +I[19, 9, 9], +I[20, 0, 0], +I[20, 
> 0, 0], +I[21, 1, 1], +I[21, 1, 1], +I[22, 2, 2], +I[22, 2, 2], +I[23, 3, 3], 
> +I[23, 3, 3], +I[24, 4, 4], +I[24, 4, 4], +I[25, 5, 5], +I[25, 5, 5], +I[26, 
> 6, 6], +I[26, 6, 6], +I[27, 7, 7], +I[27, 7, 7], +I[28, 8, 8], +I[28, 8, 8], 
> +I[29, 9, 9], +I[29, 9, 9], +I[30, 0, 0], +I[30, 0, 0], +I[31, 1, 1], +I[31, 
> 1, 1], +I[32, 2, 2], +I[32, 2, 2], +I[33, 3, 3], +I[33, 3, 3], +I[34, 4, 4], 
> +I[34, 4, 4], +I[35, 5, 5], +I[35, 5, 5], +I[36, 6, 6], +I[36, 6, 6], +I[37, 
> 7, 7], +I[37, 7, 7], +I[38, 8, 8], +I[38, 8, 8], +I[39, 9, 9], +I[39, 9, 9], 
> +I[40, 0, 0], +I[40, 0, 0], +I[41, 1, 1], +I[41, 1, 1], +I[42, 2, 2], +I[42, 
> 2, 2], +I[43, 3, 3], +I[43, 3, 3], +I[44, 4, 4], +I[44, 4, 4], +I[45, 5, 5], 
> +I[45, 5, 5], +I[46, 6, 6], +I[46, 6, 6], +I[47, 7, 7], +I[47, 7, 7], +I[48, 
> 8, 8], +I[48, 8, 8], +I[49, 9, 9], +I[49, 9, 9], +I[50, 0, 0], +I[50, 0, 0], 
> +I[51, 1, 1], +I[51, 1, 1], +I[52, 2, 2], +I[52, 2, 2], +I[53, 3, 3], +I[53, 
> 3, 3], +I[54, 4, 4], +I[54, 4, 4], +I[55, 5, 5], +I[55, 5, 5], +I[56, 6, 6], 
> +I[56, 6, 6], +I[57, 7, 7], +I[57, 7, 7], +I[58, 8, 8], +I[58, 8, 8], +I[59, 
> 9, 9], +I[59, 9, 9], +I[60, 0, 0], +I[60, 0, 0], +I[61, 1, 1], +I[61, 1, 1], 
> +I[62, 2, 2], +I[62, 2, 2], +I[63, 3, 3], +I[63, 3, 3], +I[64, 4, 4], +I[64, 
> 4, 4], +I[65, 5, 5], +I[65, 5, 5], +I[66, 6, 6], +I[66, 6, 6], +I[67, 7, 7], 
> +I[67, 7, 7], +I[68, 8, 8], +I[68, 8, 8], +I[69, 9, 9], +I[69, 9, 9], +I[70, 
> 0, 0], +I[70, 0, 0], +I[71, 1, 1], +I[71, 1, 1], +I[72, 2, 2], +I[72, 2, 2], 
> +I[73, 3, 3], +I[73, 3, 3], +I[74, 4, 4], +I[74, 4, 4], +I[75, 5, 5], +I[75, 
> 5, 5], +I[76, 6, 6], +I[76, 6, 6], +I[77, 7, 7], +I[77, 7, 7], +I[78, 8, 8], 
> +I[78, 8, 8], +I[79, 9, 9], +I[79, 9, 9], +I[80, 0, 0], +I[80, 0, 0], +I[81, 
> 1, 1], +I[81, 1, 1], +I[82, 2, 2], +I[82, 2, 2], +I[83, 3, 3], +I[83, 3, 3], 
> +I[84, 4, 4], +I[84, 4, 4], +I[85, 5, 5], +I[85, 5, 5], +I[86, 6, 6], +I[86, 
> 6, 6], +I[87, 7, 7], +I[87, 7, 7], +I[88, 8, 8], +I[88, 8, 8], +I[89, 9, 9], 
> +I[89, 9, 9], +I[90, 0, 0], +I[90, 0, 0], +I[91, 1, 1], +I[91, 1, 1], +I[92, 
> 2, 2], +I[92, 2, 2], +I[93, 3, 3], +I[93, 3, 3], +I[94, 4, 4], +I[94, 4, 4], 
> +I[95, 5, 5], +I[95, 5, 5], +I[96, 6, 6], +I[96, 6, 6], +I[97, 7, 7], +I[97, 
> 7, 7], +I[98, 8, 8], +I[98, 8, 8], +I[99, 9, 9], +I[99, 9, 9]]> but 
> was:<[+I[0, 0, 0], +I[1, 1, 1], +I[2, 2, 2], +I[3, 3, 3], +I[4, 4, 4], +I[5, 
> 5, 5], +I[6, 6, 6], +I[7, 7, 7], +I[8, 8, 8], +I[9, 9, 9], +I[10, 0, 0], 
> +I[11, 1, 1], +I[12, 2, 2], +I[13, 3, 3], +I[14, 4, 4], +I[15, 5, 5], +I[16, 
> 6, 6], +I[17, 7, 7], +I[18, 8, 8], +I[19, 9, 9], +I[20, 0, 0], +I[21, 1, 1], 
> +I[22, 2, 2], +I[23, 3, 3], +I[24, 4, 4], +I[25, 5, 5], +I[26, 6, 6], +I[27, 
> 7, 7], +I[28, 8, 8], +I[29, 9, 9], +I[30, 0, 0], +I[31, 1, 1], +I[32, 2, 2], 
> +I[33, 3, 3], +I[34, 4, 4], +I[35, 5, 5], +I[36, 6, 6], +I[37, 7, 7], +I[38, 
> 8, 8], +I[39, 9, 9], +I[40, 0, 0], +I[41, 1, 1], +I[42, 2, 2], +I[43, 3, 3], 
> +I[44, 4, 4], +I[45, 5, 5], +I[46, 6, 6], +I[47, 7, 7], +I[48, 8, 8], +I[49, 
> 9, 9], +I[50, 0, 0], +I[51, 1, 1], +I[52, 2, 2], +I[53, 3, 3], +I[54, 4, 4], 
> +I[55, 5, 5], +I[56, 6, 6], +I[57, 

[jira] [Comment Edited] (FLINK-22704) ZooKeeperHaServicesTest.testCleanupJobData failed

2021-05-19 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-22704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17348049#comment-17348049
 ] 

Guowei Ma edited comment on FLINK-22704 at 5/20/21, 4:46 AM:
-

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18151=logs=f0ac5c25-1168-55a5-07ff-0e88223afed9=0dbaca5d-7c38-52e6-f4fe-2fb69ccb3ada=8170

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18153=logs=4d4a0d10-fca2-5507-8eed-c07f0bdf4887=c2734c79-73b6-521c-e85a-67c7ecae9107=6768


was (Author: maguowei):
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18151=logs=f0ac5c25-1168-55a5-07ff-0e88223afed9=0dbaca5d-7c38-52e6-f4fe-2fb69ccb3ada=8170

> ZooKeeperHaServicesTest.testCleanupJobData failed
> -
>
> Key: FLINK-22704
> URL: https://issues.apache.org/jira/browse/FLINK-22704
> Project: Flink
>  Issue Type: Bug
>  Components: Runtime / Coordination
>Affects Versions: 1.13.0, 1.14.0
>Reporter: Guowei Ma
>Assignee: Till Rohrmann
>Priority: Critical
>  Labels: pull-request-available, test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18108=logs=77a9d8e1-d610-59b3-fc2a-4766541e0e33=7c61167f-30b3-5893-cc38-a9e3d057e392=8172
> {code:java}
> May 19 01:30:02 Expected: a collection containing 
> "1a2850d5759a2e1f4fef9cc7e6abc675"
> May 19 01:30:02  but: was "resource_manager_lock"
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (FLINK-22613) FlinkKinesisITCase.testStopWithSavepoint fails

2021-05-19 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-22613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17348052#comment-17348052
 ] 

Guowei Ma commented on FLINK-22613:
---

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18153=logs=d44f43ce-542c-597d-bf94-b0718c71e5e8=03dca39c-73e8-5aaf-601d-328ae5c35f20=14058

> FlinkKinesisITCase.testStopWithSavepoint fails
> --
>
> Key: FLINK-22613
> URL: https://issues.apache.org/jira/browse/FLINK-22613
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / Kinesis
>Affects Versions: 1.13.0, 1.14.0, 1.12.3
>Reporter: Guowei Ma
>Priority: Blocker
>  Labels: test-stability
>
> {code:java}
> 2021-05-10T03:09:18.4601182Z May 10 03:09:18 [ERROR] 
> testStopWithSavepoint(org.apache.flink.streaming.connectors.kinesis.FlinkKinesisITCase)
>   Time elapsed: 3.526 s  <<< FAILURE!
> 2021-05-10T03:09:18.4601884Z May 10 03:09:18 java.lang.AssertionError: 
> 2021-05-10T03:09:18.4605902Z May 10 03:09:18 
> 2021-05-10T03:09:18.4616154Z May 10 03:09:18 Expected: a collection with size 
> a value less than <10>
> 2021-05-10T03:09:18.4616818Z May 10 03:09:18  but: collection size <10> 
> was equal to <10>
> 2021-05-10T03:09:18.4618087Z May 10 03:09:18  at 
> org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
> 2021-05-10T03:09:18.4618702Z May 10 03:09:18  at 
> org.junit.Assert.assertThat(Assert.java:956)
> 2021-05-10T03:09:18.4619467Z May 10 03:09:18  at 
> org.junit.Assert.assertThat(Assert.java:923)
> 2021-05-10T03:09:18.4620391Z May 10 03:09:18  at 
> org.apache.flink.streaming.connectors.kinesis.FlinkKinesisITCase.testStopWithSavepoint(FlinkKinesisITCase.java:126)
> 2021-05-10T03:09:18.4621115Z May 10 03:09:18  at 
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 2021-05-10T03:09:18.4621751Z May 10 03:09:18  at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 2021-05-10T03:09:18.4622475Z May 10 03:09:18  at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 2021-05-10T03:09:18.4623142Z May 10 03:09:18  at 
> java.lang.reflect.Method.invoke(Method.java:498)
> 2021-05-10T03:09:18.4623783Z May 10 03:09:18  at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> 2021-05-10T03:09:18.4624514Z May 10 03:09:18  at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 2021-05-10T03:09:18.4625246Z May 10 03:09:18  at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> 2021-05-10T03:09:18.4625967Z May 10 03:09:18  at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> 2021-05-10T03:09:18.4626671Z May 10 03:09:18  at 
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> 2021-05-10T03:09:18.4627349Z May 10 03:09:18  at 
> org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
> 2021-05-10T03:09:18.4627979Z May 10 03:09:18  at 
> org.junit.rules.RunRules.evaluate(RunRules.java:20)
> 2021-05-10T03:09:18.4628582Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> 2021-05-10T03:09:18.4629251Z May 10 03:09:18  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> 2021-05-10T03:09:18.4629950Z May 10 03:09:18  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> 2021-05-10T03:09:18.4630616Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> 2021-05-10T03:09:18.4631339Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> 2021-05-10T03:09:18.4631986Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> 2021-05-10T03:09:18.4632630Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> 2021-05-10T03:09:18.4633269Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> 2021-05-10T03:09:18.4634016Z May 10 03:09:18  at 
> org.testcontainers.containers.FailureDetectingExternalResource$1.evaluate(FailureDetectingExternalResource.java:30)
> 2021-05-10T03:09:18.4634786Z May 10 03:09:18  at 
> org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
> 2021-05-10T03:09:18.4635412Z May 10 03:09:18  at 
> org.junit.rules.RunRules.evaluate(RunRules.java:20)
> 2021-05-10T03:09:18.4635995Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.run(ParentRunner.java:363)
> 2021-05-10T03:09:18.4636656Z May 10 03:09:18  at 
> org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
> 2021-05-10T03:09:18.4637398Z May 10 03:09:18  at 
> 

[jira] [Comment Edited] (FLINK-22692) CheckpointStoreITCase.testRestartOnRecoveryFailure fails with RuntimeException

2021-05-19 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-22692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347278#comment-17347278
 ] 

Guowei Ma edited comment on FLINK-22692 at 5/20/21, 4:44 AM:
-

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18106=logs=8fd9202e-fd17-5b26-353c-ac1ff76c8f28=a0a633b8-47ef-5c5a-2806-3c13b9e48228=4516

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18108=logs=8fd9202e-fd17-5b26-353c-ac1ff76c8f28=a0a633b8-47ef-5c5a-2806-3c13b9e48228=4510

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18151=logs=8fd9202e-fd17-5b26-353c-ac1ff76c8f28=a0a633b8-47ef-5c5a-2806-3c13b9e48228=4516


was (Author: maguowei):
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18106=logs=8fd9202e-fd17-5b26-353c-ac1ff76c8f28=a0a633b8-47ef-5c5a-2806-3c13b9e48228=4516

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18108=logs=8fd9202e-fd17-5b26-353c-ac1ff76c8f28=a0a633b8-47ef-5c5a-2806-3c13b9e48228=4510

> CheckpointStoreITCase.testRestartOnRecoveryFailure fails with RuntimeException
> --
>
> Key: FLINK-22692
> URL: https://issues.apache.org/jira/browse/FLINK-22692
> Project: Flink
>  Issue Type: Bug
>  Components: Runtime / Checkpointing
>Affects Versions: 1.13.0, 1.14.0, 1.12.4
>Reporter: Robert Metzger
>Assignee: Roman Khachatryan
>Priority: Critical
>  Labels: pull-request-available, test-stability
> Fix For: 1.14.0, 1.13.1, 1.12.5
>
>
> Not sure if it is related to the adaptive scheduler: 
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18052=logs=8fd9202e-fd17-5b26-353c-ac1ff76c8f28=a0a633b8-47ef-5c5a-2806-3c13b9e48228
> {code}
> May 17 22:29:11 [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, 
> Time elapsed: 1.351 s <<< FAILURE! - in 
> org.apache.flink.test.checkpointing.CheckpointStoreITCase
> May 17 22:29:11 [ERROR] 
> testRestartOnRecoveryFailure(org.apache.flink.test.checkpointing.CheckpointStoreITCase)
>   Time elapsed: 1.138 s  <<< ERROR!
> May 17 22:29:11 org.apache.flink.runtime.client.JobExecutionException: Job 
> execution failed.
> May 17 22:29:11   at 
> org.apache.flink.runtime.jobmaster.JobResult.toJobExecutionResult(JobResult.java:144)
> May 17 22:29:11   at 
> org.apache.flink.runtime.minicluster.MiniClusterJobClient.lambda$getJobExecutionResult$3(MiniClusterJobClient.java:137)
> May 17 22:29:11   at 
> java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:616)
> May 17 22:29:11   at 
> java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591)
> May 17 22:29:11   at 
> java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
> May 17 22:29:11   at 
> java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
> May 17 22:29:11   at 
> org.apache.flink.runtime.rpc.akka.AkkaInvocationHandler.lambda$invokeRpc$0(AkkaInvocationHandler.java:237)
> May 17 22:29:11   at 
> java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
> May 17 22:29:11   at 
> java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
> May 17 22:29:11   at 
> java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
> May 17 22:29:11   at 
> java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
> May 17 22:29:11   at 
> org.apache.flink.runtime.concurrent.FutureUtils$1.onComplete(FutureUtils.java:1081)
> May 17 22:29:11   at akka.dispatch.OnComplete.internal(Future.scala:264)
> May 17 22:29:11   at akka.dispatch.OnComplete.internal(Future.scala:261)
> May 17 22:29:11   at 
> akka.dispatch.japi$CallbackBridge.apply(Future.scala:191)
> May 17 22:29:11   at 
> akka.dispatch.japi$CallbackBridge.apply(Future.scala:188)
> May 17 22:29:11   at 
> scala.concurrent.impl.CallbackRunnable.run(Promise.scala:36)
> May 17 22:29:11   at 
> org.apache.flink.runtime.concurrent.Executors$DirectExecutionContext.execute(Executors.java:73)
> May 17 22:29:11   at 
> scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:44)
> May 17 22:29:11   at 
> scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:252)
> May 17 22:29:11   at 
> akka.pattern.PromiseActorRef.$bang(AskSupport.scala:572)
> May 17 22:29:11   at 
> akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:22)
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-22720) UpsertKafkaTableITCase.testAggregate fail due to ConcurrentModificationException

2021-05-19 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-22720:
-

 Summary: UpsertKafkaTableITCase.testAggregate fail due to 
ConcurrentModificationException
 Key: FLINK-22720
 URL: https://issues.apache.org/jira/browse/FLINK-22720
 Project: Flink
  Issue Type: Bug
  Components: Connectors / Kafka, Tests
Affects Versions: 1.14.0
Reporter: Guowei Ma


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18151=logs=c5612577-f1f7-5977-6ff6-7432788526f7=53f6305f-55e6-561c-8f1e-3a1dde2c77df=6613


{code:java}
2021-05-19T21:28:02.8689083Z May 19 21:28:02 [ERROR] testAggregate[format = 
avro](org.apache.flink.streaming.connectors.kafka.table.UpsertKafkaTableITCase) 
 Time elapsed: 2.067 s  <<< ERROR!
2021-05-19T21:28:02.8708337Z May 19 21:28:02 
java.util.ConcurrentModificationException
2021-05-19T21:28:02.8710333Z May 19 21:28:02at 
java.util.HashMap$HashIterator.nextNode(HashMap.java:1445)
2021-05-19T21:28:02.8712083Z May 19 21:28:02at 
java.util.HashMap$ValueIterator.next(HashMap.java:1474)
2021-05-19T21:28:02.8712680Z May 19 21:28:02at 
java.util.AbstractCollection.toArray(AbstractCollection.java:141)
2021-05-19T21:28:02.8713142Z May 19 21:28:02at 
java.util.ArrayList.addAll(ArrayList.java:583)
2021-05-19T21:28:02.8716029Z May 19 21:28:02at 
org.apache.flink.table.planner.factories.TestValuesRuntimeFunctions.lambda$getResults$0(TestValuesRuntimeFunctions.java:114)
2021-05-19T21:28:02.8717007Z May 19 21:28:02at 
java.util.HashMap$Values.forEach(HashMap.java:981)
2021-05-19T21:28:02.8718041Z May 19 21:28:02at 
org.apache.flink.table.planner.factories.TestValuesRuntimeFunctions.getResults(TestValuesRuntimeFunctions.java:114)
2021-05-19T21:28:02.8719339Z May 19 21:28:02at 
org.apache.flink.table.planner.factories.TestValuesTableFactory.getResults(TestValuesTableFactory.java:184)
2021-05-19T21:28:02.8720309Z May 19 21:28:02at 
org.apache.flink.streaming.connectors.kafka.table.KafkaTableTestUtils.waitingExpectedResults(KafkaTableTestUtils.java:82)
2021-05-19T21:28:02.8721311Z May 19 21:28:02at 
org.apache.flink.streaming.connectors.kafka.table.UpsertKafkaTableITCase.wordFreqToUpsertKafka(UpsertKafkaTableITCase.java:440)
2021-05-19T21:28:02.8730402Z May 19 21:28:02at 
org.apache.flink.streaming.connectors.kafka.table.UpsertKafkaTableITCase.testAggregate(UpsertKafkaTableITCase.java:73)
2021-05-19T21:28:02.8731390Z May 19 21:28:02at 
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2021-05-19T21:28:02.8732095Z May 19 21:28:02at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2021-05-19T21:28:02.8732935Z May 19 21:28:02at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2021-05-19T21:28:02.8733726Z May 19 21:28:02at 
java.lang.reflect.Method.invoke(Method.java:498)
2021-05-19T21:28:02.8734598Z May 19 21:28:02at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
2021-05-19T21:28:02.8735450Z May 19 21:28:02at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
2021-05-19T21:28:02.8736313Z May 19 21:28:02at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
2021-05-19T21:28:02.8737329Z May 19 21:28:02at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
2021-05-19T21:28:02.8738165Z May 19 21:28:02at 
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
2021-05-19T21:28:02.8738989Z May 19 21:28:02at 
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
2021-05-19T21:28:02.8739741Z May 19 21:28:02at 
org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
2021-05-19T21:28:02.8740563Z May 19 21:28:02at 
org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
2021-05-19T21:28:02.8741340Z May 19 21:28:02at 
org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
2021-05-19T21:28:02.8742077Z May 19 21:28:02at 
org.junit.rules.RunRules.evaluate(RunRules.java:20)
2021-05-19T21:28:02.8742802Z May 19 21:28:02at 
org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
2021-05-19T21:28:02.8743594Z May 19 21:28:02at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
2021-05-19T21:28:02.8744811Z May 19 21:28:02at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
2021-05-19T21:28:02.8745580Z May 19 21:28:02at 
org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
2021-05-19T21:28:02.8746330Z May 19 21:28:02at 
org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
2021-05-19T21:28:02.8747222Z May 19 21:28:02at 
org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
2021-05-19T21:28:02.8748007Z May 19 21:28:02at 

[jira] [Commented] (FLINK-22702) KafkaSourceITCase.testRedundantParallelism failed

2021-05-19 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-22702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17348050#comment-17348050
 ] 

Guowei Ma commented on FLINK-22702:
---

KafkaSourceITCase.testValueOnlyDeserializer fail because of same errors

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18151=logs=ce8f3cc3-c1ea-5281-f5eb-df9ebd24947f=f266c805-9429-58ed-2f9e-482e7b82f58b=7009



> KafkaSourceITCase.testRedundantParallelism failed
> -
>
> Key: FLINK-22702
> URL: https://issues.apache.org/jira/browse/FLINK-22702
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / Kafka
>Affects Versions: 1.14.0, 1.12.3
>Reporter: Guowei Ma
>Priority: Major
>  Labels: test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18107=logs=1fc6e7bf-633c-5081-c32a-9dea24b05730=80a658d1-f7f6-5d93-2758-53ac19fd5b19=6847
> {code:java}
> Caused by: java.lang.RuntimeException: One or more fetchers have encountered 
> exception
>   at 
> org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:199)
>   at 
> org.apache.flink.connector.base.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:154)
>   at 
> org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:116)
>   at 
> org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:275)
>   at 
> org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:67)
>   at 
> org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
>   at 
> org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:398)
>   at 
> org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:191)
>   at 
> org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:619)
>   at 
> org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:583)
>   at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:758)
>   at org.apache.flink.runtime.taskmanager.Task.run(Task.java:573)
>   at java.lang.Thread.run(Thread.java:748)
> Caused by: java.lang.RuntimeException: SplitFetcher thread 0 received 
> unexpected exception while polling the records
>   at 
> org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:146)
>   at 
> org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:101)
>   at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>   at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>   ... 1 more
> Caused by: java.lang.IllegalStateException: Consumer is not subscribed to any 
> topics or assigned any partitions
>   at 
> org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1223)
>   at 
> org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1211)
>   at 
> org.apache.flink.connector.kafka.source.reader.KafkaPartitionSplitReader.fetch(KafkaPartitionSplitReader.java:97)
>   at 
> org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:56)
>   at 
> org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:138)
>   ... 6 more
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (FLINK-22702) KafkaSourceITCase.testRedundantParallelism failed

2021-05-19 Thread Guowei Ma (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-22702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Guowei Ma updated FLINK-22702:
--
Affects Version/s: 1.14.0

> KafkaSourceITCase.testRedundantParallelism failed
> -
>
> Key: FLINK-22702
> URL: https://issues.apache.org/jira/browse/FLINK-22702
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / Kafka
>Affects Versions: 1.14.0, 1.12.3
>Reporter: Guowei Ma
>Priority: Major
>  Labels: test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18107=logs=1fc6e7bf-633c-5081-c32a-9dea24b05730=80a658d1-f7f6-5d93-2758-53ac19fd5b19=6847
> {code:java}
> Caused by: java.lang.RuntimeException: One or more fetchers have encountered 
> exception
>   at 
> org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:199)
>   at 
> org.apache.flink.connector.base.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:154)
>   at 
> org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:116)
>   at 
> org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:275)
>   at 
> org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:67)
>   at 
> org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
>   at 
> org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:398)
>   at 
> org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:191)
>   at 
> org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:619)
>   at 
> org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:583)
>   at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:758)
>   at org.apache.flink.runtime.taskmanager.Task.run(Task.java:573)
>   at java.lang.Thread.run(Thread.java:748)
> Caused by: java.lang.RuntimeException: SplitFetcher thread 0 received 
> unexpected exception while polling the records
>   at 
> org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:146)
>   at 
> org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:101)
>   at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>   at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>   ... 1 more
> Caused by: java.lang.IllegalStateException: Consumer is not subscribed to any 
> topics or assigned any partitions
>   at 
> org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1223)
>   at 
> org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1211)
>   at 
> org.apache.flink.connector.kafka.source.reader.KafkaPartitionSplitReader.fetch(KafkaPartitionSplitReader.java:97)
>   at 
> org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:56)
>   at 
> org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:138)
>   ... 6 more
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (FLINK-22704) ZooKeeperHaServicesTest.testCleanupJobData failed

2021-05-19 Thread Guowei Ma (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-22704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Guowei Ma updated FLINK-22704:
--
Affects Version/s: 1.14.0

> ZooKeeperHaServicesTest.testCleanupJobData failed
> -
>
> Key: FLINK-22704
> URL: https://issues.apache.org/jira/browse/FLINK-22704
> Project: Flink
>  Issue Type: Bug
>  Components: Runtime / Coordination
>Affects Versions: 1.13.0, 1.14.0
>Reporter: Guowei Ma
>Assignee: Till Rohrmann
>Priority: Critical
>  Labels: pull-request-available, test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18108=logs=77a9d8e1-d610-59b3-fc2a-4766541e0e33=7c61167f-30b3-5893-cc38-a9e3d057e392=8172
> {code:java}
> May 19 01:30:02 Expected: a collection containing 
> "1a2850d5759a2e1f4fef9cc7e6abc675"
> May 19 01:30:02  but: was "resource_manager_lock"
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (FLINK-22704) ZooKeeperHaServicesTest.testCleanupJobData failed

2021-05-19 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-22704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17348049#comment-17348049
 ] 

Guowei Ma commented on FLINK-22704:
---

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18151=logs=f0ac5c25-1168-55a5-07ff-0e88223afed9=0dbaca5d-7c38-52e6-f4fe-2fb69ccb3ada=8170

> ZooKeeperHaServicesTest.testCleanupJobData failed
> -
>
> Key: FLINK-22704
> URL: https://issues.apache.org/jira/browse/FLINK-22704
> Project: Flink
>  Issue Type: Bug
>  Components: Runtime / Coordination
>Affects Versions: 1.13.0
>Reporter: Guowei Ma
>Assignee: Till Rohrmann
>Priority: Critical
>  Labels: pull-request-available, test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18108=logs=77a9d8e1-d610-59b3-fc2a-4766541e0e33=7c61167f-30b3-5893-cc38-a9e3d057e392=8172
> {code:java}
> May 19 01:30:02 Expected: a collection containing 
> "1a2850d5759a2e1f4fef9cc7e6abc675"
> May 19 01:30:02  but: was "resource_manager_lock"
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (FLINK-22593) SavepointITCase.testShouldAddEntropyToSavepointPath unstable

2021-05-19 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-22593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17348047#comment-17348047
 ] 

Guowei Ma commented on FLINK-22593:
---

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18151=logs=39d5b1d5-3b41-54dc-6458-1e2ddd1cdcf3=a99e99c7-21cd-5a1f-7274-585e62b72f56=4481

> SavepointITCase.testShouldAddEntropyToSavepointPath unstable
> 
>
> Key: FLINK-22593
> URL: https://issues.apache.org/jira/browse/FLINK-22593
> Project: Flink
>  Issue Type: Bug
>  Components: Runtime / Checkpointing
>Affects Versions: 1.14.0
>Reporter: Robert Metzger
>Priority: Critical
>  Labels: test-stability
>
> https://dev.azure.com/rmetzger/Flink/_build/results?buildId=9072=logs=cc649950-03e9-5fae-8326-2f1ad744b536=51cab6ca-669f-5dc0-221d-1e4f7dc4fc85
> {code}
> 2021-05-07T10:56:20.9429367Z May 07 10:56:20 [ERROR] Tests run: 13, Failures: 
> 0, Errors: 1, Skipped: 0, Time elapsed: 33.441 s <<< FAILURE! - in 
> org.apache.flink.test.checkpointing.SavepointITCase
> 2021-05-07T10:56:20.9445862Z May 07 10:56:20 [ERROR] 
> testShouldAddEntropyToSavepointPath(org.apache.flink.test.checkpointing.SavepointITCase)
>   Time elapsed: 2.083 s  <<< ERROR!
> 2021-05-07T10:56:20.9447106Z May 07 10:56:20 
> java.util.concurrent.ExecutionException: 
> java.util.concurrent.CompletionException: 
> org.apache.flink.runtime.checkpoint.CheckpointException: Checkpoint 
> triggering task Sink: Unnamed (3/4) of job 4e155a20f0a7895043661a6446caf1cb 
> has not being executed at the moment. Aborting checkpoint. Failure reason: 
> Not all required tasks are currently running.
> 2021-05-07T10:56:20.9448194Z May 07 10:56:20  at 
> java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
> 2021-05-07T10:56:20.9448797Z May 07 10:56:20  at 
> java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
> 2021-05-07T10:56:20.9449428Z May 07 10:56:20  at 
> org.apache.flink.test.checkpointing.SavepointITCase.submitJobAndTakeSavepoint(SavepointITCase.java:305)
> 2021-05-07T10:56:20.9450160Z May 07 10:56:20  at 
> org.apache.flink.test.checkpointing.SavepointITCase.testShouldAddEntropyToSavepointPath(SavepointITCase.java:273)
> 2021-05-07T10:56:20.9450785Z May 07 10:56:20  at 
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 2021-05-07T10:56:20.9451331Z May 07 10:56:20  at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 2021-05-07T10:56:20.9451940Z May 07 10:56:20  at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 2021-05-07T10:56:20.9452498Z May 07 10:56:20  at 
> java.lang.reflect.Method.invoke(Method.java:498)
> 2021-05-07T10:56:20.9453247Z May 07 10:56:20  at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> 2021-05-07T10:56:20.9454007Z May 07 10:56:20  at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 2021-05-07T10:56:20.9454687Z May 07 10:56:20  at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> 2021-05-07T10:56:20.9455302Z May 07 10:56:20  at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> 2021-05-07T10:56:20.9455909Z May 07 10:56:20  at 
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> 2021-05-07T10:56:20.9456493Z May 07 10:56:20  at 
> org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
> 2021-05-07T10:56:20.9457074Z May 07 10:56:20  at 
> org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
> 2021-05-07T10:56:20.9457636Z May 07 10:56:20  at 
> org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
> 2021-05-07T10:56:20.9458157Z May 07 10:56:20  at 
> org.junit.rules.RunRules.evaluate(RunRules.java:20)
> 2021-05-07T10:56:20.9458678Z May 07 10:56:20  at 
> org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> 2021-05-07T10:56:20.9459252Z May 07 10:56:20  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> 2021-05-07T10:56:20.9459865Z May 07 10:56:20  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> 2021-05-07T10:56:20.9460433Z May 07 10:56:20  at 
> org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> 2021-05-07T10:56:20.9461058Z May 07 10:56:20  at 
> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> 2021-05-07T10:56:20.9461607Z May 07 10:56:20  at 
> org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> 2021-05-07T10:56:20.9462159Z May 07 10:56:20  at 
> org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> 2021-05-07T10:56:20.9462705Z May 07 10:56:20  at 
> 

[jira] [Commented] (FLINK-20495) Elasticsearch6DynamicSinkITCase Hang

2021-05-19 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-20495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17348016#comment-17348016
 ] 

Guowei Ma commented on FLINK-20495:
---

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18152=logs=ba53eb01-1462-56a3-8e98-0dd97fbcaab5=bfbc6239-57a0-5db0-63f3-41551b4f7d51=12229

> Elasticsearch6DynamicSinkITCase Hang
> 
>
> Key: FLINK-20495
> URL: https://issues.apache.org/jira/browse/FLINK-20495
> Project: Flink
>  Issue Type: Bug
>  Components: Build System / Azure Pipelines, Connectors / 
> ElasticSearch, Tests
>Affects Versions: 1.13.0
>Reporter: Huang Xingbo
>Priority: Major
>  Labels: test-stability
>
> [https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=10535=logs=d44f43ce-542c-597d-bf94-b0718c71e5e8=03dca39c-73e8-5aaf-601d-328ae5c35f20]
>  
> {code:java}
> 2020-12-04T22:39:33.9748225Z [INFO] Running 
> org.apache.flink.streaming.connectors.elasticsearch.table.Elasticsearch6DynamicSinkITCase
> 2020-12-04T22:54:51.9486410Z 
> ==
> 2020-12-04T22:54:51.9488766Z Process produced no output for 900 seconds.
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (FLINK-22613) FlinkKinesisITCase.testStopWithSavepoint fails

2021-05-19 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-22613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17348015#comment-17348015
 ] 

Guowei Ma commented on FLINK-22613:
---

1.12
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18152=logs=e1276d0f-df12-55ec-86b5-c0ad597d83c9=906e9244-f3be-5604-1979-e767c8a6f6d9=13977

> FlinkKinesisITCase.testStopWithSavepoint fails
> --
>
> Key: FLINK-22613
> URL: https://issues.apache.org/jira/browse/FLINK-22613
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / Kinesis
>Affects Versions: 1.13.0, 1.14.0, 1.12.3
>Reporter: Guowei Ma
>Priority: Blocker
>  Labels: test-stability
>
> {code:java}
> 2021-05-10T03:09:18.4601182Z May 10 03:09:18 [ERROR] 
> testStopWithSavepoint(org.apache.flink.streaming.connectors.kinesis.FlinkKinesisITCase)
>   Time elapsed: 3.526 s  <<< FAILURE!
> 2021-05-10T03:09:18.4601884Z May 10 03:09:18 java.lang.AssertionError: 
> 2021-05-10T03:09:18.4605902Z May 10 03:09:18 
> 2021-05-10T03:09:18.4616154Z May 10 03:09:18 Expected: a collection with size 
> a value less than <10>
> 2021-05-10T03:09:18.4616818Z May 10 03:09:18  but: collection size <10> 
> was equal to <10>
> 2021-05-10T03:09:18.4618087Z May 10 03:09:18  at 
> org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
> 2021-05-10T03:09:18.4618702Z May 10 03:09:18  at 
> org.junit.Assert.assertThat(Assert.java:956)
> 2021-05-10T03:09:18.4619467Z May 10 03:09:18  at 
> org.junit.Assert.assertThat(Assert.java:923)
> 2021-05-10T03:09:18.4620391Z May 10 03:09:18  at 
> org.apache.flink.streaming.connectors.kinesis.FlinkKinesisITCase.testStopWithSavepoint(FlinkKinesisITCase.java:126)
> 2021-05-10T03:09:18.4621115Z May 10 03:09:18  at 
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 2021-05-10T03:09:18.4621751Z May 10 03:09:18  at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 2021-05-10T03:09:18.4622475Z May 10 03:09:18  at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 2021-05-10T03:09:18.4623142Z May 10 03:09:18  at 
> java.lang.reflect.Method.invoke(Method.java:498)
> 2021-05-10T03:09:18.4623783Z May 10 03:09:18  at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> 2021-05-10T03:09:18.4624514Z May 10 03:09:18  at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 2021-05-10T03:09:18.4625246Z May 10 03:09:18  at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> 2021-05-10T03:09:18.4625967Z May 10 03:09:18  at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> 2021-05-10T03:09:18.4626671Z May 10 03:09:18  at 
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> 2021-05-10T03:09:18.4627349Z May 10 03:09:18  at 
> org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
> 2021-05-10T03:09:18.4627979Z May 10 03:09:18  at 
> org.junit.rules.RunRules.evaluate(RunRules.java:20)
> 2021-05-10T03:09:18.4628582Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> 2021-05-10T03:09:18.4629251Z May 10 03:09:18  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> 2021-05-10T03:09:18.4629950Z May 10 03:09:18  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> 2021-05-10T03:09:18.4630616Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> 2021-05-10T03:09:18.4631339Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> 2021-05-10T03:09:18.4631986Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> 2021-05-10T03:09:18.4632630Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> 2021-05-10T03:09:18.4633269Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> 2021-05-10T03:09:18.4634016Z May 10 03:09:18  at 
> org.testcontainers.containers.FailureDetectingExternalResource$1.evaluate(FailureDetectingExternalResource.java:30)
> 2021-05-10T03:09:18.4634786Z May 10 03:09:18  at 
> org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
> 2021-05-10T03:09:18.4635412Z May 10 03:09:18  at 
> org.junit.rules.RunRules.evaluate(RunRules.java:20)
> 2021-05-10T03:09:18.4635995Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.run(ParentRunner.java:363)
> 2021-05-10T03:09:18.4636656Z May 10 03:09:18  at 
> org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
> 2021-05-10T03:09:18.4637398Z May 10 03:09:18  at 
> 

[jira] [Updated] (FLINK-20498) SQLClientSchemaRegistryITCase.testReading test timed out after 120000 milliseconds

2021-05-19 Thread Guowei Ma (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-20498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Guowei Ma updated FLINK-20498:
--
Affects Version/s: 1.12.3

> SQLClientSchemaRegistryITCase.testReading test timed out after 12 
> milliseconds
> --
>
> Key: FLINK-20498
> URL: https://issues.apache.org/jira/browse/FLINK-20498
> Project: Flink
>  Issue Type: Bug
>  Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
>Affects Versions: 1.12.1, 1.13.0, 1.12.3
>Reporter: Huang Xingbo
>Priority: Major
>  Labels: test-stability
>
> [https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=10548=logs=739e6eac-8312-5d31-d437-294c4d26fced=a68b8d89-50e9-5977-4500-f4fde4f57f9b]
> {code:java}
> 2020-12-06T02:06:38.6416440Z Dec 06 02:06:38 
> org.junit.runners.model.TestTimedOutException: test timed out after 12 
> milliseconds
> 2020-12-06T02:06:38.6417052Z Dec 06 02:06:38  at java.lang.Object.wait(Native 
> Method)
> 2020-12-06T02:06:38.6417586Z Dec 06 02:06:38  at 
> java.lang.Thread.join(Thread.java:1252)
> 2020-12-06T02:06:38.6418170Z Dec 06 02:06:38  at 
> java.lang.Thread.join(Thread.java:1326)
> 2020-12-06T02:06:38.6418788Z Dec 06 02:06:38  at 
> org.apache.kafka.clients.admin.KafkaAdminClient.close(KafkaAdminClient.java:541)
> 2020-12-06T02:06:38.6419463Z Dec 06 02:06:38  at 
> org.apache.kafka.clients.admin.Admin.close(Admin.java:96)
> 2020-12-06T02:06:38.6420277Z Dec 06 02:06:38  at 
> org.apache.kafka.clients.admin.Admin.close(Admin.java:79)
> 2020-12-06T02:06:38.6420973Z Dec 06 02:06:38  at 
> org.apache.flink.tests.util.kafka.KafkaContainerClient.createTopic(KafkaContainerClient.java:76)
> 2020-12-06T02:06:38.6421797Z Dec 06 02:06:38  at 
> org.apache.flink.tests.util.kafka.SQLClientSchemaRegistryITCase.testReading(SQLClientSchemaRegistryITCase.java:109)
> 2020-12-06T02:06:38.6422517Z Dec 06 02:06:38  at 
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 2020-12-06T02:06:38.6423173Z Dec 06 02:06:38  at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 2020-12-06T02:06:38.6423990Z Dec 06 02:06:38  at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 2020-12-06T02:06:38.6424656Z Dec 06 02:06:38  at 
> java.lang.reflect.Method.invoke(Method.java:498)
> 2020-12-06T02:06:38.6425321Z Dec 06 02:06:38  at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> 2020-12-06T02:06:38.6426057Z Dec 06 02:06:38  at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 2020-12-06T02:06:38.6426766Z Dec 06 02:06:38  at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> 2020-12-06T02:06:38.6427478Z Dec 06 02:06:38  at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> 2020-12-06T02:06:38.6428232Z Dec 06 02:06:38  at 
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
> 2020-12-06T02:06:38.6428999Z Dec 06 02:06:38  at 
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
> 2020-12-06T02:06:38.6429707Z Dec 06 02:06:38  at 
> java.util.concurrent.FutureTask.run(FutureTask.java:266)
> 2020-12-06T02:06:38.6430292Z Dec 06 02:06:38  at 
> java.lang.Thread.run(Thread.java:748)
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (FLINK-20498) SQLClientSchemaRegistryITCase.testReading test timed out after 120000 milliseconds

2021-05-19 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-20498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17348013#comment-17348013
 ] 

Guowei Ma commented on FLINK-20498:
---

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18152=logs=6caf31d6-847a-526e-9624-468e053467d6=0b23652f-b18b-5b6e-6eb6-a11070364610=17745


> SQLClientSchemaRegistryITCase.testReading test timed out after 12 
> milliseconds
> --
>
> Key: FLINK-20498
> URL: https://issues.apache.org/jira/browse/FLINK-20498
> Project: Flink
>  Issue Type: Bug
>  Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
>Affects Versions: 1.12.1, 1.13.0
>Reporter: Huang Xingbo
>Priority: Major
>  Labels: test-stability
>
> [https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=10548=logs=739e6eac-8312-5d31-d437-294c4d26fced=a68b8d89-50e9-5977-4500-f4fde4f57f9b]
> {code:java}
> 2020-12-06T02:06:38.6416440Z Dec 06 02:06:38 
> org.junit.runners.model.TestTimedOutException: test timed out after 12 
> milliseconds
> 2020-12-06T02:06:38.6417052Z Dec 06 02:06:38  at java.lang.Object.wait(Native 
> Method)
> 2020-12-06T02:06:38.6417586Z Dec 06 02:06:38  at 
> java.lang.Thread.join(Thread.java:1252)
> 2020-12-06T02:06:38.6418170Z Dec 06 02:06:38  at 
> java.lang.Thread.join(Thread.java:1326)
> 2020-12-06T02:06:38.6418788Z Dec 06 02:06:38  at 
> org.apache.kafka.clients.admin.KafkaAdminClient.close(KafkaAdminClient.java:541)
> 2020-12-06T02:06:38.6419463Z Dec 06 02:06:38  at 
> org.apache.kafka.clients.admin.Admin.close(Admin.java:96)
> 2020-12-06T02:06:38.6420277Z Dec 06 02:06:38  at 
> org.apache.kafka.clients.admin.Admin.close(Admin.java:79)
> 2020-12-06T02:06:38.6420973Z Dec 06 02:06:38  at 
> org.apache.flink.tests.util.kafka.KafkaContainerClient.createTopic(KafkaContainerClient.java:76)
> 2020-12-06T02:06:38.6421797Z Dec 06 02:06:38  at 
> org.apache.flink.tests.util.kafka.SQLClientSchemaRegistryITCase.testReading(SQLClientSchemaRegistryITCase.java:109)
> 2020-12-06T02:06:38.6422517Z Dec 06 02:06:38  at 
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 2020-12-06T02:06:38.6423173Z Dec 06 02:06:38  at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 2020-12-06T02:06:38.6423990Z Dec 06 02:06:38  at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 2020-12-06T02:06:38.6424656Z Dec 06 02:06:38  at 
> java.lang.reflect.Method.invoke(Method.java:498)
> 2020-12-06T02:06:38.6425321Z Dec 06 02:06:38  at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> 2020-12-06T02:06:38.6426057Z Dec 06 02:06:38  at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 2020-12-06T02:06:38.6426766Z Dec 06 02:06:38  at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> 2020-12-06T02:06:38.6427478Z Dec 06 02:06:38  at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> 2020-12-06T02:06:38.6428232Z Dec 06 02:06:38  at 
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
> 2020-12-06T02:06:38.6428999Z Dec 06 02:06:38  at 
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
> 2020-12-06T02:06:38.6429707Z Dec 06 02:06:38  at 
> java.util.concurrent.FutureTask.run(FutureTask.java:266)
> 2020-12-06T02:06:38.6430292Z Dec 06 02:06:38  at 
> java.lang.Thread.run(Thread.java:748)
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-22710) ParquetProtoStreamingFileSinkITCase.testParquetProtoWriters failed

2021-05-19 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-22710:
-

 Summary: 
ParquetProtoStreamingFileSinkITCase.testParquetProtoWriters failed
 Key: FLINK-22710
 URL: https://issues.apache.org/jira/browse/FLINK-22710
 Project: Flink
  Issue Type: Bug
  Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
Affects Versions: 1.14.0
Reporter: Guowei Ma


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18114=logs=d44f43ce-542c-597d-bf94-b0718c71e5e8=03dca39c-73e8-5aaf-601d-328ae5c35f20=13181


{code:java}

May 19 03:00:31 [ERROR]   
ParquetProtoStreamingFileSinkITCase.testParquetProtoWriters:83->validateResults:92
 expected:<1> but was:<2>

{code}




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-22705) SQL Client end-to-end test (Old planner) Elasticsearch (v7.5.1) failed due to fail to download the tar

2021-05-18 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-22705:
-

 Summary: SQL Client end-to-end test (Old planner) Elasticsearch 
(v7.5.1) failed due to fail to download the tar
 Key: FLINK-22705
 URL: https://issues.apache.org/jira/browse/FLINK-22705
 Project: Flink
  Issue Type: Bug
  Components: Connectors / ElasticSearch
Affects Versions: 1.13.0
Reporter: Guowei Ma


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18100=logs=c88eea3b-64a0-564d-0031-9fdcd7b8abee=ff888d9b-cd34-53cc-d90f-3e446d355529=18408

{code:java}

May 18 17:24:23 Preparing Elasticsearch (version=7)...
May 18 17:24:23 Downloading Elasticsearch from 
https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-oss-7.5.1-no-jdk-linux-x86_64.tar.gz
 ...
--2021-05-18 17:24:23--  
https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-oss-7.5.1-no-jdk-linux-x86_64.tar.gz
Resolving artifacts.elastic.co (artifacts.elastic.co)... 34.120.127.130, 
2600:1901:0:1d7::
Connecting to artifacts.elastic.co 
(artifacts.elastic.co)|34.120.127.130|:443... failed: Connection timed out.
Connecting to artifacts.elastic.co 
(artifacts.elastic.co)|2600:1901:0:1d7::|:443... failed: Network is unreachable.
  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload   Total   SpentLeft  Speed

  0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 
0curl: (7) Failed to connect to localhost port 9200: Connection refused
May 18 17:26:34 [FAIL] Test script contains errors.
May 18 17:26:34 Checking for errors...
May 18 17:26:34 No errors in log files.
May 18 17:26:34 Checking for exceptions...
May 18 17:26:34 No exceptions in log files.
May 18 17:26:34 Checking for non-empty .out files...
grep: /home/vsts/work/_temp/debug_files/flink-logs/*.out: No such file or 
directory
May 18 17:26:34 No non-empty .out files.
May 18 17:26:34 
May 18 17:26:34 [FAIL] 'SQL Client end-to-end test (Old planner) Elasticsearch 
(v7.5.1)' failed after 2 minutes and 36 seconds! Test exited with exit code 1
May 18 17:26:34
{code}




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Comment Edited] (FLINK-22692) CheckpointStoreITCase.testRestartOnRecoveryFailure fails with RuntimeException

2021-05-18 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-22692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347278#comment-17347278
 ] 

Guowei Ma edited comment on FLINK-22692 at 5/19/21, 3:30 AM:
-

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18106=logs=8fd9202e-fd17-5b26-353c-ac1ff76c8f28=a0a633b8-47ef-5c5a-2806-3c13b9e48228=4516

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18108=logs=8fd9202e-fd17-5b26-353c-ac1ff76c8f28=a0a633b8-47ef-5c5a-2806-3c13b9e48228=4510


was (Author: maguowei):
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18106=logs=8fd9202e-fd17-5b26-353c-ac1ff76c8f28=a0a633b8-47ef-5c5a-2806-3c13b9e48228=4516


> CheckpointStoreITCase.testRestartOnRecoveryFailure fails with RuntimeException
> --
>
> Key: FLINK-22692
> URL: https://issues.apache.org/jira/browse/FLINK-22692
> Project: Flink
>  Issue Type: Bug
>  Components: Runtime / Checkpointing
>Reporter: Robert Metzger
>Priority: Critical
>  Labels: test-stability
>
> Not sure if it is related to the adaptive scheduler: 
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18052=logs=8fd9202e-fd17-5b26-353c-ac1ff76c8f28=a0a633b8-47ef-5c5a-2806-3c13b9e48228
> {code}
> May 17 22:29:11 [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, 
> Time elapsed: 1.351 s <<< FAILURE! - in 
> org.apache.flink.test.checkpointing.CheckpointStoreITCase
> May 17 22:29:11 [ERROR] 
> testRestartOnRecoveryFailure(org.apache.flink.test.checkpointing.CheckpointStoreITCase)
>   Time elapsed: 1.138 s  <<< ERROR!
> May 17 22:29:11 org.apache.flink.runtime.client.JobExecutionException: Job 
> execution failed.
> May 17 22:29:11   at 
> org.apache.flink.runtime.jobmaster.JobResult.toJobExecutionResult(JobResult.java:144)
> May 17 22:29:11   at 
> org.apache.flink.runtime.minicluster.MiniClusterJobClient.lambda$getJobExecutionResult$3(MiniClusterJobClient.java:137)
> May 17 22:29:11   at 
> java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:616)
> May 17 22:29:11   at 
> java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591)
> May 17 22:29:11   at 
> java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
> May 17 22:29:11   at 
> java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
> May 17 22:29:11   at 
> org.apache.flink.runtime.rpc.akka.AkkaInvocationHandler.lambda$invokeRpc$0(AkkaInvocationHandler.java:237)
> May 17 22:29:11   at 
> java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
> May 17 22:29:11   at 
> java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
> May 17 22:29:11   at 
> java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
> May 17 22:29:11   at 
> java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
> May 17 22:29:11   at 
> org.apache.flink.runtime.concurrent.FutureUtils$1.onComplete(FutureUtils.java:1081)
> May 17 22:29:11   at akka.dispatch.OnComplete.internal(Future.scala:264)
> May 17 22:29:11   at akka.dispatch.OnComplete.internal(Future.scala:261)
> May 17 22:29:11   at 
> akka.dispatch.japi$CallbackBridge.apply(Future.scala:191)
> May 17 22:29:11   at 
> akka.dispatch.japi$CallbackBridge.apply(Future.scala:188)
> May 17 22:29:11   at 
> scala.concurrent.impl.CallbackRunnable.run(Promise.scala:36)
> May 17 22:29:11   at 
> org.apache.flink.runtime.concurrent.Executors$DirectExecutionContext.execute(Executors.java:73)
> May 17 22:29:11   at 
> scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:44)
> May 17 22:29:11   at 
> scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:252)
> May 17 22:29:11   at 
> akka.pattern.PromiseActorRef.$bang(AskSupport.scala:572)
> May 17 22:29:11   at 
> akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:22)
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Reopened] (FLINK-22197) UnalignedCheckpointRescaleITCase.shouldRescaleUnalignedCheckpoint fail due to NoSuchFileException

2021-05-18 Thread Guowei Ma (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-22197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Guowei Ma reopened FLINK-22197:
---

happens again
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18108=logs=f2b08047-82c3-520f-51ee-a30fd6254285=601c4a98-b94a-54db-dc38-ae78131029dc=10464

> UnalignedCheckpointRescaleITCase.shouldRescaleUnalignedCheckpoint fail due to 
> NoSuchFileException
> -
>
> Key: FLINK-22197
> URL: https://issues.apache.org/jira/browse/FLINK-22197
> Project: Flink
>  Issue Type: Bug
>  Components: Runtime / Checkpointing
>Affects Versions: 1.13.0
>Reporter: Guowei Ma
>Assignee: Roman Khachatryan
>Priority: Major
>  Labels: pull-request-available, test-stability
> Fix For: 1.13.0
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=16299=logs=5c8e7682-d68f-54d1-16a2-a09310218a49=f508e270-48d6-5f1e-3138-42a17e0714f0=4114
> {code:java}
> [ERROR] shouldRescaleUnalignedCheckpoint[downscale multi_input from 2 to 
> 1](org.apache.flink.test.checkpointing.UnalignedCheckpointRescaleITCase)  
> Time elapsed: 1.207 s  <<< ERROR!
> java.io.UncheckedIOException: java.nio.file.NoSuchFileException: 
> /tmp/junit2258366408560616884/junit1534110541268652756/57fe5b8f12dabf74bc47f89597e9b59b/chk-6/7874ce15-507d-409b-b2ab-fe3ae77dbdf5
>   at 
> java.nio.file.FileTreeIterator.fetchNextIfNeeded(FileTreeIterator.java:88)
>   at java.nio.file.FileTreeIterator.hasNext(FileTreeIterator.java:104)
>   at 
> java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1811)
>   at 
> java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:126)
>   at 
> java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:499)
>   at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:486)
>   at 
> java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
>   at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:152)
>   at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
>   at 
> java.util.stream.ReferencePipeline.findAny(ReferencePipeline.java:536)
>   at 
> org.apache.flink.test.checkpointing.UnalignedCheckpointTestBase.hasMetadata(UnalignedCheckpointTestBase.java:203)
>   at 
> org.apache.flink.test.checkpointing.UnalignedCheckpointTestBase.isCompletedCheckpoint(UnalignedCheckpointTestBase.java:193)
>   at java.nio.file.Files.lambda$find$2(Files.java:3691)
>   at 
> java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174)
>   at java.util.Iterator.forEachRemaining(Iterator.java:116)
>   at 
> java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
>   at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
>   at 
> java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
>   at 
> java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
>   at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
>   at java.util.stream.ReferencePipeline.reduce(ReferencePipeline.java:546)
>   at java.util.stream.ReferencePipeline.min(ReferencePipeline.java:587)
>   at 
> org.apache.flink.test.checkpointing.UnalignedCheckpointTestBase.execute(UnalignedCheckpointTestBase.java:175)
>   at 
> org.apache.flink.test.checkpointing.UnalignedCheckpointRescaleITCase.shouldRescaleUnalignedCheckpoint(UnalignedCheckpointRescaleITCase.java:360)
>   at sun.reflect.GeneratedMethodAccessor83.invoke(Unknown Source)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:498)
>   at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
>   at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
>   at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
>   at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
>   at org.junit.rules.Verifier$1.evaluate(Verifier.java:35)
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Comment Edited] (FLINK-22613) FlinkKinesisITCase.testStopWithSavepoint fails

2021-05-18 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-22613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347276#comment-17347276
 ] 

Guowei Ma edited comment on FLINK-22613 at 5/19/21, 3:26 AM:
-

just for reporting
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18107=logs=e1276d0f-df12-55ec-86b5-c0ad597d83c9=906e9244-f3be-5604-1979-e767c8a6f6d9=13977

1.13
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18108=logs=e1276d0f-df12-55ec-86b5-c0ad597d83c9=906e9244-f3be-5604-1979-e767c8a6f6d9=14059


was (Author: maguowei):
just for reporting
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18107=logs=e1276d0f-df12-55ec-86b5-c0ad597d83c9=906e9244-f3be-5604-1979-e767c8a6f6d9=13977

> FlinkKinesisITCase.testStopWithSavepoint fails
> --
>
> Key: FLINK-22613
> URL: https://issues.apache.org/jira/browse/FLINK-22613
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / Kinesis
>Affects Versions: 1.13.0, 1.14.0, 1.12.3
>Reporter: Guowei Ma
>Priority: Blocker
>  Labels: test-stability
>
> {code:java}
> 2021-05-10T03:09:18.4601182Z May 10 03:09:18 [ERROR] 
> testStopWithSavepoint(org.apache.flink.streaming.connectors.kinesis.FlinkKinesisITCase)
>   Time elapsed: 3.526 s  <<< FAILURE!
> 2021-05-10T03:09:18.4601884Z May 10 03:09:18 java.lang.AssertionError: 
> 2021-05-10T03:09:18.4605902Z May 10 03:09:18 
> 2021-05-10T03:09:18.4616154Z May 10 03:09:18 Expected: a collection with size 
> a value less than <10>
> 2021-05-10T03:09:18.4616818Z May 10 03:09:18  but: collection size <10> 
> was equal to <10>
> 2021-05-10T03:09:18.4618087Z May 10 03:09:18  at 
> org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
> 2021-05-10T03:09:18.4618702Z May 10 03:09:18  at 
> org.junit.Assert.assertThat(Assert.java:956)
> 2021-05-10T03:09:18.4619467Z May 10 03:09:18  at 
> org.junit.Assert.assertThat(Assert.java:923)
> 2021-05-10T03:09:18.4620391Z May 10 03:09:18  at 
> org.apache.flink.streaming.connectors.kinesis.FlinkKinesisITCase.testStopWithSavepoint(FlinkKinesisITCase.java:126)
> 2021-05-10T03:09:18.4621115Z May 10 03:09:18  at 
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 2021-05-10T03:09:18.4621751Z May 10 03:09:18  at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 2021-05-10T03:09:18.4622475Z May 10 03:09:18  at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 2021-05-10T03:09:18.4623142Z May 10 03:09:18  at 
> java.lang.reflect.Method.invoke(Method.java:498)
> 2021-05-10T03:09:18.4623783Z May 10 03:09:18  at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> 2021-05-10T03:09:18.4624514Z May 10 03:09:18  at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 2021-05-10T03:09:18.4625246Z May 10 03:09:18  at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> 2021-05-10T03:09:18.4625967Z May 10 03:09:18  at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> 2021-05-10T03:09:18.4626671Z May 10 03:09:18  at 
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> 2021-05-10T03:09:18.4627349Z May 10 03:09:18  at 
> org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
> 2021-05-10T03:09:18.4627979Z May 10 03:09:18  at 
> org.junit.rules.RunRules.evaluate(RunRules.java:20)
> 2021-05-10T03:09:18.4628582Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> 2021-05-10T03:09:18.4629251Z May 10 03:09:18  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> 2021-05-10T03:09:18.4629950Z May 10 03:09:18  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> 2021-05-10T03:09:18.4630616Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> 2021-05-10T03:09:18.4631339Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> 2021-05-10T03:09:18.4631986Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> 2021-05-10T03:09:18.4632630Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> 2021-05-10T03:09:18.4633269Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> 2021-05-10T03:09:18.4634016Z May 10 03:09:18  at 
> org.testcontainers.containers.FailureDetectingExternalResource$1.evaluate(FailureDetectingExternalResource.java:30)
> 2021-05-10T03:09:18.4634786Z May 10 03:09:18  at 
> org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
> 

[jira] [Updated] (FLINK-22704) ZooKeeperHaServicesTest.testCleanupJobData failed

2021-05-18 Thread Guowei Ma (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-22704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Guowei Ma updated FLINK-22704:
--
Labels: test-stability  (was: )

> ZooKeeperHaServicesTest.testCleanupJobData failed
> -
>
> Key: FLINK-22704
> URL: https://issues.apache.org/jira/browse/FLINK-22704
> Project: Flink
>  Issue Type: Bug
>  Components: Runtime / Coordination
>Affects Versions: 1.13.0
>Reporter: Guowei Ma
>Priority: Major
>  Labels: test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18108=logs=77a9d8e1-d610-59b3-fc2a-4766541e0e33=7c61167f-30b3-5893-cc38-a9e3d057e392=8172
> {code:java}
> May 19 01:30:02 Expected: a collection containing 
> "1a2850d5759a2e1f4fef9cc7e6abc675"
> May 19 01:30:02  but: was "resource_manager_lock"
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-22704) ZooKeeperHaServicesTest.testCleanupJobData failed

2021-05-18 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-22704:
-

 Summary: ZooKeeperHaServicesTest.testCleanupJobData failed
 Key: FLINK-22704
 URL: https://issues.apache.org/jira/browse/FLINK-22704
 Project: Flink
  Issue Type: Bug
  Components: Runtime / Coordination
Affects Versions: 1.13.0
Reporter: Guowei Ma


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18108=logs=77a9d8e1-d610-59b3-fc2a-4766541e0e33=7c61167f-30b3-5893-cc38-a9e3d057e392=8172


{code:java}
May 19 01:30:02 Expected: a collection containing 
"1a2850d5759a2e1f4fef9cc7e6abc675"
May 19 01:30:02  but: was "resource_manager_lock"

{code}




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (FLINK-22692) CheckpointStoreITCase.testRestartOnRecoveryFailure fails with RuntimeException

2021-05-18 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-22692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347278#comment-17347278
 ] 

Guowei Ma commented on FLINK-22692:
---

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18106=logs=8fd9202e-fd17-5b26-353c-ac1ff76c8f28=a0a633b8-47ef-5c5a-2806-3c13b9e48228=4516


> CheckpointStoreITCase.testRestartOnRecoveryFailure fails with RuntimeException
> --
>
> Key: FLINK-22692
> URL: https://issues.apache.org/jira/browse/FLINK-22692
> Project: Flink
>  Issue Type: Bug
>  Components: Runtime / Checkpointing
>Reporter: Robert Metzger
>Priority: Critical
>  Labels: test-stability
>
> Not sure if it is related to the adaptive scheduler: 
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18052=logs=8fd9202e-fd17-5b26-353c-ac1ff76c8f28=a0a633b8-47ef-5c5a-2806-3c13b9e48228
> {code}
> May 17 22:29:11 [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, 
> Time elapsed: 1.351 s <<< FAILURE! - in 
> org.apache.flink.test.checkpointing.CheckpointStoreITCase
> May 17 22:29:11 [ERROR] 
> testRestartOnRecoveryFailure(org.apache.flink.test.checkpointing.CheckpointStoreITCase)
>   Time elapsed: 1.138 s  <<< ERROR!
> May 17 22:29:11 org.apache.flink.runtime.client.JobExecutionException: Job 
> execution failed.
> May 17 22:29:11   at 
> org.apache.flink.runtime.jobmaster.JobResult.toJobExecutionResult(JobResult.java:144)
> May 17 22:29:11   at 
> org.apache.flink.runtime.minicluster.MiniClusterJobClient.lambda$getJobExecutionResult$3(MiniClusterJobClient.java:137)
> May 17 22:29:11   at 
> java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:616)
> May 17 22:29:11   at 
> java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591)
> May 17 22:29:11   at 
> java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
> May 17 22:29:11   at 
> java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
> May 17 22:29:11   at 
> org.apache.flink.runtime.rpc.akka.AkkaInvocationHandler.lambda$invokeRpc$0(AkkaInvocationHandler.java:237)
> May 17 22:29:11   at 
> java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
> May 17 22:29:11   at 
> java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
> May 17 22:29:11   at 
> java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
> May 17 22:29:11   at 
> java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
> May 17 22:29:11   at 
> org.apache.flink.runtime.concurrent.FutureUtils$1.onComplete(FutureUtils.java:1081)
> May 17 22:29:11   at akka.dispatch.OnComplete.internal(Future.scala:264)
> May 17 22:29:11   at akka.dispatch.OnComplete.internal(Future.scala:261)
> May 17 22:29:11   at 
> akka.dispatch.japi$CallbackBridge.apply(Future.scala:191)
> May 17 22:29:11   at 
> akka.dispatch.japi$CallbackBridge.apply(Future.scala:188)
> May 17 22:29:11   at 
> scala.concurrent.impl.CallbackRunnable.run(Promise.scala:36)
> May 17 22:29:11   at 
> org.apache.flink.runtime.concurrent.Executors$DirectExecutionContext.execute(Executors.java:73)
> May 17 22:29:11   at 
> scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:44)
> May 17 22:29:11   at 
> scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:252)
> May 17 22:29:11   at 
> akka.pattern.PromiseActorRef.$bang(AskSupport.scala:572)
> May 17 22:29:11   at 
> akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:22)
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (FLINK-22703) SavepointITCase.testTriggerSavepointAndResumeWithFileBasedCheckpoints failed

2021-05-18 Thread Guowei Ma (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-22703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Guowei Ma updated FLINK-22703:
--
Component/s: Runtime / Checkpointing

> SavepointITCase.testTriggerSavepointAndResumeWithFileBasedCheckpoints failed
> 
>
> Key: FLINK-22703
> URL: https://issues.apache.org/jira/browse/FLINK-22703
> Project: Flink
>  Issue Type: Bug
>  Components: Runtime / Checkpointing, Runtime / Coordination
>Affects Versions: 1.14.0
>Reporter: Guowei Ma
>Priority: Major
>  Labels: test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18106=logs=4d4a0d10-fca2-5507-8eed-c07f0bdf4887=c2734c79-73b6-521c-e85a-67c7ecae9107=9765
> {code:java}
> May 19 00:51:42 Caused by: 
> org.apache.flink.runtime.checkpoint.CheckpointException: Checkpoint 
> triggering task Map (3/4) of job 1785ead58e598bc669c92d5a2cd14618 has not 
> being executed at the moment. Aborting checkpoint. Failure reason: Not all 
> required tasks are currently running.
> May 19 00:51:42   at 
> org.apache.flink.runtime.checkpoint.DefaultCheckpointPlanCalculator.checkTasksStarted(DefaultCheckpointPlanCalculator.java:152)
> May 19 00:51:42   at 
> org.apache.flink.runtime.checkpoint.DefaultCheckpointPlanCalculator.lambda$calculateCheckpointPlan$1(DefaultCheckpointPlanCalculator.java:114)
> May 19 00:51:42   at 
> java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
> May 19 00:51:42   at 
> org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRunAsync(AkkaRpcActor.java:440)
> May 19 00:51:42   at 
> org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:208)
> May 19 00:51:42   at 
> org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:77)
> May 19 00:51:42   at 
> org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:158)
> May 19 00:51:42   at 
> akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26)
> May 19 00:51:42   at 
> akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21)
> May 19 00:51:42   at 
> scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
> May 19 00:51:42   at 
> akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21)
> May 19 00:51:42   at 
> scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:170)
> May 19 00:51:42   at 
> scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
> May 19 00:51:42   at 
> scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
> May 19 00:51:42   at akka.actor.Actor$class.aroundReceive(Actor.scala:517)
> May 19 00:51:42   at 
> akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:225)
> May 19 00:51:42   at 
> akka.actor.ActorCell.receiveMessage(ActorCell.scala:592)
> May 19 00:51:42   at akka.actor.ActorCell.invoke(ActorCell.scala:561)
> May 19 00:51:42   at 
> akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258)
> May 19 00:51:42   at akka.dispatch.Mailbox.run(Mailbox.scala:225)
> May 19 00:51:42   at akka.dispatch.Mailbox.exec(Mailbox.scala:235)
> May 19 00:51:42   at 
> akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
> May 19 00:51:42   at 
> akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
> May 19 00:51:42   at 
> akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
> May 19 00:51:42   at 
> akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-22703) SavepointITCase.testTriggerSavepointAndResumeWithFileBasedCheckpoints failed

2021-05-18 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-22703:
-

 Summary: 
SavepointITCase.testTriggerSavepointAndResumeWithFileBasedCheckpoints failed
 Key: FLINK-22703
 URL: https://issues.apache.org/jira/browse/FLINK-22703
 Project: Flink
  Issue Type: Bug
  Components: Runtime / Coordination
Affects Versions: 1.14.0
Reporter: Guowei Ma


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18106=logs=4d4a0d10-fca2-5507-8eed-c07f0bdf4887=c2734c79-73b6-521c-e85a-67c7ecae9107=9765


{code:java}

May 19 00:51:42 Caused by: 
org.apache.flink.runtime.checkpoint.CheckpointException: Checkpoint triggering 
task Map (3/4) of job 1785ead58e598bc669c92d5a2cd14618 has not being executed 
at the moment. Aborting checkpoint. Failure reason: Not all required tasks are 
currently running.
May 19 00:51:42 at 
org.apache.flink.runtime.checkpoint.DefaultCheckpointPlanCalculator.checkTasksStarted(DefaultCheckpointPlanCalculator.java:152)
May 19 00:51:42 at 
org.apache.flink.runtime.checkpoint.DefaultCheckpointPlanCalculator.lambda$calculateCheckpointPlan$1(DefaultCheckpointPlanCalculator.java:114)
May 19 00:51:42 at 
java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
May 19 00:51:42 at 
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRunAsync(AkkaRpcActor.java:440)
May 19 00:51:42 at 
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:208)
May 19 00:51:42 at 
org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:77)
May 19 00:51:42 at 
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:158)
May 19 00:51:42 at 
akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26)
May 19 00:51:42 at 
akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21)
May 19 00:51:42 at 
scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
May 19 00:51:42 at 
akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21)
May 19 00:51:42 at 
scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:170)
May 19 00:51:42 at 
scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
May 19 00:51:42 at 
scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
May 19 00:51:42 at akka.actor.Actor$class.aroundReceive(Actor.scala:517)
May 19 00:51:42 at 
akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:225)
May 19 00:51:42 at 
akka.actor.ActorCell.receiveMessage(ActorCell.scala:592)
May 19 00:51:42 at akka.actor.ActorCell.invoke(ActorCell.scala:561)
May 19 00:51:42 at 
akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258)
May 19 00:51:42 at akka.dispatch.Mailbox.run(Mailbox.scala:225)
May 19 00:51:42 at akka.dispatch.Mailbox.exec(Mailbox.scala:235)
May 19 00:51:42 at 
akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
May 19 00:51:42 at 
akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
May 19 00:51:42 at 
akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
May 19 00:51:42 at 
akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)

{code}




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (FLINK-22702) KafkaSourceITCase.testRedundantParallelism failed

2021-05-18 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-22702:
-

 Summary: KafkaSourceITCase.testRedundantParallelism failed
 Key: FLINK-22702
 URL: https://issues.apache.org/jira/browse/FLINK-22702
 Project: Flink
  Issue Type: Bug
  Components: Connectors / Kafka
Affects Versions: 1.12.3
Reporter: Guowei Ma


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18107=logs=1fc6e7bf-633c-5081-c32a-9dea24b05730=80a658d1-f7f6-5d93-2758-53ac19fd5b19=6847

{code:java}
Caused by: java.lang.RuntimeException: One or more fetchers have encountered 
exception
at 
org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:199)
at 
org.apache.flink.connector.base.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:154)
at 
org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:116)
at 
org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:275)
at 
org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:67)
at 
org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
at 
org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:398)
at 
org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:191)
at 
org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:619)
at 
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:583)
at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:758)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:573)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: SplitFetcher thread 0 received 
unexpected exception while polling the records
at 
org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:146)
at 
org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:101)
at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
... 1 more
Caused by: java.lang.IllegalStateException: Consumer is not subscribed to any 
topics or assigned any partitions
at 
org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1223)
at 
org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1211)
at 
org.apache.flink.connector.kafka.source.reader.KafkaPartitionSplitReader.fetch(KafkaPartitionSplitReader.java:97)
at 
org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:56)
at 
org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:138)
... 6 more

{code}




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (FLINK-22613) FlinkKinesisITCase.testStopWithSavepoint fails

2021-05-18 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-22613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347276#comment-17347276
 ] 

Guowei Ma commented on FLINK-22613:
---

just for reporting
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18107=logs=e1276d0f-df12-55ec-86b5-c0ad597d83c9=906e9244-f3be-5604-1979-e767c8a6f6d9=13977

> FlinkKinesisITCase.testStopWithSavepoint fails
> --
>
> Key: FLINK-22613
> URL: https://issues.apache.org/jira/browse/FLINK-22613
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / Kinesis
>Affects Versions: 1.13.0, 1.14.0, 1.12.3
>Reporter: Guowei Ma
>Priority: Blocker
>  Labels: test-stability
>
> {code:java}
> 2021-05-10T03:09:18.4601182Z May 10 03:09:18 [ERROR] 
> testStopWithSavepoint(org.apache.flink.streaming.connectors.kinesis.FlinkKinesisITCase)
>   Time elapsed: 3.526 s  <<< FAILURE!
> 2021-05-10T03:09:18.4601884Z May 10 03:09:18 java.lang.AssertionError: 
> 2021-05-10T03:09:18.4605902Z May 10 03:09:18 
> 2021-05-10T03:09:18.4616154Z May 10 03:09:18 Expected: a collection with size 
> a value less than <10>
> 2021-05-10T03:09:18.4616818Z May 10 03:09:18  but: collection size <10> 
> was equal to <10>
> 2021-05-10T03:09:18.4618087Z May 10 03:09:18  at 
> org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
> 2021-05-10T03:09:18.4618702Z May 10 03:09:18  at 
> org.junit.Assert.assertThat(Assert.java:956)
> 2021-05-10T03:09:18.4619467Z May 10 03:09:18  at 
> org.junit.Assert.assertThat(Assert.java:923)
> 2021-05-10T03:09:18.4620391Z May 10 03:09:18  at 
> org.apache.flink.streaming.connectors.kinesis.FlinkKinesisITCase.testStopWithSavepoint(FlinkKinesisITCase.java:126)
> 2021-05-10T03:09:18.4621115Z May 10 03:09:18  at 
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 2021-05-10T03:09:18.4621751Z May 10 03:09:18  at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 2021-05-10T03:09:18.4622475Z May 10 03:09:18  at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 2021-05-10T03:09:18.4623142Z May 10 03:09:18  at 
> java.lang.reflect.Method.invoke(Method.java:498)
> 2021-05-10T03:09:18.4623783Z May 10 03:09:18  at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> 2021-05-10T03:09:18.4624514Z May 10 03:09:18  at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 2021-05-10T03:09:18.4625246Z May 10 03:09:18  at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> 2021-05-10T03:09:18.4625967Z May 10 03:09:18  at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> 2021-05-10T03:09:18.4626671Z May 10 03:09:18  at 
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> 2021-05-10T03:09:18.4627349Z May 10 03:09:18  at 
> org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
> 2021-05-10T03:09:18.4627979Z May 10 03:09:18  at 
> org.junit.rules.RunRules.evaluate(RunRules.java:20)
> 2021-05-10T03:09:18.4628582Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> 2021-05-10T03:09:18.4629251Z May 10 03:09:18  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> 2021-05-10T03:09:18.4629950Z May 10 03:09:18  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> 2021-05-10T03:09:18.4630616Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> 2021-05-10T03:09:18.4631339Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> 2021-05-10T03:09:18.4631986Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> 2021-05-10T03:09:18.4632630Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> 2021-05-10T03:09:18.4633269Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> 2021-05-10T03:09:18.4634016Z May 10 03:09:18  at 
> org.testcontainers.containers.FailureDetectingExternalResource$1.evaluate(FailureDetectingExternalResource.java:30)
> 2021-05-10T03:09:18.4634786Z May 10 03:09:18  at 
> org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
> 2021-05-10T03:09:18.4635412Z May 10 03:09:18  at 
> org.junit.rules.RunRules.evaluate(RunRules.java:20)
> 2021-05-10T03:09:18.4635995Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.run(ParentRunner.java:363)
> 2021-05-10T03:09:18.4636656Z May 10 03:09:18  at 
> org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
> 2021-05-10T03:09:18.4637398Z May 10 03:09:18  at 
> 

[jira] [Commented] (FLINK-21329) "Local recovery and sticky scheduling end-to-end test" does not finish within 600 seconds

2021-05-18 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-21329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347274#comment-17347274
 ] 

Guowei Ma commented on FLINK-21329:
---

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=18107=logs=08866332-78f7-59e4-4f7e-49a56faa3179=7f606211-1454-543c-70ab-c7a028a1ce8c=37432
Maybe we could merge the fix to the 1.12?

> "Local recovery and sticky scheduling end-to-end test" does not finish within 
> 600 seconds
> -
>
> Key: FLINK-21329
> URL: https://issues.apache.org/jira/browse/FLINK-21329
> Project: Flink
>  Issue Type: Bug
>  Components: Runtime / Checkpointing, Runtime / Coordination
>Affects Versions: 1.13.0
>Reporter: Robert Metzger
>Assignee: Roman Khachatryan
>Priority: Critical
>  Labels: pull-request-available, test-stability
> Fix For: 1.13.0
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=13118=logs=c88eea3b-64a0-564d-0031-9fdcd7b8abee=ff888d9b-cd34-53cc-d90f-3e446d355529=38515
> {code}
> Feb 08 22:25:46 
> ==
> Feb 08 22:25:46 Running 'Local recovery and sticky scheduling end-to-end test'
> Feb 08 22:25:46 
> ==
> Feb 08 22:25:46 TEST_DATA_DIR: 
> /home/vsts/work/1/s/flink-end-to-end-tests/test-scripts/temp-test-directory-46881214821
> Feb 08 22:25:47 Flink dist directory: 
> /home/vsts/work/1/s/flink-dist/target/flink-1.13-SNAPSHOT-bin/flink-1.13-SNAPSHOT
> Feb 08 22:25:47 Running local recovery test with configuration:
> Feb 08 22:25:47 parallelism: 4
> Feb 08 22:25:47 max attempts: 10
> Feb 08 22:25:47 backend: rocks
> Feb 08 22:25:47 incremental checkpoints: false
> Feb 08 22:25:47 kill JVM: false
> Feb 08 22:25:47 Starting zookeeper daemon on host fv-az127-394.
> Feb 08 22:25:47 Starting HA cluster with 1 masters.
> Feb 08 22:25:48 Starting standalonesession daemon on host fv-az127-394.
> Feb 08 22:25:49 Starting taskexecutor daemon on host fv-az127-394.
> Feb 08 22:25:49 Waiting for Dispatcher REST endpoint to come up...
> Feb 08 22:25:50 Waiting for Dispatcher REST endpoint to come up...
> Feb 08 22:25:51 Waiting for Dispatcher REST endpoint to come up...
> Feb 08 22:25:53 Waiting for Dispatcher REST endpoint to come up...
> Feb 08 22:25:54 Dispatcher REST endpoint is up.
> Feb 08 22:25:54 Started TM watchdog with PID 28961.
> Feb 08 22:25:58 Job has been submitted with JobID 
> e790e85a39040539f9386c0df7ca4812
> Feb 08 22:35:47 Test (pid: 27970) did not finish after 600 seconds.
> Feb 08 22:35:47 Printing Flink logs and killing it:
> {code}
> and
> {code}
>   at 
> org.apache.flink.runtime.leaderretrieval.ZooKeeperLeaderRetrievalDriver.unhandledError(ZooKeeperLeaderRetrievalDriver.java:184)
>   at 
> org.apache.flink.shaded.curator4.org.apache.curator.framework.imps.CuratorFrameworkImpl$6.apply(CuratorFrameworkImpl.java:713)
>   at 
> org.apache.flink.shaded.curator4.org.apache.curator.framework.imps.CuratorFrameworkImpl$6.apply(CuratorFrameworkImpl.java:709)
>   at 
> org.apache.flink.shaded.curator4.org.apache.curator.framework.listen.ListenerContainer$1.run(ListenerContainer.java:100)
>   at 
> org.apache.flink.shaded.curator4.org.apache.curator.shaded.com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
>   at 
> org.apache.flink.shaded.curator4.org.apache.curator.framework.listen.ListenerContainer.forEach(ListenerContainer.java:92)
>   at 
> org.apache.flink.shaded.curator4.org.apache.curator.framework.imps.CuratorFrameworkImpl.logError(CuratorFrameworkImpl.java:708)
>   at 
> org.apache.flink.shaded.curator4.org.apache.curator.framework.imps.CuratorFrameworkImpl.checkBackgroundRetry(CuratorFrameworkImpl.java:874)
>   at 
> org.apache.flink.shaded.curator4.org.apache.curator.framework.imps.CuratorFrameworkImpl.performBackgroundOperation(CuratorFrameworkImpl.java:990)
>   at 
> org.apache.flink.shaded.curator4.org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:943)
>   at 
> org.apache.flink.shaded.curator4.org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:66)
>   at 
> org.apache.flink.shaded.curator4.org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:346)
>   at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>   at 
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
>   at 
> 

[jira] [Commented] (FLINK-20495) Elasticsearch6DynamicSinkITCase Hang

2021-05-13 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-20495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344321#comment-17344321
 ] 

Guowei Ma commented on FLINK-20495:
---

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=17942=logs=d44f43ce-542c-597d-bf94-b0718c71e5e8=03dca39c-73e8-5aaf-601d-328ae5c35f20=11746

> Elasticsearch6DynamicSinkITCase Hang
> 
>
> Key: FLINK-20495
> URL: https://issues.apache.org/jira/browse/FLINK-20495
> Project: Flink
>  Issue Type: Bug
>  Components: Build System / Azure Pipelines, Connectors / 
> ElasticSearch, Tests
>Affects Versions: 1.13.0
>Reporter: Huang Xingbo
>Priority: Major
>  Labels: test-stability
>
> [https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=10535=logs=d44f43ce-542c-597d-bf94-b0718c71e5e8=03dca39c-73e8-5aaf-601d-328ae5c35f20]
>  
> {code:java}
> 2020-12-04T22:39:33.9748225Z [INFO] Running 
> org.apache.flink.streaming.connectors.elasticsearch.table.Elasticsearch6DynamicSinkITCase
> 2020-12-04T22:54:51.9486410Z 
> ==
> 2020-12-04T22:54:51.9488766Z Process produced no output for 900 seconds.
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (FLINK-20420) ES6 ElasticsearchSinkITCase failed due to no output for 900 seconds

2021-05-13 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-20420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344306#comment-17344306
 ] 

Guowei Ma commented on FLINK-20420:
---

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=17959=logs=e9af9cde-9a65-5281-a58e-2c8511d36983=b6c4efed-9c7d-55ea-03a9-9bd7d5b08e4c=12086

> ES6 ElasticsearchSinkITCase failed due to no output for 900 seconds
> ---
>
> Key: FLINK-20420
> URL: https://issues.apache.org/jira/browse/FLINK-20420
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / ElasticSearch
>Affects Versions: 1.12.0, 1.13.0
>Reporter: Yun Tang
>Priority: Major
>  Labels: test-stability
>
> Instance:
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=10249=logs=d44f43ce-542c-597d-bf94-b0718c71e5e8=03dca39c-73e8-5aaf-601d-328ae5c35f20=18821
> {code:java}
> Process produced no output for 900 seconds.
> ==
> ==
> The following Java processes are running (JPS)
> ==
> Picked up JAVA_TOOL_OPTIONS: -XX:+HeapDumpOnOutOfMemoryError
> 2274 Launcher
> 18260 Jps
> 15916 surefirebooter3434370240444055571.jar
> ==
> "main" #1 prio=5 os_prio=0 tid=0x7feec000b800 nid=0x3e2d runnable 
> [0x7feec8541000]
>java.lang.Thread.State: RUNNABLE
>   at org.testcontainers.shaded.okio.Buffer.indexOf(Buffer.java:1463)
>   at 
> org.testcontainers.shaded.okio.RealBufferedSource.indexOf(RealBufferedSource.java:352)
>   at 
> org.testcontainers.shaded.okio.RealBufferedSource.readUtf8LineStrict(RealBufferedSource.java:230)
>   at 
> org.testcontainers.shaded.okio.RealBufferedSource.readUtf8LineStrict(RealBufferedSource.java:224)
>   at 
> org.testcontainers.shaded.okhttp3.internal.http1.Http1ExchangeCodec$ChunkedSource.readChunkSize(Http1ExchangeCodec.java:489)
>   at 
> org.testcontainers.shaded.okhttp3.internal.http1.Http1ExchangeCodec$ChunkedSource.read(Http1ExchangeCodec.java:471)
>   at 
> org.testcontainers.shaded.okhttp3.internal.Util.skipAll(Util.java:204)
>   at 
> org.testcontainers.shaded.okhttp3.internal.Util.discard(Util.java:186)
>   at 
> org.testcontainers.shaded.okhttp3.internal.http1.Http1ExchangeCodec$ChunkedSource.close(Http1ExchangeCodec.java:511)
>   at 
> org.testcontainers.shaded.okio.ForwardingSource.close(ForwardingSource.java:43)
>   at 
> org.testcontainers.shaded.okhttp3.internal.connection.Exchange$ResponseBodySource.close(Exchange.java:313)
>   at 
> org.testcontainers.shaded.okio.RealBufferedSource.close(RealBufferedSource.java:476)
>   at 
> org.testcontainers.shaded.okhttp3.internal.Util.closeQuietly(Util.java:139)
>   at 
> org.testcontainers.shaded.okhttp3.ResponseBody.close(ResponseBody.java:192)
>   at org.testcontainers.shaded.okhttp3.Response.close(Response.java:290)
>   at 
> org.testcontainers.shaded.com.github.dockerjava.okhttp.OkDockerHttpClient$OkResponse.close(OkDockerHttpClient.java:280)
>   at 
> org.testcontainers.shaded.com.github.dockerjava.core.DefaultInvocationBuilder.lambda$null$0(DefaultInvocationBuilder.java:272)
>   at 
> org.testcontainers.shaded.com.github.dockerjava.core.DefaultInvocationBuilder$$Lambda$87/1112018050.close(Unknown
>  Source)
>   at 
> com.github.dockerjava.api.async.ResultCallbackTemplate.close(ResultCallbackTemplate.java:77)
>   at 
> org.testcontainers.utility.ResourceReaper.start(ResourceReaper.java:177)
>   at 
> org.testcontainers.DockerClientFactory.client(DockerClientFactory.java:203)
>   - locked <0x88fcbbf0> (a [Ljava.lang.Object;)
>   at 
> org.testcontainers.LazyDockerClient.getDockerClient(LazyDockerClient.java:14)
>   at 
> org.testcontainers.LazyDockerClient.listImagesCmd(LazyDockerClient.java:12)
>   at 
> org.testcontainers.images.LocalImagesCache.maybeInitCache(LocalImagesCache.java:68)
>   - locked <0x88fcb940> (a 
> org.testcontainers.images.LocalImagesCache)
>   at 
> org.testcontainers.images.LocalImagesCache.get(LocalImagesCache.java:32)
>   at 
> org.testcontainers.images.AbstractImagePullPolicy.shouldPull(AbstractImagePullPolicy.java:18)
>   at 
> org.testcontainers.images.RemoteDockerImage.resolve(RemoteDockerImage.java:66)
>   at 
> org.testcontainers.images.RemoteDockerImage.resolve(RemoteDockerImage.java:27)
>   at 
> org.testcontainers.utility.LazyFuture.getResolvedValue(LazyFuture.java:17)
>   - locked <0x890763d0> (a 
> 

[jira] [Created] (FLINK-22662) YARNHighAvailabilityITCase.testKillYarnSessionClusterEntrypoint fail

2021-05-13 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-22662:
-

 Summary: 
YARNHighAvailabilityITCase.testKillYarnSessionClusterEntrypoint fail
 Key: FLINK-22662
 URL: https://issues.apache.org/jira/browse/FLINK-22662
 Project: Flink
  Issue Type: Bug
  Components: Deployment / YARN
Affects Versions: 1.13.0
Reporter: Guowei Ma



{code:java}
2021-05-14T00:24:57.8487649Z May 14 00:24:57 [ERROR] 
testKillYarnSessionClusterEntrypoint(org.apache.flink.yarn.YARNHighAvailabilityITCase)
  Time elapsed: 34.667 s  <<< ERROR!
2021-05-14T00:24:57.8488567Z May 14 00:24:57 
java.util.concurrent.ExecutionException: 
2021-05-14T00:24:57.8489301Z May 14 00:24:57 
org.apache.flink.runtime.rest.util.RestClientException: 
[org.apache.flink.runtime.rest.handler.RestHandlerException: 
org.apache.flink.runtime.messages.FlinkJobNotFoundException: Could not find 
Flink job (610ed4b159ece04c8ee2ec40e7d0c143)
2021-05-14T00:24:57.8493142Z May 14 00:24:57at 
org.apache.flink.runtime.rest.handler.job.JobExecutionResultHandler.propagateException(JobExecutionResultHandler.java:94)
2021-05-14T00:24:57.8495823Z May 14 00:24:57at 
org.apache.flink.runtime.rest.handler.job.JobExecutionResultHandler.lambda$handleRequest$1(JobExecutionResultHandler.java:84)
2021-05-14T00:24:57.8496733Z May 14 00:24:57at 
java.util.concurrent.CompletableFuture.uniExceptionally(CompletableFuture.java:884)
2021-05-14T00:24:57.8497640Z May 14 00:24:57at 
java.util.concurrent.CompletableFuture$UniExceptionally.tryFire(CompletableFuture.java:866)
2021-05-14T00:24:57.8498491Z May 14 00:24:57at 
java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
2021-05-14T00:24:57.8499222Z May 14 00:24:57at 
java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990)
2021-05-14T00:24:57.853Z May 14 00:24:57at 
org.apache.flink.runtime.rpc.akka.AkkaInvocationHandler.lambda$invokeRpc$0(AkkaInvocationHandler.java:234)
2021-05-14T00:24:57.8500872Z May 14 00:24:57at 
java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
2021-05-14T00:24:57.8501702Z May 14 00:24:57at 
java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
2021-05-14T00:24:57.8502662Z May 14 00:24:57at 
java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
2021-05-14T00:24:57.8503472Z May 14 00:24:57at 
java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990)
2021-05-14T00:24:57.8504269Z May 14 00:24:57at 
org.apache.flink.runtime.concurrent.FutureUtils$1.onComplete(FutureUtils.java:1079)
2021-05-14T00:24:57.8504892Z May 14 00:24:57at 
akka.dispatch.OnComplete.internal(Future.scala:263)
2021-05-14T00:24:57.8505565Z May 14 00:24:57at 
akka.dispatch.OnComplete.internal(Future.scala:261)
2021-05-14T00:24:57.8506062Z May 14 00:24:57at 
akka.dispatch.japi$CallbackBridge.apply(Future.scala:191)
2021-05-14T00:24:57.8506819Z May 14 00:24:57at 
akka.dispatch.japi$CallbackBridge.apply(Future.scala:188)
2021-05-14T00:24:57.8507418Z May 14 00:24:57at 
scala.concurrent.impl.CallbackRunnable.run(Promise.scala:36)
2021-05-14T00:24:57.8508373Z May 14 00:24:57at 
org.apache.flink.runtime.concurrent.Executors$DirectExecutionContext.execute(Executors.java:73)
2021-05-14T00:24:57.8509144Z May 14 00:24:57at 
scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:44)
2021-05-14T00:24:57.8509972Z May 14 00:24:57at 
scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:252)
2021-05-14T00:24:57.8510675Z May 14 00:24:57at 
akka.pattern.PromiseActorRef.$bang(AskSupport.scala:572)
2021-05-14T00:24:57.8511376Z May 14 00:24:57at 
akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:23)
2021-05-14T00:24:57.851Z May 14 00:24:57at 
akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:21)
2021-05-14T00:24:57.8513090Z May 14 00:24:57at 
scala.concurrent.Future$$anonfun$andThen$1.apply(Future.scala:436)
2021-05-14T00:24:57.8513835Z May 14 00:24:57at 
scala.concurrent.Future$$anonfun$andThen$1.apply(Future.scala:435)
2021-05-14T00:24:57.8514576Z May 14 00:24:57at 
scala.concurrent.impl.CallbackRunnable.run(Promise.scala:36)
2021-05-14T00:24:57.8515344Z May 14 00:24:57at 
akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:55)
2021-05-14T00:24:57.8516317Z May 14 00:24:57at 
akka.dispatch.BatchingExecutor$BlockableBatch$$anonfun$run$1.apply$mcV$sp(BatchingExecutor.scala:91)
2021-05-14T00:24:57.8517537Z May 14 00:24:57at 
akka.dispatch.BatchingExecutor$BlockableBatch$$anonfun$run$1.apply(BatchingExecutor.scala:91)
2021-05-14T00:24:57.8518525Z May 14 00:24:57at 

[jira] [Commented] (FLINK-22195) YARNHighAvailabilityITCase.testClusterClientRetrieval because of TestTimedOutException

2021-05-13 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-22195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344305#comment-17344305
 ] 

Guowei Ma commented on FLINK-22195:
---

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=17959=logs=245e1f2e-ba5b-5570-d689-25ae21e5302f=e7f339b2-a7c3-57d9-00af-3712d4b15354=29666

> YARNHighAvailabilityITCase.testClusterClientRetrieval because of 
> TestTimedOutException
> --
>
> Key: FLINK-22195
> URL: https://issues.apache.org/jira/browse/FLINK-22195
> Project: Flink
>  Issue Type: Bug
>  Components: Deployment / YARN, Runtime / Coordination
>Affects Versions: 1.13.0
>Reporter: Guowei Ma
>Priority: Major
>  Labels: test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=16308=logs=8fd975ef-f478-511d-4997-6f15fe8a1fd3=ac0fa443-5d45-5a6b-3597-0310ecc1d2ab=31562
> {code:java}
> org.junit.runners.model.TestTimedOutException: test timed out after 180 
> milliseconds
>   at java.lang.Thread.sleep(Native Method)
>   at 
> org.apache.flink.yarn.YarnClusterDescriptor.startAppMaster(YarnClusterDescriptor.java:1223)
>   at 
> org.apache.flink.yarn.YarnClusterDescriptor.deployInternal(YarnClusterDescriptor.java:593)
>   at 
> org.apache.flink.yarn.YarnClusterDescriptor.deploySessionCluster(YarnClusterDescriptor.java:418)
>   at 
> org.apache.flink.yarn.YARNHighAvailabilityITCase.deploySessionCluster(YARNHighAvailabilityITCase.java:356)
>   at 
> org.apache.flink.yarn.YARNHighAvailabilityITCase.lambda$testClusterClientRetrieval$2(YARNHighAvailabilityITCase.java:224)
>   at 
> org.apache.flink.yarn.YARNHighAvailabilityITCase$$Lambda$250/401276136.run(Unknown
>  Source)
>   at org.apache.flink.yarn.YarnTestBase.runTest(YarnTestBase.java:287)
>   at 
> org.apache.flink.yarn.YARNHighAvailabilityITCase.testClusterClientRetrieval(YARNHighAvailabilityITCase.java:219)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:498)
>   at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
>   at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
>   at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
>   at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
>   at 
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
>   at 
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
>   at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>   at java.lang.Thread.run(Thread.java:748)
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (FLINK-17274) Maven: Premature end of Content-Length delimited message body

2021-05-13 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-17274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344303#comment-17344303
 ] 

Guowei Ma commented on FLINK-17274:
---

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=17959=logs=3e60b793-4158-5027-ac6d-4cdc51dffe1e=d5ed4970-7667-5f7e-2ece-62e410f74748=10513

> Maven: Premature end of Content-Length delimited message body
> -
>
> Key: FLINK-17274
> URL: https://issues.apache.org/jira/browse/FLINK-17274
> Project: Flink
>  Issue Type: Bug
>  Components: Build System / Azure Pipelines
>Reporter: Robert Metzger
>Priority: Critical
>  Labels: test-stability
>
> CI: 
> https://dev.azure.com/rmetzger/Flink/_build/results?buildId=7786=logs=52b61abe-a3cc-5bde-cc35-1bbe89bb7df5=54421a62-0c80-5aad-3319-094ff69180bb
> {code}
> [ERROR] Failed to execute goal on project 
> flink-connector-elasticsearch7_2.11: Could not resolve dependencies for 
> project 
> org.apache.flink:flink-connector-elasticsearch7_2.11:jar:1.11-SNAPSHOT: Could 
> not transfer artifact org.apache.lucene:lucene-sandbox:jar:8.3.0 from/to 
> alicloud-mvn-mirror 
> (http://mavenmirror.alicloud.dak8s.net:/repository/maven-central/): GET 
> request of: org/apache/lucene/lucene-sandbox/8.3.0/lucene-sandbox-8.3.0.jar 
> from alicloud-mvn-mirror failed: Premature end of Content-Length delimited 
> message body (expected: 289920; received: 239832 -> [Help 1]
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (FLINK-22613) FlinkKinesisITCase.testStopWithSavepoint fails

2021-05-13 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-22613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344280#comment-17344280
 ] 

Guowei Ma commented on FLINK-22613:
---

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=17958=logs=e1276d0f-df12-55ec-86b5-c0ad597d83c9=906e9244-f3be-5604-1979-e767c8a6f6d9=13977

> FlinkKinesisITCase.testStopWithSavepoint fails
> --
>
> Key: FLINK-22613
> URL: https://issues.apache.org/jira/browse/FLINK-22613
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / Kinesis
>Affects Versions: 1.13.0, 1.14.0, 1.12.3
>Reporter: Guowei Ma
>Priority: Critical
>  Labels: test-stability
>
> {code:java}
> 2021-05-10T03:09:18.4601182Z May 10 03:09:18 [ERROR] 
> testStopWithSavepoint(org.apache.flink.streaming.connectors.kinesis.FlinkKinesisITCase)
>   Time elapsed: 3.526 s  <<< FAILURE!
> 2021-05-10T03:09:18.4601884Z May 10 03:09:18 java.lang.AssertionError: 
> 2021-05-10T03:09:18.4605902Z May 10 03:09:18 
> 2021-05-10T03:09:18.4616154Z May 10 03:09:18 Expected: a collection with size 
> a value less than <10>
> 2021-05-10T03:09:18.4616818Z May 10 03:09:18  but: collection size <10> 
> was equal to <10>
> 2021-05-10T03:09:18.4618087Z May 10 03:09:18  at 
> org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
> 2021-05-10T03:09:18.4618702Z May 10 03:09:18  at 
> org.junit.Assert.assertThat(Assert.java:956)
> 2021-05-10T03:09:18.4619467Z May 10 03:09:18  at 
> org.junit.Assert.assertThat(Assert.java:923)
> 2021-05-10T03:09:18.4620391Z May 10 03:09:18  at 
> org.apache.flink.streaming.connectors.kinesis.FlinkKinesisITCase.testStopWithSavepoint(FlinkKinesisITCase.java:126)
> 2021-05-10T03:09:18.4621115Z May 10 03:09:18  at 
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 2021-05-10T03:09:18.4621751Z May 10 03:09:18  at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 2021-05-10T03:09:18.4622475Z May 10 03:09:18  at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 2021-05-10T03:09:18.4623142Z May 10 03:09:18  at 
> java.lang.reflect.Method.invoke(Method.java:498)
> 2021-05-10T03:09:18.4623783Z May 10 03:09:18  at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> 2021-05-10T03:09:18.4624514Z May 10 03:09:18  at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 2021-05-10T03:09:18.4625246Z May 10 03:09:18  at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> 2021-05-10T03:09:18.4625967Z May 10 03:09:18  at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> 2021-05-10T03:09:18.4626671Z May 10 03:09:18  at 
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> 2021-05-10T03:09:18.4627349Z May 10 03:09:18  at 
> org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
> 2021-05-10T03:09:18.4627979Z May 10 03:09:18  at 
> org.junit.rules.RunRules.evaluate(RunRules.java:20)
> 2021-05-10T03:09:18.4628582Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> 2021-05-10T03:09:18.4629251Z May 10 03:09:18  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> 2021-05-10T03:09:18.4629950Z May 10 03:09:18  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> 2021-05-10T03:09:18.4630616Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> 2021-05-10T03:09:18.4631339Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> 2021-05-10T03:09:18.4631986Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> 2021-05-10T03:09:18.4632630Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> 2021-05-10T03:09:18.4633269Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> 2021-05-10T03:09:18.4634016Z May 10 03:09:18  at 
> org.testcontainers.containers.FailureDetectingExternalResource$1.evaluate(FailureDetectingExternalResource.java:30)
> 2021-05-10T03:09:18.4634786Z May 10 03:09:18  at 
> org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
> 2021-05-10T03:09:18.4635412Z May 10 03:09:18  at 
> org.junit.rules.RunRules.evaluate(RunRules.java:20)
> 2021-05-10T03:09:18.4635995Z May 10 03:09:18  at 
> org.junit.runners.ParentRunner.run(ParentRunner.java:363)
> 2021-05-10T03:09:18.4636656Z May 10 03:09:18  at 
> org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
> 2021-05-10T03:09:18.4637398Z May 10 03:09:18  at 
> 

[jira] [Commented] (FLINK-22198) org.apache.flink.streaming.connectors.kafka.table.KafkaTableITCase hang.

2021-05-13 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-22198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344257#comment-17344257
 ] 

Guowei Ma commented on FLINK-22198:
---

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=17956=logs=4be4ed2b-549a-533d-aa33-09e28e360cc8=0db94045-2aa0-53fa-f444-0130d6933518=7903

> org.apache.flink.streaming.connectors.kafka.table.KafkaTableITCase hang.
> 
>
> Key: FLINK-22198
> URL: https://issues.apache.org/jira/browse/FLINK-22198
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / Kafka
>Affects Versions: 1.12.2
>Reporter: Guowei Ma
>Priority: Major
>  Labels: test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=16287=logs=c5f0071e-1851-543e-9a45-9ac140befc32=1fb1a56f-e8b5-5a82-00a0-a2db7757b4f5=6625
> There is no any artifacts.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Comment Edited] (FLINK-22593) SavepointITCase.testShouldAddEntropyToSavepointPath unstable

2021-05-13 Thread Guowei Ma (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-22593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344248#comment-17344248
 ] 

Guowei Ma edited comment on FLINK-22593 at 5/14/21, 2:35 AM:
-

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=17956=logs=5c8e7682-d68f-54d1-16a2-a09310218a49=f508e270-48d6-5f1e-3138-42a17e0714f0=4537


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=17956=logs=39d5b1d5-3b41-54dc-6458-1e2ddd1cdcf3=a99e99c7-21cd-5a1f-7274-585e62b72f56=4479


was (Author: maguowei):
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=17956=logs=5c8e7682-d68f-54d1-16a2-a09310218a49=f508e270-48d6-5f1e-3138-42a17e0714f0=4537

> SavepointITCase.testShouldAddEntropyToSavepointPath unstable
> 
>
> Key: FLINK-22593
> URL: https://issues.apache.org/jira/browse/FLINK-22593
> Project: Flink
>  Issue Type: Bug
>  Components: Runtime / Checkpointing
>Affects Versions: 1.14.0
>Reporter: Robert Metzger
>Priority: Critical
>  Labels: test-stability
>
> https://dev.azure.com/rmetzger/Flink/_build/results?buildId=9072=logs=cc649950-03e9-5fae-8326-2f1ad744b536=51cab6ca-669f-5dc0-221d-1e4f7dc4fc85
> {code}
> 2021-05-07T10:56:20.9429367Z May 07 10:56:20 [ERROR] Tests run: 13, Failures: 
> 0, Errors: 1, Skipped: 0, Time elapsed: 33.441 s <<< FAILURE! - in 
> org.apache.flink.test.checkpointing.SavepointITCase
> 2021-05-07T10:56:20.9445862Z May 07 10:56:20 [ERROR] 
> testShouldAddEntropyToSavepointPath(org.apache.flink.test.checkpointing.SavepointITCase)
>   Time elapsed: 2.083 s  <<< ERROR!
> 2021-05-07T10:56:20.9447106Z May 07 10:56:20 
> java.util.concurrent.ExecutionException: 
> java.util.concurrent.CompletionException: 
> org.apache.flink.runtime.checkpoint.CheckpointException: Checkpoint 
> triggering task Sink: Unnamed (3/4) of job 4e155a20f0a7895043661a6446caf1cb 
> has not being executed at the moment. Aborting checkpoint. Failure reason: 
> Not all required tasks are currently running.
> 2021-05-07T10:56:20.9448194Z May 07 10:56:20  at 
> java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
> 2021-05-07T10:56:20.9448797Z May 07 10:56:20  at 
> java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
> 2021-05-07T10:56:20.9449428Z May 07 10:56:20  at 
> org.apache.flink.test.checkpointing.SavepointITCase.submitJobAndTakeSavepoint(SavepointITCase.java:305)
> 2021-05-07T10:56:20.9450160Z May 07 10:56:20  at 
> org.apache.flink.test.checkpointing.SavepointITCase.testShouldAddEntropyToSavepointPath(SavepointITCase.java:273)
> 2021-05-07T10:56:20.9450785Z May 07 10:56:20  at 
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 2021-05-07T10:56:20.9451331Z May 07 10:56:20  at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 2021-05-07T10:56:20.9451940Z May 07 10:56:20  at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 2021-05-07T10:56:20.9452498Z May 07 10:56:20  at 
> java.lang.reflect.Method.invoke(Method.java:498)
> 2021-05-07T10:56:20.9453247Z May 07 10:56:20  at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> 2021-05-07T10:56:20.9454007Z May 07 10:56:20  at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 2021-05-07T10:56:20.9454687Z May 07 10:56:20  at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> 2021-05-07T10:56:20.9455302Z May 07 10:56:20  at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> 2021-05-07T10:56:20.9455909Z May 07 10:56:20  at 
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> 2021-05-07T10:56:20.9456493Z May 07 10:56:20  at 
> org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
> 2021-05-07T10:56:20.9457074Z May 07 10:56:20  at 
> org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
> 2021-05-07T10:56:20.9457636Z May 07 10:56:20  at 
> org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
> 2021-05-07T10:56:20.9458157Z May 07 10:56:20  at 
> org.junit.rules.RunRules.evaluate(RunRules.java:20)
> 2021-05-07T10:56:20.9458678Z May 07 10:56:20  at 
> org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> 2021-05-07T10:56:20.9459252Z May 07 10:56:20  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> 2021-05-07T10:56:20.9459865Z May 07 10:56:20  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> 2021-05-07T10:56:20.9460433Z May 07 10:56:20  at 
> org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> 2021-05-07T10:56:20.9461058Z May 

  1   2   3   4   5   6   7   8   9   10   >