[ 
https://issues.apache.org/jira/browse/FLINK-16795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17067457#comment-17067457
 ] 

Robert Metzger edited comment on FLINK-16795 at 3/26/20, 8:25 AM:
------------------------------------------------------------------

The time limit is something we can configure. The question is: why are we 
running into these timeouts.

I analyzed the durations of the tests. It seems that there's a lot of variance 
in their durations: 
https://docs.google.com/spreadsheets/d/1VpA3wsOY88ezY8qTUFl8iztPc58mRa-1pIncIBAbUL8/edit#gid=117660203

Python script to extract the execution times:
{code:python}
import sys
import re
pattern = re.compile("^.*'([^']+)'.* ([0-9]+) minutes.* ([0-9]+) seconds.*$")
with open(sys.argv[1]) as f:
        for line in f:
            if "Test exited with exit code" in line:
                result = pattern.match(line)
                test_name = result.group(1)
                seconds = int(result.group(2)) * 60 + int(result.group(3))
                print("{};{}".format(seconds,test_name))
{code}

160 minutes seems to be normal for the e2e tests. The build times can be 
between 20-30 minutes.
I will increase the limit by 20 minutes for now.


was (Author: rmetzger):
The time limit is something we can configure. The question is: why are we 
running into these timeouts.

I analyzed the durations of the tests. It seems that there's a lot of variance 
in their durations: 
https://docs.google.com/spreadsheets/d/1VpA3wsOY88ezY8qTUFl8iztPc58mRa-1pIncIBAbUL8/edit#gid=117660203

160 minutes seems to be normal for the e2e tests. The build times can be 
between 20-30 minutes.
I will increase the limit by 20 minutes for now.

> End to end tests timeout on Azure
> ---------------------------------
>
>                 Key: FLINK-16795
>                 URL: https://issues.apache.org/jira/browse/FLINK-16795
>             Project: Flink
>          Issue Type: Bug
>          Components: Build System / Azure Pipelines, Tests
>    Affects Versions: 1.11.0
>            Reporter: Robert Metzger
>            Assignee: Robert Metzger
>            Priority: Major
>
> Example: 
> https://dev.azure.com/rmetzger/Flink/_build/results?buildId=6650&view=logs&j=08866332-78f7-59e4-4f7e-49a56faa3179
>  or 
> https://dev.azure.com/rmetzger/Flink/_build/results?buildId=6637&view=logs&j=c88eea3b-64a0-564d-0031-9fdcd7b8abee&t=1e2bbe5b-4657-50be-1f07-d84bfce5b1f5
> {code}##[error]The job running on agent Azure Pipelines 6 ran longer than the 
> maximum time of 200 minutes. For more information, see 
> https://go.microsoft.com/fwlink/?linkid=2077134
> {code}
> and {code}##[error]The operation was canceled.{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to