[jira] [Commented] (FLINK-13748) Streaming File Sink s3 end-to-end test failed on Travis

2019-09-24 Thread Till Rohrmann (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-13748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936707#comment-16936707
 ] 

Till Rohrmann commented on FLINK-13748:
---

I guess that reverting the jaxb dependency addition and only excluding the 
failing test case did not cover all other Java 11 end-to-end test cases which 
fail now.

> Streaming File Sink s3 end-to-end test failed on Travis
> ---
>
> Key: FLINK-13748
> URL: https://issues.apache.org/jira/browse/FLINK-13748
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / FileSystem, Tests
>Affects Versions: 1.10.0
>Reporter: Till Rohrmann
>Assignee: Kostas Kloudas
>Priority: Blocker
>  Labels: pull-request-available, test-stability
> Fix For: 1.10.0
>
> Attachments: image-2019-09-11-01-29-25-634.png
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> The {{Streaming File Sink s3 end-to-end test}} failed on Travis because it 
> did not produce any output for 10 minutes.
> https://api.travis-ci.org/v3/job/572255913/log.txt



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (FLINK-13748) Streaming File Sink s3 end-to-end test failed on Travis

2019-09-24 Thread Yu Li (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-13748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936690#comment-16936690
 ] 

Yu Li commented on FLINK-13748:
---

There're some probably related issues, FYI: FLINK-14186, FLINK-14195, 
FLINK-14196

What's more, from the cron history, it seems all above issues occur from commit 
f65ee55 ([https://travis-ci.org/apache/flink/builds/586735914]) and the one 
before (fedf11c [https://travis-ci.org/apache/flink/builds/586250934]) only has 
the S3 file sync issue.

> Streaming File Sink s3 end-to-end test failed on Travis
> ---
>
> Key: FLINK-13748
> URL: https://issues.apache.org/jira/browse/FLINK-13748
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / FileSystem, Tests
>Affects Versions: 1.10.0
>Reporter: Till Rohrmann
>Assignee: Kostas Kloudas
>Priority: Blocker
>  Labels: pull-request-available, test-stability
> Fix For: 1.10.0
>
> Attachments: image-2019-09-11-01-29-25-634.png
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> The {{Streaming File Sink s3 end-to-end test}} failed on Travis because it 
> did not produce any output for 10 minutes.
> https://api.travis-ci.org/v3/job/572255913/log.txt



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (FLINK-13748) Streaming File Sink s3 end-to-end test failed on Travis

2019-09-23 Thread Till Rohrmann (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-13748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935748#comment-16935748
 ] 

Till Rohrmann commented on FLINK-13748:
---

[~Zentol] could you take a look at this problem? At the moment we have disabled 
this end-to-end test for Java 11 and removed the relocation of jaxb from the 
filesystem modules (FLINK-14157).

> Streaming File Sink s3 end-to-end test failed on Travis
> ---
>
> Key: FLINK-13748
> URL: https://issues.apache.org/jira/browse/FLINK-13748
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / FileSystem, Tests
>Affects Versions: 1.10.0
>Reporter: Till Rohrmann
>Assignee: Kostas Kloudas
>Priority: Blocker
>  Labels: pull-request-available, test-stability
> Fix For: 1.10.0
>
> Attachments: image-2019-09-11-01-29-25-634.png
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> The {{Streaming File Sink s3 end-to-end test}} failed on Travis because it 
> did not produce any output for 10 minutes.
> https://api.travis-ci.org/v3/job/572255913/log.txt



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (FLINK-13748) Streaming File Sink s3 end-to-end test failed on Travis

2019-09-14 Thread Kostas Kloudas (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-13748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929711#comment-16929711
 ] 

Kostas Kloudas commented on FLINK-13748:


Thanks [~till.rohrmann]. I will go with the first one then to see if it works. 
So far I was trying the second but I had tested it for Java 8 only.

> Streaming File Sink s3 end-to-end test failed on Travis
> ---
>
> Key: FLINK-13748
> URL: https://issues.apache.org/jira/browse/FLINK-13748
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / FileSystem, Tests
>Affects Versions: 1.10.0
>Reporter: Till Rohrmann
>Assignee: Kostas Kloudas
>Priority: Critical
>  Labels: test-stability
> Fix For: 1.10.0
>
> Attachments: image-2019-09-11-01-29-25-634.png
>
>
> The {{Streaming File Sink s3 end-to-end test}} failed on Travis because it 
> did not produce any output for 10 minutes.
> https://api.travis-ci.org/v3/job/572255913/log.txt



--
This message was sent by Atlassian Jira
(v8.3.2#803003)


[jira] [Commented] (FLINK-13748) Streaming File Sink s3 end-to-end test failed on Travis

2019-09-13 Thread Till Rohrmann (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-13748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929489#comment-16929489
 ] 

Till Rohrmann commented on FLINK-13748:
---

Thanks for the analysis [~kkl0u]. I think you are right that if we relocate, 
then we should always include the dependency in the created uber-jar otherwise 
the relocation pattern should be conditional (Java 11 vs. different Java 
versions). I think the former approach would be simplest.

I think you can enable the Java 11 profile by providing {{-Djdk11}} to maven. 
Alternatively you could also setup a cron job in your personal travis account 
under settings.

> Streaming File Sink s3 end-to-end test failed on Travis
> ---
>
> Key: FLINK-13748
> URL: https://issues.apache.org/jira/browse/FLINK-13748
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / FileSystem, Tests
>Affects Versions: 1.10.0
>Reporter: Till Rohrmann
>Assignee: Kostas Kloudas
>Priority: Critical
>  Labels: test-stability
> Fix For: 1.10.0
>
> Attachments: image-2019-09-11-01-29-25-634.png
>
>
> The {{Streaming File Sink s3 end-to-end test}} failed on Travis because it 
> did not produce any output for 10 minutes.
> https://api.travis-ci.org/v3/job/572255913/log.txt



--
This message was sent by Atlassian Jira
(v8.3.2#803003)


[jira] [Commented] (FLINK-13748) Streaming File Sink s3 end-to-end test failed on Travis

2019-09-13 Thread Kostas Kloudas (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-13748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929410#comment-16929410
 ] 

Kostas Kloudas commented on FLINK-13748:


[~carp84], Chesnay is on holidays currently. So I will try it locally and will 
merge the fix if it works.

> Streaming File Sink s3 end-to-end test failed on Travis
> ---
>
> Key: FLINK-13748
> URL: https://issues.apache.org/jira/browse/FLINK-13748
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / FileSystem, Tests
>Affects Versions: 1.10.0
>Reporter: Till Rohrmann
>Assignee: Kostas Kloudas
>Priority: Critical
>  Labels: test-stability
> Fix For: 1.10.0
>
> Attachments: image-2019-09-11-01-29-25-634.png
>
>
> The {{Streaming File Sink s3 end-to-end test}} failed on Travis because it 
> did not produce any output for 10 minutes.
> https://api.travis-ci.org/v3/job/572255913/log.txt



--
This message was sent by Atlassian Jira
(v8.3.2#803003)


[jira] [Commented] (FLINK-13748) Streaming File Sink s3 end-to-end test failed on Travis

2019-09-13 Thread Yu Li (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-13748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929375#comment-16929375
 ] 

Yu Li commented on FLINK-13748:
---

[~Zentol] could you help answer Klou's question about how to test against 
java-11? Thanks.

> Streaming File Sink s3 end-to-end test failed on Travis
> ---
>
> Key: FLINK-13748
> URL: https://issues.apache.org/jira/browse/FLINK-13748
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / FileSystem, Tests
>Affects Versions: 1.10.0
>Reporter: Till Rohrmann
>Assignee: Kostas Kloudas
>Priority: Critical
>  Labels: test-stability
> Fix For: 1.10.0
>
> Attachments: image-2019-09-11-01-29-25-634.png
>
>
> The {{Streaming File Sink s3 end-to-end test}} failed on Travis because it 
> did not produce any output for 10 minutes.
> https://api.travis-ci.org/v3/job/572255913/log.txt



--
This message was sent by Atlassian Jira
(v8.3.2#803003)


[jira] [Commented] (FLINK-13748) Streaming File Sink s3 end-to-end test failed on Travis

2019-09-13 Thread Yu Li (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-13748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929374#comment-16929374
 ] 

Yu Li commented on FLINK-13748:
---

One failure observed in the release-1.9 cron job: 
https://travis-ci.org/apache/flink/jobs/584110139

> Streaming File Sink s3 end-to-end test failed on Travis
> ---
>
> Key: FLINK-13748
> URL: https://issues.apache.org/jira/browse/FLINK-13748
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / FileSystem, Tests
>Affects Versions: 1.10.0
>Reporter: Till Rohrmann
>Assignee: Kostas Kloudas
>Priority: Critical
>  Labels: test-stability
> Fix For: 1.10.0
>
> Attachments: image-2019-09-11-01-29-25-634.png
>
>
> The {{Streaming File Sink s3 end-to-end test}} failed on Travis because it 
> did not produce any output for 10 minutes.
> https://api.travis-ci.org/v3/job/572255913/log.txt



--
This message was sent by Atlassian Jira
(v8.3.2#803003)


[jira] [Commented] (FLINK-13748) Streaming File Sink s3 end-to-end test failed on Travis

2019-09-13 Thread Kostas Kloudas (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-13748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929276#comment-16929276
 ] 

Kostas Kloudas commented on FLINK-13748:


The problem seems to be the relocation that  
https://issues.apache.org/jira/browse/FLINK-13893 introduced. 

A possible explanation seems to be that the relocation should be relevant for 
java 11 only and not for all the profiles. For previous java versions jaxb is 
part of java itself 
([https://stackoverflow.com/questions/43574426/how-to-resolve-java-lang-noclassdeffounderror-javax-xml-bind-jaxbexception-in-j]).
 In the current state and for java-8, it seems that Flink is looking for a 
relocated jaxb which maven has not relocated as it is not part of the 
dependencies, so it cannot find it.

I can open a PR that seems to work for java-8, but I am not sure how to test it 
for java-11 on Travis. Any ideas?

> Streaming File Sink s3 end-to-end test failed on Travis
> ---
>
> Key: FLINK-13748
> URL: https://issues.apache.org/jira/browse/FLINK-13748
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / FileSystem, Tests
>Affects Versions: 1.10.0
>Reporter: Till Rohrmann
>Assignee: Kostas Kloudas
>Priority: Critical
>  Labels: test-stability
> Fix For: 1.10.0
>
> Attachments: image-2019-09-11-01-29-25-634.png
>
>
> The {{Streaming File Sink s3 end-to-end test}} failed on Travis because it 
> did not produce any output for 10 minutes.
> https://api.travis-ci.org/v3/job/572255913/log.txt



--
This message was sent by Atlassian Jira
(v8.3.2#803003)


[jira] [Commented] (FLINK-13748) Streaming File Sink s3 end-to-end test failed on Travis

2019-09-13 Thread Kostas Kloudas (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-13748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929216#comment-16929216
 ] 

Kostas Kloudas commented on FLINK-13748:


If it does not get solved by the end of the day, I will disable the test 
without closing the issue here and keep on working on it.

> Streaming File Sink s3 end-to-end test failed on Travis
> ---
>
> Key: FLINK-13748
> URL: https://issues.apache.org/jira/browse/FLINK-13748
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / FileSystem, Tests
>Affects Versions: 1.10.0
>Reporter: Till Rohrmann
>Assignee: Kostas Kloudas
>Priority: Critical
>  Labels: test-stability
> Fix For: 1.10.0
>
> Attachments: image-2019-09-11-01-29-25-634.png
>
>
> The {{Streaming File Sink s3 end-to-end test}} failed on Travis because it 
> did not produce any output for 10 minutes.
> https://api.travis-ci.org/v3/job/572255913/log.txt



--
This message was sent by Atlassian Jira
(v8.3.2#803003)


[jira] [Commented] (FLINK-13748) Streaming File Sink s3 end-to-end test failed on Travis

2019-09-13 Thread Till Rohrmann (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-13748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929128#comment-16929128
 ] 

Till Rohrmann commented on FLINK-13748:
---

If the fix takes longer then it is an option to disable the test for the time 
being. If we decide to do that then the important bit is to follow up and to 
fix the instability in order to enable the test again. Can you do this? What I 
would like to avoid is me manually following up on this issue if you say that 
you will take care of it. Test instabilities affect every developer and should, 
hence, be swiftly addressed. That's also why they are marked as critical.

> Streaming File Sink s3 end-to-end test failed on Travis
> ---
>
> Key: FLINK-13748
> URL: https://issues.apache.org/jira/browse/FLINK-13748
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / FileSystem, Tests
>Affects Versions: 1.10.0
>Reporter: Till Rohrmann
>Assignee: Kostas Kloudas
>Priority: Critical
>  Labels: test-stability
> Fix For: 1.10.0
>
> Attachments: image-2019-09-11-01-29-25-634.png
>
>
> The {{Streaming File Sink s3 end-to-end test}} failed on Travis because it 
> did not produce any output for 10 minutes.
> https://api.travis-ci.org/v3/job/572255913/log.txt



--
This message was sent by Atlassian Jira
(v8.3.2#803003)


[jira] [Commented] (FLINK-13748) Streaming File Sink s3 end-to-end test failed on Travis

2019-09-13 Thread Kostas Kloudas (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-13748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929084#comment-16929084
 ] 

Kostas Kloudas commented on FLINK-13748:


[~till.rohrmann] not much progress. I was caught up in another thing. I will 
get back to it soon.

Till then, why not moving it to the end of the list of test to run for that 
profile so that at least the rest of the tests can run?

> Streaming File Sink s3 end-to-end test failed on Travis
> ---
>
> Key: FLINK-13748
> URL: https://issues.apache.org/jira/browse/FLINK-13748
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / FileSystem, Tests
>Affects Versions: 1.10.0
>Reporter: Till Rohrmann
>Assignee: Kostas Kloudas
>Priority: Critical
>  Labels: test-stability
> Fix For: 1.10.0
>
> Attachments: image-2019-09-11-01-29-25-634.png
>
>
> The {{Streaming File Sink s3 end-to-end test}} failed on Travis because it 
> did not produce any output for 10 minutes.
> https://api.travis-ci.org/v3/job/572255913/log.txt



--
This message was sent by Atlassian Jira
(v8.3.2#803003)


[jira] [Commented] (FLINK-13748) Streaming File Sink s3 end-to-end test failed on Travis

2019-09-13 Thread Till Rohrmann (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-13748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929029#comment-16929029
 ] 

Till Rohrmann commented on FLINK-13748:
---

Hi [~kkl0u], what is the progress on this issue? I think it would be good to be 
fixed because it constantly fails our cron jobs.

> Streaming File Sink s3 end-to-end test failed on Travis
> ---
>
> Key: FLINK-13748
> URL: https://issues.apache.org/jira/browse/FLINK-13748
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / FileSystem, Tests
>Affects Versions: 1.10.0
>Reporter: Till Rohrmann
>Assignee: Kostas Kloudas
>Priority: Critical
>  Labels: test-stability
> Fix For: 1.10.0
>
> Attachments: image-2019-09-11-01-29-25-634.png
>
>
> The {{Streaming File Sink s3 end-to-end test}} failed on Travis because it 
> did not produce any output for 10 minutes.
> https://api.travis-ci.org/v3/job/572255913/log.txt



--
This message was sent by Atlassian Jira
(v8.3.2#803003)


[jira] [Commented] (FLINK-13748) Streaming File Sink s3 end-to-end test failed on Travis

2019-09-11 Thread Kostas Kloudas (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-13748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927465#comment-16927465
 ] 

Kostas Kloudas commented on FLINK-13748:


This can also be reproduced locally and the cause seems to be:

{{java.lang.RuntimeException: Error while confirming checkpoint
at org.apache.flink.runtime.taskmanager.Task$2.run(Task.java:1205)
at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.NoClassDefFoundError: 
org/apache/flink/fs/s3hadoop/shaded/javax/xml/bind/JAXBException
at 
org.apache.flink.fs.s3base.shaded.com.amazonaws.util.BinaryUtils.toBase64(BinaryUtils.java:59)
at 
org.apache.flink.fs.s3base.shaded.com.amazonaws.services.s3.AmazonS3Client.deleteObjects(AmazonS3Client.java:2116)
at 
org.apache.flink.fs.shaded.hadoop3.org.apache.hadoop.fs.s3a.S3AFileSystem.lambda$deleteObjects$8(S3AFileSystem.java:1406)
at 
org.apache.flink.fs.shaded.hadoop3.org.apache.hadoop.fs.s3a.Invoker.retryUntranslated(Invoker.java:317)
at 
org.apache.flink.fs.shaded.hadoop3.org.apache.hadoop.fs.s3a.Invoker.retryUntranslated(Invoker.java:280)
at 
org.apache.flink.fs.shaded.hadoop3.org.apache.hadoop.fs.s3a.S3AFileSystem.deleteObjects(S3AFileSystem.java:1402)
at 
org.apache.flink.fs.shaded.hadoop3.org.apache.hadoop.fs.s3a.S3AFileSystem.removeKeys(S3AFileSystem.java:1662)
at 
org.apache.flink.fs.shaded.hadoop3.org.apache.hadoop.fs.s3a.S3AFileSystem.deleteUnnecessaryFakeDirectories(S3AFileSystem.java:2725)
at 
org.apache.flink.fs.shaded.hadoop3.org.apache.hadoop.fs.s3a.S3AFileSystem.finishedWrite(S3AFileSystem.java:2691)
at 
org.apache.flink.fs.shaded.hadoop3.org.apache.hadoop.fs.s3a.WriteOperationHelper.lambda$finalizeMultipartUpload$1(WriteOperationHelper.java:234)
at 
org.apache.flink.fs.shaded.hadoop3.org.apache.hadoop.fs.s3a.Invoker.once(Invoker.java:109)
at 
org.apache.flink.fs.shaded.hadoop3.org.apache.hadoop.fs.s3a.Invoker.lambda$retry$3(Invoker.java:260)
at 
org.apache.flink.fs.shaded.hadoop3.org.apache.hadoop.fs.s3a.Invoker.retryUntranslated(Invoker.java:317)
at 
org.apache.flink.fs.shaded.hadoop3.org.apache.hadoop.fs.s3a.Invoker.retry(Invoker.java:256)
at 
org.apache.flink.fs.shaded.hadoop3.org.apache.hadoop.fs.s3a.WriteOperationHelper.finalizeMultipartUpload(WriteOperationHelper.java:222)
at 
org.apache.flink.fs.shaded.hadoop3.org.apache.hadoop.fs.s3a.WriteOperationHelper.completeMPUwithRetries(WriteOperationHelper.java:267)
at 
org.apache.flink.fs.s3hadoop.HadoopS3AccessHelper.commitMultiPartUpload(HadoopS3AccessHelper.java:84)
at 
org.apache.flink.fs.s3.common.writer.S3Committer.commit(S3Committer.java:67)
at 
org.apache.flink.streaming.api.functions.sink.filesystem.Bucket.onSuccessfulCompletionOfCheckpoint(Bucket.java:300)
at 
org.apache.flink.streaming.api.functions.sink.filesystem.Buckets.commitUpToCheckpoint(Buckets.java:216)
at 
org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.notifyCheckpointComplete(StreamingFileSink.java:399)
at 
org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.notifyCheckpointComplete(AbstractUdfStreamOperator.java:130)
at 
org.apache.flink.streaming.runtime.tasks.StreamTask.notifyCheckpointComplete(StreamTask.java:842)
at org.apache.flink.runtime.taskmanager.Task$2.run(Task.java:1200)
... 5 more
Caused by: java.lang.ClassNotFoundException: 
org.apache.flink.fs.s3hadoop.shaded.javax.xml.bind.JAXBException
at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at 
org.apache.flink.util.ChildFirstClassLoader.loadClass(ChildFirstClassLoader.java:60)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 29 more}}

> Streaming File Sink s3 end-to-end test failed on Travis
> ---
>
> Key: FLINK-13748
> URL: https://issues.apache.org/jira/browse/FLINK-13748
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / FileSystem, Tests
>Affects Versions: 1.10.0
>Reporter: Till Rohrmann
>Assignee: Kostas Kloudas
>Priority: Critical
>  Labels: test-stability
> Fix For: 1.10.0
>
> Attachments: image-2019-09-11-01-29-25-634.png
>
>
> The {{Streaming File Sink s3 end-to-end test}} failed on Travis because it 
> did not 

[jira] [Commented] (FLINK-13748) Streaming File Sink s3 end-to-end test failed on Travis

2019-09-11 Thread Till Rohrmann (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-13748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927418#comment-16927418
 ] 

Till Rohrmann commented on FLINK-13748:
---

Another cron job seemed to have failed because of this end to end test: 
https://travis-ci.org/apache/flink/builds/583357356

> Streaming File Sink s3 end-to-end test failed on Travis
> ---
>
> Key: FLINK-13748
> URL: https://issues.apache.org/jira/browse/FLINK-13748
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / FileSystem, Tests
>Affects Versions: 1.10.0
>Reporter: Till Rohrmann
>Assignee: Kostas Kloudas
>Priority: Critical
>  Labels: test-stability
> Fix For: 1.10.0
>
> Attachments: image-2019-09-11-01-29-25-634.png
>
>
> The {{Streaming File Sink s3 end-to-end test}} failed on Travis because it 
> did not produce any output for 10 minutes.
> https://api.travis-ci.org/v3/job/572255913/log.txt



--
This message was sent by Atlassian Jira
(v8.3.2#803003)


[jira] [Commented] (FLINK-13748) Streaming File Sink s3 end-to-end test failed on Travis

2019-09-10 Thread Kostas Kloudas (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-13748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926807#comment-16926807
 ] 

Kostas Kloudas commented on FLINK-13748:


Thanks for digging into it [~carp84]! I will also have a look tomorrow to see 
if I can reproduce it locally.

> Streaming File Sink s3 end-to-end test failed on Travis
> ---
>
> Key: FLINK-13748
> URL: https://issues.apache.org/jira/browse/FLINK-13748
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / FileSystem, Tests
>Affects Versions: 1.10.0
>Reporter: Till Rohrmann
>Assignee: Kostas Kloudas
>Priority: Critical
>  Labels: test-stability
> Fix For: 1.10.0
>
> Attachments: image-2019-09-11-01-29-25-634.png
>
>
> The {{Streaming File Sink s3 end-to-end test}} failed on Travis because it 
> did not produce any output for 10 minutes.
> https://api.travis-ci.org/v3/job/572255913/log.txt



--
This message was sent by Atlassian Jira
(v8.3.2#803003)


[jira] [Commented] (FLINK-13748) Streaming File Sink s3 end-to-end test failed on Travis

2019-09-10 Thread Yu Li (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-13748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926799#comment-16926799
 ] 

Yu Li commented on FLINK-13748:
---

!image-2019-09-11-01-29-25-634.png|width=634,height=302!
 From the build history, 536ccd7 was the last green cron build and e0759c3 was 
the first failure, there're only another prometheus related commit between 
these two, so I think e0759c3 is the most questionable.

> Streaming File Sink s3 end-to-end test failed on Travis
> ---
>
> Key: FLINK-13748
> URL: https://issues.apache.org/jira/browse/FLINK-13748
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / FileSystem, Tests
>Affects Versions: 1.10.0
>Reporter: Till Rohrmann
>Assignee: Kostas Kloudas
>Priority: Critical
>  Labels: test-stability
> Fix For: 1.10.0
>
> Attachments: image-2019-09-11-01-29-25-634.png
>
>
> The {{Streaming File Sink s3 end-to-end test}} failed on Travis because it 
> did not produce any output for 10 minutes.
> https://api.travis-ci.org/v3/job/572255913/log.txt



--
This message was sent by Atlassian Jira
(v8.3.2#803003)


[jira] [Commented] (FLINK-13748) Streaming File Sink s3 end-to-end test failed on Travis

2019-09-10 Thread Yu Li (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-13748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926760#comment-16926760
 ] 

Yu Li commented on FLINK-13748:
---

Almost all e2e-misc related part failed (except for e2e-misc-jdk11) in this 
nightly run including the last instance Till posted: 
https://travis-ci.org/apache/flink/builds/582875546

>From the output we could see below line, which possibly indicating some 
>checkpoint related problem:
{noformat}
Waiting for job (xxx) to have at least 3 completed checkpoints ...

No output has been received in the last 10m0s
{noformat}

> Streaming File Sink s3 end-to-end test failed on Travis
> ---
>
> Key: FLINK-13748
> URL: https://issues.apache.org/jira/browse/FLINK-13748
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / FileSystem, Tests
>Affects Versions: 1.10.0
>Reporter: Till Rohrmann
>Assignee: Kostas Kloudas
>Priority: Critical
>  Labels: test-stability
> Fix For: 1.10.0
>
>
> The {{Streaming File Sink s3 end-to-end test}} failed on Travis because it 
> did not produce any output for 10 minutes.
> https://api.travis-ci.org/v3/job/572255913/log.txt



--
This message was sent by Atlassian Jira
(v8.3.2#803003)


[jira] [Commented] (FLINK-13748) Streaming File Sink s3 end-to-end test failed on Travis

2019-09-10 Thread Kostas Kloudas (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-13748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926377#comment-16926377
 ] 

Kostas Kloudas commented on FLINK-13748:


I will [~till.rohrmann]. I have to mention though that I do not think we 
changed anything in the {{StreamingFileSink}} recently. 

> Streaming File Sink s3 end-to-end test failed on Travis
> ---
>
> Key: FLINK-13748
> URL: https://issues.apache.org/jira/browse/FLINK-13748
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / FileSystem, Tests
>Affects Versions: 1.10.0
>Reporter: Till Rohrmann
>Priority: Critical
>  Labels: test-stability
> Fix For: 1.10.0
>
>
> The {{Streaming File Sink s3 end-to-end test}} failed on Travis because it 
> did not produce any output for 10 minutes.
> https://api.travis-ci.org/v3/job/572255913/log.txt



--
This message was sent by Atlassian Jira
(v8.3.2#803003)


[jira] [Commented] (FLINK-13748) Streaming File Sink s3 end-to-end test failed on Travis

2019-09-10 Thread Till Rohrmann (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-13748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926353#comment-16926353
 ] 

Till Rohrmann commented on FLINK-13748:
---

[~kkl0u] could you take a look at this issue in order to find out what the 
problem could be?

> Streaming File Sink s3 end-to-end test failed on Travis
> ---
>
> Key: FLINK-13748
> URL: https://issues.apache.org/jira/browse/FLINK-13748
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / FileSystem, Tests
>Affects Versions: 1.10.0
>Reporter: Till Rohrmann
>Priority: Critical
>  Labels: test-stability
> Fix For: 1.10.0
>
>
> The {{Streaming File Sink s3 end-to-end test}} failed on Travis because it 
> did not produce any output for 10 minutes.
> https://api.travis-ci.org/v3/job/572255913/log.txt



--
This message was sent by Atlassian Jira
(v8.3.2#803003)


[jira] [Commented] (FLINK-13748) Streaming File Sink s3 end-to-end test failed on Travis

2019-09-10 Thread Till Rohrmann (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-13748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926352#comment-16926352
 ] 

Till Rohrmann commented on FLINK-13748:
---

Another instance: https://api.travis-ci.org/v3/job/582875585/log.txt

> Streaming File Sink s3 end-to-end test failed on Travis
> ---
>
> Key: FLINK-13748
> URL: https://issues.apache.org/jira/browse/FLINK-13748
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / FileSystem, Tests
>Affects Versions: 1.10.0
>Reporter: Till Rohrmann
>Priority: Critical
>  Labels: test-stability
> Fix For: 1.10.0
>
>
> The {{Streaming File Sink s3 end-to-end test}} failed on Travis because it 
> did not produce any output for 10 minutes.
> https://api.travis-ci.org/v3/job/572255913/log.txt



--
This message was sent by Atlassian Jira
(v8.3.2#803003)


[jira] [Commented] (FLINK-13748) Streaming File Sink s3 end-to-end test failed on Travis

2019-09-06 Thread Gary Yao (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-13748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924013#comment-16924013
 ] 

Gary Yao commented on FLINK-13748:
--

Another instance https://api.travis-ci.org/v3/job/581399567/log.txt

> Streaming File Sink s3 end-to-end test failed on Travis
> ---
>
> Key: FLINK-13748
> URL: https://issues.apache.org/jira/browse/FLINK-13748
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / FileSystem, Tests
>Affects Versions: 1.10.0
>Reporter: Till Rohrmann
>Priority: Critical
>  Labels: test-stability
> Fix For: 1.10.0
>
>
> The {{Streaming File Sink s3 end-to-end test}} failed on Travis because it 
> did not produce any output for 10 minutes.
> https://api.travis-ci.org/v3/job/572255913/log.txt



--
This message was sent by Atlassian Jira
(v8.3.2#803003)


[jira] [Commented] (FLINK-13748) Streaming File Sink s3 end-to-end test failed on Travis

2019-09-06 Thread Gary Yao (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-13748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924015#comment-16924015
 ] 

Gary Yao commented on FLINK-13748:
--

Another instance https://api.travis-ci.org/v3/job/581399573/log.txt

> Streaming File Sink s3 end-to-end test failed on Travis
> ---
>
> Key: FLINK-13748
> URL: https://issues.apache.org/jira/browse/FLINK-13748
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / FileSystem, Tests
>Affects Versions: 1.10.0
>Reporter: Till Rohrmann
>Priority: Critical
>  Labels: test-stability
> Fix For: 1.10.0
>
>
> The {{Streaming File Sink s3 end-to-end test}} failed on Travis because it 
> did not produce any output for 10 minutes.
> https://api.travis-ci.org/v3/job/572255913/log.txt



--
This message was sent by Atlassian Jira
(v8.3.2#803003)