[jira] [Resolved] (FLINK-8941) SpanningRecordSerializationTest fails on Travis

2018-03-28 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann resolved FLINK-8941. -- Resolution: Fixed Fixed via master: 39be1996e461bbeec148bf34a2f92cedeccf59ab

[jira] [Resolved] (FLINK-9057) NPE in CreditBasedSequenceNumberingViewReader when cancelling before initilization was complete

2018-03-28 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann resolved FLINK-9057. -- Resolution: Fixed Fixed via master: f486a3fd6ed80b67e8eeed9245ad37b6b0be740b 1.5.0:

[jira] [Updated] (FLINK-9054) IllegalStateException: Buffer pool is destroyed

2018-03-28 Thread dhiraj prajapati (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhiraj prajapati updated FLINK-9054: Fix Version/s: (was: 1.5.0) > IllegalStateException: Buffer pool is destroyed >

[jira] [Commented] (FLINK-8941) SpanningRecordSerializationTest fails on Travis

2018-03-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16416868#comment-16416868 ] ASF GitHub Bot commented on FLINK-8941: --- Github user asfgit closed the pull request at:

[jira] [Commented] (FLINK-8415) Unprotected access to recordsToSend in LongRecordWriterThread#shutdown()

2018-03-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16416869#comment-16416869 ] ASF GitHub Bot commented on FLINK-8415: --- Github user asfgit closed the pull request at:

[jira] [Resolved] (FLINK-8415) Unprotected access to recordsToSend in LongRecordWriterThread#shutdown()

2018-03-28 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann resolved FLINK-8415. -- Resolution: Fixed Fix Version/s: 1.5.0 Fixed via master:

[jira] [Commented] (FLINK-9057) NPE in CreditBasedSequenceNumberingViewReader when cancelling before initilization was complete

2018-03-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16416867#comment-16416867 ] ASF GitHub Bot commented on FLINK-9057: --- Github user asfgit closed the pull request at:

[GitHub] flink pull request #5724: [FLINK-8415] Unprotected access to recordsToSend i...

2018-03-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5724 ---

[GitHub] flink pull request #5747: [FLINK-9057][network] fix an NPE when cleaning up ...

2018-03-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5747 ---

[GitHub] flink pull request #5709: [FLINK-8941][network][serializer] improve Spanning...

2018-03-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5709 ---

[jira] [Commented] (FLINK-9072) Host name with "_" causes cluster exception

2018-03-28 Thread liuzhuo (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16416926#comment-16416926 ] liuzhuo commented on FLINK-9072: I see  underscores are not a allowed in hostnames, But some devops can

[jira] [Closed] (FLINK-9072) Host name with "_" causes cluster exception

2018-03-28 Thread liuzhuo (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuzhuo closed FLINK-9072. -- Resolution: Not A Problem > Host name with "_" causes cluster exception >

[GitHub] flink pull request #5778: [FLINK-8979] (part 1) Make Kafka end-to-end tests ...

2018-03-28 Thread tzulitai
GitHub user tzulitai opened a pull request: https://github.com/apache/flink/pull/5778 [FLINK-8979] (part 1) Make Kafka end-to-end tests not embarrassingly parallel ## What is the purpose of the change This PR improves the behaviour test coverage of Kafka end-to-end tests

[jira] [Commented] (FLINK-8979) Extend Kafka end-to-end tests to run with different versions

2018-03-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16416907#comment-16416907 ] ASF GitHub Bot commented on FLINK-8979: --- GitHub user tzulitai opened a pull request:

[jira] [Updated] (FLINK-9101) HAQueryableStateRocksDBBackendITCase failed on travis

2018-03-28 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler updated FLINK-9101: Description: The test deadlocks on travis.

[jira] [Created] (FLINK-9101) HAQueryableStateRocksDBBackendITCase failed on travis

2018-03-28 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-9101: --- Summary: HAQueryableStateRocksDBBackendITCase failed on travis Key: FLINK-9101 URL: https://issues.apache.org/jira/browse/FLINK-9101 Project: Flink

[GitHub] flink pull request #5676: [FLINK-8910][tests] Automated end-to-end test for ...

2018-03-28 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5676#discussion_r177695881 --- Diff: flink-end-to-end-tests/src/main/java/org/apache/flink/streaming/tests/StickyAllocationAndLocalRecoveryTestJob.java --- @@ -0,0 +1,451 @@

[jira] [Commented] (FLINK-8740) Job-level metrics lost during job re-submission in HA mode

2018-03-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417106#comment-16417106 ] ASF GitHub Bot commented on FLINK-8740: --- Github user tillrohrmann commented on a diff in the pull

[jira] [Commented] (FLINK-8740) Job-level metrics lost during job re-submission in HA mode

2018-03-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417107#comment-16417107 ] ASF GitHub Bot commented on FLINK-8740: --- Github user tillrohrmann commented on the issue:

[GitHub] flink pull request #5755: [FLINK-8740] [metrics] Create new JobManagerJobMet...

2018-03-28 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5755#discussion_r177695516 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/jobmaster/JobMaster.java --- @@ -165,7 +166,7 @@ private final BlobServer

[jira] [Commented] (FLINK-8794) When using BucketingSink, it happens that one of the files is always in the [.in-progress] state

2018-03-28 Thread yanxiaobin (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417174#comment-16417174 ] yanxiaobin commented on FLINK-8794: --- Other problems have nothing to do with Flink. > When using

[jira] [Commented] (FLINK-8979) Extend Kafka end-to-end tests to run with different versions

2018-03-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417002#comment-16417002 ] ASF GitHub Bot commented on FLINK-8979: --- Github user zentol commented on the issue:

[GitHub] flink issue #5778: [FLINK-8979] (part 1) Make Kafka end-to-end tests not emb...

2018-03-28 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/5778 while you are at it, can you also add the savepoint tests to `run-nightly-tests.sh`? ---

[jira] [Commented] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

2018-03-28 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417032#comment-16417032 ] Stephan Ewen commented on FLINK-9061: - One advantage of making the changes in the state backend would

[GitHub] flink pull request #5779: [FLINK-8990] [test] Extend Kafka end-to-end test t...

2018-03-28 Thread tzulitai
GitHub user tzulitai opened a pull request: https://github.com/apache/flink/pull/5779 [FLINK-8990] [test] Extend Kafka end-to-end test to verify partition discovery ## What is the purpose of the change This PR is based on #5778. The changes further extends the

[jira] [Commented] (FLINK-8990) End-to-end test: Dynamic Kafka partition discovery

2018-03-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417082#comment-16417082 ] ASF GitHub Bot commented on FLINK-8990: --- GitHub user tzulitai opened a pull request:

[GitHub] flink pull request #5767: [FLINK-8887] Wait for JobMaster leader election in...

2018-03-28 Thread GJL
Github user GJL commented on a diff in the pull request: https://github.com/apache/flink/pull/5767#discussion_r177696032 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/highavailability/nonha/embedded/EmbeddedLeaderService.java --- @@ -440,28 +439,33 @@ public void

[jira] [Closed] (FLINK-9077) flip6 cluster framework doesn't work on mesos

2018-03-28 Thread Renjie Liu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Renjie Liu closed FLINK-9077. - Resolution: Not A Problem It has been proven that this is caused by my mistake. When starting

[jira] [Commented] (FLINK-2540) LocalBufferPool.requestBuffer gets into infinite loop

2018-03-28 Thread Renkai Ge (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417058#comment-16417058 ] Renkai Ge commented on FLINK-2540: -- [~uce] As far as I can see,there is no reason that the thread can

[jira] [Commented] (FLINK-8979) Extend Kafka end-to-end tests to run with different versions

2018-03-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417067#comment-16417067 ] ASF GitHub Bot commented on FLINK-8979: --- Github user tzulitai commented on the issue:

[GitHub] flink issue #5778: [FLINK-8979] (part 1) Make Kafka end-to-end tests not emb...

2018-03-28 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/5778 @zentol will do ---

[GitHub] flink issue #5755: [FLINK-8740] [metrics] Create new JobManagerJobMetricGrou...

2018-03-28 Thread tillrohrmann
Github user tillrohrmann commented on the issue: https://github.com/apache/flink/pull/5755 Thanks for the review @zentol. Addressing your last comment while merging this PR. ---

[jira] [Commented] (FLINK-8887) ClusterClient.getJobStatus can throw FencingTokenException

2018-03-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417115#comment-16417115 ] ASF GitHub Bot commented on FLINK-8887: --- Github user GJL commented on a diff in the pull request:

[jira] [Commented] (FLINK-8887) ClusterClient.getJobStatus can throw FencingTokenException

2018-03-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417116#comment-16417116 ] ASF GitHub Bot commented on FLINK-8887: --- Github user GJL commented on a diff in the pull request:

[GitHub] flink pull request #5767: [FLINK-8887] Wait for JobMaster leader election in...

2018-03-28 Thread GJL
Github user GJL commented on a diff in the pull request: https://github.com/apache/flink/pull/5767#discussion_r177684059 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/Dispatcher.java --- @@ -645,6 +637,56 @@ private void

[GitHub] flink pull request #5775: [FLINK-9099] Assign Execution to LogicalSlot when ...

2018-03-28 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5775#discussion_r177699910 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/jobmaster/slotpool/SlotPool.java --- @@ -659,7 +660,7 @@ public void

[jira] [Commented] (FLINK-8794) When using BucketingSink, it happens that one of the files is always in the [.in-progress] state

2018-03-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417140#comment-16417140 ] Steve Loughran commented on FLINK-8794: --- bq. Enable consistent-view can cause other problems.

[jira] [Reopened] (FLINK-2540) LocalBufferPool.requestBuffer gets into infinite loop

2018-03-28 Thread Renkai Ge (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Renkai Ge reopened FLINK-2540: -- It seems that this issue was not fixed at all.It is closed since some github/Jira sync bugs occured. I

[jira] [Commented] (FLINK-8910) Introduce automated end-to-end test for local recovery (including sticky scheduling)

2018-03-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417110#comment-16417110 ] ASF GitHub Bot commented on FLINK-8910: --- Github user tillrohrmann commented on a diff in the pull

[jira] [Assigned] (FLINK-9040) JobVertex#setMaxParallelism does not validate argument

2018-03-28 Thread Sihua Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sihua Zhou reassigned FLINK-9040: - Assignee: (was: Sihua Zhou) > JobVertex#setMaxParallelism does not validate argument >

[jira] [Comment Edited] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

2018-03-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417145#comment-16417145 ] Steve Loughran edited comment on FLINK-9061 at 3/28/18 10:33 AM: - The s3a

[jira] [Commented] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

2018-03-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417145#comment-16417145 ] Steve Loughran commented on FLINK-9061: --- The s3a connector will have the same issue, though there we

[jira] [Commented] (FLINK-8704) Migrate tests from TestingCluster to MiniClusterResource

2018-03-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417168#comment-16417168 ] ASF GitHub Bot commented on FLINK-8704: --- GitHub user zentol opened a pull request:

[GitHub] flink pull request #5780: [FLINK-8704][tests] Port ClassLoaderITCase to flip...

2018-03-28 Thread zentol
GitHub user zentol opened a pull request: https://github.com/apache/flink/pull/5780 [FLINK-8704][tests] Port ClassLoaderITCase to flip6 Partially based on #5766. ## What is the purpose of the change This PR ports the `ClassLoaderITCase` to flip6. ##

[GitHub] flink issue #5760: [hotfix] [doc] fix maven version in building flink

2018-03-28 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/5760 I would suggest to bump it to 3.2.5 as that's that latest version for which the shading works properly. ---

[jira] [Commented] (FLINK-8943) Jobs will not recover if DFS is temporarily unavailable

2018-03-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417237#comment-16417237 ] ASF GitHub Bot commented on FLINK-8943: --- Github user GJL commented on a diff in the pull request:

[jira] [Commented] (FLINK-8943) Jobs will not recover if DFS is temporarily unavailable

2018-03-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417236#comment-16417236 ] ASF GitHub Bot commented on FLINK-8943: --- Github user GJL commented on a diff in the pull request:

[GitHub] flink pull request #5746: [FLINK-8943] [ha] Fail Dispatcher if jobs cannot b...

2018-03-28 Thread GJL
Github user GJL commented on a diff in the pull request: https://github.com/apache/flink/pull/5746#discussion_r177722358 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/util/TestingFatalErrorHandler.java --- @@ -19,45 +19,81 @@ package

[jira] [Commented] (FLINK-8943) Jobs will not recover if DFS is temporarily unavailable

2018-03-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417235#comment-16417235 ] ASF GitHub Bot commented on FLINK-8943: --- Github user GJL commented on a diff in the pull request:

[GitHub] flink pull request #5746: [FLINK-8943] [ha] Fail Dispatcher if jobs cannot b...

2018-03-28 Thread GJL
Github user GJL commented on a diff in the pull request: https://github.com/apache/flink/pull/5746#discussion_r177723226 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/jobmanager/JobManagerHARecoveryTest.java --- @@ -396,15 +398,22 @@ public void

[GitHub] flink pull request #5746: [FLINK-8943] [ha] Fail Dispatcher if jobs cannot b...

2018-03-28 Thread GJL
Github user GJL commented on a diff in the pull request: https://github.com/apache/flink/pull/5746#discussion_r177721959 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/util/TestingFatalErrorHandler.java --- @@ -19,45 +19,81 @@ package

[jira] [Commented] (FLINK-9099) Failing allocated slots not noticed

2018-03-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417250#comment-16417250 ] ASF GitHub Bot commented on FLINK-9099: --- Github user tillrohrmann commented on the issue:

[GitHub] flink issue #5775: [FLINK-9099] Assign Execution to LogicalSlot when slot is...

2018-03-28 Thread tillrohrmann
Github user tillrohrmann commented on the issue: https://github.com/apache/flink/pull/5775 Thanks for the review @GJL. Rebasing onto the latest master and merging. ---

[jira] [Commented] (FLINK-9102) Make the JobGraph disable queued scheduling for Flip6LocalStreamEnvironment

2018-03-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417263#comment-16417263 ] ASF GitHub Bot commented on FLINK-9102: --- GitHub user sihuazhou opened a pull request:

[jira] [Commented] (FLINK-9102) Make the JobGraph disable queued scheduling for Flip6LocalStreamEnvironment

2018-03-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417264#comment-16417264 ] ASF GitHub Bot commented on FLINK-9102: --- Github user sihuazhou commented on the issue:

[GitHub] flink pull request #5781: [FLINK-9102][FLIP6] disable queued scheduling for ...

2018-03-28 Thread sihuazhou
GitHub user sihuazhou opened a pull request: https://github.com/apache/flink/pull/5781 [FLINK-9102][FLIP6] disable queued scheduling for JobGraph in Flip6LocalStreamEnvironment ## What is the purpose of the change When we start cluster locally with fixed TMS and build

[GitHub] flink issue #5781: [FLINK-9102][FLIP6] disable queued scheduling for JobGrap...

2018-03-28 Thread sihuazhou
Github user sihuazhou commented on the issue: https://github.com/apache/flink/pull/5781 CC: @tillrohrmann ---

[jira] [Commented] (FLINK-8943) Jobs will not recover if DFS is temporarily unavailable

2018-03-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417270#comment-16417270 ] ASF GitHub Bot commented on FLINK-8943: --- Github user tillrohrmann commented on a diff in the pull

[GitHub] flink pull request #5746: [FLINK-8943] [ha] Fail Dispatcher if jobs cannot b...

2018-03-28 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5746#discussion_r177731653 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/util/TestingFatalErrorHandler.java --- @@ -19,45 +19,81 @@ package

[jira] [Commented] (FLINK-8943) Jobs will not recover if DFS is temporarily unavailable

2018-03-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417269#comment-16417269 ] ASF GitHub Bot commented on FLINK-8943: --- Github user tillrohrmann commented on a diff in the pull

[jira] [Commented] (FLINK-8943) Jobs will not recover if DFS is temporarily unavailable

2018-03-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417277#comment-16417277 ] ASF GitHub Bot commented on FLINK-8943: --- Github user tillrohrmann commented on the issue:

[jira] [Updated] (FLINK-9102) Make the JobGraph disable queued scheduling for cluster with fixed TMs

2018-03-28 Thread Sihua Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sihua Zhou updated FLINK-9102: -- Description: When we start cluster locally with fixed TMS and we should disable queued scheduling for

[GitHub] flink pull request #5774: [FLINK-9097] Fail fatally if job submission fails ...

2018-03-28 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5774#discussion_r177734109 --- Diff: flink-runtime/src/test/resources/log4j-test.properties --- @@ -16,7 +16,7 @@ # limitations under the License.

[jira] [Commented] (FLINK-9097) Jobs can be dropped in HA when job submission fails

2018-03-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417281#comment-16417281 ] ASF GitHub Bot commented on FLINK-9097: --- Github user tillrohrmann commented on a diff in the pull

[jira] [Commented] (FLINK-7897) Consider using nio.Files for file deletion in TransientBlobCleanupTask

2018-03-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417286#comment-16417286 ] ASF GitHub Bot commented on FLINK-7897: --- Github user yuqi1129 commented on a diff in the pull

[GitHub] flink pull request #5777: [FLINK-7897] Consider using nio.Files for file del...

2018-03-28 Thread yuqi1129
Github user yuqi1129 commented on a diff in the pull request: https://github.com/apache/flink/pull/5777#discussion_r177736130 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/blob/TransientBlobCleanupTask.java --- @@ -100,9 +102,15 @@ public void run() {

[GitHub] flink pull request #5774: [FLINK-9097] Fail fatally if job submission fails ...

2018-03-28 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5774#discussion_r177739972 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/dispatcher/DispatcherTest.java --- @@ -507,19 +539,21 @@ private TestingDispatcher(

[jira] [Commented] (FLINK-9097) Jobs can be dropped in HA when job submission fails

2018-03-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417297#comment-16417297 ] ASF GitHub Bot commented on FLINK-9097: --- Github user tillrohrmann commented on a diff in the pull

[jira] [Issue Comment Deleted] (FLINK-5372) Fix RocksDBAsyncSnapshotTest.testCancelFullyAsyncCheckpoints()

2018-03-28 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler updated FLINK-5372: Comment: was deleted (was: The instability seems to be caused by a plain race condition in

[jira] [Updated] (FLINK-7958) Allow reporters to override the default delimiter

2018-03-28 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler updated FLINK-7958: Fix Version/s: (was: 1.5.0) 1.6.0 > Allow reporters to override the

[jira] [Assigned] (FLINK-8700) Port tests from FlinkMiniCluster to MiniClusterResource

2018-03-28 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler reassigned FLINK-8700: --- Assignee: Chesnay Schepler > Port tests from FlinkMiniCluster to MiniClusterResource

[jira] [Commented] (FLINK-9094) AccumulatorLiveITCase unstable on Travis

2018-03-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417313#comment-16417313 ] ASF GitHub Bot commented on FLINK-9094: --- Github user zentol commented on a diff in the pull request:

[GitHub] flink pull request #5771: [FLINK-9094] [tests] Harden AccumulatorLiveITCase

2018-03-28 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/5771#discussion_r177746665 --- Diff: flink-tests/src/test/java/org/apache/flink/test/accumulators/AccumulatorLiveITCase.java --- @@ -167,6 +172,9 @@ private static void

[jira] [Assigned] (FLINK-6567) ExecutionGraphMetricsTest fails on Windows CI

2018-03-28 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann reassigned FLINK-6567: Assignee: Till Rohrmann > ExecutionGraphMetricsTest fails on Windows CI >

[GitHub] flink pull request #5771: [FLINK-9094] [tests] Harden AccumulatorLiveITCase

2018-03-28 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5771#discussion_r177751742 --- Diff: flink-tests/src/test/java/org/apache/flink/test/accumulators/AccumulatorLiveITCase.java --- @@ -167,6 +172,9 @@ private static void

[jira] [Commented] (FLINK-6567) ExecutionGraphMetricsTest fails on Windows CI

2018-03-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417332#comment-16417332 ] ASF GitHub Bot commented on FLINK-6567: --- GitHub user tillrohrmann opened a pull request:

[GitHub] flink pull request #5774: [FLINK-9097] Fail fatally if job submission fails ...

2018-03-28 Thread GJL
Github user GJL commented on a diff in the pull request: https://github.com/apache/flink/pull/5774#discussion_r177725828 --- Diff: flink-runtime/src/test/resources/log4j-test.properties --- @@ -16,7 +16,7 @@ # limitations under the License.

[GitHub] flink issue #5746: [FLINK-8943] [ha] Fail Dispatcher if jobs cannot be recov...

2018-03-28 Thread tillrohrmann
Github user tillrohrmann commented on the issue: https://github.com/apache/flink/pull/5746 Thanks for the review @GJL. I've addressed your comments and rebased onto the soon to be master. ---

[jira] [Updated] (FLINK-9102) Make the JobGraph disable queued scheduling for cluster with fixed TMs

2018-03-28 Thread Sihua Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sihua Zhou updated FLINK-9102: -- Summary: Make the JobGraph disable queued scheduling for cluster with fixed TMs (was: Make the

[jira] [Commented] (FLINK-9097) Jobs can be dropped in HA when job submission fails

2018-03-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417287#comment-16417287 ] ASF GitHub Bot commented on FLINK-9097: --- Github user GJL commented on a diff in the pull request:

[jira] [Commented] (FLINK-8704) Migrate tests from TestingCluster to MiniClusterResource

2018-03-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417294#comment-16417294 ] ASF GitHub Bot commented on FLINK-8704: --- Github user pnowojski commented on the issue:

[jira] [Commented] (FLINK-8943) Jobs will not recover if DFS is temporarily unavailable

2018-03-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417295#comment-16417295 ] ASF GitHub Bot commented on FLINK-8943: --- Github user GJL commented on a diff in the pull request:

[GitHub] flink issue #5694: [FLINK-8704][tests] Port SlotCountExceedingParallelismTes...

2018-03-28 Thread pnowojski
Github user pnowojski commented on the issue: https://github.com/apache/flink/pull/5694 @zentol, why did you have to copy `LegacySlotCountExceedingParallelismTest`? Shouldn't the new one work as well for non FLIP6? ---

[GitHub] flink pull request #5746: [FLINK-8943] [ha] Fail Dispatcher if jobs cannot b...

2018-03-28 Thread GJL
Github user GJL commented on a diff in the pull request: https://github.com/apache/flink/pull/5746#discussion_r177739371 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/util/TestingFatalErrorHandler.java --- @@ -19,45 +19,81 @@ package

[jira] [Assigned] (FLINK-5372) Fix RocksDBAsyncSnapshotTest.testCancelFullyAsyncCheckpoints()

2018-03-28 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler reassigned FLINK-5372: --- Assignee: (was: Chesnay Schepler) > Fix

[jira] [Commented] (FLINK-8943) Jobs will not recover if DFS is temporarily unavailable

2018-03-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417303#comment-16417303 ] ASF GitHub Bot commented on FLINK-8943: --- Github user GJL commented on the issue:

[GitHub] flink issue #5746: [FLINK-8943] [ha] Fail Dispatcher if jobs cannot be recov...

2018-03-28 Thread GJL
Github user GJL commented on the issue: https://github.com/apache/flink/pull/5746 I had one more comment regarding `Thread.interrupted()`. ---

[GitHub] flink pull request #5669: [FLINK-8703][tests] Port KafkaTestBase to MiniClus...

2018-03-28 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/5669#discussion_r177742687 --- Diff: flink-connectors/flink-connector-kafka-base/src/test/java/org/apache/flink/streaming/connectors/kafka/KafkaConsumerTestBase.java --- @@ -244,7

[GitHub] flink pull request #5669: [FLINK-8703][tests] Port KafkaTestBase to MiniClus...

2018-03-28 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/5669#discussion_r177747320 --- Diff: flink-connectors/flink-connector-kafka-base/src/test/java/org/apache/flink/streaming/connectors/kafka/KafkaConsumerTestBase.java --- @@

[GitHub] flink pull request #5669: [FLINK-8703][tests] Port KafkaTestBase to MiniClus...

2018-03-28 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/5669#discussion_r177743725 --- Diff: flink-connectors/flink-connector-kafka-base/src/test/java/org/apache/flink/streaming/connectors/kafka/KafkaConsumerTestBase.java --- @@ -132,8

[GitHub] flink pull request #5782: [FLINK-6567] [tests] Harden ExecutionGraphMetricsT...

2018-03-28 Thread tillrohrmann
GitHub user tillrohrmann opened a pull request: https://github.com/apache/flink/pull/5782 [FLINK-6567] [tests] Harden ExecutionGraphMetricsTest ## What is the purpose of the change The problem was that in some cases the currentRestartingTime would not increase because

[jira] [Commented] (FLINK-9055) WebUI shows job as Running although not enough resources are available

2018-03-28 Thread Sihua Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417248#comment-16417248 ] Sihua Zhou commented on FLINK-9055: --- Hi [~fhueske] shall we fail the job immediately when job

[jira] [Commented] (FLINK-9099) Failing allocated slots not noticed

2018-03-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417249#comment-16417249 ] ASF GitHub Bot commented on FLINK-9099: --- Github user tillrohrmann commented on a diff in the pull

[GitHub] flink pull request #5775: [FLINK-9099] Assign Execution to LogicalSlot when ...

2018-03-28 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5775#discussion_r177726389 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/executiongraph/ExecutionGraphSchedulingTest.java --- @@ -465,6 +464,58 @@ public void

[jira] [Created] (FLINK-9102) Make the JobGraph disable queued scheduling for Flip6LocalStreamEnvironment

2018-03-28 Thread Sihua Zhou (JIRA)
Sihua Zhou created FLINK-9102: - Summary: Make the JobGraph disable queued scheduling for Flip6LocalStreamEnvironment Key: FLINK-9102 URL: https://issues.apache.org/jira/browse/FLINK-9102 Project: Flink

[GitHub] flink pull request #5767: [FLINK-8887] Wait for JobMaster leader election in...

2018-03-28 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5767#discussion_r177728701 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/Dispatcher.java --- @@ -645,6 +637,56 @@ private void

[GitHub] flink pull request #5767: [FLINK-8887] Wait for JobMaster leader election in...

2018-03-28 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5767#discussion_r177728773 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/highavailability/nonha/embedded/EmbeddedLeaderService.java --- @@ -440,28 +439,33 @@

[jira] [Commented] (FLINK-8887) ClusterClient.getJobStatus can throw FencingTokenException

2018-03-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417261#comment-16417261 ] ASF GitHub Bot commented on FLINK-8887: --- Github user tillrohrmann commented on the issue:

[GitHub] flink issue #5767: [FLINK-8887] Wait for JobMaster leader election in Dispat...

2018-03-28 Thread tillrohrmann
Github user tillrohrmann commented on the issue: https://github.com/apache/flink/pull/5767 Thanks for the review @GJL. I've addressed your comments and rebased on the soon to be master and force pushed. ---

[GitHub] flink pull request #5746: [FLINK-8943] [ha] Fail Dispatcher if jobs cannot b...

2018-03-28 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5746#discussion_r177731740 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/jobmanager/JobManagerHARecoveryTest.java --- @@ -396,15 +398,22 @@ public void

  1   2   3   >