[GitHub] flink pull request #5746: [FLINK-8943] [ha] Fail Dispatcher if jobs cannot b...

2018-03-22 Thread tillrohrmann
GitHub user tillrohrmann opened a pull request: https://github.com/apache/flink/pull/5746 [FLINK-8943] [ha] Fail Dispatcher if jobs cannot be recovered from HA store ## What is the purpose of the change In HA mode, the Dispatcher should fail if it cannot recover the

[GitHub] flink issue #5488: [FLINK-8335] [hbase] Upgrade hbase connector dependency t...

2018-03-22 Thread zhangminglei
Github user zhangminglei commented on the issue: https://github.com/apache/flink/pull/5488 @StephanEwen I would ask , what way you used for judging exclude those dependencies (jersey, jruby, tomcat) ? I used ```mvn dependency:analyze``` under

[jira] [Commented] (FLINK-9045) LocalEnvironment with web UI does not work with flip-6

2018-03-22 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409355#comment-16409355 ] Chesnay Schepler commented on FLINK-9045: - The logging can be improved i agree. Earlier versions

[jira] [Commented] (FLINK-8623) ConnectionUtilsTest.testReturnLocalHostAddressUsingHeuristics unstable on Travis

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409363#comment-16409363 ] ASF GitHub Bot commented on FLINK-8623: --- Github user zhangminglei commented on the issue:

[jira] [Commented] (FLINK-8335) Upgrade hbase connector dependency to 1.4.1

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409444#comment-16409444 ] ASF GitHub Bot commented on FLINK-8335: --- Github user zhangminglei commented on the issue:

[jira] [Commented] (FLINK-9047) SlotPool can fail to release slots

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409455#comment-16409455 ] ASF GitHub Bot commented on FLINK-9047: --- Github user GJL commented on a diff in the pull request:

[jira] [Commented] (FLINK-9047) SlotPool can fail to release slots

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409456#comment-16409456 ] ASF GitHub Bot commented on FLINK-9047: --- Github user GJL commented on a diff in the pull request:

[GitHub] flink pull request #5739: [FLINK-9047] Fix slot recycling in case of failed ...

2018-03-22 Thread GJL
Github user GJL commented on a diff in the pull request: https://github.com/apache/flink/pull/5739#discussion_r176401066 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/jobmaster/slotpool/SlotPoolTest.java --- @@ -634,6 +653,99 @@ public void testCheckIdleSlot()

[GitHub] flink pull request #5739: [FLINK-9047] Fix slot recycling in case of failed ...

2018-03-22 Thread GJL
Github user GJL commented on a diff in the pull request: https://github.com/apache/flink/pull/5739#discussion_r176400741 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/jobmaster/slotpool/SlotPoolTest.java --- @@ -634,6 +653,99 @@ public void testCheckIdleSlot()

[jira] [Commented] (FLINK-9047) SlotPool can fail to release slots

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409457#comment-16409457 ] ASF GitHub Bot commented on FLINK-9047: --- Github user GJL commented on a diff in the pull request:

[jira] [Created] (FLINK-9053) RescalingITCase failed on travis

2018-03-22 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-9053: --- Summary: RescalingITCase failed on travis Key: FLINK-9053 URL: https://issues.apache.org/jira/browse/FLINK-9053 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-9049) Create unified interfaces to configure and instatiate TableSink

2018-03-22 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409304#comment-16409304 ] Fabian Hueske commented on FLINK-9049: -- Thanks for the issue [~suez1224]. I think it would be great,

[jira] [Commented] (FLINK-8943) Jobs will not recover if DFS is temporarily unavailable

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409316#comment-16409316 ] ASF GitHub Bot commented on FLINK-8943: --- GitHub user tillrohrmann opened a pull request:

[GitHub] flink issue #5488: [FLINK-8335] [hbase] Upgrade hbase connector dependency t...

2018-03-22 Thread zhangminglei
Github user zhangminglei commented on the issue: https://github.com/apache/flink/pull/5488 Yeah. Actually, We had those dependencies when 1.3.1. We should exclude them at that time. But we did not. ---

[jira] [Commented] (FLINK-8931) TASK_KILLING is not covered by match in TaskMonitor#whenUnhandled

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409428#comment-16409428 ] ASF GitHub Bot commented on FLINK-8931: --- Github user tillrohrmann commented on the issue:

[GitHub] flink issue #5488: [FLINK-8335] [hbase] Upgrade hbase connector dependency t...

2018-03-22 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/5488 Thanks! The dependency tree is huge, and a good amount is for `org.apache.hbase:hbase-server`. Is that really needed for the connector, or can we exclude that? ---

[GitHub] flink issue #5488: [FLINK-8335] [hbase] Upgrade hbase connector dependency t...

2018-03-22 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/5488 Okay, seems we cannot exclude hbase server (hell, hadoop projects really mess up their dependencies). Can you try to exclude some of the dependencies, like jersey, jruby, tomcat, etc?

[GitHub] flink issue #5744: [FLINK-8931] TASK_KILLING is not covered by match in Task...

2018-03-22 Thread tillrohrmann
Github user tillrohrmann commented on the issue: https://github.com/apache/flink/pull/5744 Thanks for the contribution @yanghua. I fear that the `TASK_KILLING` states have been left out deliberately. When a task is being killed, then you don't stop. Thus, the issue is actually a non

[jira] [Commented] (FLINK-6595) Nested SQL queries do not expose proctime / rowtime attributes

2018-03-22 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409282#comment-16409282 ] Fabian Hueske commented on FLINK-6595: -- You don't need to separate the query (and I did not say

[GitHub] flink issue #5449: [FLINK-8623] ConnectionUtilsTest.testReturnLocalHostAddre...

2018-03-22 Thread zhangminglei
Github user zhangminglei commented on the issue: https://github.com/apache/flink/pull/5449 I copied the Travis log here, and I think this is what we want. And the line of 63 verifies it is not a loopback address. ``` // make sure that the InetAddress.getLocalHost is not

[jira] [Commented] (FLINK-8946) TaskManager stop sending metrics after JobManager failover

2018-03-22 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409430#comment-16409430 ] Till Rohrmann commented on FLINK-8946: -- Sorry [~yanghua], I confused this issue with FLINK-9026. I

[jira] [Created] (FLINK-9054) IllegalStateException: Buffer pool is destroyed

2018-03-22 Thread dhiraj prajapati (JIRA)
dhiraj prajapati created FLINK-9054: --- Summary: IllegalStateException: Buffer pool is destroyed Key: FLINK-9054 URL: https://issues.apache.org/jira/browse/FLINK-9054 Project: Flink Issue

[jira] [Commented] (FLINK-8335) Upgrade hbase connector dependency to 1.4.1

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409274#comment-16409274 ] ASF GitHub Bot commented on FLINK-8335: --- Github user StephanEwen commented on the issue:

[jira] [Commented] (FLINK-8335) Upgrade hbase connector dependency to 1.4.1

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409297#comment-16409297 ] ASF GitHub Bot commented on FLINK-8335: --- Github user StephanEwen commented on the issue:

[jira] [Commented] (FLINK-8335) Upgrade hbase connector dependency to 1.4.1

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409318#comment-16409318 ] ASF GitHub Bot commented on FLINK-8335: --- Github user zhangminglei commented on the issue:

[GitHub] flink pull request #5739: [FLINK-9047] Fix slot recycling in case of failed ...

2018-03-22 Thread GJL
Github user GJL commented on a diff in the pull request: https://github.com/apache/flink/pull/5739#discussion_r176404156 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/clusterframework/types/TaskManagerSlot.java --- @@ -139,6 +139,16 @@ public boolean

[jira] [Commented] (FLINK-6595) Nested SQL queries do not expose proctime / rowtime attributes

2018-03-22 Thread yinhua.dai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409640#comment-16409640 ] yinhua.dai commented on FLINK-6595: --- I didn't notice that, great thanks [~fhueske] > Nested SQL queries

[GitHub] flink issue #5744: [FLINK-8931] TASK_KILLING is not covered by match in Task...

2018-03-22 Thread yanghua
Github user yanghua commented on the issue: https://github.com/apache/flink/pull/5744 hi @tillrohrmann you mean change to `stay()`? I have changed to this style. It seems that in scala FSM we could not do nothing, it should return task monitor's state. ---

[GitHub] flink issue #5740: [FLINK-9027] [web] Clean up web UI resources by installin...

2018-03-22 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/5740 Okay, seems like the TaskManager design diverged from the "single temp dir" assumption we had originally. How about creating the upload dir inside the web temp dir by default (then it

[jira] [Commented] (FLINK-9027) Web UI does not cleanup temporary files

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409557#comment-16409557 ] ASF GitHub Bot commented on FLINK-9027: --- Github user StephanEwen commented on the issue:

[jira] [Resolved] (FLINK-9034) State Descriptors drop TypeInformation on serialization

2018-03-22 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-9034. - Resolution: Fixed Fix Version/s: (was: 1.6.0) 1.5.0 Fixed in -

[jira] [Commented] (FLINK-9027) Web UI does not cleanup temporary files

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409515#comment-16409515 ] ASF GitHub Bot commented on FLINK-9027: --- Github user tillrohrmann commented on the issue:

[jira] [Created] (FLINK-9055) WebUI shows job as Running although not enough resources are available

2018-03-22 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-9055: Summary: WebUI shows job as Running although not enough resources are available Key: FLINK-9055 URL: https://issues.apache.org/jira/browse/FLINK-9055 Project: Flink

[jira] [Closed] (FLINK-9035) State Descriptors have broken hashCode() and equals()

2018-03-22 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-9035. --- > State Descriptors have broken hashCode() and equals() >

[jira] [Resolved] (FLINK-9035) State Descriptors have broken hashCode() and equals()

2018-03-22 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-9035. - Resolution: Fixed Fix Version/s: (was: 1.6.0) 1.5.0 Fixed in -

[jira] [Created] (FLINK-9056) Job submission fails with AskTimeoutException if not enough slots are available

2018-03-22 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-9056: Summary: Job submission fails with AskTimeoutException if not enough slots are available Key: FLINK-9056 URL: https://issues.apache.org/jira/browse/FLINK-9056

[GitHub] flink pull request #5706: [FLINK-8903] [table] Fix VAR_SAMP, VAR_POP, STDDEV...

2018-03-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5706 ---

[GitHub] flink pull request #5737: [FLINK-8721][flip6] Handle archiving failures for ...

2018-03-22 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/5737#discussion_r176454726 --- Diff: flink-tests/src/test/java/org/apache/flink/test/accumulators/AccumulatorErrorITCase.java --- @@ -45,84 +47,87 @@ * b) are not compatible

[jira] [Commented] (FLINK-8721) Client blocks indefinitely if job archiving fails

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409680#comment-16409680 ] ASF GitHub Bot commented on FLINK-8721: --- Github user pnowojski commented on a diff in the pull

[jira] [Commented] (FLINK-8946) TaskManager stop sending metrics after JobManager failover

2018-03-22 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409704#comment-16409704 ] Till Rohrmann commented on FLINK-8946: -- It would be good to fix this issue. Do you want to take stab

[jira] [Commented] (FLINK-8903) Built-in agg functions VAR_POP, VAR_SAMP, STDEV_POP, STDEV_SAMP are broken in Group Windows

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409603#comment-16409603 ] ASF GitHub Bot commented on FLINK-8903: --- Github user asfgit closed the pull request at:

[jira] [Closed] (FLINK-8903) Built-in agg functions VAR_POP, VAR_SAMP, STDEV_POP, STDEV_SAMP are broken in Group Windows

2018-03-22 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske closed FLINK-8903. Resolution: Fixed Fixed for 1.5.0 with 555e80a089c7d4a5d2d69d9a2f05d606e12d2eff Fixed for 1.6.0

[jira] [Commented] (FLINK-8931) TASK_KILLING is not covered by match in TaskMonitor#whenUnhandled

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409656#comment-16409656 ] ASF GitHub Bot commented on FLINK-8931: --- Github user yanghua commented on the issue:

[jira] [Commented] (FLINK-8946) TaskManager stop sending metrics after JobManager failover

2018-03-22 Thread vinoyang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409672#comment-16409672 ] vinoyang commented on FLINK-8946: - So [~till.rohrmann] what do you think about this issue in TaskManager

[jira] [Closed] (FLINK-9034) State Descriptors drop TypeInformation on serialization

2018-03-22 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-9034. --- > State Descriptors drop TypeInformation on serialization >

[jira] [Commented] (FLINK-8887) ClusterClient.getJobStatus can throw FencingTokenException

2018-03-22 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409738#comment-16409738 ] Till Rohrmann commented on FLINK-8887: -- When did you observe the problem [~gjy]? I think this problem

[jira] [Created] (FLINK-9057) NPE in CreditBasedSequenceNumberingViewReader when cancelling before initilization was complete

2018-03-22 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-9057: -- Summary: NPE in CreditBasedSequenceNumberingViewReader when cancelling before initilization was complete Key: FLINK-9057 URL: https://issues.apache.org/jira/browse/FLINK-9057

[jira] [Commented] (FLINK-8956) Port RescalingITCase to flip6

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409766#comment-16409766 ] ASF GitHub Bot commented on FLINK-8956: --- Github user tillrohrmann commented on a diff in the pull

[GitHub] flink pull request #5696: [hotfix][javadoc] fix doc of SlotProvider.allocate...

2018-03-22 Thread sihuazhou
Github user sihuazhou closed the pull request at: https://github.com/apache/flink/pull/5696 ---

[GitHub] flink pull request #5727: [FLINK-8964][tests] Port JobSubmissionFailsITCase ...

2018-03-22 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5727#discussion_r176489375 --- Diff: flink-tests/src/test/java/org/apache/flink/test/example/failing/JobSubmissionFailsITCase.java --- @@ -105,90 +85,51 @@ public

[jira] [Commented] (FLINK-8964) Port JobSubmissionFailsITCase to flip6

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409841#comment-16409841 ] ASF GitHub Bot commented on FLINK-8964: --- Github user tillrohrmann commented on a diff in the pull

[jira] [Commented] (FLINK-8943) Jobs will not recover if DFS is temporarily unavailable

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409888#comment-16409888 ] ASF GitHub Bot commented on FLINK-8943: --- Github user sihuazhou commented on the issue:

[GitHub] flink issue #5746: [FLINK-8943] [ha] Fail Dispatcher if jobs cannot be recov...

2018-03-22 Thread sihuazhou
Github user sihuazhou commented on the issue: https://github.com/apache/flink/pull/5746 Hi @tillrohrmann there is one question I want ask about this PR, is it means that in HA mode we can't tolerant jobs partial broken? ---

[GitHub] flink issue #5746: [FLINK-8943] [ha] Fail Dispatcher if jobs cannot be recov...

2018-03-22 Thread sihuazhou
Github user sihuazhou commented on the issue: https://github.com/apache/flink/pull/5746 please just ignore my question... ---

[jira] [Updated] (FLINK-9053) RescalingITCase failed on travis

2018-03-22 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-9053: --- Affects Version/s: 1.6.0 > RescalingITCase failed on travis > > >

[jira] [Updated] (FLINK-9053) RescalingITCase failed on travis

2018-03-22 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-9053: --- Component/s: (was: Tests) > RescalingITCase failed on travis > >

[jira] [Updated] (FLINK-9053) RescalingITCase failed on travis

2018-03-22 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-9053: --- Labels: (was: test-stability) > RescalingITCase failed on travis >

[GitHub] flink pull request #5720: [FLINK-8957][tests] Port JMXJobManagerMetricTest t...

2018-03-22 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5720#discussion_r176482195 --- Diff: flink-metrics/flink-metrics-jmx/src/test/java/org/apache/flink/runtime/jobmanager/JMXJobManagerMetricTest.java --- @@ -92,28 +101,26 @@

[jira] [Commented] (FLINK-8957) Port JMXJobManagerMetricTest to flip6

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409800#comment-16409800 ] ASF GitHub Bot commented on FLINK-8957: --- Github user tillrohrmann commented on a diff in the pull

[jira] [Commented] (FLINK-8943) Jobs will not recover if DFS is temporarily unavailable

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409913#comment-16409913 ] ASF GitHub Bot commented on FLINK-8943: --- Github user sihuazhou commented on the issue:

[jira] [Commented] (FLINK-8943) Jobs will not recover if DFS is temporarily unavailable

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409907#comment-16409907 ] ASF GitHub Bot commented on FLINK-8943: --- Github user sihuazhou commented on the issue:

[GitHub] flink issue #5746: [FLINK-8943] [ha] Fail Dispatcher if jobs cannot be recov...

2018-03-22 Thread sihuazhou
Github user sihuazhou commented on the issue: https://github.com/apache/flink/pull/5746 Thanks for your reply ;) ---

[jira] [Commented] (FLINK-8943) Jobs will not recover if DFS is temporarily unavailable

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409908#comment-16409908 ] ASF GitHub Bot commented on FLINK-8943: --- Github user tillrohrmann commented on the issue:

[jira] [Commented] (FLINK-8919) Add KeyedProcessFunctionWIthCleanupState

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409918#comment-16409918 ] ASF GitHub Bot commented on FLINK-8919: --- Github user fhueske commented on a diff in the pull

[jira] [Assigned] (FLINK-9053) Exception in RecordWriter during cleanup of StreamTask with the checkpoint trigger running in parallel

2018-03-22 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber reassigned FLINK-9053: -- Assignee: Nico Kruber > Exception in RecordWriter during cleanup of StreamTask with the

[jira] [Commented] (FLINK-9053) Exception in RecordWriter during cleanup of StreamTask with the checkpoint trigger running in parallel

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409803#comment-16409803 ] ASF GitHub Bot commented on FLINK-9053: --- GitHub user NicoK opened a pull request:

[GitHub] flink pull request #5715: [FLINK-8956][tests] Port RescalingITCase to flip6

2018-03-22 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5715#discussion_r176475682 --- Diff: flink-tests/src/test/java/org/apache/flink/test/checkpointing/RescalingITCase.java --- @@ -528,54 +454,44 @@ public void

[jira] [Commented] (FLINK-8959) Port AccumulatorLiveITCase to flip6

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409777#comment-16409777 ] ASF GitHub Bot commented on FLINK-8959: --- Github user tillrohrmann commented on the issue:

[GitHub] flink pull request #5748: [FLINK-9053][runtime] only release outputs under t...

2018-03-22 Thread NicoK
GitHub user NicoK opened a pull request: https://github.com/apache/flink/pull/5748 [FLINK-9053][runtime] only release outputs under the checkpoint lock ## What is the purpose of the change Releasing an operator chain's outputs will call `RecordWriter#clearBuffers()` and

[jira] [Commented] (FLINK-8964) Port JobSubmissionFailsITCase to flip6

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409833#comment-16409833 ] ASF GitHub Bot commented on FLINK-8964: --- Github user tillrohrmann commented on a diff in the pull

[GitHub] flink pull request #5727: [FLINK-8964][tests] Port JobSubmissionFailsITCase ...

2018-03-22 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5727#discussion_r176487399 --- Diff: flink-tests/src/test/java/org/apache/flink/test/example/failing/JobSubmissionFailsITCase.java --- @@ -105,90 +85,51 @@ public

[jira] [Commented] (FLINK-8964) Port JobSubmissionFailsITCase to flip6

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409832#comment-16409832 ] ASF GitHub Bot commented on FLINK-8964: --- Github user tillrohrmann commented on a diff in the pull

[GitHub] flink pull request #5727: [FLINK-8964][tests] Port JobSubmissionFailsITCase ...

2018-03-22 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5727#discussion_r176487184 --- Diff: flink-tests/src/test/java/org/apache/flink/test/example/failing/JobSubmissionFailsITCase.java --- @@ -105,90 +85,51 @@ public

[jira] [Commented] (FLINK-9031) DataSet Job result changes when adding rebalance after union

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409899#comment-16409899 ] ASF GitHub Bot commented on FLINK-9031: --- Github user fhueske commented on the issue:

[GitHub] flink issue #5742: [FLINK-9031] Fix DataSet Union operator translation bug.

2018-03-22 Thread fhueske
Github user fhueske commented on the issue: https://github.com/apache/flink/pull/5742 Updated the PR. Tests are passing (mod an unrelated failure). ---

[GitHub] flink issue #5746: [FLINK-8943] [ha] Fail Dispatcher if jobs cannot be recov...

2018-03-22 Thread tillrohrmann
Github user tillrohrmann commented on the issue: https://github.com/apache/flink/pull/5746 Yes @sihuazhou. In such a case the JM will terminate in order to let another JM try to recover the jobs. ---

[GitHub] flink pull request #5680: [FLINK-8919] [Table API & SQL] Add KeyedProcessFun...

2018-03-22 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/5680#discussion_r176499309 --- Diff: flink-libraries/flink-table/src/test/scala/org/apache/flink/table/runtime/operators/KeyedProcessFunctionWithCleanupStateTest.scala --- @@ -0,0

[GitHub] flink issue #5740: [FLINK-9027] [web] Clean up web UI resources by installin...

2018-03-22 Thread tillrohrmann
Github user tillrohrmann commented on the issue: https://github.com/apache/flink/pull/5740 I agree that having a single shut down hook for cleaning up the temp directory is the best solution. I think that the `TaskManager` does not properly do it like you've described. The

[jira] [Commented] (FLINK-9027) Web UI does not cleanup temporary files

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409587#comment-16409587 ] ASF GitHub Bot commented on FLINK-9027: --- Github user tillrohrmann commented on the issue:

[GitHub] flink issue #5740: [FLINK-9027] [web] Clean up web UI resources by installin...

2018-03-22 Thread tillrohrmann
Github user tillrohrmann commented on the issue: https://github.com/apache/flink/pull/5740 Sounds like a good idea. ---

[jira] [Assigned] (FLINK-9055) WebUI shows job as Running although not enough resources are available

2018-03-22 Thread Sihua Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sihua Zhou reassigned FLINK-9055: - Assignee: Sihua Zhou > WebUI shows job as Running although not enough resources are available >

[jira] [Updated] (FLINK-9053) Exception in RecordWriter during cleanup of StreamTask with the checkpoint trigger running in parallel

2018-03-22 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-9053: --- Summary: Exception in RecordWriter during cleanup of StreamTask with the checkpoint trigger running

[GitHub] flink issue #5719: [FLINK-8959][tests] Port AccumulatorLiveITCase to flip6

2018-03-22 Thread tillrohrmann
Github user tillrohrmann commented on the issue: https://github.com/apache/flink/pull/5719 Good work @zentol. I guess only a rebase is missing. +1 for merging then. ---

[GitHub] flink pull request #5624: [FLINK-8402][s3][tests] fix hadoop/presto S3 IT ca...

2018-03-22 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/5624#discussion_r176492623 --- Diff: flink-filesystems/flink-s3-fs-presto/src/test/java/org/apache/flink/fs/s3presto/PrestoS3FileSystemITCase.java --- @@ -143,7 +157,20 @@ public void

[jira] [Commented] (FLINK-8402) HadoopS3FileSystemITCase.testDirectoryListing fails on Travis

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409866#comment-16409866 ] ASF GitHub Bot commented on FLINK-8402: --- Github user NicoK commented on a diff in the pull request:

[jira] [Commented] (FLINK-8402) HadoopS3FileSystemITCase.testDirectoryListing fails on Travis

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409887#comment-16409887 ] ASF GitHub Bot commented on FLINK-8402: --- Github user NicoK commented on the issue:

[GitHub] flink issue #5624: [FLINK-8402][s3][tests] fix hadoop/presto S3 IT cases for...

2018-03-22 Thread NicoK
Github user NicoK commented on the issue: https://github.com/apache/flink/pull/5624 @StephanEwen unfortunately not, for example: `org.apache.flink.runtime.fs.hdfs.HadoopFileSystem#create()` -> `org.apache.hadoop.fs.FileSystem#create()` ->

[jira] [Resolved] (FLINK-8562) Fix YARNSessionFIFOSecuredITCase

2018-03-22 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann resolved FLINK-8562. -- Resolution: Fixed Fixed via master: 37a114875afb9352e6f7b10e2729a94d0eeb72ee

[jira] [Commented] (FLINK-8562) Fix YARNSessionFIFOSecuredITCase

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409949#comment-16409949 ] ASF GitHub Bot commented on FLINK-8562: --- Github user asfgit closed the pull request at:

[GitHub] flink pull request #5416: [FLINK-8562] [Security] Fix YARNSessionFIFOSecured...

2018-03-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5416 ---

[jira] [Commented] (FLINK-9058) Relax ListState.addAll() and ListState.update() to take Iterable

2018-03-22 Thread Ken Krugler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1640#comment-1640 ] Ken Krugler commented on FLINK-9058: Would it make sense to file a related enhancement issue, for the

[jira] [Commented] (FLINK-8721) Client blocks indefinitely if job archiving fails

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16410005#comment-16410005 ] ASF GitHub Bot commented on FLINK-8721: --- Github user tillrohrmann commented on a diff in the pull

[jira] [Commented] (FLINK-8721) Client blocks indefinitely if job archiving fails

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16410010#comment-16410010 ] ASF GitHub Bot commented on FLINK-8721: --- Github user tillrohrmann commented on a diff in the pull

[jira] [Commented] (FLINK-8721) Client blocks indefinitely if job archiving fails

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16410004#comment-16410004 ] ASF GitHub Bot commented on FLINK-8721: --- Github user tillrohrmann commented on a diff in the pull

[jira] [Commented] (FLINK-8721) Client blocks indefinitely if job archiving fails

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16410009#comment-16410009 ] ASF GitHub Bot commented on FLINK-8721: --- Github user tillrohrmann commented on a diff in the pull

[jira] [Created] (FLINK-9058) Relax ListState.addAll() and ListState.update() to take Iterable

2018-03-22 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-9058: --- Summary: Relax ListState.addAll() and ListState.update() to take Iterable Key: FLINK-9058 URL: https://issues.apache.org/jira/browse/FLINK-9058 Project: Flink

[jira] [Commented] (FLINK-9058) Relax ListState.addAll() and ListState.update() to take Iterable

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409985#comment-16409985 ] ASF GitHub Bot commented on FLINK-9058: --- GitHub user aljoscha opened a pull request:

[jira] [Commented] (FLINK-8721) Client blocks indefinitely if job archiving fails

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16410007#comment-16410007 ] ASF GitHub Bot commented on FLINK-8721: --- Github user tillrohrmann commented on a diff in the pull

[jira] [Commented] (FLINK-8721) Client blocks indefinitely if job archiving fails

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16410011#comment-16410011 ] ASF GitHub Bot commented on FLINK-8721: --- Github user tillrohrmann commented on a diff in the pull

[jira] [Commented] (FLINK-8721) Client blocks indefinitely if job archiving fails

2018-03-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16410008#comment-16410008 ] ASF GitHub Bot commented on FLINK-8721: --- Github user tillrohrmann commented on a diff in the pull

  1   2   >