[jira] [Assigned] (FLINK-9202) AvroSerializer should not be serializing the target Avro type class

2018-05-14 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai reassigned FLINK-9202: -- Assignee: Tzu-Li (Gordon) Tai > AvroSerializer should not be serializing the

[jira] [Commented] (FLINK-9202) AvroSerializer should not be serializing the target Avro type class

2018-05-14 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473868#comment-16473868 ] Tzu-Li (Gordon) Tai commented on FLINK-9202: Will close this ticket, and reopen one that

[jira] [Updated] (FLINK-8987) End-to-end test: Avro state evolution

2018-05-14 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-8987: --- Priority: Blocker (was: Major) > End-to-end test: Avro state evolution >

[jira] [Commented] (FLINK-9181) Add SQL Client documentation page

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473982#comment-16473982 ] ASF GitHub Bot commented on FLINK-9181: --- Github user twalthr commented on a diff in the pull

[GitHub] flink pull request #5913: [FLINK-9181] [docs] [sql-client] Add documentation...

2018-05-14 Thread twalthr
Github user twalthr commented on a diff in the pull request: https://github.com/apache/flink/pull/5913#discussion_r187894788 --- Diff: docs/dev/table/sqlClient.md --- @@ -0,0 +1,539 @@ +--- +title: "SQL Client" +nav-parent_id: tableapi +nav-pos: 100 +is_beta:

[jira] [Commented] (FLINK-8518) Support DOW, EPOCH, DECADE for EXTRACT

2018-05-14 Thread Sergey Nuyanzin (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474000#comment-16474000 ] Sergey Nuyanzin commented on FLINK-8518: Just added DOW support + tests for it, other changes are

[jira] [Comment Edited] (FLINK-8518) Support DOW, EPOCH, DECADE for EXTRACT

2018-05-14 Thread Sergey Nuyanzin (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474000#comment-16474000 ] Sergey Nuyanzin edited comment on FLINK-8518 at 5/14/18 10:13 AM: -- Just

[jira] [Commented] (FLINK-8659) Add migration tests for Broadcast state.

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473871#comment-16473871 ] ASF GitHub Bot commented on FLINK-8659: --- Github user kl0u commented on the issue:

[jira] [Commented] (FLINK-9201) same merge window will be fired twice if watermark already passed the merge window

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473891#comment-16473891 ] ASF GitHub Bot commented on FLINK-9201: --- Github user aljoscha commented on a diff in the pull

[GitHub] flink pull request #5917: [FLINK-9201] Fixed the same merge window will be f...

2018-05-14 Thread aljoscha
Github user aljoscha commented on a diff in the pull request: https://github.com/apache/flink/pull/5917#discussion_r187865922 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/windowing/triggers/ProcessingTimeTrigger.java --- @@ -60,7 +60,12 @@ public

[jira] [Updated] (FLINK-9320) Update `test-ha.sh` end-to-end test to use general purpose DataStream job

2018-05-14 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-9320: --- Priority: Critical (was: Blocker) > Update `test-ha.sh` end-to-end test to use

[jira] [Updated] (FLINK-9320) Update `test-ha.sh` end-to-end test to use general purpose DataStream job

2018-05-14 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-9320: --- Priority: Blocker (was: Major) > Update `test-ha.sh` end-to-end test to use general

[jira] [Updated] (FLINK-9320) Update `test-ha.sh` end-to-end test to use general purpose DataStream job

2018-05-14 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-9320: --- Fix Version/s: 1.5.1 1.6.0 > Update `test-ha.sh` end-to-end test

[jira] [Updated] (FLINK-8987) End-to-end test: Avro state evolution

2018-05-14 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-8987: --- Fix Version/s: 1.5.1 1.6.0 > End-to-end test: Avro state evolution

[jira] [Commented] (FLINK-9351) RM stop assigning slot to Job because the TM killed before connecting to JM successfully

2018-05-14 Thread Sihua Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473980#comment-16473980 ] Sihua Zhou commented on FLINK-9351: --- Hi [~till.rohrmann] Do you mind if I take this ticket? If not, I'd

[jira] [Issue Comment Deleted] (FLINK-9008) End-to-end test: Quickstarts

2018-05-14 Thread mingleizhang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingleizhang updated FLINK-9008: Comment: was deleted (was: Hi, [~till.rohrmann] I would like to confirm one stuff with you here for

[GitHub] flink pull request #5676: [FLINK-8910][tests] Automated end-to-end test for ...

2018-05-14 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/5676#discussion_r187843886 --- Diff: flink-end-to-end-tests/test-scripts/test_local_recovery_and_scheduling.sh --- @@ -0,0 +1,115 @@ +#!/usr/bin/env bash +

[GitHub] flink pull request #5676: [FLINK-8910][tests] Automated end-to-end test for ...

2018-05-14 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/5676#discussion_r187842776 --- Diff: flink-core/src/main/java/org/apache/flink/configuration/JobManagerOptions.java --- @@ -140,7 +140,8 @@ public static final

[GitHub] flink pull request #5676: [FLINK-8910][tests] Automated end-to-end test for ...

2018-05-14 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/5676#discussion_r187844104 --- Diff: flink-end-to-end-tests/test-scripts/test_local_recovery_and_scheduling.sh --- @@ -0,0 +1,115 @@ +#!/usr/bin/env bash +

[GitHub] flink issue #6002: [FLINK-9350] Parameter baseInterval has wrong check messa...

2018-05-14 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/6002 Good fix, thanks. +1 to merge ---

[jira] [Commented] (FLINK-9325) generate the _meta file for checkpoint only when the writing is truly successful

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473870#comment-16473870 ] ASF GitHub Bot commented on FLINK-9325: --- Github user sihuazhou commented on the issue:

[GitHub] flink issue #5955: [FLINK-8659] Add migration itcases for broadcast state.

2018-05-14 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/5955 Could you review it @tzulitai ? ---

[jira] [Commented] (FLINK-9355) Simplify configuration of local recovery to a simple on/off

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473989#comment-16473989 ] ASF GitHub Bot commented on FLINK-9355: --- Github user zentol commented on the issue:

[jira] [Assigned] (FLINK-3952) Bump Netty to 4.1

2018-05-14 Thread Piotr Nowojski (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-3952: - Assignee: Piotr Nowojski > Bump Netty to 4.1 > - > >

[jira] [Resolved] (FLINK-9202) AvroSerializer should not be serializing the target Avro type class

2018-05-14 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai resolved FLINK-9202. Resolution: Not A Problem > AvroSerializer should not be serializing the target

[GitHub] flink issue #6001: [FLINK-9299] ProcessWindowFunction documentation Java exa...

2018-05-14 Thread yanghua
Github user yanghua commented on the issue: https://github.com/apache/flink/pull/6001 cc @fhueske changed and fixed a remained error before ---

[jira] [Commented] (FLINK-9299) ProcessWindowFunction documentation Java examples have errors

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473923#comment-16473923 ] ASF GitHub Bot commented on FLINK-9299: --- Github user yanghua commented on the issue:

[jira] [Created] (FLINK-9354) print execution times for end-to-end tests

2018-05-14 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-9354: --- Summary: print execution times for end-to-end tests Key: FLINK-9354 URL: https://issues.apache.org/jira/browse/FLINK-9354 Project: Flink Issue Type:

[GitHub] flink issue #5982: [FLINK-9325][checkpoint]generate the meta file for checkp...

2018-05-14 Thread sihuazhou
Github user sihuazhou commented on the issue: https://github.com/apache/flink/pull/5982 @StephanEwen After thinking your comments again, I think I misunderstood the `Also, we need this method to be implemented in all FileSystem subclasses.` 😭 , I will address that. But the

[jira] [Commented] (FLINK-9325) generate the _meta file for checkpoint only when the writing is truly successful

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473941#comment-16473941 ] ASF GitHub Bot commented on FLINK-9325: --- Github user sihuazhou commented on the issue:

[jira] [Assigned] (FLINK-9354) print execution times for end-to-end tests

2018-05-14 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler reassigned FLINK-9354: --- Assignee: Chesnay Schepler > print execution times for end-to-end tests >

[GitHub] flink pull request #6005: [FLINK-9176][tests] Remove category annotations

2018-05-14 Thread zentol
GitHub user zentol opened a pull request: https://github.com/apache/flink/pull/6005 [FLINK-9176][tests] Remove category annotations Subsumes #5851. ## What is the purpose of the change This PR removes the category annotations that were once used to selectively

[jira] [Commented] (FLINK-9176) Category annotations are unused

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473954#comment-16473954 ] ASF GitHub Bot commented on FLINK-9176: --- GitHub user zentol opened a pull request:

[jira] [Created] (FLINK-9355) Simplify configuration of local recovery to a simple on/off

2018-05-14 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-9355: - Summary: Simplify configuration of local recovery to a simple on/off Key: FLINK-9355 URL: https://issues.apache.org/jira/browse/FLINK-9355 Project: Flink

[GitHub] flink pull request #5676: [FLINK-8910][tests] Automated end-to-end test for ...

2018-05-14 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/5676#discussion_r187845478 --- Diff:

[jira] [Commented] (FLINK-8910) Introduce automated end-to-end test for local recovery (including sticky scheduling)

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473807#comment-16473807 ] ASF GitHub Bot commented on FLINK-8910: --- Github user tzulitai commented on a diff in the pull

[jira] [Commented] (FLINK-8910) Introduce automated end-to-end test for local recovery (including sticky scheduling)

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473804#comment-16473804 ] ASF GitHub Bot commented on FLINK-8910: --- Github user tzulitai commented on a diff in the pull

[jira] [Commented] (FLINK-8910) Introduce automated end-to-end test for local recovery (including sticky scheduling)

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473806#comment-16473806 ] ASF GitHub Bot commented on FLINK-8910: --- Github user tzulitai commented on a diff in the pull

[jira] [Commented] (FLINK-8910) Introduce automated end-to-end test for local recovery (including sticky scheduling)

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473805#comment-16473805 ] ASF GitHub Bot commented on FLINK-8910: --- Github user tzulitai commented on a diff in the pull

[GitHub] flink issue #6002: [FLINK-9350] Parameter baseInterval has wrong check messa...

2018-05-14 Thread yanghua
Github user yanghua commented on the issue: https://github.com/apache/flink/pull/6002 cc @tzulitai ---

[jira] [Reopened] (FLINK-9202) AvroSerializer should not be serializing the target Avro type class

2018-05-14 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reopened FLINK-9202: - reopen to remove {{fixVersion}} > AvroSerializer should not be serializing the target Avro

[jira] [Closed] (FLINK-9202) AvroSerializer should not be serializing the target Avro type class

2018-05-14 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-9202. --- Resolution: Not A Problem Fix Version/s: (was: 1.6.0) > AvroSerializer should not

[jira] [Commented] (FLINK-9299) ProcessWindowFunction documentation Java examples have errors

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473912#comment-16473912 ] ASF GitHub Bot commented on FLINK-9299: --- Github user fhueske commented on a diff in the pull

[GitHub] flink pull request #6001: [FLINK-9299] ProcessWindowFunction documentation J...

2018-05-14 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/6001#discussion_r187871263 --- Diff: docs/dev/stream/operators/windows.md --- @@ -883,7 +883,7 @@ private static class AverageAggregate @Override public Double

[jira] [Updated] (FLINK-9008) End-to-end test: Quickstarts

2018-05-14 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-9008: --- Fix Version/s: (was: 1.5.0) 1.6.0 > End-to-end test:

[jira] [Updated] (FLINK-9008) End-to-end test: Quickstarts

2018-05-14 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-9008: --- Priority: Blocker (was: Critical) > End-to-end test: Quickstarts >

[jira] [Updated] (FLINK-8974) End-to-end test: Run general purpose DataSet job with failures in standalone mode

2018-05-14 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-8974: --- Priority: Blocker (was: Critical) > End-to-end test: Run general purpose DataSet job

[jira] [Updated] (FLINK-8974) End-to-end test: Run general purpose DataSet job with failures in standalone mode

2018-05-14 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-8974: --- Fix Version/s: (was: 1.5.0) 1.6.0 > End-to-end test: Run

[GitHub] flink issue #6006: [FLINK-9355][checkpointing] Simplify configuration of loc...

2018-05-14 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/6006 You have to regenerate the config docs, instructions can be found [here](https://github.com/apache/flink/blob/master/flink-docs/README.md). ---

[jira] [Commented] (FLINK-9337) Implement AvroDeserializationSchema

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473860#comment-16473860 ] ASF GitHub Bot commented on FLINK-9337: --- Github user StephanEwen commented on the issue:

[GitHub] flink issue #5995: [FLINK-9337] Implemented AvroDeserializationSchema

2018-05-14 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/5995 Thanks, the main code looks good! Unfortunately, this seems to wither break the compatibility with prior savepoints (when Avro types were implicitly handled through Kryo, now bridged

[jira] [Commented] (FLINK-9299) ProcessWindowFunction documentation Java examples have errors

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473913#comment-16473913 ] ASF GitHub Bot commented on FLINK-9299: --- Github user fhueske commented on the issue:

[GitHub] flink issue #6001: [FLINK-9299] ProcessWindowFunction documentation Java exa...

2018-05-14 Thread fhueske
Github user fhueske commented on the issue: https://github.com/apache/flink/pull/6001 Thanks for the fix @yanghua. I left a minor comment. Otherwise +1 to merge. ---

[jira] [Commented] (FLINK-9181) Add SQL Client documentation page

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473929#comment-16473929 ] ASF GitHub Bot commented on FLINK-9181: --- Github user twalthr commented on a diff in the pull

[GitHub] flink pull request #5913: [FLINK-9181] [docs] [sql-client] Add documentation...

2018-05-14 Thread twalthr
Github user twalthr commented on a diff in the pull request: https://github.com/apache/flink/pull/5913#discussion_r187876131 --- Diff: docs/dev/table/sqlClient.md --- @@ -0,0 +1,538 @@ +--- +title: "SQL Client" +nav-parent_id: tableapi +nav-pos: 100 +is_beta:

[jira] [Commented] (FLINK-9355) Simplify configuration of local recovery to a simple on/off

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473965#comment-16473965 ] ASF GitHub Bot commented on FLINK-9355: --- Github user StefanRRichter commented on the issue:

[GitHub] flink pull request #6006: [FLINK-9355][checkpointing] Simplify configuration...

2018-05-14 Thread StefanRRichter
GitHub user StefanRRichter opened a pull request: https://github.com/apache/flink/pull/6006 [FLINK-9355][checkpointing] Simplify configuration of local recovery … …to a simple on/off switch ## What is the purpose of the change This PR makes the configuration of

[GitHub] flink pull request #5917: [FLINK-9201] Fixed the same merge window will be f...

2018-05-14 Thread hzyuemeng1
Github user hzyuemeng1 commented on a diff in the pull request: https://github.com/apache/flink/pull/5917#discussion_r187887606 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/windowing/triggers/ProcessingTimeTrigger.java --- @@ -60,7 +60,12 @@ public

[GitHub] flink issue #6006: [FLINK-9355][checkpointing] Simplify configuration of loc...

2018-05-14 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/6006 CC @tillrohrmann ---

[jira] [Updated] (FLINK-9355) Simplify configuration of local recovery to a simple on/off

2018-05-14 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann updated FLINK-9355: - Fix Version/s: 1.5.0 > Simplify configuration of local recovery to a simple on/off >

[jira] [Commented] (FLINK-9350) Parameter baseInterval has wrong check message in CheckpointCoordinator constructor

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473826#comment-16473826 ] ASF GitHub Bot commented on FLINK-9350: --- Github user yanghua commented on the issue:

[GitHub] flink issue #5982: [FLINK-9325][checkpoint]generate the meta file for checkp...

2018-05-14 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/5982 Thanks for preparing this. I looked at the `TwoPhraseFSDatautputStream` - maybe we can make this simpler. Do we need the distinction between phases? Is it not enough to behave as a

[jira] [Commented] (FLINK-9325) generate the _meta file for checkpoint only when the writing is truly successful

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473859#comment-16473859 ] ASF GitHub Bot commented on FLINK-9325: --- Github user StephanEwen commented on the issue:

[jira] [Commented] (FLINK-8518) Support DOW, EPOCH, DECADE for EXTRACT

2018-05-14 Thread Timo Walther (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473882#comment-16473882 ] Timo Walther commented on FLINK-8518: - Hi [~Sergey Nuyanzin], if we are blocked on CALCITE-2303 we

[jira] [Commented] (FLINK-9201) same merge window will be fired twice if watermark already passed the merge window

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473966#comment-16473966 ] ASF GitHub Bot commented on FLINK-9201: --- Github user hzyuemeng1 commented on a diff in the pull

[jira] [Commented] (FLINK-8989) End-to-end test: ElasticSearch connector

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473818#comment-16473818 ] ASF GitHub Bot commented on FLINK-8989: --- Github user tzulitai commented on a diff in the pull

[jira] [Commented] (FLINK-8989) End-to-end test: ElasticSearch connector

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473820#comment-16473820 ] ASF GitHub Bot commented on FLINK-8989: --- Github user tzulitai commented on a diff in the pull

[jira] [Commented] (FLINK-8989) End-to-end test: ElasticSearch connector

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473821#comment-16473821 ] ASF GitHub Bot commented on FLINK-8989: --- Github user tzulitai commented on a diff in the pull

[jira] [Commented] (FLINK-8989) End-to-end test: ElasticSearch connector

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473823#comment-16473823 ] ASF GitHub Bot commented on FLINK-8989: --- Github user tzulitai commented on a diff in the pull

[jira] [Commented] (FLINK-8989) End-to-end test: ElasticSearch connector

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473822#comment-16473822 ] ASF GitHub Bot commented on FLINK-8989: --- Github user tzulitai commented on a diff in the pull

[jira] [Commented] (FLINK-8989) End-to-end test: ElasticSearch connector

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473819#comment-16473819 ] ASF GitHub Bot commented on FLINK-8989: --- Github user tzulitai commented on a diff in the pull

[jira] [Commented] (FLINK-8989) End-to-end test: ElasticSearch connector

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473817#comment-16473817 ] ASF GitHub Bot commented on FLINK-8989: --- Github user tzulitai commented on a diff in the pull

[jira] [Commented] (FLINK-8989) End-to-end test: ElasticSearch connector

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473824#comment-16473824 ] ASF GitHub Bot commented on FLINK-8989: --- Github user tzulitai commented on a diff in the pull

[jira] [Commented] (FLINK-9350) Parameter baseInterval has wrong check message in CheckpointCoordinator constructor

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473861#comment-16473861 ] ASF GitHub Bot commented on FLINK-9350: --- Github user StephanEwen commented on the issue:

[GitHub] flink issue #5982: [FLINK-9325][checkpoint]generate the meta file for checkp...

2018-05-14 Thread sihuazhou
Github user sihuazhou commented on the issue: https://github.com/apache/flink/pull/5982 Hi @StephanEwen Thank you very much for your reply, I'm not sure whether just overriding `close()` to do `super.close()` + `rename()` is enough, for example. ``` try (outputStream = new

[jira] [Created] (FLINK-9352) In Standalone checkpoint recover mode many jobs with same checkpoint interval cause IO pressure

2018-05-14 Thread vinoyang (JIRA)
vinoyang created FLINK-9352: --- Summary: In Standalone checkpoint recover mode many jobs with same checkpoint interval cause IO pressure Key: FLINK-9352 URL: https://issues.apache.org/jira/browse/FLINK-9352

[GitHub] flink pull request #5917: [FLINK-9201] Fixed the same merge window will be f...

2018-05-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5917 ---

[GitHub] flink issue #5917: [FLINK-9201] Fixed the same merge window will be fired tw...

2018-05-14 Thread aljoscha
Github user aljoscha commented on the issue: https://github.com/apache/flink/pull/5917 Thanks @hzyuemeng1 for finding and fixing this. 👍 ---

[jira] [Commented] (FLINK-9201) same merge window will be fired twice if watermark already passed the merge window

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473902#comment-16473902 ] ASF GitHub Bot commented on FLINK-9201: --- Github user aljoscha commented on the issue:

[jira] [Closed] (FLINK-9201) same merge window will be fired twice if watermark already passed the merge window

2018-05-14 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-9201. --- Resolution: Fixed Fix Version/s: (was: 1.6.0) 1.5.0

[jira] [Commented] (FLINK-9201) same merge window will be fired twice if watermark already passed the merge window

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473903#comment-16473903 ] ASF GitHub Bot commented on FLINK-9201: --- Github user asfgit closed the pull request at:

[jira] [Updated] (FLINK-9353) End-to-end test: Kubernetes integration

2018-05-14 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-9353: Issue Type: Sub-task (was: Improvement) Parent: FLINK-8970 > End-to-end test:

[jira] [Updated] (FLINK-8910) Introduce automated end-to-end test for local recovery (including sticky scheduling)

2018-05-14 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-8910: --- Priority: Blocker (was: Major) > Introduce automated end-to-end test for local

[jira] [Commented] (FLINK-9353) End-to-end test: Kubernetes integration

2018-05-14 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473935#comment-16473935 ] Tzu-Li (Gordon) Tai commented on FLINK-9353: Can we move this to

[jira] [Updated] (FLINK-8910) Introduce automated end-to-end test for local recovery (including sticky scheduling)

2018-05-14 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-8910: --- Fix Version/s: (was: 1.5.0) 1.6.0 > Introduce automated

[jira] [Commented] (FLINK-9355) Simplify configuration of local recovery to a simple on/off

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473964#comment-16473964 ] ASF GitHub Bot commented on FLINK-9355: --- GitHub user StefanRRichter opened a pull request:

[jira] [Updated] (FLINK-9351) RM stop assigning slot to Job because the TM killed before connecting to JM successfully

2018-05-14 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann updated FLINK-9351: - Fix Version/s: 1.6.0 > RM stop assigning slot to Job because the TM killed before connecting to

[jira] [Commented] (FLINK-8518) Support DOW, EPOCH, DECADE for EXTRACT

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473987#comment-16473987 ] ASF GitHub Bot commented on FLINK-8518: --- GitHub user snuyanzin opened a pull request:

[GitHub] flink pull request #6007: [FLINK-8518][Table API & SQL] Support DOW, EPOCH, ...

2018-05-14 Thread snuyanzin
GitHub user snuyanzin opened a pull request: https://github.com/apache/flink/pull/6007 [FLINK-8518][Table API & SQL] Support DOW, EPOCH, DECADE for EXTRACT dow extraction support implemented + tests *Thank you very much for contributing to Apache Flink - we are happy

[GitHub] flink pull request #5761: [FLINK-8989] [e2eTests] Elasticsearch1&2&5 end to ...

2018-05-14 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/5761#discussion_r187847923 --- Diff: flink-end-to-end-tests/test-scripts/test_streaming_elasticsearch1.sh --- @@ -0,0 +1,66 @@ +#!/usr/bin/env bash

[GitHub] flink pull request #5761: [FLINK-8989] [e2eTests] Elasticsearch1&2&5 end to ...

2018-05-14 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/5761#discussion_r187847421 --- Diff: flink-end-to-end-tests/flink-elasticsearch1-test/src/main/java/org/apache/flink/elasticsearch1/test/Elasticsearch1SinkExample.java --- @@ -15,10

[GitHub] flink pull request #5761: [FLINK-8989] [e2eTests] Elasticsearch1&2&5 end to ...

2018-05-14 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/5761#discussion_r187848661 --- Diff: flink-end-to-end-tests/test-scripts/test_streaming_elasticsearch1.sh --- @@ -0,0 +1,66 @@ +#!/usr/bin/env bash

[GitHub] flink pull request #5761: [FLINK-8989] [e2eTests] Elasticsearch1&2&5 end to ...

2018-05-14 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/5761#discussion_r187847586 --- Diff: flink-end-to-end-tests/flink-elasticsearch2-test/pom.xml --- @@ -0,0 +1,140 @@ + + +http://maven.apache.org/POM/4.0.0; +

[GitHub] flink pull request #5761: [FLINK-8989] [e2eTests] Elasticsearch1&2&5 end to ...

2018-05-14 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/5761#discussion_r187847815 --- Diff: flink-end-to-end-tests/run-pre-commit-tests.sh --- @@ -53,6 +53,30 @@ if [ $EXIT_CODE == 0 ]; then EXIT_CODE=$? fi +if [

[GitHub] flink pull request #5761: [FLINK-8989] [e2eTests] Elasticsearch1&2&5 end to ...

2018-05-14 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/5761#discussion_r187848008 --- Diff: flink-end-to-end-tests/test-scripts/test_streaming_elasticsearch1.sh --- @@ -0,0 +1,66 @@ +#!/usr/bin/env bash

[GitHub] flink pull request #5761: [FLINK-8989] [e2eTests] Elasticsearch1&2&5 end to ...

2018-05-14 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/5761#discussion_r187847498 --- Diff: flink-end-to-end-tests/flink-elasticsearch1-test/src/main/java/org/apache/flink/elasticsearch1/test/Elasticsearch1SinkExample.java --- @@ -37,20

[GitHub] flink pull request #5761: [FLINK-8989] [e2eTests] Elasticsearch1&2&5 end to ...

2018-05-14 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/5761#discussion_r187848355 --- Diff: flink-end-to-end-tests/test-scripts/test_streaming_elasticsearch1.sh --- @@ -0,0 +1,66 @@ +#!/usr/bin/env bash

[jira] [Commented] (FLINK-9305) Register flink-s3-fs-hadoop for the s3a:// scheme as well

2018-05-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473849#comment-16473849 ] ASF GitHub Bot commented on FLINK-9305: --- Github user StephanEwen commented on the issue:

[GitHub] flink issue #5963: [FLINK-9305][s3] also register flink-s3-fs-hadoop's facto...

2018-05-14 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/5963 Looks good, thanks. +1 to merge ---

[jira] [Created] (FLINK-9353) End-to-end test: Kubernetes integration

2018-05-14 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-9353: --- Summary: End-to-end test: Kubernetes integration Key: FLINK-9353 URL: https://issues.apache.org/jira/browse/FLINK-9353 Project: Flink Issue Type:

  1   2   3   >