[jira] [Commented] (FLINK-9190) YarnResourceManager sometimes does not request new Containers

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463386#comment-16463386 ] ASF GitHub Bot commented on FLINK-9190: --- Github user shuai-xu commented on the issue:

[GitHub] flink issue #5931: [FLINK-9190][flip6,yarn] Request new container if contain...

2018-05-03 Thread shuai-xu
Github user shuai-xu commented on the issue: https://github.com/apache/flink/pull/5931 @GJL In blink, we solve this problem like this. When a container complete, we will first whether the container has registered yet, if it has registered before, RM will not request a new

[jira] [Commented] (FLINK-9169) NPE when restoring from old savepoint and state serializer could not be deserialized

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463384#comment-16463384 ] ASF GitHub Bot commented on FLINK-9169: --- Github user tzulitai commented on the issue:

[GitHub] flink issue #5950: [FLINK-9169] [state-backend] Allow absence of old seriali...

2018-05-03 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/5950 I think even with the `UnloadableTypeSerializerException` exception bubbling approach, we actually still need a flag in the serialization proxy to decide how to handle the exception. The

[GitHub] flink issue #5950: [FLINK-9169] [state-backend] Allow absence of old seriali...

2018-05-03 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/5950 @StefanRRichter yes, now that you mentioned it, the `isSerializerPresenceRequiredFlag` does seem a bit awkward to be in the serialization proxy. Essentially, what it is only doing is serving as a

[jira] [Commented] (FLINK-9169) NPE when restoring from old savepoint and state serializer could not be deserialized

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463363#comment-16463363 ] ASF GitHub Bot commented on FLINK-9169: --- Github user tzulitai commented on the issue:

[jira] [Updated] (FLINK-9294) Improve type inference for UDFs with composite parameter or result type

2018-05-03 Thread Rong Rong (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rong Rong updated FLINK-9294: - Description: Most of the UDF function signatures that includes composite types such as *{{MAP}}*,

[jira] [Updated] (FLINK-9294) Improve type inference for UDFs with composite parameter or result type

2018-05-03 Thread Rong Rong (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rong Rong updated FLINK-9294: - Description: Most of the UDF function signatures that includes composite types such as *{{MAP}}*,

[jira] [Comment Edited] (FLINK-7795) Utilize error-prone to discover common coding mistakes

2018-05-03 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345955#comment-16345955 ] Ted Yu edited comment on FLINK-7795 at 5/3/18 11:40 PM: error-prone has JDK 8

[jira] [Assigned] (FLINK-8554) Upgrade AWS SDK

2018-05-03 Thread vinoyang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned FLINK-8554: --- Assignee: vinoyang > Upgrade AWS SDK > --- > > Key: FLINK-8554 >

[jira] [Closed] (FLINK-6719) Add details about fault-tolerance of timers to ProcessFunction docs

2018-05-03 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske closed FLINK-6719. Resolution: Fixed Fix Version/s: (was: 1.5.1) (was: 1.6.0)

[jira] [Commented] (FLINK-6719) Add details about fault-tolerance of timers to ProcessFunction docs

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463147#comment-16463147 ] ASF GitHub Bot commented on FLINK-6719: --- Github user asfgit closed the pull request at:

[GitHub] flink pull request #5887: [FLINK-6719] [docs] Add details about fault-tolera...

2018-05-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5887 ---

[jira] [Resolved] (FLINK-9293) SlotPool should check slot id when accepting a slot offer with existing allocation id

2018-05-03 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-9293. - Resolution: Fixed Fixed in - 1.5.0 via df1eda8646a769b419388db2cf699cc53b009849 - 1.6.0 via

[jira] [Closed] (FLINK-9293) SlotPool should check slot id when accepting a slot offer with existing allocation id

2018-05-03 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-9293. --- > SlotPool should check slot id when accepting a slot offer with existing > allocation id >

[jira] [Commented] (FLINK-9293) SlotPool should check slot id when accepting a slot offer with existing allocation id

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463122#comment-16463122 ] ASF GitHub Bot commented on FLINK-9293: --- Github user asfgit closed the pull request at:

[GitHub] flink pull request #5951: [FLINK-9293] [runtime] SlotPool should check slot ...

2018-05-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5951 ---

[jira] [Commented] (FLINK-9141) Calling getSideOutput() and split() on one DataStream causes NPE

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463093#comment-16463093 ] ASF GitHub Bot commented on FLINK-9141: --- Github user fhueske commented on a diff in the pull

[jira] [Commented] (FLINK-9141) Calling getSideOutput() and split() on one DataStream causes NPE

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463092#comment-16463092 ] ASF GitHub Bot commented on FLINK-9141: --- Github user fhueske commented on a diff in the pull

[GitHub] flink pull request #5836: [FLINK-9141][datastream] Fail early when using bot...

2018-05-03 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/5836#discussion_r185942219 --- Diff: flink-streaming-java/src/test/java/org/apache/flink/streaming/api/datastream/SplitSideOutputTest.java --- @@ -0,0 +1,75 @@ +/* + *

[GitHub] flink pull request #5836: [FLINK-9141][datastream] Fail early when using bot...

2018-05-03 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/5836#discussion_r185942147 --- Diff: flink-streaming-java/src/test/java/org/apache/flink/streaming/api/datastream/SplitSideOutputTest.java --- @@ -0,0 +1,75 @@ +/* + *

[jira] [Comment Edited] (FLINK-6105) Properly handle InterruptedException in HadoopInputFormatBase

2018-05-03 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16307281#comment-16307281 ] Ted Yu edited comment on FLINK-6105 at 5/3/18 9:24 PM: --- In

[jira] [Commented] (FLINK-8726) Code highlighting partially broken

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463056#comment-16463056 ] ASF GitHub Bot commented on FLINK-8726: --- Github user asfgit closed the pull request at:

[GitHub] flink pull request #5909: [FLINK-8726][docs] Fix and normalize code-highligh...

2018-05-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5909 ---

[jira] [Closed] (FLINK-8726) Code highlighting partially broken

2018-05-03 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler closed FLINK-8726. --- Resolution: Fixed master: b13c70b60b04e0d51604d0e37868612f77e86299 1.5:

[GitHub] flink issue #5909: [FLINK-8726][docs] Fix and normalize code-highlighting

2018-05-03 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/5909 merging. ---

[jira] [Commented] (FLINK-8726) Code highlighting partially broken

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463052#comment-16463052 ] ASF GitHub Bot commented on FLINK-8726: --- Github user zentol commented on the issue:

[jira] [Commented] (FLINK-8237) BucketingSink throws NPE when Writer.duplicate returns null

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463037#comment-16463037 ] ASF GitHub Bot commented on FLINK-8237: --- Github user fhueske commented on the issue:

[GitHub] flink issue #5927: [FLINK-8237] [BucketingSink] Better error message added

2018-05-03 Thread fhueske
Github user fhueske commented on the issue: https://github.com/apache/flink/pull/5927 Thanks for the PR @pavel-shvetsov-git! I've left a suggestion to improve the error message. Afterwards the PR should be good to merge. ---

[jira] [Commented] (FLINK-8237) BucketingSink throws NPE when Writer.duplicate returns null

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463035#comment-16463035 ] ASF GitHub Bot commented on FLINK-8237: --- Github user fhueske commented on a diff in the pull

[GitHub] flink pull request #5927: [FLINK-8237] [BucketingSink] Better error message ...

2018-05-03 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/5927#discussion_r185932952 --- Diff: flink-connectors/flink-connector-filesystem/src/main/java/org/apache/flink/streaming/connectors/fs/bucketing/BucketingSink.java --- @@ -550,6

[jira] [Commented] (FLINK-8726) Code highlighting partially broken

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463025#comment-16463025 ] ASF GitHub Bot commented on FLINK-8726: --- Github user fhueske commented on the issue:

[GitHub] flink issue #5909: [FLINK-8726][docs] Fix and normalize code-highlighting

2018-05-03 Thread fhueske
Github user fhueske commented on the issue: https://github.com/apache/flink/pull/5909 Thanks for cleaning up the syntax highlighting @zentol! +1 to merge ---

[jira] [Commented] (FLINK-8978) End-to-end test: Job upgrade

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462758#comment-16462758 ] ASF GitHub Bot commented on FLINK-8978: --- Github user azagrebin commented on the issue:

[GitHub] flink issue #5947: [FLINK-8978] Stateful generic stream job upgrade e2e test

2018-05-03 Thread azagrebin
Github user azagrebin commented on the issue: https://github.com/apache/flink/pull/5947 agree, I added constant check of previous non-null state into its update method ---

[jira] [Updated] (FLINK-9295) FlinkKafkaProducer011 sometimes throws ProducerFencedExceptions when in EXACTLY_ONCE mode

2018-05-03 Thread Christopher Ng (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christopher Ng updated FLINK-9295: -- Description: {{FlinkKafkaProducer011}} can throw {{ProducerFencedExceptions}} if multiple

[jira] [Updated] (FLINK-9295) FlinkKafkaProducer011 sometimes throws ProducerFencedExceptions when in EXACTLY_ONCE mode

2018-05-03 Thread Christopher Ng (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christopher Ng updated FLINK-9295: -- Description: {{FlinkKafkaProducer011}} can throw {{ProducerFencedExceptions}} if multiple

[jira] [Created] (FLINK-9295) FlinkKafkaProducer011 sometimes throws ProducerFencedExceptions when in EXACTLY_ONCE mode

2018-05-03 Thread Christopher Ng (JIRA)
Christopher Ng created FLINK-9295: - Summary: FlinkKafkaProducer011 sometimes throws ProducerFencedExceptions when in EXACTLY_ONCE mode Key: FLINK-9295 URL: https://issues.apache.org/jira/browse/FLINK-9295

[jira] [Commented] (FLINK-9293) SlotPool should check slot id when accepting a slot offer with existing allocation id

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462665#comment-16462665 ] ASF GitHub Bot commented on FLINK-9293: --- Github user StephanEwen commented on the issue:

[GitHub] flink issue #5951: [FLINK-9293] [runtime] SlotPool should check slot id when...

2018-05-03 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/5951 Good catch! Thank you for the PR. Will try to review this asap... ---

[jira] [Commented] (FLINK-9235) Add Integration test for Flink-Yarn-Kerberos integration for flip-6

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462643#comment-16462643 ] ASF GitHub Bot commented on FLINK-9235: --- Github user aljoscha commented on the issue:

[jira] [Commented] (FLINK-9235) Add Integration test for Flink-Yarn-Kerberos integration for flip-6

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462641#comment-16462641 ] ASF GitHub Bot commented on FLINK-9235: --- Github user aljoscha commented on the issue:

[GitHub] flink issue #5953: [FLINK-9235] Add Integration test for Flink-Yarn-Kerberos...

2018-05-03 Thread aljoscha
Github user aljoscha commented on the issue: https://github.com/apache/flink/pull/5953 R: @zentol @suez1224 At least the secured ITCase is currently failing for legacy mode. Investigating... ---

[GitHub] flink issue #5901: [FLINK-9235][Security] Add integration tests for YARN ker...

2018-05-03 Thread aljoscha
Github user aljoscha commented on the issue: https://github.com/apache/flink/pull/5901 @suez1224 I did an alternative version in #5953. All YARN tests currently have the problem that they are only executed with the "new" (FLIP-6) mode or legacy mode (only the secured IT Case). In my

[jira] [Updated] (FLINK-9294) Improve type inference for UDFs with composite parameter or result type

2018-05-03 Thread Rong Rong (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rong Rong updated FLINK-9294: - Description: Most of the UDF function signatures that includes composite types such as *{{MAP}}*,

[jira] [Assigned] (FLINK-9294) Improve type inference for UDFs with composite parameter or result type

2018-05-03 Thread Rong Rong (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rong Rong reassigned FLINK-9294: Assignee: Rong Rong > Improve type inference for UDFs with composite parameter or result type >

[jira] [Updated] (FLINK-9294) Improve type inference for UDFs with composite parameter or result type

2018-05-03 Thread Rong Rong (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rong Rong updated FLINK-9294: - Description: Most of the UDF function signatures that includes composite types such as

[jira] [Updated] (FLINK-9294) Improve type inference for UDFs with composite parameter or result type

2018-05-03 Thread Rong Rong (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rong Rong updated FLINK-9294: - Description: Most of the UDF function signatures that includes composite types such as

[jira] [Updated] (FLINK-9294) Improve type inference for UDFs with composite parameter or result type

2018-05-03 Thread Rong Rong (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rong Rong updated FLINK-9294: - Description: Most of the UDF function signatures that includes composite types such as {code}MAP{/code}

[jira] [Updated] (FLINK-9294) Improve type inference for UDFs with composite parameter or result type

2018-05-03 Thread Rong Rong (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rong Rong updated FLINK-9294: - Description: For now most of the UDF function signatures that includes composite types such as {{MAP}}

[jira] [Created] (FLINK-9294) Improve type inference for UDFs with composite parameter or result type

2018-05-03 Thread Rong Rong (JIRA)
Rong Rong created FLINK-9294: Summary: Improve type inference for UDFs with composite parameter or result type Key: FLINK-9294 URL: https://issues.apache.org/jira/browse/FLINK-9294 Project: Flink

[jira] [Commented] (FLINK-9235) Add Integration test for Flink-Yarn-Kerberos integration for flip-6

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462615#comment-16462615 ] ASF GitHub Bot commented on FLINK-9235: --- GitHub user aljoscha opened a pull request:

[GitHub] flink pull request #5953: [FLINK-9235] Add Integration test for Flink-Yarn-K...

2018-05-03 Thread aljoscha
GitHub user aljoscha opened a pull request: https://github.com/apache/flink/pull/5953 [FLINK-9235] Add Integration test for Flink-Yarn-Kerberos integration for flip-6 Alternative version of #5901 You can merge this pull request into a Git repository by running: $ git pull

[jira] [Commented] (FLINK-8978) End-to-end test: Job upgrade

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462608#comment-16462608 ] ASF GitHub Bot commented on FLINK-8978: --- Github user StefanRRichter commented on the issue:

[GitHub] flink issue #5947: [FLINK-8978] Stateful generic stream job upgrade e2e test

2018-05-03 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/5947 Please also double check, it seems there are files without license header. ---

[jira] [Commented] (FLINK-8978) End-to-end test: Job upgrade

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462591#comment-16462591 ] ASF GitHub Bot commented on FLINK-8978: --- Github user StefanRRichter commented on a diff in the pull

[GitHub] flink pull request #5947: [FLINK-8978] Stateful generic stream job upgrade e...

2018-05-03 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5947#discussion_r185840683 --- Diff:

[jira] [Commented] (FLINK-8978) End-to-end test: Job upgrade

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462589#comment-16462589 ] ASF GitHub Bot commented on FLINK-8978: --- Github user StefanRRichter commented on a diff in the pull

[GitHub] flink pull request #5947: [FLINK-8978] Stateful generic stream job upgrade e...

2018-05-03 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5947#discussion_r185840213 --- Diff:

[jira] [Commented] (FLINK-9245) Can't create a BucketingSink with a provided Configuration if no hadoop defaults

2018-05-03 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462583#comment-16462583 ] Aljoscha Krettek commented on FLINK-9245: - I think the problem is that there really is no

[jira] [Updated] (FLINK-9293) SlotPool should check slot id when accepting a slot offer with existing allocation id

2018-05-03 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-9293: Fix Version/s: 1.5.0 > SlotPool should check slot id when accepting a slot offer with

[jira] [Commented] (FLINK-9169) NPE when restoring from old savepoint and state serializer could not be deserialized

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462563#comment-16462563 ] ASF GitHub Bot commented on FLINK-9169: --- Github user StefanRRichter commented on the issue:

[GitHub] flink issue #5950: [FLINK-9169] [state-backend] Allow absence of old seriali...

2018-05-03 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/5950 Please also check the travis build, some related tests seem to fail: Tests in error:

[jira] [Commented] (FLINK-9169) NPE when restoring from old savepoint and state serializer could not be deserialized

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462554#comment-16462554 ] ASF GitHub Bot commented on FLINK-9169: --- Github user StefanRRichter commented on a diff in the pull

[GitHub] flink pull request #5950: [FLINK-9169] [state-backend] Allow absence of old ...

2018-05-03 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5950#discussion_r185828137 --- Diff: flink-core/src/main/java/org/apache/flink/api/common/typeutils/TypeSerializerSerializationUtil.java --- @@ -200,7 +197,7 @@ public static

[jira] [Commented] (FLINK-9169) NPE when restoring from old savepoint and state serializer could not be deserialized

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462547#comment-16462547 ] ASF GitHub Bot commented on FLINK-9169: --- Github user StefanRRichter commented on a diff in the pull

[GitHub] flink pull request #5950: [FLINK-9169] [state-backend] Allow absence of old ...

2018-05-03 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5950#discussion_r185825767 --- Diff: flink-core/src/main/java/org/apache/flink/api/common/typeutils/TypeSerializerSerializationUtil.java --- @@ -200,7 +197,7 @@ public static

[jira] [Commented] (FLINK-9169) NPE when restoring from old savepoint and state serializer could not be deserialized

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462534#comment-16462534 ] ASF GitHub Bot commented on FLINK-9169: --- Github user StefanRRichter commented on a diff in the pull

[GitHub] flink pull request #5923: [FLINK-9253][network] make the maximum floating bu...

2018-05-03 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/5923#discussion_r185817506 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/io/network/NetworkEnvironment.java --- @@ -228,20 +228,19 @@ public void

[jira] [Commented] (FLINK-9253) Make buffer count per InputGate always #channels*buffersPerChannel + ExclusiveBuffers

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462535#comment-16462535 ] ASF GitHub Bot commented on FLINK-9253: --- Github user pnowojski commented on a diff in the pull

[jira] [Commented] (FLINK-9253) Make buffer count per InputGate always #channels*buffersPerChannel + ExclusiveBuffers

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462536#comment-16462536 ] ASF GitHub Bot commented on FLINK-9253: --- Github user pnowojski commented on a diff in the pull

[GitHub] flink pull request #5923: [FLINK-9253][network] make the maximum floating bu...

2018-05-03 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/5923#discussion_r185819830 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/io/network/NetworkEnvironment.java --- @@ -228,20 +228,19 @@ public void

[GitHub] flink pull request #5950: [FLINK-9169] [state-backend] Allow absence of old ...

2018-05-03 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5950#discussion_r185821296 --- Diff: flink-core/src/main/java/org/apache/flink/api/common/typeutils/TypeSerializerSerializationUtil.java --- @@ -373,15 +370,14 @@ public void

[jira] [Commented] (FLINK-9088) Upgrade Nifi connector dependency to 1.6.0

2018-05-03 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462530#comment-16462530 ] Ted Yu commented on FLINK-9088: --- lgtm > Upgrade Nifi connector dependency to 1.6.0 >

[jira] [Updated] (FLINK-8554) Upgrade AWS SDK

2018-05-03 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated FLINK-8554: -- Description: AWS SDK 1.11.271 fixes a lot of bugs. One of which would exhibit the following: {code} Caused

[jira] [Updated] (FLINK-9236) Use Apache Parent POM 19

2018-05-03 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated FLINK-9236: -- Description: Flink is still using Apache Parent POM 18. Apache Parent POM 19 is out. This will also fix

[jira] [Commented] (FLINK-8978) End-to-end test: Job upgrade

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462520#comment-16462520 ] ASF GitHub Bot commented on FLINK-8978: --- Github user azagrebin commented on the issue:

[GitHub] flink issue #5947: [FLINK-8978] Stateful generic stream job upgrade e2e test

2018-05-03 Thread azagrebin
Github user azagrebin commented on the issue: https://github.com/apache/flink/pull/5947 Thanks for review and good points @StefanRRichter I updated the PR to address the comments. The resume state e2e test also checks operator <-> state correspondence upon state restoration

[jira] [Commented] (FLINK-9287) KafkaProducer011 seems to leak threads when not in exactly-once mode

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462480#comment-16462480 ] ASF GitHub Bot commented on FLINK-9287: --- GitHub user pnowojski opened a pull request:

[jira] [Assigned] (FLINK-9287) KafkaProducer011 seems to leak threads when not in exactly-once mode

2018-05-03 Thread Piotr Nowojski (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-9287: - Assignee: Piotr Nowojski > KafkaProducer011 seems to leak threads when not in

[GitHub] flink pull request #5952: [FLINK-9287][kafka] Properly clean up resources in...

2018-05-03 Thread pnowojski
GitHub user pnowojski opened a pull request: https://github.com/apache/flink/pull/5952 [FLINK-9287][kafka] Properly clean up resources in non EXACTLY_ONCE FlinkKafkaProducer011 Previously FlinkKafkaProducer was not being closed for AT_LEAST_ONCE and NONE Semantics when closing

[jira] [Assigned] (FLINK-9284) Update CLI page

2018-05-03 Thread mingleizhang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingleizhang reassigned FLINK-9284: --- Assignee: Triones Deng > Update CLI page > --- > > Key:

[jira] [Closed] (FLINK-8900) YARN FinalStatus always shows as KILLED with Flip-6

2018-05-03 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-8900. --- > YARN FinalStatus always shows as KILLED with Flip-6 >

[jira] [Resolved] (FLINK-8900) YARN FinalStatus always shows as KILLED with Flip-6

2018-05-03 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-8900. - Resolution: Fixed Assignee: Stephan Ewen (was: Gary Yao) Fixed in - 1.5.0 via

[jira] [Commented] (FLINK-9288) clarify a few points in the event time / watermark docs

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462401#comment-16462401 ] ASF GitHub Bot commented on FLINK-9288: --- Github user asfgit closed the pull request at:

[jira] [Commented] (FLINK-8900) YARN FinalStatus always shows as KILLED with Flip-6

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462402#comment-16462402 ] ASF GitHub Bot commented on FLINK-8900: --- Github user asfgit closed the pull request at:

[jira] [Resolved] (FLINK-9288) clarify a few points in the event time / watermark docs

2018-05-03 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-9288. - Resolution: Fixed Fix Version/s: (was: 1.6.0) Fixed in - 1.5.0 via

[jira] [Closed] (FLINK-9288) clarify a few points in the event time / watermark docs

2018-05-03 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-9288. --- > clarify a few points in the event time / watermark docs >

[GitHub] flink pull request #5944: [FLINK-8900] [yarn] Set correct application status...

2018-05-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5944 ---

[GitHub] flink pull request #5949: [FLINK-9288][docs] clarify the event time / waterm...

2018-05-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5949 ---

[jira] [Commented] (FLINK-9235) Add Integration test for Flink-Yarn-Kerberos integration for flip-6

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462393#comment-16462393 ] ASF GitHub Bot commented on FLINK-9235: --- Github user aljoscha commented on the issue:

[GitHub] flink issue #5901: [FLINK-9235][Security] Add integration tests for YARN ker...

2018-05-03 Thread aljoscha
Github user aljoscha commented on the issue: https://github.com/apache/flink/pull/5901 @suez1224 Ah, I think the reason this test passes even without your fix in #5896 is that the test doesn't really test submission to a YARN cluster on different machines. The TaskManager runner will

[jira] [Commented] (FLINK-9207) Client returns SUCCESS(0) return code for canceled job

2018-05-03 Thread Amit Jain (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462366#comment-16462366 ] Amit Jain commented on FLINK-9207: -- [~aljoscha] I've not got the time to check on 1.4.x however, I tested

[jira] [Commented] (FLINK-8500) Get the timestamp of the Kafka message from kafka consumer(Kafka010Fetcher)

2018-05-03 Thread Fred Teunissen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462345#comment-16462345 ] Fred Teunissen commented on FLINK-8500: --- [~aljoscha] I have some time that I can spend on this, so

[jira] [Commented] (FLINK-9169) NPE when restoring from old savepoint and state serializer could not be deserialized

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462341#comment-16462341 ] ASF GitHub Bot commented on FLINK-9169: --- Github user StefanRRichter commented on a diff in the pull

[GitHub] flink pull request #5950: [FLINK-9169] [state-backend] Allow absence of old ...

2018-05-03 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5950#discussion_r185775633 --- Diff: flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBKeyedStateBackend.java ---

[jira] [Commented] (FLINK-9169) NPE when restoring from old savepoint and state serializer could not be deserialized

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462326#comment-16462326 ] ASF GitHub Bot commented on FLINK-9169: --- Github user StefanRRichter commented on a diff in the pull

[GitHub] flink pull request #5950: [FLINK-9169] [state-backend] Allow absence of old ...

2018-05-03 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5950#discussion_r185772501 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/testutils/ArtificialCNFErrorThrowingClassLoader.java --- @@ -0,0 +1,42 @@

[jira] [Commented] (FLINK-9169) NPE when restoring from old savepoint and state serializer could not be deserialized

2018-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462321#comment-16462321 ] ASF GitHub Bot commented on FLINK-9169: --- Github user StefanRRichter commented on a diff in the pull

[GitHub] flink pull request #5950: [FLINK-9169] [state-backend] Allow absence of old ...

2018-05-03 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5950#discussion_r185771830 --- Diff: flink-core/src/main/java/org/apache/flink/api/common/typeutils/TypeSerializerSerializationUtil.java --- @@ -69,7 +69,7 @@ *

  1   2   3   >