[jira] [Commented] (FLINK-9201) same merge window will be fired twice if watermark already passed the merge window

2018-05-02 Thread yuemeng (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460606#comment-16460606 ] yuemeng commented on FLINK-9201: [~jark],[~StephanEwen]   can you  check this issue? thanks   > same

[jira] [Commented] (FLINK-9267) Classloading issues when using RemoteEnvironment ...

2018-05-02 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460652#comment-16460652 ] Chesnay Schepler commented on FLINK-9267: - That exception means that the client and server are

[jira] [Commented] (FLINK-9235) Add Integration test for Flink-Yarn-Kerberos integration for flip-6

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460680#comment-16460680 ] ASF GitHub Bot commented on FLINK-9235: --- Github user aljoscha commented on the issue:

[GitHub] flink pull request #5896: [FLINK-8286][Security] Fix kerberos security confi...

2018-05-02 Thread aljoscha
Github user aljoscha commented on a diff in the pull request: https://github.com/apache/flink/pull/5896#discussion_r185422695 --- Diff: flink-yarn/src/main/java/org/apache/flink/yarn/YarnTaskExecutorRunnerFactory.java --- @@ -73,61 +105,68 @@ public static void main(String[]

[GitHub] flink issue #5919: [hotfix][state.md]modify typo in the state.md

2018-05-02 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/5919 merging. ---

[GitHub] flink pull request #5901: [FLINK-9235][Security] Add integration tests for Y...

2018-05-02 Thread aljoscha
Github user aljoscha commented on a diff in the pull request: https://github.com/apache/flink/pull/5901#discussion_r185423908 --- Diff: flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOITCase.java --- @@ -85,54 +88,75 @@ public void

[jira] [Created] (FLINK-9284) Update CLI page

2018-05-02 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-9284: --- Summary: Update CLI page Key: FLINK-9284 URL: https://issues.apache.org/jira/browse/FLINK-9284 Project: Flink Issue Type: Improvement

[jira] [Assigned] (FLINK-9283) Update cluster execution docs

2018-05-02 Thread yuqi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuqi reassigned FLINK-9283: --- Assignee: yuqi > Update cluster execution docs > - > > Key:

[jira] [Assigned] (FLINK-9284) Update CLI page

2018-05-02 Thread yuqi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuqi reassigned FLINK-9284: --- Assignee: yuqi > Update CLI page > --- > > Key: FLINK-9284 >

[jira] [Comment Edited] (FLINK-9283) Update cluster execution docs

2018-05-02 Thread yuqi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460740#comment-16460740 ] yuqi edited comment on FLINK-9283 at 5/2/18 9:04 AM: - Could not understand why change

[jira] [Commented] (FLINK-9250) JoinTaskExternalITCase deadlocks on travis

2018-05-02 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460776#comment-16460776 ] Chesnay Schepler commented on FLINK-9250: - The test usually finishes within ~15 seconds, but in

[GitHub] flink pull request #5901: [FLINK-9235][Security] Add integration tests for Y...

2018-05-02 Thread aljoscha
Github user aljoscha commented on a diff in the pull request: https://github.com/apache/flink/pull/5901#discussion_r185445414 --- Diff: flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOITCase.java --- @@ -85,54 +88,75 @@ public void

[jira] [Commented] (FLINK-9235) Add Integration test for Flink-Yarn-Kerberos integration for flip-6

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460790#comment-16460790 ] ASF GitHub Bot commented on FLINK-9235: --- Github user aljoscha commented on a diff in the pull

[jira] [Assigned] (FLINK-9286) Upadte classloading debugging page

2018-05-02 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler reassigned FLINK-9286: --- Assignee: Chesnay Schepler > Upadte classloading debugging page >

[jira] [Commented] (FLINK-8978) End-to-end test: Job upgrade

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460798#comment-16460798 ] ASF GitHub Bot commented on FLINK-8978: --- Github user azagrebin commented on the issue:

[jira] [Commented] (FLINK-8978) End-to-end test: Job upgrade

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460797#comment-16460797 ] ASF GitHub Bot commented on FLINK-8978: --- GitHub user azagrebin opened a pull request:

[GitHub] flink pull request #5946: [FLINK-9285][REST][docs] Update REST API docs

2018-05-02 Thread zentol
GitHub user zentol opened a pull request: https://github.com/apache/flink/pull/5946 [FLINK-9285][REST][docs] Update REST API docs ## What is the purpose of the change This PR updates the REST API documentation for 1.5. ## Brief change log * move legacy

[GitHub] flink issue #5947: [FLINK-8978] Stateful generic stream job upgrade e2e test

2018-05-02 Thread azagrebin
Github user azagrebin commented on the issue: https://github.com/apache/flink/pull/5947 cc @StefanRRichter ---

[jira] [Commented] (FLINK-9285) Update REST API page

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460796#comment-16460796 ] ASF GitHub Bot commented on FLINK-9285: --- GitHub user zentol opened a pull request:

[GitHub] flink pull request #5948: [FLINK-9286][docs] Update classloading docs

2018-05-02 Thread zentol
GitHub user zentol opened a pull request: https://github.com/apache/flink/pull/5948 [FLINK-9286][docs] Update classloading docs ## What is the purpose of the change This PR updates the `Configuring ClassLoader Resolution Order` section of the `Debugging Classloading` page.

[jira] [Commented] (FLINK-9235) Add Integration test for Flink-Yarn-Kerberos integration for flip-6

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460810#comment-16460810 ] ASF GitHub Bot commented on FLINK-9235: --- Github user aljoscha commented on a diff in the pull

[GitHub] flink pull request #5922: [FLINK-8780] [docs] Add Broadcast State documentat...

2018-05-02 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5922#discussion_r185449653 --- Diff: docs/dev/stream/state/broadcast_state.md --- @@ -0,0 +1,281 @@ +--- +title: "The Broadcast State Pattern" +nav-parent_id: streaming_state

[jira] [Commented] (FLINK-9235) Add Integration test for Flink-Yarn-Kerberos integration for flip-6

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460812#comment-16460812 ] ASF GitHub Bot commented on FLINK-9235: --- Github user aljoscha commented on a diff in the pull

[jira] [Commented] (FLINK-8780) Add Broadcast State documentation.

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460814#comment-16460814 ] ASF GitHub Bot commented on FLINK-8780: --- Github user kl0u commented on a diff in the pull request:

[jira] [Commented] (FLINK-9235) Add Integration test for Flink-Yarn-Kerberos integration for flip-6

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460811#comment-16460811 ] ASF GitHub Bot commented on FLINK-9235: --- Github user aljoscha commented on a diff in the pull

[jira] [Commented] (FLINK-8780) Add Broadcast State documentation.

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460840#comment-16460840 ] ASF GitHub Bot commented on FLINK-8780: --- Github user kl0u commented on the issue:

[jira] [Closed] (FLINK-9275) Set more distinctive output flusher thread names

2018-05-02 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-9275. --- > Set more distinctive output flusher thread names > > >

[jira] [Resolved] (FLINK-9275) Set more distinctive output flusher thread names

2018-05-02 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-9275. - Resolution: Fixed Fix Version/s: 1.5.0 Fixed in - 1.5.0 via

[jira] [Closed] (FLINK-9274) Add thread name to Kafka Partition Discovery

2018-05-02 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-9274. --- > Add thread name to Kafka Partition Discovery > > >

[jira] [Resolved] (FLINK-9274) Add thread name to Kafka Partition Discovery

2018-05-02 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-9274. - Resolution: Fixed Fix Version/s: 1.5.0 Fixed in - 1.5.0 via

[jira] [Resolved] (FLINK-9214) YarnClient should be stopped in YARNSessionCapacitySchedulerITCase#testDetachedPerJobYarnClusterInternal

2018-05-02 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-9214. - Resolution: Fixed Fix Version/s: 1.5.0 Fixed in - 1.5.0 via

[jira] [Closed] (FLINK-9214) YarnClient should be stopped in YARNSessionCapacitySchedulerITCase#testDetachedPerJobYarnClusterInternal

2018-05-02 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-9214. --- > YarnClient should be stopped in >

[jira] [Commented] (FLINK-5544) Implement Internal Timer Service in RocksDB

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460862#comment-16460862 ] ASF GitHub Bot commented on FLINK-5544: --- Github user shixiaogang commented on the issue:

[GitHub] flink issue #3359: [FLINK-5544][streaming] Add InternalTimerService implemen...

2018-05-02 Thread shixiaogang
Github user shixiaogang commented on the issue: https://github.com/apache/flink/pull/3359 @StefanRRichter Sorry for the delayed response. I am working on it and shall update the PR by this weekend. ---

[jira] [Commented] (FLINK-8500) Get the timestamp of the Kafka message from kafka consumer(Kafka010Fetcher)

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460869#comment-16460869 ] Aljoscha Krettek commented on FLINK-8500: - Thanks for opening the PR and pushing the discussion! I

[GitHub] flink issue #4607: [FLINK-6306][connectors] Sink for eventually consistent f...

2018-05-02 Thread aljoscha
Github user aljoscha commented on the issue: https://github.com/apache/flink/pull/4607 @stevenzwu I'm afraid the currently isn't. But one should be started once work starts on the new sink for Flink 1.6 ---

[jira] [Commented] (FLINK-8500) Get the timestamp of the Kafka message from kafka consumer(Kafka010Fetcher)

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460879#comment-16460879 ] Aljoscha Krettek commented on FLINK-8500: - [~tzulitai] I thought about that second approach as

[jira] [Reopened] (FLINK-9043) Flink recover from checkpoint like Spark Streaming

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reopened FLINK-9043: - > Flink recover from checkpoint like Spark Streaming >

[jira] [Updated] (FLINK-9101) HAQueryableStateRocksDBBackendITCase failed on travis

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-9101: Fix Version/s: 1.5.1 1.6.0 > HAQueryableStateRocksDBBackendITCase failed

[jira] [Comment Edited] (FLINK-9178) Add rate control for kafka source

2018-05-02 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460891#comment-16460891 ] Tzu-Li (Gordon) Tai edited comment on FLINK-9178 at 5/2/18 11:22 AM: -

[GitHub] flink pull request #5934: [FLINK-9269][state] fix concurrency problem when p...

2018-05-02 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5934#discussion_r185465407 --- Diff: flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBKeyedStateBackend.java ---

[jira] [Commented] (FLINK-9269) Concurrency problem in HeapKeyedStateBackend when performing checkpoint async

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460904#comment-16460904 ] ASF GitHub Bot commented on FLINK-9269: --- Github user StefanRRichter commented on a diff in the pull

[jira] [Commented] (FLINK-9269) Concurrency problem in HeapKeyedStateBackend when performing checkpoint async

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460902#comment-16460902 ] ASF GitHub Bot commented on FLINK-9269: --- Github user StefanRRichter commented on a diff in the pull

[GitHub] flink pull request #5934: [FLINK-9269][state] fix concurrency problem when p...

2018-05-02 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5934#discussion_r185465142 --- Diff: flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBKeyedStateBackend.java ---

[GitHub] flink issue #5922: [FLINK-8780] [docs] Add Broadcast State documentation.

2018-05-02 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/5922 This seems like a nice suggestion. I will do that and let’s see how it reads afterwards. > On May 2, 2018, at 12:21 PM, Tzu-Li Tai wrote: > > @tzulitai

[jira] [Resolved] (FLINK-9256) NPE in SingleInputGate#updateInputChannel() for non-credit based flow control

2018-05-02 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-9256. - Resolution: Fixed Fixed in - 1.5.0 via 56e2b0b5d600935eae590a985643a5879f224d04 - 1.6.0 via

[jira] [Closed] (FLINK-9256) NPE in SingleInputGate#updateInputChannel() for non-credit based flow control

2018-05-02 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-9256. --- > NPE in SingleInputGate#updateInputChannel() for non-credit based flow control >

[jira] [Resolved] (FLINK-6557) RocksDBKeyedStateBackend broken on Windows

2018-05-02 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-6557. - Resolution: Fixed Fix Version/s: 1.5.0 Fixed in - 1.5.0 via

[jira] [Resolved] (FLINK-9196) YARN: Flink binaries are not deleted from HDFS after cluster shutdown

2018-05-02 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-9196. - Resolution: Fixed Fixed in - 1.5.0 via d130f87822818ba6f5c9dbd77ab3a774fdc41e60 - 1.6.0 via

[jira] [Closed] (FLINK-9196) YARN: Flink binaries are not deleted from HDFS after cluster shutdown

2018-05-02 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-9196. --- > YARN: Flink binaries are not deleted from HDFS after cluster shutdown >

[jira] [Created] (FLINK-9287) KafkaProducer011 seems to leak threads when not in exactly-once mode

2018-05-02 Thread Christopher Ng (JIRA)
Christopher Ng created FLINK-9287: - Summary: KafkaProducer011 seems to leak threads when not in exactly-once mode Key: FLINK-9287 URL: https://issues.apache.org/jira/browse/FLINK-9287 Project: Flink

[jira] [Comment Edited] (FLINK-8500) Get the timestamp of the Kafka message from kafka consumer(Kafka010Fetcher)

2018-05-02 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460871#comment-16460871 ] Tzu-Li (Gordon) Tai edited comment on FLINK-8500 at 5/2/18 11:04 AM: -

[jira] [Commented] (FLINK-8500) Get the timestamp of the Kafka message from kafka consumer(Kafka010Fetcher)

2018-05-02 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460871#comment-16460871 ] Tzu-Li (Gordon) Tai commented on FLINK-8500: +1 to the general idea; simplifying the schema

[jira] [Comment Edited] (FLINK-8500) Get the timestamp of the Kafka message from kafka consumer(Kafka010Fetcher)

2018-05-02 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460871#comment-16460871 ] Tzu-Li (Gordon) Tai edited comment on FLINK-8500 at 5/2/18 11:05 AM: -

[jira] [Comment Edited] (FLINK-8500) Get the timestamp of the Kafka message from kafka consumer(Kafka010Fetcher)

2018-05-02 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460871#comment-16460871 ] Tzu-Li (Gordon) Tai edited comment on FLINK-8500 at 5/2/18 11:06 AM: -

[jira] [Comment Edited] (FLINK-8500) Get the timestamp of the Kafka message from kafka consumer(Kafka010Fetcher)

2018-05-02 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460871#comment-16460871 ] Tzu-Li (Gordon) Tai edited comment on FLINK-8500 at 5/2/18 11:05 AM: -

[jira] [Commented] (FLINK-6306) Sink for eventually consistent file systems

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460873#comment-16460873 ] ASF GitHub Bot commented on FLINK-6306: --- Github user aljoscha commented on the issue:

[jira] [Closed] (FLINK-9263) Kafka010ITCase failed on travis because of the concurrency problem in DefaultOperateStateBackend

2018-05-02 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-9263. - Resolution: Fixed Merged in: master: c11f11359b release 1.5: de4f283087 > Kafka010ITCase

[jira] [Updated] (FLINK-9269) Concurrency problem in HeapKeyedStateBackend when performing checkpoint async

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-9269: Fix Version/s: (was: 1.5.0) 1.6.0 > Concurrency problem in

[GitHub] flink issue #3359: [FLINK-5544][streaming] Add InternalTimerService implemen...

2018-05-02 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/3359 @shixiaogang Thank you very much, appreciate your efforts on this feature! There is no need to rush this if you are busy right now, the cycle for the 1.6 release is just beginning. ---

[jira] [Commented] (FLINK-5544) Implement Internal Timer Service in RocksDB

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460884#comment-16460884 ] ASF GitHub Bot commented on FLINK-5544: --- Github user StefanRRichter commented on the issue:

[jira] [Commented] (FLINK-9178) Add rate control for kafka source

2018-05-02 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460891#comment-16460891 ] Tzu-Li (Gordon) Tai commented on FLINK-9178: [~app-tarush] Sorry for slow late reply here.

[GitHub] flink pull request #5934: [FLINK-9269][state] fix concurrency problem when p...

2018-05-02 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5934#discussion_r185464970 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/StateBackendTestBase.java --- @@ -3594,6 +3599,58 @@ public String fold(String

[jira] [Commented] (FLINK-9269) Concurrency problem in HeapKeyedStateBackend when performing checkpoint async

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460901#comment-16460901 ] ASF GitHub Bot commented on FLINK-9269: --- Github user StefanRRichter commented on a diff in the pull

[jira] [Commented] (FLINK-7484) CaseClassSerializer.duplicate() does not perform proper deep copy

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460905#comment-16460905 ] Aljoscha Krettek commented on FLINK-7484: - cc [~srichter] > CaseClassSerializer.duplicate() does

[jira] [Reopened] (FLINK-5372) Fix RocksDBAsyncSnapshotTest.testCancelFullyAsyncCheckpoints()

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reopened FLINK-5372: - Reopen to change fixVersion > Fix RocksDBAsyncSnapshotTest.testCancelFullyAsyncCheckpoints()

[jira] [Closed] (FLINK-5372) Fix RocksDBAsyncSnapshotTest.testCancelFullyAsyncCheckpoints()

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-5372. --- Resolution: Fixed Fix Version/s: (was: 1.6.0) > Fix

[jira] [Commented] (FLINK-7484) CaseClassSerializer.duplicate() does not perform proper deep copy

2018-05-02 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460907#comment-16460907 ] Stefan Richter commented on FLINK-7484: --- [~joshlemer] this looks like a different problem to me,

[GitHub] flink issue #5922: [FLINK-8780] [docs] Add Broadcast State documentation.

2018-05-02 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/5922 Thanks a lot for the reviews! I pushed a commit that integrates your comments. Let me know if now it looks ok. ---

[jira] [Commented] (FLINK-8780) Add Broadcast State documentation.

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460920#comment-16460920 ] ASF GitHub Bot commented on FLINK-8780: --- Github user kl0u commented on the issue:

[jira] [Created] (FLINK-9288) clarify a few points in the event time / watermark docs

2018-05-02 Thread David Anderson (JIRA)
David Anderson created FLINK-9288: - Summary: clarify a few points in the event time / watermark docs Key: FLINK-9288 URL: https://issues.apache.org/jira/browse/FLINK-9288 Project: Flink

[jira] [Commented] (FLINK-8743) Add annotation to override documented default

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460668#comment-16460668 ] ASF GitHub Bot commented on FLINK-8743: --- Github user zentol commented on the issue:

[GitHub] flink issue #5901: [FLINK-9235][Security] Add integration tests for YARN ker...

2018-05-02 Thread aljoscha
Github user aljoscha commented on the issue: https://github.com/apache/flink/pull/5901 Shouldn't this fail without the changes in #5896? ---

[GitHub] flink issue #5833: [FLINK-9154][REST][docs] Document WebSubmissionExtension ...

2018-05-02 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/5833 merging. ---

[GitHub] flink pull request #5945: [FLINK-9169] [runtime] Allow KeyedBackendSerializa...

2018-05-02 Thread tzulitai
GitHub user tzulitai opened a pull request: https://github.com/apache/flink/pull/5945 [FLINK-9169] [runtime] Allow KeyedBackendSerializationProxy to specify whether serializer presence is required ## What is the purpose of the change Previously, in both the RocksDB and

[jira] [Commented] (FLINK-9235) Add Integration test for Flink-Yarn-Kerberos integration for flip-6

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460703#comment-16460703 ] ASF GitHub Bot commented on FLINK-9235: --- Github user aljoscha commented on a diff in the pull

[jira] [Updated] (FLINK-9257) End-to-end tests prints "All tests PASS" even if individual test-script returns non-zero exit code

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-9257: Priority: Blocker (was: Critical) > End-to-end tests prints "All tests PASS" even if

[jira] [Updated] (FLINK-9257) End-to-end tests prints "All tests PASS" even if individual test-script returns non-zero exit code

2018-05-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-9257: Priority: Critical (was: Blocker) > End-to-end tests prints "All tests PASS" even if

[jira] [Created] (FLINK-9285) Update REST API page

2018-05-02 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-9285: --- Summary: Update REST API page Key: FLINK-9285 URL: https://issues.apache.org/jira/browse/FLINK-9285 Project: Flink Issue Type: Improvement

[jira] [Assigned] (FLINK-9178) Add rate control for kafka source

2018-05-02 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske reassigned FLINK-9178: Assignee: Tarush Grover > Add rate control for kafka source >

[jira] [Commented] (FLINK-9119) example code error in Concepts & Common API

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460794#comment-16460794 ] ASF GitHub Bot commented on FLINK-9119: --- Github user fhueske commented on the issue:

[GitHub] flink pull request #5947: [FLINK-8978] Stateful generic stream job upgrade e...

2018-05-02 Thread azagrebin
GitHub user azagrebin opened a pull request: https://github.com/apache/flink/pull/5947 [FLINK-8978] Stateful generic stream job upgrade e2e test ## What is the purpose of the change e2e test for generic state job upgrade and state recovery based operator uid. ##

[jira] [Updated] (FLINK-9286) Update classloading debugging page

2018-05-02 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler updated FLINK-9286: Summary: Update classloading debugging page (was: Upadte classloading debugging page) >

[GitHub] flink issue #5935: [FLINK-9119] example code error in Concepts & Common API

2018-05-02 Thread fhueske
Github user fhueske commented on the issue: https://github.com/apache/flink/pull/5935 Thanks for the fix @yanghua! +1 to merge ---

[GitHub] flink issue #5934: [FLINK-9269][state] fix concurrency problem when performi...

2018-05-02 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/5934 Yes, there is a theoretical problem if the serialization would not be threadsafe. I think currently the silent assumption that holds is that serializers are immutable w.r.t. serialization

[jira] [Commented] (FLINK-9286) Update classloading debugging page

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460805#comment-16460805 ] ASF GitHub Bot commented on FLINK-9286: --- GitHub user zentol opened a pull request:

[GitHub] flink issue #5934: [FLINK-9269][state] fix concurrency problem when performi...

2018-05-02 Thread sihuazhou
Github user sihuazhou commented on the issue: https://github.com/apache/flink/pull/5934 Hi @StefanRRichter Thanks for your reply, I have updated the PR and add a test to guard this, but I not sure whether the test is indeed required because it looks a bit wired in my mind... ---

[GitHub] flink issue #5901: [FLINK-9235][Security] Add integration tests for YARN ker...

2018-05-02 Thread aljoscha
Github user aljoscha commented on the issue: https://github.com/apache/flink/pull/5901 If I only remove this line I mentioned earlier from `master` the test actually fails for me:

[jira] [Commented] (FLINK-9269) Concurrency problem in HeapKeyedStateBackend when performing checkpoint async

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460817#comment-16460817 ] ASF GitHub Bot commented on FLINK-9269: --- Github user sihuazhou commented on the issue:

[jira] [Commented] (FLINK-9235) Add Integration test for Flink-Yarn-Kerberos integration for flip-6

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460815#comment-16460815 ] ASF GitHub Bot commented on FLINK-9235: --- Github user aljoscha commented on the issue:

[GitHub] flink pull request #5922: [FLINK-8780] [docs] Add Broadcast State documentat...

2018-05-02 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/5922#discussion_r185452174 --- Diff: docs/dev/stream/state/broadcast_state.md --- @@ -0,0 +1,281 @@ +--- +title: "The Broadcast State Pattern" +nav-parent_id:

[jira] [Commented] (FLINK-9263) Kafka010ITCase failed on travis because of the concurrency problem in DefaultOperateStateBackend

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460829#comment-16460829 ] ASF GitHub Bot commented on FLINK-9263: --- Github user asfgit closed the pull request at:

[GitHub] flink pull request #5930: [FLINK-9263][state] Fix concurrency problem in Def...

2018-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5930 ---

[jira] [Commented] (FLINK-8780) Add Broadcast State documentation.

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460828#comment-16460828 ] ASF GitHub Bot commented on FLINK-8780: --- Github user tzulitai commented on a diff in the pull

[jira] [Closed] (FLINK-9270) Upgrade RocksDB to 5.11.3, and resolve concurrent test invocation problem of @RetryOnFailure

2018-05-02 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-9270. - Resolution: Won't Fix Won't fix until we figure out a way around the performance regression of

[jira] [Commented] (FLINK-9154) Include WebSubmissionExtension in REST API docs

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460692#comment-16460692 ] ASF GitHub Bot commented on FLINK-9154: --- Github user zentol commented on the issue:

[jira] [Commented] (FLINK-8286) Fix Flink-Yarn-Kerberos integration for FLIP-6

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460696#comment-16460696 ] ASF GitHub Bot commented on FLINK-8286: --- Github user aljoscha commented on a diff in the pull

[GitHub] flink pull request #5922: [FLINK-8780] [docs] Add Broadcast State documentat...

2018-05-02 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/5922#discussion_r185417488 --- Diff: docs/dev/stream/state/broadcast_state.md --- @@ -0,0 +1,281 @@ +--- +title: "The Broadcast State Pattern" +nav-parent_id:

[jira] [Commented] (FLINK-9169) NPE when restoring from old savepoint and state serializer could not be deserialized

2018-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460706#comment-16460706 ] ASF GitHub Bot commented on FLINK-9169: --- GitHub user tzulitai opened a pull request:

[jira] [Assigned] (FLINK-8480) Implement Java API to expose join functionality of TimeBoundedStreamJoinOperator

2018-05-02 Thread Florian Schmidt (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Florian Schmidt reassigned FLINK-8480: -- Assignee: Florian Schmidt > Implement Java API to expose join functionality of >

  1   2   3   >