[GitHub] flink pull request #6281: [FLINK-9750] Add new StreamingFileSink with Resuma...

2018-07-15 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/6281#discussion_r202574665 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/functions/sink/filesystem/StreamingFileSink.java --- @@ -0,0 +1,397

[GitHub] flink issue #6281: [FLINK-9750] Add new StreamingFileSink with ResumableWrit...

2018-07-11 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/6281 Hi @aljoscha and @StephanEwen . I have updated the PR, please have a look. ---

[GitHub] flink pull request #6281: [FLINK-9750] Add new StreamingFileSink with Resuma...

2018-07-10 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/6281#discussion_r201342618 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/functions/sink/filesystem/StreamingFileSink.java --- @@ -0,0 +1,397

[GitHub] flink pull request #6281: [FLINK-9750] Add new StreamingFileSink with Resuma...

2018-07-09 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/6281#discussion_r201059374 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/functions/sink/filesystem/Bucket.java --- @@ -0,0 +1,297

[GitHub] flink pull request #6281: [FLINK-9750] Add new StreamingFileSink with Resuma...

2018-07-09 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/6281#discussion_r201059444 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/functions/sink/filesystem/Bucket.java --- @@ -0,0 +1,297

[GitHub] flink issue #6176: [FLINK-9603][connector-filesystem] fix part indexing, whe...

2018-07-09 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/6176 Hi @kent2171 ! Do not worry, I can fix it ;) Thanks for having a look! ---

[GitHub] flink issue #6176: [FLINK-9603][connector-filesystem] fix part indexing, whe...

2018-07-09 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/6176 Thanks for the work @kent2171 ! I will merge this as soon as Travis gives the green light! ---

[GitHub] flink issue #6281: [FLINK-9750] Add new StreamingFileSink with ResumableWrit...

2018-07-09 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/6281 Hi @xndai ! I will update an outdated design doc and will attach it to the JIRA! I will ping you here to have a look. ---

[GitHub] flink pull request #6281: [FLINK-9750] Add new StreamingFileSink with Resuma...

2018-07-09 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/6281#discussion_r200909011 --- Diff: flink-core/src/main/java/org/apache/flink/api/common/serialization/Writer.java --- @@ -0,0 +1,36 @@ +/* + * Licensed to the Apache Software

[GitHub] flink pull request #6281: [FLINK-9750] Add new StreamingFileSink with Resuma...

2018-07-07 Thread kl0u
GitHub user kl0u opened a pull request: https://github.com/apache/flink/pull/6281 [FLINK-9750] Add new StreamingFileSink with ResumableWriter. ## What is the purpose of the change This PR is the first step towards introducing a new Streaming Filesystem sink that works

[GitHub] flink issue #5342: [FLINK-8479] Timebounded stream join

2018-07-05 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/5342 Thanks for the work @florianschmidt1994 ! Merging this. ---

[GitHub] flink pull request #6171: [FLINK-9593] Unified After Match semantics with SQ...

2018-06-27 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/6171#discussion_r198474417 --- Diff: flink-libraries/flink-cep/src/main/java/org/apache/flink/cep/nfa/NFA.java --- @@ -330,77 +328,85 @@ private boolean isStateTimedOut(final

[GitHub] flink pull request #6171: [FLINK-9593] Unified After Match semantics with SQ...

2018-06-27 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/6171#discussion_r198473426 --- Diff: flink-libraries/flink-cep/src/main/java/org/apache/flink/cep/nfa/aftermatch/AfterMatchSkipStrategy.java --- @@ -0,0 +1,155

[GitHub] flink pull request #6171: [FLINK-9593] Unified After Match semantics with SQ...

2018-06-27 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/6171#discussion_r198472975 --- Diff: flink-libraries/flink-cep/src/main/java/org/apache/flink/cep/nfa/NFAState.java --- @@ -79,18 +98,18 @@ public boolean equals(Object o

[GitHub] flink pull request #6171: [FLINK-9593] Unified After Match semantics with SQ...

2018-06-27 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/6171#discussion_r198472927 --- Diff: flink-libraries/flink-cep/src/main/java/org/apache/flink/cep/nfa/NFAState.java --- @@ -79,18 +98,18 @@ public boolean equals(Object o

[GitHub] flink pull request #6171: [FLINK-9593] Unified After Match semantics with SQ...

2018-06-27 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/6171#discussion_r198473858 --- Diff: flink-libraries/flink-cep/src/main/java/org/apache/flink/cep/nfa/NFA.java --- @@ -330,77 +328,85 @@ private boolean isStateTimedOut(final

[GitHub] flink pull request #6152: [FLINK-9467][metrics][WebUI] Fix watermark display...

2018-06-21 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/6152#discussion_r197087153 --- Diff: docs/monitoring/metrics.md --- @@ -1254,15 +1254,15 @@ Thus, in order to infer the metric identifier: Counter

[GitHub] flink pull request #6152: [FLINK-9467][metrics][WebUI] Fix watermark display...

2018-06-21 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/6152#discussion_r197086995 --- Diff: docs/monitoring/metrics.md --- @@ -1228,7 +1228,7 @@ Thus, in order to infer the metric identifier: Meter

[GitHub] flink issue #6130: [FLINK-9545] Support read a file multiple times in Flink ...

2018-06-15 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/6130 Hi @bowenli86, Me, @zentol and @aljoscha both seem to have doubts about the utility of the feature. So given this, and to have a clean JIRA and list of PRs we have to work on, I would

[GitHub] flink issue #6130: [FLINK-9545] Support read a file multiple times in Flink ...

2018-06-13 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/6130 Hi @bowenli86 ! Why not having a `flatmap` after the `readFile` and for every incoming element you emit as many copies as you want? Personally, I am not so fond of adding methods

[GitHub] flink issue #5342: [FLINK-8479] Timebounded stream join

2018-06-13 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/5342 Thanks @florianschmidt1994 . I will, but may be not today. ---

[GitHub] flink issue #5960: [Flink-8725] Separate state from NFA in CEP library

2018-06-13 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/5960 @dawidwys Also when you merge the other one, could you also close this PR? ---

[GitHub] flink issue #6059: [Flink-9418] Migrate SharedBuffer to use MapState

2018-06-13 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/6059 It would be great if @Aitozi could also report any numbers he has, so that we see the benefits of the change. ---

[GitHub] flink issue #6126: [FLINK-9530][metrics] Fix numRecords task metric for chai...

2018-06-11 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/6126 I got this, it is just that I am wondering how useful this is, given that the operators/functions are chained. ---

[GitHub] flink pull request #6059: [Flink-9418] Migrate SharedBuffer to use MapState

2018-06-11 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/6059#discussion_r194473454 --- Diff: flink-libraries/flink-cep/src/main/java/org/apache/flink/cep/nfa/NFA.java --- @@ -296,42 +292,31 @@ public void resetNFAChanged

[GitHub] flink pull request #6059: [Flink-9418] Migrate SharedBuffer to use MapState

2018-06-11 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/6059#discussion_r194470370 --- Diff: flink-libraries/flink-cep/src/main/java/org/apache/flink/cep/nfa/NFA.java --- @@ -296,42 +292,31 @@ public void resetNFAChanged

[GitHub] flink pull request #6059: [Flink-9418] Migrate SharedBuffer to use MapState

2018-06-11 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/6059#discussion_r194468194 --- Diff: flink-libraries/flink-cep/src/main/java/org/apache/flink/cep/nfa/NFA.java --- @@ -296,42 +292,31 @@ public void resetNFAChanged

[GitHub] flink issue #6126: [FLINK-9530][metrics] Fix numRecords task metric for chai...

2018-06-11 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/6126 If this is correct, then I suppose we can remove it altogether so that the code is also cleaner, right? ---

[GitHub] flink issue #6108: [FLINK-9367] [Streaming Connectors] Allow to do truncate(...

2018-06-11 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/6108 @zhangxinyu1 as soon as this sink is ready, I believe that the existing File Source will be able to read the output of the Bucketing Sink. As far as bandwidth limitations are concerned, could you

[GitHub] flink issue #6108: [FLINK-9367] [Streaming Connectors] Allow to do truncate(...

2018-06-04 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/6108 Thanks for the useful input here @zhangxinyu1 and @StephanEwen. As soon as I have sth concrete I create the JIRA and post it here. ---

[GitHub] flink issue #6059: [Flink-9418] Migrate SharedBuffer to use MapState

2018-06-01 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/6059 Hi @dawidwys! Thanks for the work. The changes seem really good. As we discussed privately I did a review and the comments you can find them in the branch I sent you. The only things

[GitHub] flink pull request #6097: [FLINK-9470] Allow querying the key in KeyedProces...

2018-05-29 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/6097#discussion_r191460728 --- Diff: flink-streaming-java/src/test/java/org/apache/flink/streaming/api/operators/KeyedProcessOperatorTest.java --- @@ -50,6 +52,30 @@ @Rule

[GitHub] flink pull request #6097: [FLINK-9470] Allow querying the key in KeyedProces...

2018-05-29 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/6097#discussion_r191460316 --- Diff: flink-streaming-java/src/test/java/org/apache/flink/streaming/api/operators/KeyedProcessOperatorTest.java --- @@ -50,6 +52,30 @@ @Rule

[GitHub] flink issue #6028: [FLINK-9356] Improve error message for when queryable sta...

2018-05-29 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/6028 LGTM, so +1 and I will merge later. Thanks for the work @yanghua and for the review @florianschmidt1994 . ---

[GitHub] flink pull request #6028: [FLINK-9356] Improve error message for when querya...

2018-05-17 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/6028#discussion_r189015635 --- Diff: flink-queryable-state/flink-queryable-state-runtime/src/main/java/org/apache/flink/queryablestate/client/proxy/KvStateClientProxyHandler.java

[GitHub] flink issue #5955: [FLINK-8659] Add migration itcases for broadcast state.

2018-05-16 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/5955 Hi @tzulitai ! Thanks for the review. I integrated most of your comments. The only one I left out is the one about merging the checkpointing and the checking. I am not against that. It is just

[GitHub] flink pull request #5955: [FLINK-8659] Add migration itcases for broadcast s...

2018-05-16 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5955#discussion_r188614213 --- Diff: flink-tests/src/test/java/org/apache/flink/test/checkpointing/utils/StatefulJobWBroadcastStateMigrationITCase.java --- @@ -0,0 +1,418

[GitHub] flink issue #5922: [FLINK-8780] [docs] Add Broadcast State documentation.

2018-05-14 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/5922 Thanks for the review! Merging this. ---

[GitHub] flink pull request #5922: [FLINK-8780] [docs] Add Broadcast State documentat...

2018-05-14 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5922#discussion_r187924456 --- Diff: docs/dev/stream/state/broadcast_state.md --- @@ -0,0 +1,279 @@ +--- +title: "The Broadcast State Pattern" +nav-parent_id: strea

[GitHub] flink pull request #5922: [FLINK-8780] [docs] Add Broadcast State documentat...

2018-05-14 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5922#discussion_r187922328 --- Diff: docs/dev/stream/state/broadcast_state.md --- @@ -0,0 +1,279 @@ +--- +title: "The Broadcast State Pattern" +nav-parent_id: strea

[GitHub] flink issue #5955: [FLINK-8659] Add migration itcases for broadcast state.

2018-05-14 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/5955 Could you review it @tzulitai ? ---

[GitHub] flink pull request #5807: [FLINK-8982][E2E Tests] Add test for known failure...

2018-05-11 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5807#discussion_r187677168 --- Diff: flink-end-to-end-tests/flink-queryable-state-test/src/main/java/org/apache/flink/streaming/tests/queryablestate/QsStateProducer.java --- @@ -0,0

[GitHub] flink pull request #5807: [FLINK-8982][E2E Tests] Add test for known failure...

2018-05-11 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5807#discussion_r187676881 --- Diff: flink-end-to-end-tests/test-scripts/test_queryable_state_restart_tm.sh --- @@ -0,0 +1,120 @@ +#!/usr/bin/env bash

[GitHub] flink pull request #5807: [FLINK-8982][E2E Tests] Add test for known failure...

2018-05-11 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5807#discussion_r187676635 --- Diff: flink-end-to-end-tests/test-scripts/test_queryable_state_restart_tm.sh --- @@ -0,0 +1,120 @@ +#!/usr/bin/env bash

[GitHub] flink pull request #5807: [FLINK-8982][E2E Tests] Add test for known failure...

2018-05-11 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5807#discussion_r187675826 --- Diff: flink-end-to-end-tests/test-scripts/test_queryable_state_restart_tm.sh --- @@ -0,0 +1,120 @@ +#!/usr/bin/env bash

[GitHub] flink pull request #5807: [FLINK-8982][E2E Tests] Add test for known failure...

2018-05-11 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5807#discussion_r187675012 --- Diff: flink-end-to-end-tests/flink-queryable-state-test/pom.xml --- @@ -0,0 +1,134 @@ + + +http://maven.apache.org/POM/4.0.0

[GitHub] flink pull request #5807: [FLINK-8982][E2E Tests] Add test for known failure...

2018-05-11 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5807#discussion_r187674099 --- Diff: flink-end-to-end-tests/flink-queryable-state-test/src/main/java/org/apache/flink/streaming/tests/queryablestate/QsStateProducer.java --- @@ -0,0

[GitHub] flink issue #5993: [FLINK-9336][state] fix deserialization problem for query...

2018-05-11 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/5993 Thanks for the work @sihuazhou and for reporting this @florianschmidt1994 ! This fixes the problem described in the JIRA but I will look at the PR a bit more thoroughly on Monday at the latest

[GitHub] flink issue #5955: [FLINK-8659] Add migration itcases for broadcast state.

2018-05-08 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/5955 Could you review it @aljoscha ? ---

[GitHub] flink issue #5495: [FLINK-8659] Add migration itcases for broadcast state.

2018-05-04 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/5495 I close this and I will open an updated one. ---

[GitHub] flink pull request #5495: [FLINK-8659] Add migration itcases for broadcast s...

2018-05-04 Thread kl0u
Github user kl0u closed the pull request at: https://github.com/apache/flink/pull/5495 ---

[GitHub] flink pull request #5955: [FLINK-8659] Add migration itcases for broadcast s...

2018-05-04 Thread kl0u
GitHub user kl0u opened a pull request: https://github.com/apache/flink/pull/5955 [FLINK-8659] Add migration itcases for broadcast state. As the name implies, this PR add migration tests for the newly introduced broadcast state. For the `scala` case, more refactoring

[GitHub] flink pull request #5860: [FLINK-9138][filesystem-connectors] Implement time...

2018-05-03 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5860#discussion_r185731699 --- Diff: flink-connectors/flink-connector-filesystem/src/main/java/org/apache/flink/streaming/connectors/fs/bucketing/BucketingSink.java --- @@ -908,6

[GitHub] flink issue #5922: [FLINK-8780] [docs] Add Broadcast State documentation.

2018-05-02 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/5922 Thanks a lot for the reviews! I pushed a commit that integrates your comments. Let me know if now it looks ok. ---

[GitHub] flink issue #5922: [FLINK-8780] [docs] Add Broadcast State documentation.

2018-05-02 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/5922 This seems like a nice suggestion. I will do that and let’s see how it reads afterwards. > On May 2, 2018, at 12:21 PM, Tzu-Li Tai <notificati...@github.com> wrote: >

[GitHub] flink issue #5922: [FLINK-8780] [docs] Add Broadcast State documentation.

2018-05-02 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/5922 Thanks a lot for the comments @alpinegizmo and @tzulitai ! I integrated most of them and I am not sure how to integrate your comment @tzulitai . Do you have any proposal on how this can be made clearer? ---

[GitHub] flink pull request #5922: [FLINK-8780] [docs] Add Broadcast State documentat...

2018-05-02 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5922#discussion_r185449653 --- Diff: docs/dev/stream/state/broadcast_state.md --- @@ -0,0 +1,281 @@ +--- +title: "The Broadcast State Pattern" +nav-parent_id: strea

[GitHub] flink pull request #5913: [FLINK-9181] [docs] [sql-client] Add documentation...

2018-04-27 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5913#discussion_r184677692 --- Diff: docs/dev/table/sqlClient.md --- @@ -0,0 +1,538 @@ +--- +title: "SQL Client" +nav-parent_id: tableapi +nav-pos: 100 +is_

[GitHub] flink pull request #5913: [FLINK-9181] [docs] [sql-client] Add documentation...

2018-04-27 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5913#discussion_r184678745 --- Diff: docs/dev/table/sqlClient.md --- @@ -0,0 +1,538 @@ +--- +title: "SQL Client" +nav-parent_id: tableapi +nav-pos: 100 +is_

[GitHub] flink pull request #5913: [FLINK-9181] [docs] [sql-client] Add documentation...

2018-04-27 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5913#discussion_r184678478 --- Diff: docs/dev/table/sqlClient.md --- @@ -0,0 +1,538 @@ +--- +title: "SQL Client" +nav-parent_id: tableapi +nav-pos: 100 +is_

[GitHub] flink pull request #5913: [FLINK-9181] [docs] [sql-client] Add documentation...

2018-04-27 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5913#discussion_r184676876 --- Diff: docs/dev/table/sqlClient.md --- @@ -0,0 +1,538 @@ +--- +title: "SQL Client" +nav-parent_id: tableapi +nav-pos: 100 +is_

[GitHub] flink pull request #5913: [FLINK-9181] [docs] [sql-client] Add documentation...

2018-04-27 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5913#discussion_r184675777 --- Diff: docs/dev/table/sqlClient.md --- @@ -0,0 +1,538 @@ +--- +title: "SQL Client" +nav-parent_id: tableapi +nav-pos: 100 +is_

[GitHub] flink pull request #5913: [FLINK-9181] [docs] [sql-client] Add documentation...

2018-04-27 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5913#discussion_r184678308 --- Diff: docs/dev/table/sqlClient.md --- @@ -0,0 +1,538 @@ +--- +title: "SQL Client" +nav-parent_id: tableapi +nav-pos: 100 +is_

[GitHub] flink pull request #5913: [FLINK-9181] [docs] [sql-client] Add documentation...

2018-04-27 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5913#discussion_r184676407 --- Diff: docs/dev/table/sqlClient.md --- @@ -0,0 +1,538 @@ +--- +title: "SQL Client" +nav-parent_id: tableapi +nav-pos: 100 +is_

[GitHub] flink pull request #5913: [FLINK-9181] [docs] [sql-client] Add documentation...

2018-04-27 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5913#discussion_r184673962 --- Diff: docs/dev/table/sqlClient.md --- @@ -0,0 +1,538 @@ +--- +title: "SQL Client" +nav-parent_id: tableapi +nav-pos: 100 +is_

[GitHub] flink pull request #5913: [FLINK-9181] [docs] [sql-client] Add documentation...

2018-04-27 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5913#discussion_r184675917 --- Diff: docs/dev/table/sqlClient.md --- @@ -0,0 +1,538 @@ +--- +title: "SQL Client" +nav-parent_id: tableapi +nav-pos: 100 +is_

[GitHub] flink pull request #5913: [FLINK-9181] [docs] [sql-client] Add documentation...

2018-04-27 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5913#discussion_r184677353 --- Diff: docs/dev/table/sqlClient.md --- @@ -0,0 +1,538 @@ +--- +title: "SQL Client" +nav-parent_id: tableapi +nav-pos: 100 +is_

[GitHub] flink pull request #5913: [FLINK-9181] [docs] [sql-client] Add documentation...

2018-04-27 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5913#discussion_r184676633 --- Diff: docs/dev/table/sqlClient.md --- @@ -0,0 +1,538 @@ +--- +title: "SQL Client" +nav-parent_id: tableapi +nav-pos: 100 +is_

[GitHub] flink pull request #5913: [FLINK-9181] [docs] [sql-client] Add documentation...

2018-04-27 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5913#discussion_r184676032 --- Diff: docs/dev/table/sqlClient.md --- @@ -0,0 +1,538 @@ +--- +title: "SQL Client" +nav-parent_id: tableapi +nav-pos: 100 +is_

[GitHub] flink pull request #5913: [FLINK-9181] [docs] [sql-client] Add documentation...

2018-04-27 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5913#discussion_r184678944 --- Diff: docs/dev/table/sqlClient.md --- @@ -0,0 +1,538 @@ +--- +title: "SQL Client" +nav-parent_id: tableapi +nav-pos: 100 +is_

[GitHub] flink pull request #5913: [FLINK-9181] [docs] [sql-client] Add documentation...

2018-04-27 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5913#discussion_r184675061 --- Diff: docs/dev/table/sqlClient.md --- @@ -0,0 +1,538 @@ +--- +title: "SQL Client" +nav-parent_id: tableapi +nav-pos: 100 +is_

[GitHub] flink pull request #5913: [FLINK-9181] [docs] [sql-client] Add documentation...

2018-04-27 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5913#discussion_r184674272 --- Diff: docs/dev/table/sqlClient.md --- @@ -0,0 +1,538 @@ +--- +title: "SQL Client" +nav-parent_id: tableapi +nav-pos: 100 +is_

[GitHub] flink pull request #5913: [FLINK-9181] [docs] [sql-client] Add documentation...

2018-04-27 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5913#discussion_r184674886 --- Diff: docs/dev/table/sqlClient.md --- @@ -0,0 +1,538 @@ +--- +title: "SQL Client" +nav-parent_id: tableapi +nav-pos: 100 +is_

[GitHub] flink pull request #5922: [FLINK-8780] [docs] Add Broadcast State documentat...

2018-04-26 Thread kl0u
GitHub user kl0u opened a pull request: https://github.com/apache/flink/pull/5922 [FLINK-8780] [docs] Add Broadcast State documentation. R @fhueske You can merge this pull request into a Git repository by running: $ git pull https://github.com/kl0u/flink broadcast-docs-inv2

[GitHub] flink issue #5910: [FLINK-8841] [state] Remove HashMapSerializer and use Map...

2018-04-26 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/5910 Thanks @yuqi1129, @bowenli86 and @StefanRRichter for the reviews. I integrated your comments. If you are done with reviewing, I will merge it as soon as Travis gives the green light. ---

[GitHub] flink pull request #5910: [FLINK-8841] [state] Remove HashMapSerializer and ...

2018-04-25 Thread kl0u
GitHub user kl0u opened a pull request: https://github.com/apache/flink/pull/5910 [FLINK-8841] [state] Remove HashMapSerializer and use MapSerializer instead. ## What is the purpose of the change So far we had the `MapSerializer` and the `HashMapSerializer`. The two had

[GitHub] flink pull request #5482: [FLINK-8480][DataStream] Add Java API for timeboun...

2018-04-24 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5482#discussion_r183745456 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/datastream/JoinedStreams.java --- @@ -137,6 +158,151 @@ public EqualTo equalTo

[GitHub] flink issue #5813: [FLINK-8980] [e2e] Add a BucketingSink end-to-end test

2018-04-19 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/5813 Sounds good @twalthr ! ---

[GitHub] flink issue #5813: [FLINK-8980] [e2e] Add a BucketingSink end-to-end test

2018-04-16 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/5813 Thanks for the work @twalthr ! The test looks good but it fails occasionally due to https://issues.apache.org/jira/browse/FLINK-9113. Given that the test is unstable, I would suggest to not merge

[GitHub] flink pull request #5830: [FLINK-9152] Harmonize BroadcastProcessFunction Co...

2018-04-10 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5830#discussion_r180541104 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/functions/co/KeyedBroadcastProcessFunction.java --- @@ -89,11 +89,11

[GitHub] flink pull request #5830: [FLINK-9152] Harmonize BroadcastProcessFunction Co...

2018-04-10 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5830#discussion_r180538022 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/operators/co/CoBroadcastWithKeyedOperator.java --- @@ -33,6 +33,8 @@ import

[GitHub] flink pull request #5830: [FLINK-9152] Harmonize BroadcastProcessFunction Co...

2018-04-10 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5830#discussion_r180541190 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/functions/co/KeyedBroadcastProcessFunction.java --- @@ -89,11 +89,11

[GitHub] flink issue #5811: [FLINK-9113] [connectors] Fix flushing behavior of bucket...

2018-04-06 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/5811 Well it seems like for these tests, the `flush` is not actually flushing. The files are there, the `validPartLength` is correct (=6 as we just write `test1\n`) but the data is not actually on disk

[GitHub] flink pull request #5807: [FLINK-8982][E2E Tests] Add test for known failure...

2018-04-03 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5807#discussion_r178827723 --- Diff: flink-end-to-end-tests/flink-queryable-state-test/src/main/java/org/apache/flink/streaming/tests/queryablestate/EmailInformation.java --- @@ -0,0

[GitHub] flink pull request #5807: [FLINK-8982][E2E Tests] Add test for known failure...

2018-04-03 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5807#discussion_r178828967 --- Diff: flink-end-to-end-tests/flink-queryable-state-test/src/main/java/org/apache/flink/streaming/tests/queryablestate/QsBugPoc.java --- @@ -0,0 +1,133

[GitHub] flink pull request #5807: [FLINK-8982][E2E Tests] Add test for known failure...

2018-04-03 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5807#discussion_r178828372 --- Diff: flink-end-to-end-tests/run-pre-commit-tests.sh --- @@ -37,6 +37,14 @@ echo "Flink distribution directory: $FLINK_DIR" E

[GitHub] flink pull request #5807: [FLINK-8982][E2E Tests] Add test for known failure...

2018-04-03 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5807#discussion_r178827995 --- Diff: flink-end-to-end-tests/flink-queryable-state-test/src/main/java/org/apache/flink/streaming/tests/queryablestate/LabelSurrogate.java --- @@ -0,0

[GitHub] flink pull request #5807: [FLINK-8982][E2E Tests] Add test for known failure...

2018-04-03 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5807#discussion_r178827936 --- Diff: flink-end-to-end-tests/flink-queryable-state-test/src/main/java/org/apache/flink/streaming/tests/queryablestate/LabelSurrogate.java --- @@ -0,0

[GitHub] flink pull request #5807: [FLINK-8982][E2E Tests] Add test for known failure...

2018-04-03 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5807#discussion_r178829164 --- Diff: flink-end-to-end-tests/flink-queryable-state-test/src/main/java/org/apache/flink/streaming/tests/queryablestate/QsBugPoc.java --- @@ -0,0 +1,133

[GitHub] flink pull request #5807: [FLINK-8982][E2E Tests] Add test for known failure...

2018-04-03 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5807#discussion_r178827415 --- Diff: flink-end-to-end-tests/flink-queryable-state-test/src/main/java/org/apache/flink/streaming/tests/queryablestate/EmailInformation.java --- @@ -0,0

[GitHub] flink pull request #5807: [FLINK-8982][E2E Tests] Add test for known failure...

2018-04-03 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5807#discussion_r178827698 --- Diff: flink-end-to-end-tests/flink-queryable-state-test/src/main/java/org/apache/flink/streaming/tests/queryablestate/EmailInformation.java --- @@ -0,0

[GitHub] flink pull request #5807: [FLINK-8982][E2E Tests] Add test for known failure...

2018-04-03 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5807#discussion_r178827543 --- Diff: flink-end-to-end-tests/flink-queryable-state-test/src/main/java/org/apache/flink/streaming/tests/queryablestate/EmailInformation.java --- @@ -0,0

[GitHub] flink pull request #5807: [FLINK-8982][E2E Tests] Add test for known failure...

2018-04-03 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5807#discussion_r178827678 --- Diff: flink-end-to-end-tests/flink-queryable-state-test/src/main/java/org/apache/flink/streaming/tests/queryablestate/EmailInformation.java --- @@ -0,0

[GitHub] flink issue #5750: [FLINK-8973] [E2E] HA end-to-end test with StateMachineEx...

2018-04-03 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/5750 Thanks a lot @twalthr for the review! ---

[GitHub] flink pull request #5756: [FLINK-8813][flip6] Disallow PARALLELISM_AUTO_MAX ...

2018-03-29 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5756#discussion_r178030866 --- Diff: flink-test-utils-parent/flink-test-utils/src/main/java/org/apache/flink/test/util/MiniClusterResource.java --- @@ -93,6 +93,10 @@ private

[GitHub] flink pull request #5756: [FLINK-8813][flip6] Disallow PARALLELISM_AUTO_MAX ...

2018-03-28 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5756#discussion_r15838 --- Diff: flink-test-utils-parent/flink-test-utils/src/main/java/org/apache/flink/test/util/MiniClusterResource.java --- @@ -93,6 +93,10 @@ private

[GitHub] flink issue #5750: [FLINK-8973] [E2E] HA end-to-end test with StateMachineEx...

2018-03-27 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/5750 Hi @walterddr, I addressed most of your comments. Feel free to have another look. ---

[GitHub] flink pull request #5750: [FLINK-8973] [E2E] HA end-to-end test with StateMa...

2018-03-27 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5750#discussion_r177436350 --- Diff: flink-end-to-end-tests/test-scripts/common.sh --- @@ -59,9 +162,42 @@ function start_cluster { done } +function jm_watchdog

[GitHub] flink pull request #5750: [FLINK-8973] [E2E] HA end-to-end test with StateMa...

2018-03-27 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/5750#discussion_r177364376 --- Diff: flink-end-to-end-tests/test-scripts/common.sh --- @@ -39,6 +39,109 @@ cd $TEST_ROOT export TEST_DATA_DIR=$TEST_INFRA_DIR/temp-test-directory

[GitHub] flink issue #5751: [FLINK-9060][state] Deleting state using KeyedStateBacken...

2018-03-27 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/5751 Hi @sihuazhou ! I think that for now materializing the list of keys and then passing it to the `process` is the best solution. But keep in mind that this is only for the `HeapKeyedStateBackend

  1   2   3   4   5   6   7   8   9   10   >