[jira] [Updated] (FLINK-8709) Flaky test: SlotPoolRpcTest.testCancelSlotAllocationWithoutResourceManager

2018-02-19 Thread Bowen Li (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bowen Li updated FLINK-8709: Description: In both [https://travis-ci.org/apache/flink/jobs/343258724] and

[jira] [Updated] (FLINK-8710) AbstractYarnClusterDescriptor doesn't use pre-defined configs in Hadoop's YarnConfiguration

2018-02-19 Thread Bowen Li (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bowen Li updated FLINK-8710: Component/s: YARN > AbstractYarnClusterDescriptor doesn't use pre-defined configs in Hadoop's >

[jira] [Created] (FLINK-8710) AbstractYarnClusterDescriptor doesn't use pre-defined configs in Hadoop's YarnConfiguration

2018-02-19 Thread Bowen Li (JIRA)
Bowen Li created FLINK-8710: --- Summary: AbstractYarnClusterDescriptor doesn't use pre-defined configs in Hadoop's YarnConfiguration Key: FLINK-8710 URL: https://issues.apache.org/jira/browse/FLINK-8710

[jira] [Updated] (FLINK-8415) Unprotected access to recordsToSend in LongRecordWriterThread#shutdown()

2018-02-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated FLINK-8415: -- Description: {code} public void shutdown() { running = false; recordsToSend.complete(0L); {code} In

[jira] [Commented] (FLINK-8667) expose key in KeyedBroadcastProcessFunction#onTimer()

2018-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369741#comment-16369741 ] ASF GitHub Bot commented on FLINK-8667: --- Github user bowenli86 commented on the issue:

[GitHub] flink issue #5500: [FLINK-8667] expose key in KeyedBroadcastProcessFunction#...

2018-02-19 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5500 a irrelavent flaky unit test caused the error in travis build, and I've filed [FLINK-8709](https://issues.apache.org/jira/browse/FLINK-8709) for it ---

[jira] [Assigned] (FLINK-8709) Flaky test: SlotPoolRpcTest.testCancelSlotAllocationWithoutResourceManager

2018-02-19 Thread Bowen Li (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bowen Li reassigned FLINK-8709: --- Assignee: (was: Bowen Li) > Flaky test:

[jira] [Updated] (FLINK-8711) Flink with YARN uses wrong SlotsPerTaskManager

2018-02-19 Thread Aleksandr (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksandr updated FLINK-8711: - Labels: (was: yarn) > Flink with YARN uses wrong SlotsPerTaskManager >

[jira] [Updated] (FLINK-8711) Flink with YARN uses wrong SlotsPerTaskManager

2018-02-19 Thread Aleksandr (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksandr updated FLINK-8711: - Labels: yarn (was: ) > Flink with YARN uses wrong SlotsPerTaskManager >

[jira] [Updated] (FLINK-8711) Flink with YARN use wrong SlotsPerTaskManager

2018-02-19 Thread Aleksandr (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksandr updated FLINK-8711: - Description: I see wrong behavior for Flink in YARN. I tried to setup SlotsPerTaskManager using "-ys 2 

[jira] [Updated] (FLINK-8711) Flink with YARN uses wrong SlotsPerTaskManager

2018-02-19 Thread Aleksandr (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksandr updated FLINK-8711: - Summary: Flink with YARN uses wrong SlotsPerTaskManager (was: Flink with YARN use wrong

[jira] [Created] (FLINK-8711) Flink with YARN use wrong SlotsPerTaskManager

2018-02-19 Thread Aleksandr (JIRA)
Aleksandr created FLINK-8711: Summary: Flink with YARN use wrong SlotsPerTaskManager Key: FLINK-8711 URL: https://issues.apache.org/jira/browse/FLINK-8711 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-8695) Move RocksDB State Backend from 'flink-contrib' to 'flink-state-backends'

2018-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368951#comment-16368951 ] ASF GitHub Bot commented on FLINK-8695: --- Github user zentol commented on the issue:

[jira] [Commented] (FLINK-8695) Move RocksDB State Backend from 'flink-contrib' to 'flink-state-backends'

2018-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368950#comment-16368950 ] ASF GitHub Bot commented on FLINK-8695: --- Github user zentol commented on the issue:

[jira] [Updated] (FLINK-8679) RocksDBKeyedBackend.getKeys(stateName, namespace) doesn't filter data with namespace

2018-02-19 Thread Sihua Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sihua Zhou updated FLINK-8679: -- Affects Version/s: 1.5.0 > RocksDBKeyedBackend.getKeys(stateName, namespace) doesn't filter data with

[GitHub] flink issue #5523: [FLINK-8695] [rocksdb] Move flink-statebackend-rocksdb fr...

2018-02-19 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/5523 otherwise this looks good to me. ---

[GitHub] flink issue #5523: [FLINK-8695] [rocksdb] Move flink-statebackend-rocksdb fr...

2018-02-19 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/5523 Please modify travis_mvn_watchdog and update the rocksdb entry: ``` MODULES_CORE="\ flink-test-utils-parent/flink-test-utils,\ flink-contrib/flink-statebackend-rocksdb,\

[jira] [Created] (FLINK-8694) Make notifyDataAvailable call reliable

2018-02-19 Thread Piotr Nowojski (JIRA)
Piotr Nowojski created FLINK-8694: - Summary: Make notifyDataAvailable call reliable Key: FLINK-8694 URL: https://issues.apache.org/jira/browse/FLINK-8694 Project: Flink Issue Type: Sub-task

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-19 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r169021546 --- Diff: flink-contrib/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBKeyedStateBackend.java --- @@

[jira] [Commented] (FLINK-8695) Move RocksDB State Backend from 'flink-contrib' to 'flink-state-backends'

2018-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368945#comment-16368945 ] ASF GitHub Bot commented on FLINK-8695: --- GitHub user StephanEwen opened a pull request:

[jira] [Commented] (FLINK-5860) Replace all the file creating from java.io.tmpdir with TemporaryFolder

2018-02-19 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368944#comment-16368944 ] Chesnay Schepler commented on FLINK-5860: - Currently running another search, these are what i got

[GitHub] flink pull request #5523: [FLINK-8695] [rocksdb] Move flink-statebackend-roc...

2018-02-19 Thread StephanEwen
GitHub user StephanEwen opened a pull request: https://github.com/apache/flink/pull/5523 [FLINK-8695] [rocksdb] Move flink-statebackend-rocksdb from 'flink-contrib' to 'flink-state-backends'. ## What is the purpose of the change This moves the `flink-statebackend-rocksdb`

[jira] [Updated] (FLINK-8679) RocksDBKeyedBackend.getKeys(stateName, namespace) doesn't filter data with namespace

2018-02-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-8679: Fix Version/s: 1.5.0 > RocksDBKeyedBackend.getKeys(stateName, namespace) doesn't filter

[jira] [Commented] (FLINK-7477) Use "hadoop classpath" to augment classpath when available

2018-02-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368926#comment-16368926 ] Aljoscha Krettek commented on FLINK-7477: - Could you maybe comment on that magic? > Use "hadoop

[jira] [Closed] (FLINK-8668) Remove "hadoop classpath" from config.sh

2018-02-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-8668. --- Resolution: Fixed Fix Version/s: 1.5.0 Release Note: We removed the automatic

[jira] [Created] (FLINK-8695) Move RocksDB State Backend from 'flink-contrib' to 'flink-state-backends'

2018-02-19 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-8695: --- Summary: Move RocksDB State Backend from 'flink-contrib' to 'flink-state-backends' Key: FLINK-8695 URL: https://issues.apache.org/jira/browse/FLINK-8695 Project: Flink

[jira] [Commented] (FLINK-7756) RocksDB state backend Checkpointing (Async and Incremental) is not working with CEP.

2018-02-19 Thread tarun razdan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368869#comment-16368869 ] tarun razdan commented on FLINK-7756: - [~aljoscha] I've tried writing a minimal CEP program and it

[jira] [Commented] (FLINK-5860) Replace all the file creating from java.io.tmpdir with TemporaryFolder

2018-02-19 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368910#comment-16368910 ] Stephan Ewen commented on FLINK-5860: - [~shijinkui] I think this should be fixed by now. Can you

[jira] [Commented] (FLINK-5761) ClassNotFoundException during cancel job

2018-02-19 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368901#comment-16368901 ] Stephan Ewen commented on FLINK-5761: - Is this issue still relevant? This should be fixed for a while

[GitHub] flink pull request #5522: [hotfix] [javadoc] fix wrong javadoc in AbstractYa...

2018-02-19 Thread bowenli86
GitHub user bowenli86 opened a pull request: https://github.com/apache/flink/pull/5522 [hotfix] [javadoc] fix wrong javadoc in AbstractYarnClusterDescriptor ## What is the purpose of the change hotfix of javadoc in AbstractYarnClusterDescriptor ## Brief change log

[jira] [Commented] (FLINK-8688) Enable distinct aggregation for data stream on Table/SQL API

2018-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368913#comment-16368913 ] ASF GitHub Bot commented on FLINK-8688: --- Github user aljoscha closed the pull request at:

[jira] [Commented] (FLINK-5761) ClassNotFoundException during cancel job

2018-02-19 Thread Andrey (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368917#comment-16368917 ] Andrey commented on FLINK-5761: --- Hi! Haven't seen it for a while. Let's close it. Will re-open if reproduce

[jira] [Commented] (FLINK-7756) RocksDB state backend Checkpointing (Async and Incremental) is not working with CEP.

2018-02-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368911#comment-16368911 ] Aljoscha Krettek commented on FLINK-7756: - [~trazdan] If you would be willing to try a custom

[jira] [Commented] (FLINK-8547) Implement CheckpointBarrierHandler not to spill data for exactly-once based on credit-based flow control

2018-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368912#comment-16368912 ] ASF GitHub Bot commented on FLINK-8547: --- Github user zhijiangW commented on the issue:

[GitHub] flink pull request #5502: [FLINK-8688] Remove "hadoop classpath" from config...

2018-02-19 Thread aljoscha
Github user aljoscha closed the pull request at: https://github.com/apache/flink/pull/5502 ---

[GitHub] flink issue #5400: [FLINK-8547][network] Implement CheckpointBarrierHandler ...

2018-02-19 Thread zhijiangW
Github user zhijiangW commented on the issue: https://github.com/apache/flink/pull/5400 @pnowojski , I have changed the `EXACTLY_ONCE_BLOCKING_DATA_ENABLED` as true and squashed the commits. ---

[jira] [Updated] (FLINK-8679) RocksDBKeyedBackend.getKeys(stateName, namespace) doesn't filter data with namespace

2018-02-19 Thread Sihua Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sihua Zhou updated FLINK-8679: -- Priority: Blocker (was: Critical) > RocksDBKeyedBackend.getKeys(stateName, namespace) doesn't filter

[jira] [Commented] (FLINK-8663) Execution of DataStreams result in non functionality of size of Window for countWindow

2018-02-19 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368957#comment-16368957 ] Stephan Ewen commented on FLINK-8663: - I don't think this is wrong, it depends on what you assume as

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-19 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r169047804 --- Diff: flink-contrib/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBKeyedStateBackend.java --- @@

[jira] [Commented] (FLINK-8667) expose key in KeyedBroadcastProcessFunction#onTimer()

2018-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369061#comment-16369061 ] ASF GitHub Bot commented on FLINK-8667: --- Github user pnowojski commented on a diff in the pull

[jira] [Commented] (FLINK-8667) expose key in KeyedBroadcastProcessFunction#onTimer()

2018-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369057#comment-16369057 ] ASF GitHub Bot commented on FLINK-8667: --- Github user pnowojski commented on a diff in the pull

[jira] [Commented] (FLINK-8667) expose key in KeyedBroadcastProcessFunction#onTimer()

2018-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369060#comment-16369060 ] ASF GitHub Bot commented on FLINK-8667: --- Github user pnowojski commented on a diff in the pull

[jira] [Commented] (FLINK-8667) expose key in KeyedBroadcastProcessFunction#onTimer()

2018-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369058#comment-16369058 ] ASF GitHub Bot commented on FLINK-8667: --- Github user pnowojski commented on a diff in the pull

[jira] [Commented] (FLINK-8667) expose key in KeyedBroadcastProcessFunction#onTimer()

2018-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369056#comment-16369056 ] ASF GitHub Bot commented on FLINK-8667: --- Github user pnowojski commented on a diff in the pull

[jira] [Commented] (FLINK-8667) expose key in KeyedBroadcastProcessFunction#onTimer()

2018-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369055#comment-16369055 ] ASF GitHub Bot commented on FLINK-8667: --- Github user pnowojski commented on a diff in the pull

[GitHub] flink pull request #5500: [FLINK-8667] expose key in KeyedBroadcastProcessFu...

2018-02-19 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/5500#discussion_r169055105 --- Diff: flink-tests/src/test/java/org/apache/flink/test/streaming/runtime/BroadcastStateITCase.java --- @@ -145,17 +147,16 @@ public Watermark

[GitHub] flink pull request #5500: [FLINK-8667] expose key in KeyedBroadcastProcessFu...

2018-02-19 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/5500#discussion_r169051991 --- Diff: flink-streaming-java/src/test/java/org/apache/flink/streaming/api/operators/co/CoBroadcastWithKeyedOperatorTest.java --- @@ -358,6 +365,8 @@

[GitHub] flink pull request #5500: [FLINK-8667] expose key in KeyedBroadcastProcessFu...

2018-02-19 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/5500#discussion_r169055575 --- Diff: flink-tests/src/test/java/org/apache/flink/test/streaming/runtime/BroadcastStateITCase.java --- @@ -145,17 +147,16 @@ public Watermark

[jira] [Commented] (FLINK-8667) expose key in KeyedBroadcastProcessFunction#onTimer()

2018-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369062#comment-16369062 ] ASF GitHub Bot commented on FLINK-8667: --- Github user pnowojski commented on a diff in the pull

[jira] [Commented] (FLINK-8667) expose key in KeyedBroadcastProcessFunction#onTimer()

2018-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369059#comment-16369059 ] ASF GitHub Bot commented on FLINK-8667: --- Github user pnowojski commented on a diff in the pull

[GitHub] flink pull request #5500: [FLINK-8667] expose key in KeyedBroadcastProcessFu...

2018-02-19 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/5500#discussion_r169057826 --- Diff: flink-tests/src/test/java/org/apache/flink/test/streaming/runtime/BroadcastStateITCase.java --- @@ -169,7 +170,10 @@ public void

[GitHub] flink pull request #5500: [FLINK-8667] expose key in KeyedBroadcastProcessFu...

2018-02-19 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/5500#discussion_r169051920 --- Diff: flink-streaming-java/src/test/java/org/apache/flink/streaming/api/operators/co/CoBroadcastWithKeyedOperatorTest.java --- @@ -204,6 +208,8 @@

[GitHub] flink pull request #5500: [FLINK-8667] expose key in KeyedBroadcastProcessFu...

2018-02-19 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/5500#discussion_r169054889 --- Diff: flink-tests/src/test/java/org/apache/flink/test/streaming/runtime/BroadcastStateITCase.java --- @@ -145,17 +147,16 @@ public Watermark

[GitHub] flink pull request #5500: [FLINK-8667] expose key in KeyedBroadcastProcessFu...

2018-02-19 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/5500#discussion_r169058054 --- Diff: flink-tests/src/test/java/org/apache/flink/test/streaming/runtime/BroadcastStateITCase.java --- @@ -145,17 +147,16 @@ public Watermark

[GitHub] flink pull request #5500: [FLINK-8667] expose key in KeyedBroadcastProcessFu...

2018-02-19 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/5500#discussion_r169057332 --- Diff: flink-tests/src/test/java/org/apache/flink/test/streaming/runtime/BroadcastStateITCase.java --- @@ -169,7 +170,10 @@ public void

[jira] [Commented] (FLINK-8560) add KeyedProcessFunction to expose the key in onTimer() and other methods

2018-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369066#comment-16369066 ] ASF GitHub Bot commented on FLINK-8560: --- Github user pnowojski commented on a diff in the pull

[jira] [Closed] (FLINK-8699) Fix concurrency problem in rocksdb full checkpoint

2018-02-19 Thread Sihua Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sihua Zhou closed FLINK-8699. - Resolution: Fixed Release Note: Richter has fixed this in his hotfix. > Fix concurrency problem in

[GitHub] flink issue #5465: [FLINK-8639][State Backends]Fix always need to seek multi...

2018-02-19 Thread sihuazhou
Github user sihuazhou commented on the issue: https://github.com/apache/flink/pull/5465 I think maybe a best way to fix this is to make `mapState.iterator()` return a `FlinkIterator` , aand `FlinkIterator` implement `AutoCloseable`, and let `FlinkIterator` hold the `RocsdbIterator`

[jira] [Commented] (FLINK-8639) Fix always need to seek multiple times when iterator RocksDBMapState

2018-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369107#comment-16369107 ] ASF GitHub Bot commented on FLINK-8639: --- Github user sihuazhou commented on the issue:

[jira] [Updated] (FLINK-8704) Migrate tests from TestingCluster to MiniClusterResource

2018-02-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-8704: Fix Version/s: 1.5.0 > Migrate tests from TestingCluster to MiniClusterResource >

[jira] [Updated] (FLINK-8704) Migrate tests from TestingCluster to MiniClusterResource

2018-02-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-8704: Component/s: Tests > Migrate tests from TestingCluster to MiniClusterResource >

[jira] [Updated] (FLINK-8703) Migrate tests from LocalFlinkMiniCluster to MiniClusterResource

2018-02-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-8703: Priority: Blocker (was: Major) > Migrate tests from LocalFlinkMiniCluster to

[jira] [Resolved] (FLINK-8584) Handle read-only buffers in DataInputDeserializer

2018-02-19 Thread Piotr Nowojski (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski resolved FLINK-8584. --- Resolution: Fixed > Handle read-only buffers in DataInputDeserializer >

[jira] [Closed] (FLINK-8587) Drop unused AdaptiveSpanningRecordDeserializer

2018-02-19 Thread Piotr Nowojski (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-8587. - Resolution: Fixed > Drop unused AdaptiveSpanningRecordDeserializer >

[jira] [Resolved] (FLINK-8583) Pass BufferConsumer to subpartitions

2018-02-19 Thread Piotr Nowojski (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski resolved FLINK-8583. --- Resolution: Fixed > Pass BufferConsumer to subpartitions >

[GitHub] flink issue #5486: [FLINK-8600] Don't use flaky truncate() test in Bucketing...

2018-02-19 Thread aljoscha
Github user aljoscha commented on the issue: https://github.com/apache/flink/pull/5486 @kl0u Thanks for the review! I changed the code to check `useTruncate` before calling. Regarding `fsConfig`, the settings in there are for `FileSystem` while the settings that are

[jira] [Commented] (FLINK-8706) Supported Data Types - Six or Seven

2018-02-19 Thread Timo Walther (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369229#comment-16369229 ] Timo Walther commented on FLINK-8706: - Thanks for the hint [~anonz3...@gmail.com]. The documentation

[jira] [Closed] (FLINK-8383) flink-mesos build failing: duplicate Jackson relocation in shaded jar

2018-02-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-8383. --- Resolution: Fixed > flink-mesos build failing: duplicate Jackson relocation in shaded jar >

[jira] [Assigned] (FLINK-6489) Rework 'start-local.bat' to 'start-local-cluster.bat'

2018-02-19 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen reassigned FLINK-6489: --- Assignee: Stephan Ewen > Rework 'start-local.bat' to 'start-local-cluster.bat' >

[jira] [Commented] (FLINK-8581) Improve performance for low latency network

2018-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369010#comment-16369010 ] ASF GitHub Bot commented on FLINK-8581: --- Github user pnowojski commented on the issue:

[jira] [Created] (FLINK-8698) Use Flip-6 MiniCluster in Local(Stream)Environment

2018-02-19 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8698: Summary: Use Flip-6 MiniCluster in Local(Stream)Environment Key: FLINK-8698 URL: https://issues.apache.org/jira/browse/FLINK-8698 Project: Flink Issue Type:

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-19 Thread sihuazhou
Github user sihuazhou commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r169062887 --- Diff: flink-contrib/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBKeyedStateBackend.java --- @@ -336,1697

[jira] [Commented] (FLINK-8699) Fix concurrency problem in rocksdb full checkpoint

2018-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369087#comment-16369087 ] ASF GitHub Bot commented on FLINK-8699: --- Github user sihuazhou closed the pull request at:

[GitHub] flink pull request #5525: [FLINK-8699][hotfix] Fix in concurrency problem fo...

2018-02-19 Thread sihuazhou
Github user sihuazhou closed the pull request at: https://github.com/apache/flink/pull/5525 ---

[GitHub] flink pull request #5423: [FLINK-8581] Improve performance for low latency n...

2018-02-19 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5423#discussion_r169082736 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/consumer/InputGate.java --- @@ -72,7 +73,19 @@

[jira] [Commented] (FLINK-8581) Improve performance for low latency network

2018-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369142#comment-16369142 ] ASF GitHub Bot commented on FLINK-8581: --- Github user StefanRRichter commented on a diff in the pull

[GitHub] flink issue #5423: [FLINK-8581] Improve performance for low latency network

2018-02-19 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/5423 Thanks for those very good improvements, I will merge this. ---

[GitHub] flink issue #5490: [FLINK-8657][doc]Fix incorrect description in the documen...

2018-02-19 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/5490 Thanks for the correction, LGTM 👍 ---

[jira] [Commented] (FLINK-8657) Fix incorrect description for external checkpoint vs savepoint

2018-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369168#comment-16369168 ] ASF GitHub Bot commented on FLINK-8657: --- Github user StefanRRichter commented on the issue:

[jira] [Commented] (FLINK-8600) BucketingSink errors out when used with Presto filesystem

2018-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369190#comment-16369190 ] ASF GitHub Bot commented on FLINK-8600: --- Github user aljoscha commented on the issue:

[GitHub] flink issue #5486: [FLINK-8600] Don't use flaky truncate() test in Bucketing...

2018-02-19 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/5486 @aljoscha Yes it does. I did not get it in the first place but I think that this clarifies things! ---

[jira] [Created] (FLINK-8705) Integrate Remote(Stream)Environment with Flip-6 cluster

2018-02-19 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8705: Summary: Integrate Remote(Stream)Environment with Flip-6 cluster Key: FLINK-8705 URL: https://issues.apache.org/jira/browse/FLINK-8705 Project: Flink Issue

[jira] [Commented] (FLINK-8705) Integrate Remote(Stream)Environment with Flip-6 cluster

2018-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369204#comment-16369204 ] ASF GitHub Bot commented on FLINK-8705: --- GitHub user tillrohrmann opened a pull request:

[jira] [Commented] (FLINK-8639) Fix always need to seek multiple times when iterator RocksDBMapState

2018-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369231#comment-16369231 ] ASF GitHub Bot commented on FLINK-8639: --- Github user StefanRRichter commented on a diff in the pull

[jira] [Commented] (FLINK-8581) Improve performance for low latency network

2018-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369149#comment-16369149 ] ASF GitHub Bot commented on FLINK-8581: --- Github user asfgit closed the pull request at:

[jira] [Closed] (FLINK-8586) Drop SpilledSubpartitionViewTest

2018-02-19 Thread Piotr Nowojski (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-8586. - > Drop SpilledSubpartitionViewTest > - > > Key:

[GitHub] flink pull request #5518: [FLINK-8679][State Backends]Fix RocksDBKeyedBacken...

2018-02-19 Thread aljoscha
Github user aljoscha commented on a diff in the pull request: https://github.com/apache/flink/pull/5518#discussion_r169065861 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/StateBackendTestBase.java --- @@ -211,24 +211,55 @@ protected CheckpointStreamFactory

[jira] [Commented] (FLINK-8679) RocksDBKeyedBackend.getKeys(stateName, namespace) doesn't filter data with namespace

2018-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369171#comment-16369171 ] ASF GitHub Bot commented on FLINK-8679: --- Github user aljoscha commented on a diff in the pull

[GitHub] flink pull request #5465: [FLINK-8639][State Backends]Fix always need to see...

2018-02-19 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5465#discussion_r169099355 --- Diff: flink-contrib/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBMapState.java --- @@ -319,6 +321,9

[GitHub] flink pull request #5465: [FLINK-8639][State Backends]Fix always need to see...

2018-02-19 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5465#discussion_r169100675 --- Diff: flink-contrib/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBMapState.java --- @@ -400,7 +410,7

[jira] [Commented] (FLINK-8639) Fix always need to seek multiple times when iterator RocksDBMapState

2018-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369216#comment-16369216 ] ASF GitHub Bot commented on FLINK-8639: --- Github user StefanRRichter commented on a diff in the pull

[GitHub] flink pull request #5465: [FLINK-8639][State Backends]Fix always need to see...

2018-02-19 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5465#discussion_r169099948 --- Diff: flink-contrib/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBMapState.java --- @@ -520,7 +530,7

[jira] [Commented] (FLINK-8639) Fix always need to seek multiple times when iterator RocksDBMapState

2018-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369215#comment-16369215 ] ASF GitHub Bot commented on FLINK-8639: --- Github user StefanRRichter commented on a diff in the pull

[jira] [Commented] (FLINK-8639) Fix always need to seek multiple times when iterator RocksDBMapState

2018-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369214#comment-16369214 ] ASF GitHub Bot commented on FLINK-8639: --- Github user StefanRRichter commented on a diff in the pull

[jira] [Commented] (FLINK-8581) Improve performance for low latency network

2018-02-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16369143#comment-16369143 ] ASF GitHub Bot commented on FLINK-8581: --- Github user StefanRRichter commented on the issue:

[GitHub] flink pull request #5423: [FLINK-8581] Improve performance for low latency n...

2018-02-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5423 ---

[jira] [Closed] (FLINK-8590) Drop ResultPartitionWriter#writeBufferToAllSubpartitions method

2018-02-19 Thread Piotr Nowojski (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-8590. - Resolution: Fixed > Drop ResultPartitionWriter#writeBufferToAllSubpartitions method >

[jira] [Closed] (FLINK-8588) Handle sliced buffers in RecordDeserializer

2018-02-19 Thread Piotr Nowojski (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-8588. - Resolution: Fixed > Handle sliced buffers in RecordDeserializer >

[jira] [Closed] (FLINK-8584) Handle read-only buffers in DataInputDeserializer

2018-02-19 Thread Piotr Nowojski (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-8584. - > Handle read-only buffers in DataInputDeserializer >

[jira] [Closed] (FLINK-8589) Add data polling method to InputGate

2018-02-19 Thread Piotr Nowojski (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-8589. - Resolution: Fixed > Add data polling method to InputGate > >

  1   2   3   >