[GitHub] flink pull request #5660: [FLINK-8861] [table] Add support for batch queries...

2018-03-07 Thread xccui
GitHub user xccui opened a pull request: https://github.com/apache/flink/pull/5660 [FLINK-8861] [table] Add support for batch queries in SQL Client ## What is the purpose of the change This PR added support for batch queries in SQL Client. ## Brief change log

[jira] [Commented] (FLINK-8861) Add support for batch queries in SQL Client

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389906#comment-16389906 ] ASF GitHub Bot commented on FLINK-8861: --- GitHub user xccui opened a pull request:

[jira] [Closed] (FLINK-8892) Travis Build: Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.18.1:test (integration-tests) on project flink-tests_2.11

2018-03-07 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler closed FLINK-8892. --- Resolution: Duplicate Fix Version/s: (was: 1.6.0) > Travis Build: Failed to

[GitHub] flink pull request #5650: [FLINK-8845][state] Introduce RocksDBWriteBatchWra...

2018-03-07 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/5650#discussion_r172934683 --- Diff: flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBWriteBatchWrapper.java --- @@

[jira] [Commented] (FLINK-8487) State loss after multiple restart attempts

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390155#comment-16390155 ] ASF GitHub Bot commented on FLINK-8487: --- Github user StephanEwen commented on a diff in the pull

[jira] [Commented] (FLINK-8487) State loss after multiple restart attempts

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390157#comment-16390157 ] ASF GitHub Bot commented on FLINK-8487: --- Github user StephanEwen commented on a diff in the pull

[jira] [Commented] (FLINK-8487) State loss after multiple restart attempts

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390152#comment-16390152 ] ASF GitHub Bot commented on FLINK-8487: --- Github user StephanEwen commented on a diff in the pull

[jira] [Commented] (FLINK-8487) State loss after multiple restart attempts

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390156#comment-16390156 ] ASF GitHub Bot commented on FLINK-8487: --- Github user StephanEwen commented on a diff in the pull

[jira] [Commented] (FLINK-8487) State loss after multiple restart attempts

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390154#comment-16390154 ] ASF GitHub Bot commented on FLINK-8487: --- Github user StephanEwen commented on a diff in the pull

[GitHub] flink pull request #5654: [FLINK-8487] Verify ZooKeeper checkpoint store beh...

2018-03-07 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/5654#discussion_r172972120 --- Diff: flink-tests/src/test/java/org/apache/flink/test/checkpointing/ZooKeeperHighAvailabilityITCase.java --- @@ -0,0 +1,387 @@ +/* + *

[jira] [Closed] (FLINK-8877) Configure Kryo's log level based on Flink's log level

2018-03-07 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-8877. --- > Configure Kryo's log level based on Flink's log level >

[jira] [Resolved] (FLINK-8876) Improve concurrent access handling in stateful serializers

2018-03-07 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-8876. - Resolution: Fixed Fixed by resolving all sub-issues > Improve concurrent access handling in

[jira] [Closed] (FLINK-8876) Improve concurrent access handling in stateful serializers

2018-03-07 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-8876. --- > Improve concurrent access handling in stateful serializers >

[jira] [Resolved] (FLINK-8878) Check for concurrent access to Kryo Serializer

2018-03-07 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-8878. - Resolution: Fixed Fixed in - 1.5.0 via 8a77dbf16febea72d389b2dc497e63cb768a3d2d - 1.6.0 via

[jira] [Resolved] (FLINK-8877) Configure Kryo's log level based on Flink's log level

2018-03-07 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-8877. - Resolution: Fixed Fixed in - 1.5.0 via b0418b41f8fa02d3217b760c5bdfcdd7efdc1eac - 1.6.0 via

[jira] [Closed] (FLINK-8878) Check for concurrent access to Kryo Serializer

2018-03-07 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-8878. --- > Check for concurrent access to Kryo Serializer > -- > >

[jira] [Commented] (FLINK-8876) Improve concurrent access handling in stateful serializers

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389934#comment-16389934 ] ASF GitHub Bot commented on FLINK-8876: --- Github user StephanEwen commented on the issue:

[GitHub] flink issue #5645: FLINK-8876 Improve concurrent access handling in stateful...

2018-03-07 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/5645 Merging this after fixing the comment... ---

[jira] [Commented] (FLINK-8876) Improve concurrent access handling in stateful serializers

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389933#comment-16389933 ] ASF GitHub Bot commented on FLINK-8876: --- Github user StephanEwen commented on a diff in the pull

[GitHub] flink pull request #5645: FLINK-8876 Improve concurrent access handling in s...

2018-03-07 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/5645#discussion_r172939401 --- Diff: flink-formats/flink-avro/src/main/java/org/apache/flink/formats/avro/typeutils/AvroSerializer.java --- @@ -163,8 +224,9 @@ public T copy(T

[GitHub] flink pull request #5654: [FLINK-8487] Verify ZooKeeper checkpoint store beh...

2018-03-07 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/5654#discussion_r172963487 --- Diff: flink-tests/src/test/java/org/apache/flink/test/checkpointing/ZooKeeperHighAvailabilityITCase.java --- @@ -0,0 +1,387 @@ +/* + *

[GitHub] flink pull request #5654: [FLINK-8487] Verify ZooKeeper checkpoint store beh...

2018-03-07 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/5654#discussion_r172972943 --- Diff: flink-tests/src/test/java/org/apache/flink/test/checkpointing/ZooKeeperHighAvailabilityITCase.java --- @@ -0,0 +1,387 @@ +/* + *

[GitHub] flink pull request #5654: [FLINK-8487] Verify ZooKeeper checkpoint store beh...

2018-03-07 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/5654#discussion_r172972678 --- Diff: flink-tests/src/test/java/org/apache/flink/test/checkpointing/ZooKeeperHighAvailabilityITCase.java --- @@ -0,0 +1,387 @@ +/* + *

[GitHub] flink pull request #5654: [FLINK-8487] Verify ZooKeeper checkpoint store beh...

2018-03-07 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/5654#discussion_r172972454 --- Diff: flink-tests/src/test/java/org/apache/flink/test/checkpointing/ZooKeeperHighAvailabilityITCase.java --- @@ -0,0 +1,387 @@ +/* + *

[GitHub] flink pull request #5654: [FLINK-8487] Verify ZooKeeper checkpoint store beh...

2018-03-07 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/5654#discussion_r172972736 --- Diff: flink-tests/src/test/java/org/apache/flink/test/checkpointing/ZooKeeperHighAvailabilityITCase.java --- @@ -0,0 +1,387 @@ +/* + *

[jira] [Commented] (FLINK-8487) State loss after multiple restart attempts

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390175#comment-16390175 ] ASF GitHub Bot commented on FLINK-8487: --- Github user StephanEwen commented on a diff in the pull

[jira] [Commented] (FLINK-8487) State loss after multiple restart attempts

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390204#comment-16390204 ] ASF GitHub Bot commented on FLINK-8487: --- Github user StephanEwen commented on a diff in the pull

[jira] [Commented] (FLINK-8487) State loss after multiple restart attempts

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390206#comment-16390206 ] ASF GitHub Bot commented on FLINK-8487: --- Github user StephanEwen commented on a diff in the pull

[GitHub] flink pull request #5656: [FLINK-8487] Verify ZooKeeper checkpoint store beh...

2018-03-07 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/5656#discussion_r172980021 --- Diff: flink-tests/src/test/java/org/apache/flink/test/checkpointing/ZooKeeperHighAvailabilityITCase.java --- @@ -0,0 +1,333 @@ +/* + *

[GitHub] flink pull request #5656: [FLINK-8487] Verify ZooKeeper checkpoint store beh...

2018-03-07 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/5656#discussion_r172980585 --- Diff: flink-tests/src/test/java/org/apache/flink/test/checkpointing/ZooKeeperHighAvailabilityITCase.java --- @@ -0,0 +1,333 @@ +/* + *

[GitHub] flink pull request #5656: [FLINK-8487] Verify ZooKeeper checkpoint store beh...

2018-03-07 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/5656#discussion_r172979459 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/concurrent/FutureUtils.java --- @@ -223,6 +224,81 @@ } }

[GitHub] flink pull request #5656: [FLINK-8487] Verify ZooKeeper checkpoint store beh...

2018-03-07 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/5656#discussion_r172978813 --- Diff: flink-core/src/main/java/org/apache/flink/api/common/time/Deadline.java --- @@ -0,0 +1,68 @@ +/* + * Licensed to the Apache Software

[GitHub] flink pull request #5656: [FLINK-8487] Verify ZooKeeper checkpoint store beh...

2018-03-07 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/5656#discussion_r172978556 --- Diff: flink-core/src/main/java/org/apache/flink/api/common/time/Deadline.java --- @@ -0,0 +1,68 @@ +/* + * Licensed to the Apache Software

[GitHub] flink issue #5634: [FLINK-5479] [kafka] Idleness detection for periodic per-...

2018-03-07 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/5634 @tweise @tzulitai I would suggest to solve this the following way, which should be both simple and cover our cases: - We extend the current periodic watermark generators for

[GitHub] flink pull request #5620: [FLINK-8824] [kafka] Replace getCanonicalName with...

2018-03-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5620 ---

[GitHub] flink pull request #5643: can integrate and support on apache kudu ?

2018-03-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5643 ---

[GitHub] flink pull request #5646: [hotfix] [javadocs] minor javadoc fix in Timestamp...

2018-03-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5646 ---

[GitHub] flink pull request #5614: [FLINK-8827] When FLINK_CONF_DIR contains spaces, ...

2018-03-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5614 ---

[GitHub] flink issue #5655: [FLINK-8487] Verify ZooKeeper checkpoint store behaviour ...

2018-03-07 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/5655 This code is (except for lambdas) identical to #5654 Please apply the same changes here as to the other PR (with regard to the review comments). ---

[jira] [Commented] (FLINK-8487) State loss after multiple restart attempts

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390207#comment-16390207 ] ASF GitHub Bot commented on FLINK-8487: --- Github user StephanEwen commented on a diff in the pull

[jira] [Commented] (FLINK-8487) State loss after multiple restart attempts

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390205#comment-16390205 ] ASF GitHub Bot commented on FLINK-8487: --- Github user StephanEwen commented on a diff in the pull

[jira] [Commented] (FLINK-8487) State loss after multiple restart attempts

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390208#comment-16390208 ] ASF GitHub Bot commented on FLINK-8487: --- Github user StephanEwen commented on a diff in the pull

[jira] [Commented] (FLINK-8824) In Kafka Consumers, replace 'getCanonicalName()' with 'getClassName()'

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390163#comment-16390163 ] ASF GitHub Bot commented on FLINK-8824: --- Github user asfgit closed the pull request at:

[jira] [Commented] (FLINK-8827) When FLINK_CONF_DIR contains spaces, execute zookeeper related scripts failed

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390162#comment-16390162 ] ASF GitHub Bot commented on FLINK-8827: --- Github user asfgit closed the pull request at:

[GitHub] flink pull request #5654: [FLINK-8487] Verify ZooKeeper checkpoint store beh...

2018-03-07 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/5654#discussion_r172977111 --- Diff: flink-tests/src/test/java/org/apache/flink/test/checkpointing/ZooKeeperHighAvailabilityITCase.java --- @@ -0,0 +1,387 @@ +/* + *

[jira] [Commented] (FLINK-8487) State loss after multiple restart attempts

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390174#comment-16390174 ] ASF GitHub Bot commented on FLINK-8487: --- Github user StephanEwen commented on the issue:

[jira] [Closed] (FLINK-8879) Add concurrent access check to AvroSerializer

2018-03-07 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-8879. --- > Add concurrent access check to AvroSerializer > - > >

[jira] [Resolved] (FLINK-8879) Add concurrent access check to AvroSerializer

2018-03-07 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-8879. - Resolution: Fixed Fixed in - 1.5.0 via 6ec1b784e5fea4d9d5208d44caf6fefde14f4aa8 - 1.6.0 via

[jira] [Assigned] (FLINK-8863) Add user-defined function support in SQL Client

2018-03-07 Thread Xingcan Cui (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingcan Cui reassigned FLINK-8863: -- Assignee: Xingcan Cui > Add user-defined function support in SQL Client >

[GitHub] flink issue #5634: [FLINK-5479] [kafka] Idleness detection for periodic per-...

2018-03-07 Thread tweise
Github user tweise commented on the issue: https://github.com/apache/flink/pull/5634 @tzulitai @StephanEwen the current idleness detection in the source context isn't a replacement for what is required to deal with an inactive partition (or Kinesis shard). When a connector subtask

[jira] [Commented] (FLINK-5479) Per-partition watermarks in FlinkKafkaConsumer should consider idle partitions

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389940#comment-16389940 ] ASF GitHub Bot commented on FLINK-5479: --- Github user tweise commented on the issue:

[jira] [Commented] (FLINK-8799) Make AbstractYarnClusterDescriptor immutable

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390201#comment-16390201 ] ASF GitHub Bot commented on FLINK-8799: --- Github user GJL commented on a diff in the pull request:

[jira] [Resolved] (FLINK-8824) In Kafka Consumers, replace 'getCanonicalName()' with 'getClassName()'

2018-03-07 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-8824. - Resolution: Fixed Fix Version/s: 1.6.0 Fixed in - 1.5.0 via

[jira] [Commented] (FLINK-5479) Per-partition watermarks in FlinkKafkaConsumer should consider idle partitions

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390245#comment-16390245 ] ASF GitHub Bot commented on FLINK-5479: --- Github user StephanEwen commented on the issue:

[GitHub] flink pull request #5659: [FLINK-8661] [table] Add support for batch queries...

2018-03-07 Thread xccui
GitHub user xccui opened a pull request: https://github.com/apache/flink/pull/5659 [FLINK-8661] [table] Add support for batch queries in SQL Client ## What is the purpose of the change This PR added support for batch queries in SQL Client. ## Brief change log

[jira] [Created] (FLINK-8892) Travis Build: Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.18.1:test (integration-tests) on project flink-tests_2.11

2018-03-07 Thread Bowen Li (JIRA)
Bowen Li created FLINK-8892: --- Summary: Travis Build: Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.18.1:test (integration-tests) on project flink-tests_2.11 Key: FLINK-8892 URL:

[jira] [Commented] (FLINK-8661) Replace Collections.EMPTY_MAP with Collections.emptyMap()

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389898#comment-16389898 ] ASF GitHub Bot commented on FLINK-8661: --- GitHub user xccui opened a pull request:

[jira] [Commented] (FLINK-8487) State loss after multiple restart attempts

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390153#comment-16390153 ] ASF GitHub Bot commented on FLINK-8487: --- Github user StephanEwen commented on a diff in the pull

[GitHub] flink pull request #5659: [FLINK-8661] [table] Add support for batch queries...

2018-03-07 Thread xccui
Github user xccui closed the pull request at: https://github.com/apache/flink/pull/5659 ---

[jira] [Commented] (FLINK-8661) Replace Collections.EMPTY_MAP with Collections.emptyMap()

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389900#comment-16389900 ] ASF GitHub Bot commented on FLINK-8661: --- Github user xccui closed the pull request at:

[jira] [Commented] (FLINK-8845) Use WriteBatch to improve performance for recovery in RocksDB backend

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390026#comment-16390026 ] ASF GitHub Bot commented on FLINK-8845: --- Github user bowenli86 commented on a diff in the pull

[jira] [Commented] (FLINK-8845) Use WriteBatch to improve performance for recovery in RocksDB backend

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390024#comment-16390024 ] ASF GitHub Bot commented on FLINK-8845: --- Github user bowenli86 commented on a diff in the pull

[jira] [Commented] (FLINK-8845) Use WriteBatch to improve performance for recovery in RocksDB backend

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390025#comment-16390025 ] ASF GitHub Bot commented on FLINK-8845: --- Github user bowenli86 commented on a diff in the pull

[GitHub] flink pull request #5650: [FLINK-8845][state] Introduce RocksDBWriteBatchWra...

2018-03-07 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/5650#discussion_r172935414 --- Diff: flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBWriteBatchWrapper.java --- @@

[GitHub] flink pull request #5650: [FLINK-8845][state] Introduce RocksDBWriteBatchWra...

2018-03-07 Thread bowenli86
Github user bowenli86 commented on a diff in the pull request: https://github.com/apache/flink/pull/5650#discussion_r172935214 --- Diff: flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBWriteBatchWrapper.java --- @@

[GitHub] flink pull request #5617: [FLINK-8799][YARN] Make AbstractYarnClusterDescrip...

2018-03-07 Thread GJL
Github user GJL commented on a diff in the pull request: https://github.com/apache/flink/pull/5617#discussion_r172979651 --- Diff: flink-yarn/src/main/java/org/apache/flink/yarn/AbstractYarnClusterDescriptor.java --- @@ -172,6 +181,88 @@ public AbstractYarnClusterDescriptor(

[jira] [Resolved] (FLINK-8827) When FLINK_CONF_DIR contains spaces, execute zookeeper related scripts failed

2018-03-07 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-8827. - Resolution: Fixed Fix Version/s: 1.6.0 1.5.0 Fixed in - 1.5.0 via

[jira] [Closed] (FLINK-8824) In Kafka Consumers, replace 'getCanonicalName()' with 'getClassName()'

2018-03-07 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-8824. --- > In Kafka Consumers, replace 'getCanonicalName()' with 'getClassName()' >

[jira] [Closed] (FLINK-8827) When FLINK_CONF_DIR contains spaces, execute zookeeper related scripts failed

2018-03-07 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-8827. --- > When FLINK_CONF_DIR contains spaces, execute zookeeper related scripts failed >

[jira] [Commented] (FLINK-8867) Rocksdb checkpointing failing with fs.default-scheme: hdfs:// config

2018-03-07 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390255#comment-16390255 ] Stephan Ewen commented on FLINK-8867: - I would suggest that the fact that these follow-up exceptions

[jira] [Commented] (FLINK-5697) Add per-shard watermarks for FlinkKinesisConsumer

2018-03-07 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390365#comment-16390365 ] Thomas Weise commented on FLINK-5697: - For idleness detection see:

[jira] [Commented] (FLINK-7129) Support dynamically changing CEP patterns

2018-03-07 Thread Che Lui Shum (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390326#comment-16390326 ] Che Lui Shum commented on FLINK-7129: - Hi [~fhueske] and [~dawidwys], may I ask if there is any update

[jira] [Commented] (FLINK-8690) Update logical rule set to generate FlinkLogicalAggregate explicitly allow distinct agg on DataStream

2018-03-07 Thread Rong Rong (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390467#comment-16390467 ] Rong Rong commented on FLINK-8690: -- I created one of the initial (not at all perfect) support trying to

[GitHub] flink issue #5634: [FLINK-5479] [kafka] Idleness detection for periodic per-...

2018-03-07 Thread tweise
Github user tweise commented on the issue: https://github.com/apache/flink/pull/5634 This is a good proposal, it should also survive a general connector refactor that will be necessary to address other code duplication. The Kinesis ticket is

[jira] [Commented] (FLINK-5479) Per-partition watermarks in FlinkKafkaConsumer should consider idle partitions

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390362#comment-16390362 ] ASF GitHub Bot commented on FLINK-5479: --- Github user tweise commented on the issue:

[jira] [Commented] (FLINK-8845) Use WriteBatch to improve performance for recovery in RocksDB backend

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390632#comment-16390632 ] ASF GitHub Bot commented on FLINK-8845: --- Github user sihuazhou commented on a diff in the pull

[GitHub] flink pull request #5650: [FLINK-8845][state] Introduce RocksDBWriteBatchWra...

2018-03-07 Thread sihuazhou
Github user sihuazhou commented on a diff in the pull request: https://github.com/apache/flink/pull/5650#discussion_r173048697 --- Diff: flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBWriteBatchWrapper.java --- @@

[jira] [Commented] (FLINK-4811) Checkpoint Overview should list failed checkpoints

2018-03-07 Thread Sihua Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390689#comment-16390689 ] Sihua Zhou commented on FLINK-4811: --- This jira's state is still Unresolved, I think this has been

[GitHub] flink pull request #5650: [FLINK-8845][state] Introduce RocksDBWriteBatchWra...

2018-03-07 Thread sihuazhou
Github user sihuazhou commented on a diff in the pull request: https://github.com/apache/flink/pull/5650#discussion_r173048763 --- Diff: flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBWriteBatchWrapper.java --- @@

[jira] [Commented] (FLINK-8845) Use WriteBatch to improve performance for recovery in RocksDB backend

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390623#comment-16390623 ] ASF GitHub Bot commented on FLINK-8845: --- Github user sihuazhou commented on a diff in the pull

[jira] [Commented] (FLINK-8845) Use WriteBatch to improve performance for recovery in RocksDB backend

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390622#comment-16390622 ] ASF GitHub Bot commented on FLINK-8845: --- Github user sihuazhou commented on a diff in the pull

[jira] [Updated] (FLINK-8790) Improve performance for recovery from incremental checkpoint

2018-03-07 Thread Sihua Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sihua Zhou updated FLINK-8790: -- Fix Version/s: (was: 1.5.0) 1.6.0 > Improve performance for recovery from

[jira] [Commented] (FLINK-8867) Rocksdb checkpointing failing with fs.default-scheme: hdfs:// config

2018-03-07 Thread Shashank Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390847#comment-16390847 ] Shashank Agarwal commented on FLINK-8867: - [~StephanEwen] [~srichter] You can check full logs at

[jira] [Commented] (FLINK-8756) Support ClusterClient.getAccumulators() in RestClusterClient

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390813#comment-16390813 ] ASF GitHub Bot commented on FLINK-8756: --- Github user yanghua commented on the issue:

[GitHub] flink issue #5573: [FLINK-8756][Client] Support ClusterClient.getAccumulator...

2018-03-07 Thread yanghua
Github user yanghua commented on the issue: https://github.com/apache/flink/pull/5573 @zentol it seems the Travis CI has some problem, always build failed. Please review my latest change. ---

[GitHub] flink pull request #5650: [FLINK-8845][state] Introduce RocksDBWriteBatchWra...

2018-03-07 Thread sihuazhou
Github user sihuazhou commented on a diff in the pull request: https://github.com/apache/flink/pull/5650#discussion_r173049537 --- Diff: flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBWriteBatchWrapper.java --- @@

[jira] [Created] (FLINK-8893) NPE when netty try to allocate directBuffer

2018-03-07 Thread aitozi (JIRA)
aitozi created FLINK-8893: - Summary: NPE when netty try to allocate directBuffer Key: FLINK-8893 URL: https://issues.apache.org/jira/browse/FLINK-8893 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-8828) Add collect method to DataStream / DataSet scala api

2018-03-07 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389832#comment-16389832 ] Stephan Ewen commented on FLINK-8828: - [~fhueske] and [~twalthr] Please have a look at [~jelmer]'s

[GitHub] flink pull request #5645: FLINK-8876 Improve concurrent access handling in s...

2018-03-07 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/5645#discussion_r172922843 --- Diff: flink-formats/flink-avro/src/main/java/org/apache/flink/formats/avro/typeutils/AvroSerializer.java --- @@ -163,8 +224,9 @@ public T copy(T from, T

[jira] [Commented] (FLINK-8876) Improve concurrent access handling in stateful serializers

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389855#comment-16389855 ] ASF GitHub Bot commented on FLINK-8876: --- Github user zentol commented on a diff in the pull request:

[GitHub] flink pull request #5658: [FLINK-8856] [TaskManager] Move all cancellation i...

2018-03-07 Thread StephanEwen
GitHub user StephanEwen opened a pull request: https://github.com/apache/flink/pull/5658 [FLINK-8856] [TaskManager] Move all cancellation interrupt calls to TaskCanceller thread ## What is the purpose of the change This cleans up the code and guards against a JVM bug

[jira] [Commented] (FLINK-8856) Move all interrupt() calls to TaskCanceler

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389860#comment-16389860 ] ASF GitHub Bot commented on FLINK-8856: --- GitHub user StephanEwen opened a pull request:

[jira] [Updated] (FLINK-8845) Use WriteBatch to improve performance for recovery in RocksDB backend

2018-03-07 Thread Sihua Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sihua Zhou updated FLINK-8845: -- Summary: Use WriteBatch to improve performance for recovery in RocksDB backend (was: Introduce

[GitHub] flink issue #5652: [hotfix][tests] Do not use singleActorSystem in LocalFlin...

2018-03-07 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/5652 yup. But one profile is already scratching the 50m limit as is :/ ---

[GitHub] flink pull request #5648: [FLINK-8887][flip-6] ClusterClient.getJobStatus ca...

2018-03-07 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/5648#discussion_r172775779 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/Dispatcher.java --- @@ -404,16 +404,25 @@ public void start() throws Exception {

[jira] [Created] (FLINK-8889) Do not override config values in TestBaseUtils#startCluster

2018-03-07 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-8889: --- Summary: Do not override config values in TestBaseUtils#startCluster Key: FLINK-8889 URL: https://issues.apache.org/jira/browse/FLINK-8889 Project: Flink

[jira] [Updated] (FLINK-8890) Compare checkpoints with order in CompletedCheckpoint.checkpointsMatch()

2018-03-07 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-8890: Summary: Compare checkpoints with order in CompletedCheckpoint.checkpointsMatch() (was:

[jira] [Commented] (FLINK-8843) Decouple bind REST address from advertised address

2018-03-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389228#comment-16389228 ] ASF GitHub Bot commented on FLINK-8843: --- Github user yanghua commented on the issue:

[GitHub] flink issue #5652: [hotfix][tests] Do not use singleActorSystem in LocalFlin...

2018-03-07 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/5652 All legacy tests going through the `MiniClusterResource` will take longer. I don't know by how much, but we now have to start multiple actor systems and the JM<->TM communication is no longer local.

[GitHub] flink issue #5632: [FLINK-8843][REST] Decouple bind REST address from advert...

2018-03-07 Thread yanghua
Github user yanghua commented on the issue: https://github.com/apache/flink/pull/5632 hi @zentol , it seems @tillrohrmann has no free time recently. Would you please review this? ---

  1   2   3   >