[jira] [Commented] (FLINK-9032) Deprecate ConfigConstants#YARN_CONTAINER_START_COMMAND_TEMPLATE

2018-03-26 Thread Hai Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16415050#comment-16415050 ] Hai Zhou commented on FLINK-9032: - [~Zentol] , What do you think about this ticket? > Deprecate

[jira] [Commented] (FLINK-9060) Deleting state using KeyedStateBackend.getKeys() throws Exception

2018-03-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16415039#comment-16415039 ] ASF GitHub Bot commented on FLINK-9060: --- Github user sihuazhou commented on the issue:

[GitHub] flink issue #5751: [FLINK-9060][state] Deleting state using KeyedStateBacken...

2018-03-26 Thread sihuazhou
Github user sihuazhou commented on the issue: https://github.com/apache/flink/pull/5751 Hi @kl0u , do you have any idea now? Or we can just buffer the keys in to a `list` in `applyToAllKeys()`, I think it also seems not like a bad choice. :) ---

[jira] [Closed] (FLINK-9092) End to end test for elasticsearch2.x

2018-03-26 Thread mingleizhang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingleizhang closed FLINK-9092. --- Resolution: Invalid > End to end test for elasticsearch2.x > > >

[jira] [Created] (FLINK-9092) End to end test for elasticsearch2.x

2018-03-26 Thread mingleizhang (JIRA)
mingleizhang created FLINK-9092: --- Summary: End to end test for elasticsearch2.x Key: FLINK-9092 URL: https://issues.apache.org/jira/browse/FLINK-9092 Project: Flink Issue Type: Task

[jira] [Updated] (FLINK-9062) As the Chinese government closed its visit to Google(GFW),the drop-down menu about document on the home page (https://flink.apache.org/) doesn't work .

2018-03-26 Thread PengYang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] PengYang updated FLINK-9062: Issue Type: Bug (was: Improvement) > As the Chinese government closed its visit to Google(GFW),the

[jira] [Commented] (FLINK-9069) Fix some double semicolons to single semicolons, and update checkstyle

2018-03-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414940#comment-16414940 ] ASF GitHub Bot commented on FLINK-9069: --- GitHub user jparkie opened a pull request:

[GitHub] flink pull request #5769: [FLINK-9069] Add checkstyle rule to detect multipl...

2018-03-26 Thread jparkie
GitHub user jparkie opened a pull request: https://github.com/apache/flink/pull/5769 [FLINK-9069] Add checkstyle rule to detect multiple consecutive semicolons ## What is the purpose of the change This pull request introduces a new checkstyle rule that detects multiple

[jira] [Assigned] (FLINK-7917) The return of taskInformationOrBlobKey should be placed inside synchronized in ExecutionJobVertex

2018-03-26 Thread vinoyang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned FLINK-7917: --- Assignee: vinoyang > The return of taskInformationOrBlobKey should be placed inside synchronized >

[jira] [Assigned] (FLINK-9089) Upgrade Orc dependency to 1.4.3

2018-03-26 Thread vinoyang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned FLINK-9089: --- Assignee: vinoyang > Upgrade Orc dependency to 1.4.3 > --- > >

[jira] [Commented] (FLINK-8415) Unprotected access to recordsToSend in LongRecordWriterThread#shutdown()

2018-03-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414883#comment-16414883 ] ASF GitHub Bot commented on FLINK-8415: --- Github user yanghua commented on the issue:

[GitHub] flink issue #5724: [FLINK-8415] Unprotected access to recordsToSend in LongR...

2018-03-26 Thread yanghua
Github user yanghua commented on the issue: https://github.com/apache/flink/pull/5724 cc @tillrohrmann ---

[jira] [Commented] (FLINK-8907) Unable to start the process by start-cluster.sh

2018-03-26 Thread mingleizhang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414871#comment-16414871 ] mingleizhang commented on FLINK-8907: - Thanks [~greghogan] I think this might be a firewall issue. But

[jira] [Assigned] (FLINK-9090) Replace UUID.randomUUID with deterministic PRNG

2018-03-26 Thread Hai Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hai Zhou reassigned FLINK-9090: --- Assignee: Hai Zhou > Replace UUID.randomUUID with deterministic PRNG >

[jira] [Assigned] (FLINK-9088) Upgrade Nifi connector dependency to 1.6.0

2018-03-26 Thread Hai Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hai Zhou reassigned FLINK-9088: --- Assignee: Hai Zhou > Upgrade Nifi connector dependency to 1.6.0 >

[jira] [Assigned] (FLINK-9091) Failure while enforcing releasability in building flink-json module

2018-03-26 Thread Hai Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hai Zhou reassigned FLINK-9091: --- Assignee: Hai Zhou > Failure while enforcing releasability in building flink-json module >

[jira] [Assigned] (FLINK-9087) Return value of broadcastEvent should be closed in StreamTask#performCheckpoint

2018-03-26 Thread Sihua Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sihua Zhou reassigned FLINK-9087: - Assignee: Sihua Zhou > Return value of broadcastEvent should be closed in >

[jira] [Commented] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

2018-03-26 Thread Jamie Grier (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414828#comment-16414828 ] Jamie Grier commented on FLINK-9061: [~ste...@apache.org] Here's the full stack trace:      

[jira] [Comment Edited] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

2018-03-26 Thread Jamie Grier (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414828#comment-16414828 ] Jamie Grier edited comment on FLINK-9061 at 3/27/18 12:45 AM: --

[jira] [Comment Edited] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

2018-03-26 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414085#comment-16414085 ] Steven Zhen Wu edited comment on FLINK-9061 at 3/26/18 11:49 PM: -

[jira] [Comment Edited] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

2018-03-26 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414696#comment-16414696 ] Steven Zhen Wu edited comment on FLINK-9061 at 3/26/18 11:46 PM: - It seems

[jira] [Comment Edited] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

2018-03-26 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414085#comment-16414085 ] Steven Zhen Wu edited comment on FLINK-9061 at 3/26/18 11:39 PM: -

[jira] [Comment Edited] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

2018-03-26 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414085#comment-16414085 ] Steven Zhen Wu edited comment on FLINK-9061 at 3/26/18 11:38 PM: -

[jira] [Commented] (FLINK-9091) Failure while enforcing releasability in building flink-json module

2018-03-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414776#comment-16414776 ] Ted Yu commented on FLINK-9091: --- {code} Java HotSpot(TM) 64-Bit Server VM warning: ignoring option

[jira] [Updated] (FLINK-9091) Failure while enforcing releasability in building flink-json module

2018-03-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated FLINK-9091: -- Attachment: f-json.out > Failure while enforcing releasability in building flink-json module >

[jira] [Created] (FLINK-9091) Failure while enforcing releasability in building flink-json module

2018-03-26 Thread Ted Yu (JIRA)
Ted Yu created FLINK-9091: - Summary: Failure while enforcing releasability in building flink-json module Key: FLINK-9091 URL: https://issues.apache.org/jira/browse/FLINK-9091 Project: Flink Issue

[jira] [Commented] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

2018-03-26 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414696#comment-16414696 ] Steven Zhen Wu commented on FLINK-9061: --- It seems that our internal change *only* works with

[jira] [Comment Edited] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

2018-03-26 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414085#comment-16414085 ] Steven Zhen Wu edited comment on FLINK-9061 at 3/26/18 10:34 PM: -

[jira] [Comment Edited] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

2018-03-26 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414085#comment-16414085 ] Steven Zhen Wu edited comment on FLINK-9061 at 3/26/18 10:28 PM: -

[jira] [Created] (FLINK-9090) Replace UUID.randomUUID with deterministic PRNG

2018-03-26 Thread Ted Yu (JIRA)
Ted Yu created FLINK-9090: - Summary: Replace UUID.randomUUID with deterministic PRNG Key: FLINK-9090 URL: https://issues.apache.org/jira/browse/FLINK-9090 Project: Flink Issue Type: Improvement

[jira] [Comment Edited] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

2018-03-26 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414085#comment-16414085 ] Steven Zhen Wu edited comment on FLINK-9061 at 3/26/18 10:24 PM: -

[jira] [Comment Edited] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

2018-03-26 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414085#comment-16414085 ] Steven Zhen Wu edited comment on FLINK-9061 at 3/26/18 10:21 PM: -

[jira] [Commented] (FLINK-9049) Create unified interfaces to configure and instatiate TableSink

2018-03-26 Thread Shuyi Chen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414626#comment-16414626 ] Shuyi Chen commented on FLINK-9049: --- Thanks a lot, [~twalthr]. Assigned

[jira] [Updated] (FLINK-8866) Create unified interfaces to configure and instatiate TableSinks

2018-03-26 Thread Shuyi Chen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyi Chen updated FLINK-8866: -- Description: Similar to the efforts done in FLINK-8240. We need unified ways to configure and

[jira] [Assigned] (FLINK-8866) Create unified interfaces to configure and instatiate TableSinks

2018-03-26 Thread Shuyi Chen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyi Chen reassigned FLINK-8866: - Assignee: Shuyi Chen (was: Timo Walther) > Create unified interfaces to configure and

[jira] [Commented] (FLINK-9059) Add support for unified table source and sink declaration in environment file

2018-03-26 Thread Shuyi Chen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414618#comment-16414618 ] Shuyi Chen commented on FLINK-9059: --- Hi [~twalthr], thanks a lot for the comments. In the Pull Request,

[jira] [Updated] (FLINK-9059) Add support for unified table source and sink declaration in environment file

2018-03-26 Thread Shuyi Chen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyi Chen updated FLINK-9059: -- Description: 1) Add a common property called "type" with single value 'source'. 2) in yaml file,

[jira] [Created] (FLINK-9089) Upgrade Orc dependency to 1.4.3

2018-03-26 Thread Ted Yu (JIRA)
Ted Yu created FLINK-9089: - Summary: Upgrade Orc dependency to 1.4.3 Key: FLINK-9089 URL: https://issues.apache.org/jira/browse/FLINK-9089 Project: Flink Issue Type: Improvement

[jira] [Comment Edited] (FLINK-6105) Properly handle InterruptedException in HadoopInputFormatBase

2018-03-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16307281#comment-16307281 ] Ted Yu edited comment on FLINK-6105 at 3/26/18 8:37 PM: In

[jira] [Created] (FLINK-9088) Upgrade Nifi connector dependency to 1.6.0

2018-03-26 Thread Ted Yu (JIRA)
Ted Yu created FLINK-9088: - Summary: Upgrade Nifi connector dependency to 1.6.0 Key: FLINK-9088 URL: https://issues.apache.org/jira/browse/FLINK-9088 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-9087) Return value of broadcastEvent should be closed in StreamTask#performCheckpoint

2018-03-26 Thread Ted Yu (JIRA)
Ted Yu created FLINK-9087: - Summary: Return value of broadcastEvent should be closed in StreamTask#performCheckpoint Key: FLINK-9087 URL: https://issues.apache.org/jira/browse/FLINK-9087 Project: Flink

[jira] [Commented] (FLINK-9033) Replace usages of deprecated TASK_MANAGER_NUM_TASK_SLOTS

2018-03-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414456#comment-16414456 ] ASF GitHub Bot commented on FLINK-9033: --- Github user greghogan commented on the issue:

[GitHub] flink issue #5731: [FLINK-9033][config] Replace usages of deprecated TASK_MA...

2018-03-26 Thread greghogan
Github user greghogan commented on the issue: https://github.com/apache/flink/pull/5731 Test failures, and needs rebasing. ---

[jira] [Commented] (FLINK-9086) Use INTERNAL_HADOOP_CLASSPATHS as classpath for launching Yarn cluster for Scala Shell

2018-03-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414427#comment-16414427 ] ASF GitHub Bot commented on FLINK-9086: --- GitHub user ruankd opened a pull request:

[GitHub] flink pull request #5768: [FLINK-9086] Use INTERNAL_HADOOP_CLASSPATHS as cla...

2018-03-26 Thread ruankd
GitHub user ruankd opened a pull request: https://github.com/apache/flink/pull/5768 [FLINK-9086] Use INTERNAL_HADOOP_CLASSPATHS as classpath for Yarn Session ## What is the purpose of the change * This change improves user experience for Flink on some environments such as

[jira] [Commented] (FLINK-8907) Unable to start the process by start-cluster.sh

2018-03-26 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414424#comment-16414424 ] Greg Hogan commented on FLINK-8907: --- [~mingleizhang], is the remote-access issue fixed by FLINK-8843? >

[jira] [Updated] (FLINK-9048) LocalFlinkMiniClusterITCase#testLocalFlinkMiniClusterWithMultipleTaskManagers sometimes fails

2018-03-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated FLINK-9048: -- Description: As of commit e0bc37bef69f5376d03214578e9b95816add661b, I got the following : {code}

[jira] [Updated] (FLINK-8933) Avoid calling Class#newInstance

2018-03-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated FLINK-8933: -- Description: Class#newInstance is deprecated starting in Java 9 -

[jira] [Updated] (FLINK-9086) Use INTERNAL_HADOOP_CLASSPATHS as classpath for launching Yarn cluster for Scala Shell

2018-03-26 Thread Keda Ruan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Keda Ruan updated FLINK-9086: - Description: Some environments don't have hadoop jars in {{HADOOP_CLASSPATH}}, causing Flink Yarn

[jira] [Created] (FLINK-9086) Use INTERNAL_HADOOP_CLASSPATHS as classpath for launching Yarn cluster for Scala Shell

2018-03-26 Thread Keda Ruan (JIRA)
Keda Ruan created FLINK-9086: Summary: Use INTERNAL_HADOOP_CLASSPATHS as classpath for launching Yarn cluster for Scala Shell Key: FLINK-9086 URL: https://issues.apache.org/jira/browse/FLINK-9086

[jira] [Updated] (FLINK-9084) Upgrade cassandra-driver-core to 3.4.0 to introduce BusyPoolException retries to Cassandra Connector

2018-03-26 Thread Jacob Park (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacob Park updated FLINK-9084: -- Summary: Upgrade cassandra-driver-core to 3.4.0 to introduce BusyPoolException retries to Cassandra

[jira] [Updated] (FLINK-9084) Upgrade cassandra-driver-core to 3.4.0 to introduce BusyPoolException retries to Cassandra Connector

2018-03-26 Thread Jacob Park (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacob Park updated FLINK-9084: -- Description: As per [https://datastax-oss.atlassian.net/browse/SPARKC-503,] that exception will be

[jira] [Updated] (FLINK-9085) Add a rate limiter to the Cassandra Connector

2018-03-26 Thread Jacob Park (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacob Park updated FLINK-9085: -- Description: The spark-cassandra-connector uses a rate limiter. In production, this allows our

[jira] [Created] (FLINK-9085) Add a rate limiter to the Cassandra Connector

2018-03-26 Thread Jacob Park (JIRA)
Jacob Park created FLINK-9085: - Summary: Add a rate limiter to the Cassandra Connector Key: FLINK-9085 URL: https://issues.apache.org/jira/browse/FLINK-9085 Project: Flink Issue Type:

[jira] [Created] (FLINK-9084) Upgrade cassandra-driver-core to 3.4.0 to introduce BusyPoolException retries

2018-03-26 Thread Jacob Park (JIRA)
Jacob Park created FLINK-9084: - Summary: Upgrade cassandra-driver-core to 3.4.0 to introduce BusyPoolException retries Key: FLINK-9084 URL: https://issues.apache.org/jira/browse/FLINK-9084 Project: Flink

[jira] [Commented] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

2018-03-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414280#comment-16414280 ] Steve Loughran commented on FLINK-9061: --- you can get it on delete requests too, if you try hard.

[jira] [Created] (FLINK-9083) Add async backpressure support to Cassandra Connector

2018-03-26 Thread Jacob Park (JIRA)
Jacob Park created FLINK-9083: - Summary: Add async backpressure support to Cassandra Connector Key: FLINK-9083 URL: https://issues.apache.org/jira/browse/FLINK-9083 Project: Flink Issue Type:

[jira] [Commented] (FLINK-8794) When using BucketingSink, it happens that one of the files is always in the [.in-progress] state

2018-03-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414272#comment-16414272 ] Steve Loughran commented on FLINK-8794: --- {quote} writing to local disks would decrease performance,

[jira] [Commented] (FLINK-8907) Unable to start the process by start-cluster.sh

2018-03-26 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414267#comment-16414267 ] Greg Hogan commented on FLINK-8907: --- [~mingleizhang], do I understand correctly that you are able to

[jira] [Commented] (FLINK-8794) When using BucketingSink, it happens that one of the files is always in the [.in-progress] state

2018-03-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414262#comment-16414262 ] Steve Loughran commented on FLINK-8794: --- it does if you turn s3guard on with Hadoop 3.0+ and its S3A

[jira] [Updated] (FLINK-9082) Submission with higher parallelism than task slots fails with TimeoutException

2018-03-26 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-9082: Priority: Blocker (was: Major) > Submission with higher parallelism than task slots fails

[jira] [Updated] (FLINK-9082) Submission with higher parallelism than task slots fails with TimeoutException

2018-03-26 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-9082: Fix Version/s: 1.5.0 > Submission with higher parallelism than task slots fails with

[jira] [Updated] (FLINK-9081) ResourceManagerTaskExecutorTest is unstable

2018-03-26 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-9081: Fix Version/s: 1.5.0 > ResourceManagerTaskExecutorTest is unstable >

[jira] [Updated] (FLINK-9081) ResourceManagerTaskExecutorTest is unstable

2018-03-26 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-9081: Priority: Blocker (was: Major) > ResourceManagerTaskExecutorTest is unstable >

[jira] [Commented] (FLINK-3679) Allow Kafka consumer to skip corrupted messages

2018-03-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414130#comment-16414130 ] ASF GitHub Bot commented on FLINK-3679: --- Github user InfinitiesLoop commented on the issue:

[GitHub] flink issue #3314: [FLINK-3679] DeserializationSchema should handle zero or ...

2018-03-26 Thread InfinitiesLoop
Github user InfinitiesLoop commented on the issue: https://github.com/apache/flink/pull/3314 Sorry for necro'ing this thread, but where does the community land on the multiple record per kafka payload idea this PR originally intended to solve? I have this scenario, where a

[jira] [Commented] (FLINK-8887) ClusterClient.getJobStatus can throw FencingTokenException

2018-03-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414127#comment-16414127 ] ASF GitHub Bot commented on FLINK-8887: --- Github user zentol commented on a diff in the pull request:

[GitHub] flink pull request #5767: [FLINK-8887] Wait for JobMaster leader election in...

2018-03-26 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/5767#discussion_r177163114 --- Diff: flink-clients/src/main/java/org/apache/flink/client/program/MiniClusterClient.java --- @@ -67,7 +61,7 @@ private final

[jira] [Resolved] (FLINK-8833) Create a SQL Client JSON format fat-jar

2018-03-26 Thread Timo Walther (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timo Walther resolved FLINK-8833. - Resolution: Fixed Fix Version/s: 1.5.0 Fixed in 1.6.0:

[jira] [Commented] (FLINK-8833) Create a SQL Client JSON format fat-jar

2018-03-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414114#comment-16414114 ] ASF GitHub Bot commented on FLINK-8833: --- Github user asfgit closed the pull request at:

[GitHub] flink pull request #5700: [FLINK-8833] [sql-client] Create a SQL Client JSON...

2018-03-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5700 ---

[jira] [Commented] (FLINK-8833) Create a SQL Client JSON format fat-jar

2018-03-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414101#comment-16414101 ] ASF GitHub Bot commented on FLINK-8833: --- Github user twalthr commented on the issue:

[jira] [Assigned] (FLINK-7554) Add a testing RuntimeContext to test utilities

2018-03-26 Thread Jiayi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiayi reassigned FLINK-7554: Assignee: Jiayi > Add a testing RuntimeContext to test utilities >

[GitHub] flink issue #5700: [FLINK-8833] [sql-client] Create a SQL Client JSON format...

2018-03-26 Thread twalthr
Github user twalthr commented on the issue: https://github.com/apache/flink/pull/5700 Thanks for the hint @fhueske. I will the the jar plugin and merge this... ---

[jira] [Commented] (FLINK-8887) ClusterClient.getJobStatus can throw FencingTokenException

2018-03-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414099#comment-16414099 ] ASF GitHub Bot commented on FLINK-8887: --- GitHub user tillrohrmann opened a pull request:

[GitHub] flink pull request #5767: [FLINK-8887] Wait for JobMaster leader election in...

2018-03-26 Thread tillrohrmann
GitHub user tillrohrmann opened a pull request: https://github.com/apache/flink/pull/5767 [FLINK-8887] Wait for JobMaster leader election in Dispatcher ## What is the purpose of the change Before sending requests from the Dispatcher to the JobMasters, the Dispatcher must

[jira] [Comment Edited] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

2018-03-26 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414085#comment-16414085 ] Steven Zhen Wu edited comment on FLINK-9061 at 3/26/18 4:31 PM:

[jira] [Commented] (FLINK-9080) Flink Scheduler goes OOM, suspecting a memory leak

2018-03-26 Thread Rohit Singh (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414093#comment-16414093 ] Rohit Singh commented on FLINK-9080: Based on documentation on Flink, Tried adding job in the flink

[jira] [Comment Edited] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

2018-03-26 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414085#comment-16414085 ] Steven Zhen Wu edited comment on FLINK-9061 at 3/26/18 4:30 PM:

[jira] [Comment Edited] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

2018-03-26 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414085#comment-16414085 ] Steven Zhen Wu edited comment on FLINK-9061 at 3/26/18 4:27 PM:

[jira] [Comment Edited] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

2018-03-26 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414085#comment-16414085 ] Steven Zhen Wu edited comment on FLINK-9061 at 3/26/18 4:27 PM:

[jira] [Comment Edited] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

2018-03-26 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414085#comment-16414085 ] Steven Zhen Wu edited comment on FLINK-9061 at 3/26/18 4:27 PM:

[jira] [Commented] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

2018-03-26 Thread Steven Zhen Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414085#comment-16414085 ] Steven Zhen Wu commented on FLINK-9061: --- [~StephanEwen] [~jgrier] We run into S3 throttling issue

[jira] [Commented] (FLINK-7554) Add a testing RuntimeContext to test utilities

2018-03-26 Thread Timo Walther (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414083#comment-16414083 ] Timo Walther commented on FLINK-7554: - [~wind_ljy] I gave you contributor permissions. You can now

[jira] [Commented] (FLINK-7554) Add a testing RuntimeContext to test utilities

2018-03-26 Thread Jiayi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414074#comment-16414074 ] Jiayi commented on FLINK-7554: -- [~twalthr] Could you assign this to me if possible? I'm aware of the

[GitHub] flink pull request #:

2018-03-26 Thread zentol
Github user zentol commented on the pull request: https://github.com/apache/flink/commit/5803950ef0c8c57534b11de459b92d01da4d3fc0#commitcomment-28272592 In flink-end-to-end-tests/test-scripts/test_batch_allround.sh: In flink-end-to-end-tests/test-scripts/test_batch_allround.sh on

[jira] [Resolved] (FLINK-8972) Create general purpose DataSet testing job

2018-03-26 Thread Timo Walther (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timo Walther resolved FLINK-8972. - Resolution: Fixed Fix Version/s: 1.5.0 Fixed in 1.6.0:

[jira] [Commented] (FLINK-8972) Create general purpose DataSet testing job

2018-03-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414045#comment-16414045 ] ASF GitHub Bot commented on FLINK-8972: --- Github user asfgit closed the pull request at:

[GitHub] flink pull request #5752: [FLINK-8972] [e2eTests] Add DataSetAllroundTestPro...

2018-03-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5752 ---

[jira] [Commented] (FLINK-8887) ClusterClient.getJobStatus can throw FencingTokenException

2018-03-26 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414043#comment-16414043 ] Till Rohrmann commented on FLINK-8887: -- The problem is that we do not wait for {{JobMaster}} to be

[jira] [Created] (FLINK-9082) Submission with higher parallelism than task slots fails with TimeoutException

2018-03-26 Thread Timo Walther (JIRA)
Timo Walther created FLINK-9082: --- Summary: Submission with higher parallelism than task slots fails with TimeoutException Key: FLINK-9082 URL: https://issues.apache.org/jira/browse/FLINK-9082 Project:

[jira] [Commented] (FLINK-8415) Unprotected access to recordsToSend in LongRecordWriterThread#shutdown()

2018-03-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16413990#comment-16413990 ] Ted Yu commented on FLINK-8415: --- lgtm > Unprotected access to recordsToSend in

[jira] [Comment Edited] (FLINK-7795) Utilize error-prone to discover common coding mistakes

2018-03-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345955#comment-16345955 ] Ted Yu edited comment on FLINK-7795 at 3/26/18 3:25 PM: error-prone has JDK 8

[jira] [Updated] (FLINK-7917) The return of taskInformationOrBlobKey should be placed inside synchronized in ExecutionJobVertex

2018-03-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated FLINK-7917: -- Description: Currently in ExecutionJobVertex#getTaskInformationOrBlobKey: {code} } return

[jira] [Assigned] (FLINK-2435) Add support for custom CSV field parsers

2018-03-26 Thread Dmitrii Kober (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitrii Kober reassigned FLINK-2435: Assignee: Dmitrii Kober > Add support for custom CSV field parsers >

[jira] [Commented] (FLINK-9072) Host name with "_" causes cluster exception

2018-03-26 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16413975#comment-16413975 ] Chesnay Schepler commented on FLINK-9072: - According to https://tools.ietf.org/html/rfc952

[jira] [Commented] (FLINK-8809) Decrease maximum value of DirectMemory at default config

2018-03-26 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16413978#comment-16413978 ] Greg Hogan commented on FLINK-8809: --- As you have noted this maximum value is set only for

[jira] [Commented] (FLINK-9057) NPE in CreditBasedSequenceNumberingViewReader when cancelling before initilization was complete

2018-03-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16413906#comment-16413906 ] ASF GitHub Bot commented on FLINK-9057: --- Github user NicoK commented on the issue:

[jira] [Closed] (FLINK-8458) Add the switch for keeping both the old mode and the new credit-based mode

2018-03-26 Thread Piotr Nowojski (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-8458. - > Add the switch for keeping both the old mode and the new credit-based mode >

[jira] [Resolved] (FLINK-8852) SQL Client does not work with new FLIP-6 mode

2018-03-26 Thread Timo Walther (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timo Walther resolved FLINK-8852. - Resolution: Fixed Fixed in 1.6.0: d8a376a85e0fd54c725e9117396fc5819ce17dfa Fixed in 1.5.0:

  1   2   3   >