[jira] [Created] (FLINK-9540) Apache Flink 1.4.2 S3 Hadooplibrary for Hadoop 2.7 is built for Hadoop 2.8 and fails

2018-06-06 Thread Razvan (JIRA)
Razvan created FLINK-9540: - Summary: Apache Flink 1.4.2 S3 Hadooplibrary for Hadoop 2.7 is built for Hadoop 2.8 and fails Key: FLINK-9540 URL: https://issues.apache.org/jira/browse/FLINK-9540 Project: Flink

[jira] [Commented] (FLINK-8468) Make the connector to take advantage of AMQP features (routing key, exchange and message properties)

2018-06-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503071#comment-16503071 ] ASF GitHub Bot commented on FLINK-8468: --- Github user pduveau commented on a diff in the pull

[GitHub] flink pull request #5410: [FLINK-8468] [RabbitMQ Connector] Take advantage o...

2018-06-06 Thread pduveau
Github user pduveau commented on a diff in the pull request: https://github.com/apache/flink/pull/5410#discussion_r193357238 --- Diff: flink-connectors/flink-connector-rabbitmq/src/main/java/org/apache/flink/streaming/connectors/rabbitmq/RMQSink.java --- @@ -40,22 +42,63 @@

[jira] [Commented] (FLINK-9525) Missing META-INF/services/*FileSystemFactory in flink-hadoop-fs module

2018-06-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503109#comment-16503109 ] ASF GitHub Bot commented on FLINK-9525: --- Github user StephanEwen commented on the issue:

[GitHub] flink issue #6118: [FLINK-9525][filesystem] Add missing `META-INF/services/*...

2018-06-06 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/6118 Where in the loading of the factories do you see the error? My suspicion is still an issue with inverted class loading. To confirm, can we check the following? - Are you running

[jira] [Commented] (FLINK-8468) Make the connector to take advantage of AMQP features (routing key, exchange and message properties)

2018-06-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503160#comment-16503160 ] ASF GitHub Bot commented on FLINK-8468: --- Github user pduveau commented on a diff in the pull

[GitHub] flink pull request #5410: [FLINK-8468] [RabbitMQ Connector] Take advantage o...

2018-06-06 Thread pduveau
Github user pduveau commented on a diff in the pull request: https://github.com/apache/flink/pull/5410#discussion_r193377245 --- Diff: flink-connectors/flink-connector-rabbitmq/src/main/java/org/apache/flink/streaming/connectors/rabbitmq/RMQSink.java --- @@ -105,7 +153,18 @@

[GitHub] flink issue #6079: [FLINK-8430] [table] Implement stream-stream non-window f...

2018-06-06 Thread hequn8128
Github user hequn8128 commented on the issue: https://github.com/apache/flink/pull/6079 @twalthr Thanks a lot for the review and merging. I will take a look at the FLINK-9440 and see if we can do any improvement. ---

[jira] [Commented] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-06 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503284#comment-16503284 ] swy commented on FLINK-9506: [~srichter] Thanks for tips, after implement Rocksdb the performance seems much

[jira] [Commented] (FLINK-9444) KafkaAvroTableSource failed to work for map and array fields

2018-06-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503120#comment-16503120 ] ASF GitHub Bot commented on FLINK-9444: --- Github user fhueske commented on the issue:

[jira] [Commented] (FLINK-8430) Implement stream-stream non-window full outer join

2018-06-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503192#comment-16503192 ] ASF GitHub Bot commented on FLINK-8430: --- Github user hequn8128 commented on the issue:

[jira] [Commented] (FLINK-3952) Bump Netty to 4.1

2018-06-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503037#comment-16503037 ] ASF GitHub Bot commented on FLINK-3952: --- Github user zentol commented on a diff in the pull

[GitHub] flink pull request #6071: [FLINK-3952][runtine] Upgrade to Netty 4.1

2018-06-06 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/6071#discussion_r193345578 --- Diff: pom.xml --- @@ -300,15 +300,7 @@ under the License. org.apache.flink

[jira] [Commented] (FLINK-8468) Make the connector to take advantage of AMQP features (routing key, exchange and message properties)

2018-06-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503082#comment-16503082 ] ASF GitHub Bot commented on FLINK-8468: --- Github user pduveau commented on a diff in the pull

[GitHub] flink pull request #5410: [FLINK-8468] [RabbitMQ Connector] Take advantage o...

2018-06-06 Thread pduveau
Github user pduveau commented on a diff in the pull request: https://github.com/apache/flink/pull/5410#discussion_r193359300 --- Diff: flink-connectors/flink-connector-rabbitmq/src/test/java/org/apache/flink/streaming/connectors/rabbitmq/RMQSinkTest.java --- @@ -83,7 +103,22 @@

[GitHub] flink pull request #5410: [FLINK-8468] [RabbitMQ Connector] Take advantage o...

2018-06-06 Thread pduveau
Github user pduveau commented on a diff in the pull request: https://github.com/apache/flink/pull/5410#discussion_r193359253 --- Diff: flink-connectors/flink-connector-rabbitmq/src/test/java/org/apache/flink/streaming/connectors/rabbitmq/RMQSinkTest.java --- @@ -83,7 +103,22 @@

[jira] [Commented] (FLINK-8468) Make the connector to take advantage of AMQP features (routing key, exchange and message properties)

2018-06-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503081#comment-16503081 ] ASF GitHub Bot commented on FLINK-8468: --- Github user pduveau commented on a diff in the pull

[jira] [Updated] (FLINK-9544) Impossible to downgrade kinesis protocole from CBOR to JSON as required by kinesalite

2018-06-06 Thread Ph.Duveau (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ph.Duveau updated FLINK-9544: - Description: The amazon client do not downgrade from CBOR to JSON while setting env AWS_CBOR_DISABLE to

[jira] [Assigned] (FLINK-8886) Job isolation via scheduling in shared cluster

2018-06-06 Thread Renjie Liu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Renjie Liu reassigned FLINK-8886: - Assignee: Renjie Liu > Job isolation via scheduling in shared cluster >

[jira] [Updated] (FLINK-9540) Apache Flink 1.4.2 S3 Hadoop library for Hadoop 2.7 is built for Hadoop 2.8 and fails

2018-06-06 Thread Razvan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Razvan updated FLINK-9540: -- Description: Download Apache Flink 1.4.2 for Hadoop 2.7 or earlier. Go to opt/ inside 

[jira] [Commented] (FLINK-8468) Make the connector to take advantage of AMQP features (routing key, exchange and message properties)

2018-06-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503077#comment-16503077 ] ASF GitHub Bot commented on FLINK-8468: --- Github user pduveau commented on a diff in the pull

[GitHub] flink pull request #5410: [FLINK-8468] [RabbitMQ Connector] Take advantage o...

2018-06-06 Thread pduveau
Github user pduveau commented on a diff in the pull request: https://github.com/apache/flink/pull/5410#discussion_r193358805 --- Diff: flink-connectors/flink-connector-rabbitmq/src/test/java/org/apache/flink/streaming/connectors/rabbitmq/RMQSinkTest.java --- @@ -66,12 +79,19 @@

[jira] [Created] (FLINK-9543) Expose JobMaster IDs to metric system

2018-06-06 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-9543: --- Summary: Expose JobMaster IDs to metric system Key: FLINK-9543 URL: https://issues.apache.org/jira/browse/FLINK-9543 Project: Flink Issue Type: New

[jira] [Updated] (FLINK-9540) Apache Flink 1.4.2 S3 Hadooplibrary for Hadoop 2.7 is built for Hadoop 2.8 and fails

2018-06-06 Thread Razvan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Razvan updated FLINK-9540: -- Description: Download Apache Flink 1.4.2 for Hadoop 2.7 or earlier. Go to opt/ inside 

[GitHub] flink issue #5954: [FLINK-9276] Improve error message when TaskManager fails

2018-06-06 Thread yanghua
Github user yanghua commented on the issue: https://github.com/apache/flink/pull/5954 @aljoscha @kl0u ---

[jira] [Commented] (FLINK-9528) Incorrect results: Filter does not treat Upsert messages correctly.

2018-06-06 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503155#comment-16503155 ] Fabian Hueske commented on FLINK-9528: -- Hi [~hequn8128], can you explain in more detail what you

[jira] [Commented] (FLINK-9276) Improve error message when TaskManager fails

2018-06-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503153#comment-16503153 ] ASF GitHub Bot commented on FLINK-9276: --- Github user yanghua commented on the issue:

[GitHub] flink pull request #6089: [FLINK-9451]End-to-end test: Scala Quickstarts

2018-06-06 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/6089#discussion_r193395032 --- Diff: flink-end-to-end-tests/test-scripts/test_quickstarts.sh --- @@ -51,12 +59,12 @@ sed -i -e ''"$(($position + 1))"'i\ ${flink.version}\ ---

[GitHub] flink pull request #6089: [FLINK-9451]End-to-end test: Scala Quickstarts

2018-06-06 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/6089#discussion_r193394392 --- Diff: flink-end-to-end-tests/flink-quickstart-test/pom.xml --- @@ -0,0 +1,98 @@ + + +http://maven.apache.org/POM/4.0.0; +

[GitHub] flink pull request #6128: [FLINK-9539][build] Integrate flink-shaded 4.0

2018-06-06 Thread zentol
GitHub user zentol opened a pull request: https://github.com/apache/flink/pull/6128 [FLINK-9539][build] Integrate flink-shaded 4.0 ## What is the purpose of the change This PR bumps the flink-shaded version to 4.0 . The workarounds for the faulty jackson shading can be

[jira] [Commented] (FLINK-9539) Integrate flink-shaded 4.0

2018-06-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503035#comment-16503035 ] ASF GitHub Bot commented on FLINK-9539: --- GitHub user zentol opened a pull request:

[jira] [Updated] (FLINK-9540) Apache Flink 1.4.2 S3 Hadoop library for Hadoop 2.7 is built for Hadoop 2.8 and fails

2018-06-06 Thread Razvan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Razvan updated FLINK-9540: -- Summary: Apache Flink 1.4.2 S3 Hadoop library for Hadoop 2.7 is built for Hadoop 2.8 and fails (was: Apache

[jira] [Commented] (FLINK-8468) Make the connector to take advantage of AMQP features (routing key, exchange and message properties)

2018-06-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503092#comment-16503092 ] ASF GitHub Bot commented on FLINK-8468: --- Github user pduveau commented on a diff in the pull

[GitHub] flink pull request #5410: [FLINK-8468] [RabbitMQ Connector] Take advantage o...

2018-06-06 Thread pduveau
Github user pduveau commented on a diff in the pull request: https://github.com/apache/flink/pull/5410#discussion_r193361587 --- Diff: flink-connectors/flink-connector-rabbitmq/src/test/java/org/apache/flink/streaming/connectors/rabbitmq/RMQSinkTest.java --- @@ -83,7 +103,22 @@

[jira] [Created] (FLINK-9542) ExEnv#registerCachedFile should accept Path

2018-06-06 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-9542: --- Summary: ExEnv#registerCachedFile should accept Path Key: FLINK-9542 URL: https://issues.apache.org/jira/browse/FLINK-9542 Project: Flink Issue Type:

[GitHub] flink pull request #6089: [FLINK-9451]End-to-end test: Scala Quickstarts

2018-06-06 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/6089#discussion_r193392673 --- Diff: flink-end-to-end-tests/flink-quickstart-test/pom.xml --- @@ -0,0 +1,98 @@ + + +http://maven.apache.org/POM/4.0.0; +

[jira] [Commented] (FLINK-9451) End-to-end test: Scala Quickstarts

2018-06-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503232#comment-16503232 ] ASF GitHub Bot commented on FLINK-9451: --- Github user zentol commented on a diff in the pull

[jira] [Commented] (FLINK-9451) End-to-end test: Scala Quickstarts

2018-06-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503233#comment-16503233 ] ASF GitHub Bot commented on FLINK-9451: --- Github user zentol commented on a diff in the pull

[GitHub] flink pull request #6089: [FLINK-9451]End-to-end test: Scala Quickstarts

2018-06-06 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/6089#discussion_r193392825 --- Diff: flink-end-to-end-tests/flink-quickstart-test/pom.xml --- @@ -0,0 +1,98 @@ + + +http://maven.apache.org/POM/4.0.0; +

[jira] [Commented] (FLINK-9451) End-to-end test: Scala Quickstarts

2018-06-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503231#comment-16503231 ] ASF GitHub Bot commented on FLINK-9451: --- Github user zentol commented on a diff in the pull

[jira] [Commented] (FLINK-9451) End-to-end test: Scala Quickstarts

2018-06-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503234#comment-16503234 ] ASF GitHub Bot commented on FLINK-9451: --- Github user zentol commented on a diff in the pull

[jira] [Commented] (FLINK-8468) Make the connector to take advantage of AMQP features (routing key, exchange and message properties)

2018-06-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503066#comment-16503066 ] ASF GitHub Bot commented on FLINK-8468: --- Github user pduveau commented on a diff in the pull

[GitHub] flink pull request #5410: [FLINK-8468] [RabbitMQ Connector] Take advantage o...

2018-06-06 Thread pduveau
Github user pduveau commented on a diff in the pull request: https://github.com/apache/flink/pull/5410#discussion_r193356713 --- Diff: flink-connectors/flink-connector-rabbitmq/src/main/java/org/apache/flink/streaming/connectors/rabbitmq/RMQSink.java --- @@ -40,22 +42,63 @@

[GitHub] flink pull request #5410: [FLINK-8468] [RabbitMQ Connector] Take advantage o...

2018-06-06 Thread pduveau
Github user pduveau commented on a diff in the pull request: https://github.com/apache/flink/pull/5410#discussion_r193356675 --- Diff: flink-connectors/flink-connector-rabbitmq/src/test/java/org/apache/flink/streaming/connectors/rabbitmq/RMQSinkTest.java --- @@ -124,7 +159,82 @@

[GitHub] flink pull request #5410: [FLINK-8468] [RabbitMQ Connector] Take advantage o...

2018-06-06 Thread pduveau
Github user pduveau commented on a diff in the pull request: https://github.com/apache/flink/pull/5410#discussion_r193356620 --- Diff: flink-connectors/flink-connector-rabbitmq/src/main/java/org/apache/flink/streaming/connectors/rabbitmq/common/RMQConnectionConfig.java --- @@

[jira] [Commented] (FLINK-8468) Make the connector to take advantage of AMQP features (routing key, exchange and message properties)

2018-06-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503067#comment-16503067 ] ASF GitHub Bot commented on FLINK-8468: --- Github user pduveau commented on a diff in the pull

[jira] [Commented] (FLINK-8468) Make the connector to take advantage of AMQP features (routing key, exchange and message properties)

2018-06-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503069#comment-16503069 ] ASF GitHub Bot commented on FLINK-8468: --- Github user pduveau commented on a diff in the pull

[jira] [Commented] (FLINK-8468) Make the connector to take advantage of AMQP features (routing key, exchange and message properties)

2018-06-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503090#comment-16503090 ] ASF GitHub Bot commented on FLINK-8468: --- Github user pduveau commented on a diff in the pull

[GitHub] flink pull request #5410: [FLINK-8468] [RabbitMQ Connector] Take advantage o...

2018-06-06 Thread pduveau
Github user pduveau commented on a diff in the pull request: https://github.com/apache/flink/pull/5410#discussion_r193360923 --- Diff: flink-connectors/flink-connector-rabbitmq/src/test/java/org/apache/flink/streaming/connectors/rabbitmq/RMQSinkTest.java --- @@ -83,7 +103,22 @@

[jira] [Updated] (FLINK-9540) Apache Flink 1.4.2 S3 Hadooplibrary for Hadoop 2.7 is built for Hadoop 2.8 and fails

2018-06-06 Thread Razvan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Razvan updated FLINK-9540: -- Description: ++Download Apache Flink 1.4.2 for Hadoop 2.7 or earlier.  > Apache Flink 1.4.2 S3 Hadooplibrary

[GitHub] flink issue #6082: [FLINK-9444][table] KafkaAvroTableSource failed to work f...

2018-06-06 Thread fhueske
Github user fhueske commented on the issue: https://github.com/apache/flink/pull/6082 We treat sequences of values as arrays in SQL and the Table API. There are no built-in functions to handle lists. So we should return the values as an array, and hence don't need a List type. ---

[jira] [Created] (FLINK-9541) Add robots.txt and sitemap.xml to Flink website

2018-06-06 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-9541: Summary: Add robots.txt and sitemap.xml to Flink website Key: FLINK-9541 URL: https://issues.apache.org/jira/browse/FLINK-9541 Project: Flink Issue Type:

[jira] [Assigned] (FLINK-9538) Make KeyedStateFunction an interface

2018-06-06 Thread vinoyang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned FLINK-9538: --- Assignee: vinoyang > Make KeyedStateFunction an interface > >

[jira] [Created] (FLINK-9544) Impossible to downgrade kinesis protocole from CBOR to JSON as required by kinesalite

2018-06-06 Thread Ph.Duveau (JIRA)
Ph.Duveau created FLINK-9544: Summary: Impossible to downgrade kinesis protocole from CBOR to JSON as required by kinesalite Key: FLINK-9544 URL: https://issues.apache.org/jira/browse/FLINK-9544 Project:

[jira] [Created] (FLINK-9539) Integrate flink-shaded 4.0

2018-06-06 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-9539: --- Summary: Integrate flink-shaded 4.0 Key: FLINK-9539 URL: https://issues.apache.org/jira/browse/FLINK-9539 Project: Flink Issue Type: Improvement

[jira] [Updated] (FLINK-9540) Apache Flink 1.4.2 S3 Hadooplibrary for Hadoop 2.7 is built for Hadoop 2.8 and fails

2018-06-06 Thread Razvan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Razvan updated FLINK-9540: -- Description: Download Apache Flink 1.4.2 for Hadoop 2.7 or earlier. Go to opt/ inside 

[jira] [Commented] (FLINK-5232) Add a Thread default uncaught exception handler on the JobManager

2018-06-06 Thread vinoyang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16502895#comment-16502895 ] vinoyang commented on FLINK-5232: - [~StephanEwen] any opinion? if not, I will try to fix this. > Add a

[GitHub] flink issue #6092: [FLINK-9352] In Standalone checkpoint recover mode many j...

2018-06-06 Thread yanghua
Github user yanghua commented on the issue: https://github.com/apache/flink/pull/6092 cc @zentol if you have time, can you review this? ---

[jira] [Commented] (FLINK-9352) In Standalone checkpoint recover mode many jobs with same checkpoint interval cause IO pressure

2018-06-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16502896#comment-16502896 ] ASF GitHub Bot commented on FLINK-9352: --- Github user yanghua commented on the issue:

[jira] [Created] (FLINK-9537) JobManager isolation in session mode

2018-06-06 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-9537: Summary: JobManager isolation in session mode Key: FLINK-9537 URL: https://issues.apache.org/jira/browse/FLINK-9537 Project: Flink Issue Type: Improvement

[jira] [Commented] (FLINK-9533) CEP cant deal with the known outOfOrder config with event time

2018-06-06 Thread Dawid Wysakowicz (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16502901#comment-16502901 ] Dawid Wysakowicz commented on FLINK-9533: - Hi [~aitozi], I don't think this is a bug at all,

[jira] [Commented] (FLINK-9455) Make SlotManager aware of multi slot TaskManagers

2018-06-06 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16502918#comment-16502918 ] Till Rohrmann commented on FLINK-9455: -- Hi [~sihuazhou], the issue is indeed a bit more involved

[jira] [Commented] (FLINK-9294) Improve type inference for UDFs with composite parameter or result type

2018-06-06 Thread Timo Walther (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16502920#comment-16502920 ] Timo Walther commented on FLINK-9294: - The problem why we don't extract {{MapTypeInfo}} is because we

[jira] [Created] (FLINK-9538) Make KeyedStateFunction an interface

2018-06-06 Thread Dawid Wysakowicz (JIRA)
Dawid Wysakowicz created FLINK-9538: --- Summary: Make KeyedStateFunction an interface Key: FLINK-9538 URL: https://issues.apache.org/jira/browse/FLINK-9538 Project: Flink Issue Type:

[jira] [Commented] (FLINK-9538) Make KeyedStateFunction an interface

2018-06-06 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16502923#comment-16502923 ] Aljoscha Krettek commented on FLINK-9538: - Sounds good! > Make KeyedStateFunction an interface >

[jira] [Updated] (FLINK-9538) Make KeyedStateFunction an interface

2018-06-06 Thread Dawid Wysakowicz (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dawid Wysakowicz updated FLINK-9538: Description: I suggest to change the KeyedStateFunction from abstract class to interface

[jira] [Comment Edited] (FLINK-9533) CEP cant deal with the known outOfOrder config with event time

2018-06-06 Thread Dawid Wysakowicz (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16502901#comment-16502901 ] Dawid Wysakowicz edited comment on FLINK-9533 at 6/6/18 7:46 AM: - Hi

[jira] [Closed] (FLINK-9533) CEP cant deal with the known outOfOrder config with event time

2018-06-06 Thread Dawid Wysakowicz (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dawid Wysakowicz closed FLINK-9533. --- Resolution: Not A Problem > CEP cant deal with the known outOfOrder config with event time >

[jira] [Commented] (FLINK-9455) Make SlotManager aware of multi slot TaskManagers

2018-06-06 Thread Sihua Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16502935#comment-16502935 ] Sihua Zhou commented on FLINK-9455: --- [~till.rohrmann] Thanks for your reply, I agreed. I'll give a

[GitHub] flink pull request #6126: [FLINK-9530][metrics] Fix numRecords task metric f...

2018-06-06 Thread zentol
GitHub user zentol opened a pull request: https://github.com/apache/flink/pull/6126 [FLINK-9530][metrics] Fix numRecords task metric for chains ## What is the purpose of the change This PR fixes the task re-use of operator `numRecordsIn/Out` metrics. Tasks were re-using

[jira] [Commented] (FLINK-9530) Task numRecords metrics broken for chains

2018-06-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16502947#comment-16502947 ] ASF GitHub Bot commented on FLINK-9530: --- GitHub user zentol opened a pull request:

[jira] [Updated] (FLINK-9532) Flink Overview of Jobs Documentation Incorrect

2018-06-06 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler updated FLINK-9532: Description:

[jira] [Updated] (FLINK-9532) Flink Overview of Jobs Documentation Incorrect

2018-06-06 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler updated FLINK-9532: Description:

[GitHub] flink pull request #6125: [FLINK-9532] Flink Overview of Jobs Documentation ...

2018-06-06 Thread yanghua
GitHub user yanghua opened a pull request: https://github.com/apache/flink/pull/6125 [FLINK-9532] Flink Overview of Jobs Documentation Incorrect ## What is the purpose of the change *This pull request fixed Flink Overview of Jobs Documentation Incorrect* ##

[jira] [Commented] (FLINK-9532) Flink Overview of Jobs Documentation Incorrect

2018-06-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16502885#comment-16502885 ] ASF GitHub Bot commented on FLINK-9532: --- GitHub user yanghua opened a pull request:

[jira] [Assigned] (FLINK-9535) log4j.properties specified in env.java.options doesn't get picked.

2018-06-06 Thread vinoyang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned FLINK-9535: --- Assignee: vinoyang > log4j.properties specified in env.java.options doesn't get picked. >

[jira] [Assigned] (FLINK-9471) Job ending exceptions being logged at Info level

2018-06-06 Thread vinoyang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned FLINK-9471: --- Assignee: vinoyang > Job ending exceptions being logged at Info level >

[jira] [Assigned] (FLINK-9536) Rolling logs using log4j.properties, prevents them from showing on the UI.

2018-06-06 Thread vinoyang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned FLINK-9536: --- Assignee: vinoyang > Rolling logs using log4j.properties, prevents them from showing on the UI. >

[jira] [Created] (FLINK-9535) log4j.properties specified in env.java.options doesn't get picked.

2018-06-06 Thread SUBRAMANYA SURESH (JIRA)
SUBRAMANYA SURESH created FLINK-9535: Summary: log4j.properties specified in env.java.options doesn't get picked. Key: FLINK-9535 URL: https://issues.apache.org/jira/browse/FLINK-9535 Project:

[jira] [Created] (FLINK-9536) Rolling logs using log4j.properties, prevents them from showing on the UI.

2018-06-06 Thread SUBRAMANYA SURESH (JIRA)
SUBRAMANYA SURESH created FLINK-9536: Summary: Rolling logs using log4j.properties, prevents them from showing on the UI. Key: FLINK-9536 URL: https://issues.apache.org/jira/browse/FLINK-9536

[jira] [Closed] (FLINK-7917) The return of taskInformationOrBlobKey should be placed inside synchronized in ExecutionJobVertex

2018-06-06 Thread vinoyang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed FLINK-7917. --- Resolution: Fixed Fix Version/s: 1.6.0 > The return of taskInformationOrBlobKey should be placed

[jira] [Commented] (FLINK-9368) End-to-end test: Python API

2018-06-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16502977#comment-16502977 ] ASF GitHub Bot commented on FLINK-9368: --- GitHub user zentol opened a pull request:

[GitHub] flink pull request #6127: [FLINK-9368][py][tests] Add Python API E2E test

2018-06-06 Thread zentol
GitHub user zentol opened a pull request: https://github.com/apache/flink/pull/6127 [FLINK-9368][py][tests] Add Python API E2E test ## What is the purpose of the change This PR adds en end-to-end test for the batch Python API. It uses the built-in wordcount example.

[jira] [Updated] (FLINK-8744) Add annotations for documenting common/advanced options

2018-06-06 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler updated FLINK-8744: Summary: Add annotations for documenting common/advanced options (was: Add annotations

[jira] [Updated] (FLINK-8886) Job isolation via scheduling in shared cluster

2018-06-06 Thread mingleizhang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingleizhang updated FLINK-8886: Description: Flink's TaskManager executes tasks from different jobs within the same JVM as

[jira] [Commented] (FLINK-8886) Job isolation via scheduling in shared cluster

2018-06-06 Thread Renjie Liu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16502997#comment-16502997 ] Renjie Liu commented on FLINK-8886: --- I think there are two parts of this issue: # Task manager

[jira] [Commented] (FLINK-9366) Distribute Cache only works for client-accessible files

2018-06-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503024#comment-16503024 ] ASF GitHub Bot commented on FLINK-9366: --- Github user zentol commented on a diff in the pull

[GitHub] flink pull request #6107: [FLINK-9366] DistributedCache works with Distribut...

2018-06-06 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/6107#discussion_r193340830 --- Diff: flink-java/src/main/java/org/apache/flink/api/java/ExecutionEnvironment.java --- @@ -844,7 +844,7 @@ public JobExecutionResult execute() throws

[jira] [Commented] (FLINK-9366) Distribute Cache only works for client-accessible files

2018-06-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503025#comment-16503025 ] ASF GitHub Bot commented on FLINK-9366: --- Github user zentol commented on a diff in the pull

[GitHub] flink pull request #6107: [FLINK-9366] DistributedCache works with Distribut...

2018-06-06 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/6107#discussion_r193341492 --- Diff: flink-java/src/main/java/org/apache/flink/api/java/ExecutionEnvironment.java --- @@ -844,7 +844,7 @@ public JobExecutionResult execute() throws

[GitHub] flink pull request #6076: [hotfix][docs] Specify operators behaviour on proc...

2018-06-06 Thread eliaslevy
Github user eliaslevy commented on a diff in the pull request: https://github.com/apache/flink/pull/6076#discussion_r193619225 --- Diff: docs/dev/event_time.md --- @@ -213,10 +213,33 @@ arrive after the system's event time clock (as signaled by the watermarks) has a

[jira] [Commented] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-06 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503426#comment-16503426 ] swy commented on FLINK-9506: [~kkrugler] please don't close the ticket yet. Because the performance

[jira] [Commented] (FLINK-9444) KafkaAvroTableSource failed to work for map and array fields

2018-06-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16504249#comment-16504249 ] ASF GitHub Bot commented on FLINK-9444: --- Github user tragicjun commented on the issue:

[jira] [Commented] (FLINK-9503) Migrate integration tests for iterative aggregators

2018-06-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16504199#comment-16504199 ] ASF GitHub Bot commented on FLINK-9503: --- Github user yanghua commented on the issue:

[GitHub] flink issue #6129: [FLINK-9503] Migrate integration tests for iterative aggr...

2018-06-06 Thread yanghua
Github user yanghua commented on the issue: https://github.com/apache/flink/pull/6129 cc @zentol please review again, the reason of CI error is other problem ---

[jira] [Commented] (FLINK-9535) log4j.properties specified in env.java.options doesn't get picked.

2018-06-06 Thread Ken Krugler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503396#comment-16503396 ] Ken Krugler commented on FLINK-9535: I believe that {{log4j.configuration}} takes a path to a file,

[jira] [Commented] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-06 Thread Ken Krugler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503401#comment-16503401 ] Ken Krugler commented on FLINK-9506: @swy - the questions about setting up RocksDB, and your

[jira] [Commented] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-06 Thread Sihua Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503505#comment-16503505 ] Sihua Zhou commented on FLINK-9506: --- [~yow] Maybe there is one more optimization that could have a try,

[jira] [Assigned] (FLINK-9543) Expose JobMaster IDs to metric system

2018-06-06 Thread vinoyang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned FLINK-9543: --- Assignee: vinoyang > Expose JobMaster IDs to metric system > -

[jira] [Commented] (FLINK-9503) Migrate integration tests for iterative aggregators

2018-06-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503542#comment-16503542 ] ASF GitHub Bot commented on FLINK-9503: --- GitHub user yanghua opened a pull request:

  1   2   >