Re: Confusions About JDBCOutputFormat

2018-07-11 Thread Hequn Cheng
Hi wangsan, What I mean is establishing a connection each time write data into JDBC, i.e. establish a connection in flush() function. I think this will make sure the connection is ok. What do you think? On Wed, Jul 11, 2018 at 12:12 AM, wangsan wrote: > Hi Hequn, > > Establishing a connection

Register

2018-07-11 Thread 陈梓立
Register

Re: [VOTE] Release 1.5.1, release candidate #3

2018-07-11 Thread Chesnay Schepler
oh, the packages that include hadoop are really missing it... On 11.07.2018 09:25, Chesnay Schepler wrote: @Yaz which binary package did you check? I looked into the hadoop-free package and the folder is there. Did you maybe encounter an error when extracting the package? On 11.07.2018

Re: [VOTE] Release 1.5.1, release candidate #3

2018-07-11 Thread Chesnay Schepler
@Yaz which binary package did you check? I looked into the hadoop-free package and the folder is there. Did you maybe encounter an error when extracting the package? On 11.07.2018 05:44, Yaz Sh wrote: -1 ./examples/streaming folder is missing in binary packages Cheers, Yazdan On Jul 10,

Re: Register

2018-07-11 Thread Chesnay Schepler
To subscribe to the dev list you have to send a mail to dev-subscr...@flink.apache.org On 11.07.2018 09:17, 陈梓立 wrote: Register

Re: [VOTE] Release 1.5.1, release candidate #3

2018-07-11 Thread Chesnay Schepler
Correction on my part, it does affect all packages. I've also found the cause. To speed up the process I only built modules that flink-dist depends on (see FLINK-9768). However flink-dist depends on neither flink-examples-batch nor flink-examples-streaming, yet happily accesses their target

[jira] [Created] (FLINK-9797) Separate state serializers from network serializers

2018-07-11 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-9797: -- Summary: Separate state serializers from network serializers Key: FLINK-9797 URL: https://issues.apache.org/jira/browse/FLINK-9797 Project: Flink Issue Type:

[jira] [Created] (FLINK-9798) Drop canEqual() from TypeInformation, TypeSerializer, etc.

2018-07-11 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-9798: --- Summary: Drop canEqual() from TypeInformation, TypeSerializer, etc. Key: FLINK-9798 URL: https://issues.apache.org/jira/browse/FLINK-9798 Project: Flink

[jira] [Created] (FLINK-9800) Return the relation between a running job and the original jar in REST API

2018-07-11 Thread Lasse Nedergaard (JIRA)
Lasse Nedergaard created FLINK-9800: Summary: Return the relation between a running job and the original jar in REST API Key: FLINK-9800 URL: https://issues.apache.org/jira/browse/FLINK-9800

Re: [DISCUSS] Drop "canEqual" from TypeInformation, TypeSerializer, etc.

2018-07-11 Thread Aljoscha Krettek
I created https://issues.apache.org/jira/browse/FLINK-9798 > On 18. May 2018, at 16:10, Till Rohrmann wrote: > > +1 > > If we don't have a hierarchy of serializers then this method has no right > to exist. > > Cheers, > Till > > On Wed, May 16, 2018 at 11:06 AM, Timo Walther wrote: > >> +1

[jira] [Created] (FLINK-9799) Generalize/unify state meta info

2018-07-11 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-9799: - Summary: Generalize/unify state meta info Key: FLINK-9799 URL: https://issues.apache.org/jira/browse/FLINK-9799 Project: Flink Issue Type: Sub-task

Re: Confusions About JDBCOutputFormat

2018-07-11 Thread wangsan
Well, I see. If the connection is established when writing data into DB, we need to cache received rows since last write. IMO, maybe we do not need to open connections repeatedly or introduce connection pools. Test and refresh the connection periodically can simply solve this problem. I’ve

[jira] [Created] (FLINK-9801) flink-dist is missing dependency on flink-examples

2018-07-11 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-9801: --- Summary: flink-dist is missing dependency on flink-examples Key: FLINK-9801 URL: https://issues.apache.org/jira/browse/FLINK-9801 Project: Flink Issue

[jira] [Created] (FLINK-9802) Harden End-to-end tests against download failures

2018-07-11 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-9802: --- Summary: Harden End-to-end tests against download failures Key: FLINK-9802 URL: https://issues.apache.org/jira/browse/FLINK-9802 Project: Flink Issue

[jira] [Created] (FLINK-9803) Drop canEqual() from TypeInformation, TypeSerializer, etc.

2018-07-11 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-9803: --- Summary: Drop canEqual() from TypeInformation, TypeSerializer, etc. Key: FLINK-9803 URL: https://issues.apache.org/jira/browse/FLINK-9803 Project: Flink

Re: [VOTE] Release 1.5.1, release candidate #3

2018-07-11 Thread Chesnay Schepler
+1 * verified that the binary packages contained streaming examples * started local cluster without exceptions in the logs * ran multiple streaming examples On 11.07.2018 16:51, Chesnay Schepler wrote: I have rebuilt the binary release packages, they should now contain all examples. On

Re: flink JPS result changes

2018-07-11 Thread miki haiat
Flink 6 changed the execution model compactly https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=65147077 https://docs.google.com/document/d/1zwBP3LKnJ0LI1R4-9hLXBVjOXAkQS5jKrGYYoPz-xRk/edit#heading=h.giuwq6q8d23j On Wed, Jul 11, 2018 at 5:09 PM Will Du wrote: > Hi folks > Do

[jira] [Created] (FLINK-9808) Implement state conversion procedure in state backends

2018-07-11 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-9808: -- Summary: Implement state conversion procedure in state backends Key: FLINK-9808 URL: https://issues.apache.org/jira/browse/FLINK-9808 Project: Flink

Re: flink JPS result changes

2018-07-11 Thread Chesnay Schepler
Generally speaking no, the DIspatcher (here called StandaloneSessionClusterEntrypoint) will spawn a jobmanager internally when a job is submitted On 11.07.2018 16:42, Will Du wrote: In this case, do i need to add a jobManager On Jul 11, 2018, at 10:14 AM, miki haiat

Re: [VOTE] Release 1.5.1, release candidate #3

2018-07-11 Thread Chesnay Schepler
I have rebuilt the binary release packages, they should now contain all examples. On 11.07.2018 09:49, Chesnay Schepler wrote: Correction on my part, it does affect all packages. I've also found the cause. To speed up the process I only built modules that flink-dist depends on (see

Re: [VOTE] Release 1.5.1, release candidate #3

2018-07-11 Thread Till Rohrmann
+1 (binding) - Verified the signatures of all binary artifacts - Verified that no new dependencies were added for which the LICENSE and NOTICE files need to be adapted. - Build 1.5.1 from the source artifact - Run flink-end-to-end tests for 12 hours for the 1.5.1 Hadoop 2.7 binary artifact - Run

[jira] [Created] (FLINK-9812) SpanningRecordSerializationTest fails on travis

2018-07-11 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-9812: --- Summary: SpanningRecordSerializationTest fails on travis Key: FLINK-9812 URL: https://issues.apache.org/jira/browse/FLINK-9812 Project: Flink Issue

[jira] [Created] (FLINK-9814) CsvTableSource lack of column warning

2018-07-11 Thread JIRA
François Lacombe created FLINK-9814: --- Summary: CsvTableSource lack of column warning Key: FLINK-9814 URL: https://issues.apache.org/jira/browse/FLINK-9814 Project: Flink Issue Type: Wish

Re: [VOTE] Release 1.5.1, release candidate #3

2018-07-11 Thread Yaz Sh
+1 - Verified the signatures for all binary artifacts - Verifies Checksum for all binary packages - Ran local cluster with no error on logs and empty *.out - Stop local cluster with no error on logs - Ran multiple batch and streaming example via WebUI - Rab multiple batch and streaming examples

[jira] [Created] (FLINK-9813) Build xTableSource from Avro schemas

2018-07-11 Thread JIRA
François Lacombe created FLINK-9813: --- Summary: Build xTableSource from Avro schemas Key: FLINK-9813 URL: https://issues.apache.org/jira/browse/FLINK-9813 Project: Flink Issue Type: Wish

[jira] [Created] (FLINK-9815) YARNSessionCapacitySchedulerITCase flaky

2018-07-11 Thread Dawid Wysakowicz (JIRA)
Dawid Wysakowicz created FLINK-9815: --- Summary: YARNSessionCapacitySchedulerITCase flaky Key: FLINK-9815 URL: https://issues.apache.org/jira/browse/FLINK-9815 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-9816) Support Netty SslEngine based on openSSL

2018-07-11 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-9816: -- Summary: Support Netty SslEngine based on openSSL Key: FLINK-9816 URL: https://issues.apache.org/jira/browse/FLINK-9816 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-9805) HTTP Redirect to Active JM in Flink CLI

2018-07-11 Thread Sayat Satybaldiyev (JIRA)
Sayat Satybaldiyev created FLINK-9805: - Summary: HTTP Redirect to Active JM in Flink CLI Key: FLINK-9805 URL: https://issues.apache.org/jira/browse/FLINK-9805 Project: Flink Issue Type:

[jira] [Created] (FLINK-9807) Improve EventTimeWindowCheckpointITCase with parameterized

2018-07-11 Thread Congxian Qiu (JIRA)
Congxian Qiu created FLINK-9807: --- Summary: Improve EventTimeWindowCheckpointITCase with parameterized Key: FLINK-9807 URL: https://issues.apache.org/jira/browse/FLINK-9807 Project: Flink

Flink on Mesos - have to manually add host name to /etc/hosts

2018-07-11 Thread NEKRASSOV, ALEXEI
When I attempted to start Flink 1.4.2 on Mesos - I've ran into issue described here: https://stackoverflow.com/questions/45391980/error-installing-flink-in-dcos This workaround solved the problem: https://stackoverflow.com/a/48184752 Is there something that can be changed in the Flink project,

[jira] [Created] (FLINK-9804) KeyedStateBackend.getKeys() does not work on RocksDB MapState

2018-07-11 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-9804: --- Summary: KeyedStateBackend.getKeys() does not work on RocksDB MapState Key: FLINK-9804 URL: https://issues.apache.org/jira/browse/FLINK-9804 Project: Flink

Re: Confusions About JDBCOutputFormat

2018-07-11 Thread Hequn Cheng
Cool. I will take a look. Thanks. On Wed, Jul 11, 2018 at 7:08 PM, wangsan wrote: > Well, I see. If the connection is established when writing data into DB, > we need to cache received rows since last write. > > IMO, maybe we do not need to open connections repeatedly or introduce > connection

[jira] [Created] (FLINK-9806) Add a canonical link element to documentation HTML

2018-07-11 Thread Patrick Lucas (JIRA)
Patrick Lucas created FLINK-9806: Summary: Add a canonical link element to documentation HTML Key: FLINK-9806 URL: https://issues.apache.org/jira/browse/FLINK-9806 Project: Flink Issue Type:

[jira] [Created] (FLINK-9810) JarListHandler does not close opened jars

2018-07-11 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-9810: --- Summary: JarListHandler does not close opened jars Key: FLINK-9810 URL: https://issues.apache.org/jira/browse/FLINK-9810 Project: Flink Issue Type:

[jira] [Created] (FLINK-9811) Add ITCase for interactions of Jar handlers

2018-07-11 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-9811: --- Summary: Add ITCase for interactions of Jar handlers Key: FLINK-9811 URL: https://issues.apache.org/jira/browse/FLINK-9811 Project: Flink Issue Type:

[jira] [Created] (FLINK-9809) Support setting CoLocation constraints on the DataStream Transformations

2018-07-11 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-9809: --- Summary: Support setting CoLocation constraints on the DataStream Transformations Key: FLINK-9809 URL: https://issues.apache.org/jira/browse/FLINK-9809 Project: Flink

[jira] [Created] (FLINK-9826) Implement FLIP-6 YARN Resource Manager for SESSION mode

2018-07-11 Thread shuai.xu (JIRA)
shuai.xu created FLINK-9826: --- Summary: Implement FLIP-6 YARN Resource Manager for SESSION mode Key: FLINK-9826 URL: https://issues.apache.org/jira/browse/FLINK-9826 Project: Flink Issue Type: New

[jira] [Created] (FLINK-9822) Add Dockerfile for StandaloneJobClusterEntryPoint image

2018-07-11 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-9822: Summary: Add Dockerfile for StandaloneJobClusterEntryPoint image Key: FLINK-9822 URL: https://issues.apache.org/jira/browse/FLINK-9822 Project: Flink Issue

[jira] [Created] (FLINK-9825) Upgrade checkstyle version to 8.6

2018-07-11 Thread Ted Yu (JIRA)
Ted Yu created FLINK-9825: - Summary: Upgrade checkstyle version to 8.6 Key: FLINK-9825 URL: https://issues.apache.org/jira/browse/FLINK-9825 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-9828) Resource manager should recover slot resource status after failover

2018-07-11 Thread shuai.xu (JIRA)
shuai.xu created FLINK-9828: --- Summary: Resource manager should recover slot resource status after failover Key: FLINK-9828 URL: https://issues.apache.org/jira/browse/FLINK-9828 Project: Flink

[jira] [Created] (FLINK-9827) ResourceManager may receive outdate report of slots status from task manager

2018-07-11 Thread shuai.xu (JIRA)
shuai.xu created FLINK-9827: --- Summary: ResourceManager may receive outdate report of slots status from task manager Key: FLINK-9827 URL: https://issues.apache.org/jira/browse/FLINK-9827 Project: Flink

[jira] [Created] (FLINK-9820) Let dynamic properties overwrite configuration settings in ClusterEntrypoint

2018-07-11 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-9820: Summary: Let dynamic properties overwrite configuration settings in ClusterEntrypoint Key: FLINK-9820 URL: https://issues.apache.org/jira/browse/FLINK-9820 Project:

Re: Flink on Mesos - have to manually add host name to /etc/hosts

2018-07-11 Thread vino yang
Hi Alex, It seems it's a issue about finding host mapping. If you use hostname, flink will try to find the real IP address, if it can not find the host/ip mapping, will throw the exception. I think the link of the answer is a correct way of fixing this issue. Thanks. Vino. 2018-07-11 21:30

[jira] [Created] (FLINK-9821) Let dynamic properties overwrite configuration settings in TaskManagerRunner

2018-07-11 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-9821: Summary: Let dynamic properties overwrite configuration settings in TaskManagerRunner Key: FLINK-9821 URL: https://issues.apache.org/jira/browse/FLINK-9821 Project:

[jira] [Created] (FLINK-9819) Create start up scripts for the StandaloneJobClusterEntryPoint

2018-07-11 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-9819: Summary: Create start up scripts for the StandaloneJobClusterEntryPoint Key: FLINK-9819 URL: https://issues.apache.org/jira/browse/FLINK-9819 Project: Flink

[jira] [Created] (FLINK-9823) Add Kubernetes deployment files for standalone job cluster

2018-07-11 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-9823: Summary: Add Kubernetes deployment files for standalone job cluster Key: FLINK-9823 URL: https://issues.apache.org/jira/browse/FLINK-9823 Project: Flink

[jira] [Created] (FLINK-9824) Support IPv6 literal

2018-07-11 Thread Ted Yu (JIRA)
Ted Yu created FLINK-9824: - Summary: Support IPv6 literal Key: FLINK-9824 URL: https://issues.apache.org/jira/browse/FLINK-9824 Project: Flink Issue Type: Bug Reporter: Ted Yu

[jira] [Created] (FLINK-9817) Version not correctly bumped to 5.0

2018-07-11 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-9817: -- Summary: Version not correctly bumped to 5.0 Key: FLINK-9817 URL: https://issues.apache.org/jira/browse/FLINK-9817 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-9818) Add cluster component command line parser

2018-07-11 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-9818: Summary: Add cluster component command line parser Key: FLINK-9818 URL: https://issues.apache.org/jira/browse/FLINK-9818 Project: Flink Issue Type: