[jira] [Created] (FLINK-18855) Translate the "Cluster Execution" page of "Application Development's DataSet API" into Chinese

Roc Marshal created FLINK-18855: --- Summary: Translate the "Cluster Execution" page of "Application Development's DataSet API" into Chinese Key: FLINK-18855 URL: https://issues.apache.org/jira/browse/FLINK-18855

[jira] [Created] (FLINK-18854) Translate the 'API Migration Guides' page of 'Application Development' into Chinese

Roc Marshal created FLINK-18854: --- Summary: Translate the 'API Migration Guides' page of 'Application Development' into Chinese Key: FLINK-18854 URL: https://issues.apache.org/jira/browse/FLINK-18854

Re: Kinesis Performance Issue (was [VOTE] Release 1.11.0, release candidate #4)

Just another update: The duration of snapshotState is capped by the Kinesis producer's "RecordTtl" setting (default 30s). The sleep time in flushSync does not contribute to the observed behavior. I guess the open question is why, with the same settings, is 1.11 since commit

Re: Kinesis Performance Issue (was [VOTE] Release 1.11.0, release candidate #4)

Hi Roman, Here are the checkpoint summaries for both commits: https://docs.google.com/presentation/d/159IVXQGXabjnYJk3oVm3UP2UW_5G-TGs_u9yzYb030I/edit#slide=id.g86d15b2fc7_0_0 The config: CheckpointConfig checkpointConfig = env.getCheckpointConfig();

Re: [DISCUSS] Retrieve savepoint location after suspension of jobclusters

+1 Thank you Fabian! On Fri, Aug 7, 2020 at 6:58 AM Fabian Paul wrote: > Hi all, > > Due to recent changes in the shutdown mechanism of Flink [1] it is not > conveniently possible anymore to suspend a job running on a jobcluster > with a savepoint and retrieve the savepoint location via the

Re: [DISCUSS] Upgrade HBase connector to 2.2.x

I'm +1 to add HBase 2.x However, I have some concerns about moving HBase 1.x to Bahir: 1) As discussed above, there are still lots of people using HBase 1.x. 2) Bahir doesn't have the infrastructure to run the existing HBase E2E tests. 3) We also paid lots of effort to provide an uber connector

[DISCUSS] Retrieve savepoint location after suspension of jobclusters

Hi all, Due to recent changes in the shutdown mechanism of Flink [1] it is not conveniently possible anymore to suspend a job running on a jobcluster with a savepoint and retrieve the savepoint location via the Flink API programmatically. With the introduced changes the rest endpoint

[jira] [Created] (FLINK-18853) Supports properties from flink-conf.yaml for SET command in sql client

godfrey he created FLINK-18853: -- Summary: Supports properties from flink-conf.yaml for SET command in sql client Key: FLINK-18853 URL: https://issues.apache.org/jira/browse/FLINK-18853 Project: Flink

[jira] [Created] (FLINK-18852) StreamScan should keep the same parallelism as the input

liupengcheng created FLINK-18852: Summary: StreamScan should keep the same parallelism as the input Key: FLINK-18852 URL: https://issues.apache.org/jira/browse/FLINK-18852 Project: Flink

[jira] [Created] (FLINK-18851) Add checkpoint type to checkpoint history entries in Web UI

Arvid Heise created FLINK-18851: --- Summary: Add checkpoint type to checkpoint history entries in Web UI Key: FLINK-18851 URL: https://issues.apache.org/jira/browse/FLINK-18851 Project: Flink

[jira] [Created] (FLINK-18850) Add late records dropped metric for row time over windows

Benchao Li created FLINK-18850: -- Summary: Add late records dropped metric for row time over windows Key: FLINK-18850 URL: https://issues.apache.org/jira/browse/FLINK-18850 Project: Flink Issue

Re: Adding a new "Docker Images" component to Jira

+1 for unifying Deployment / Docker, Dockerfiles and Release System / Docker into Docker. Cheers, Till On Fri, Aug 7, 2020 at 12:18 PM Robert Metzger wrote: > Hi all, > > we now have 3 components containing the word "docker": > - Deployment / Docker > < >

[jira] [Created] (FLINK-18849) Improve the code tabs of the Flink documents

Wei Zhong created FLINK-18849: - Summary: Improve the code tabs of the Flink documents Key: FLINK-18849 URL: https://issues.apache.org/jira/browse/FLINK-18849 Project: Flink Issue Type:

Re: Adding a new "Docker Images" component to Jira

Hi all, we now have 3 components containing the word "docker": - Deployment / Docker (63 issues) - Dockerfiles

Re: [DISCUSS] Upgrade HBase connector to 2.2.x

Hi, Thank you for picking this up so quickly. I have no objections regarding all the proposed items. @Gyula: Once the bahir contribution is properly reviewed, ping me if you need somebody to merge it. On Fri, Aug 7, 2020 at 10:43 AM Márton Balassi wrote: > Hi Robert and Gyula, > > Thanks for

Re: Kinesis Performance Issue (was [VOTE] Release 1.11.0, release candidate #4)

Hi Thomas, Thanks for your reply! I think you are right, we can remove this sleep and improve KinesisProducer. Probably, it's snapshotState can also be sped up by forcing records flush more often. Do you see that 30s checkpointing duration is caused by KinesisProducer (or maybe other operators)?

Re: [DISCUSS] Upgrade HBase connector to 2.2.x

Hi Robert and Gyula, Thanks for reviving this thread. We have the implementation (currently for 2.2.3) and it is straightforward to contribute it back. Miklos (ccd) has recently written a readme for said version, he would be interested in contributing the upgraded connector back. The latest HBase

[jira] [Created] (FLINK-18848) table.to_pandas should thrown exceptions if table is not append only

Dian Fu created FLINK-18848: --- Summary: table.to_pandas should thrown exceptions if table is not append only Key: FLINK-18848 URL: https://issues.apache.org/jira/browse/FLINK-18848 Project: Flink

Re: [DISCUSS] Upgrade HBase connector to 2.2.x

Hi Robert, I completely agree with you on the Bahir based approach. I am happy to help with the contribution on the bahir side, with thorough review and testing. Cheers, Gyula On Fri, 7 Aug 2020 at 09:30, Robert Metzger wrote: > It seems that this thead is not on dev@ anymore. Adding it

Re: [DISCUSS] Upgrade HBase connector to 2.2.x

It seems that this thead is not on dev@ anymore. Adding it back ... On Fri, Aug 7, 2020 at 9:23 AM Robert Metzger wrote: > I would like to revive this discussion. There's a new JIRA[1] + PR[2] for > adding HBase 2 support. > > it seems that there is demand for a HBase 2 connector, and consensus

[jira] [Created] (FLINK-18847) Add documentation about data types in Python Table API

Dian Fu created FLINK-18847: --- Summary: Add documentation about data types in Python Table API Key: FLINK-18847 URL: https://issues.apache.org/jira/browse/FLINK-18847 Project: Flink Issue Type:

Re: [DISCUSS] Releasing Flink 1.10.2

Thanks Zhu Zhu for taking care of this. Regards, Dian > 在 2020年8月7日，下午2:47，Zhu Zhu 写道： > > Thank you all for the confirmation and suggestion. > And thanks Zhijiang for offering the PMC power to help with the release. > > Robert's suggestion sounds good to me. I will keep watching the ML and >

Re: [DISCUSS] Releasing Flink 1.10.2

Thank you all for the confirmation and suggestion. And thanks Zhijiang for offering the PMC power to help with the release. Robert's suggestion sounds good to me. I will keep watching the ML and JIRA issues until next Monday evening. If there were no new concerns nor blocking issues, I will start

Re: [DISCUSS] Releasing Flink 1.10.2

Thanks for volunteering as the release manager, zhuzhu. +1 for the 1.10.2 release and I am willing to provide any help in the procedure if needing PMC permission operations. Best, Zhijiang -- From:Robert Metzger Send

Re: [DISCUSS] Releasing Flink 1.10.2

Thanks for taking care of this Zhu Zhu. The list of bugs from your list certainly justifies pushing out a bugfix release. I would propose to wait until Monday for people to speak up if they want to have a fix included in the release. Otherwise, we could create the first RC on Monday evening (China