[SURVEY] How do you use ExternallyInducedSource or WithMasterCheckpointHook

Hi everyone, I would like to reach out to the user who uses or is interested in `ExternallyInducedSource` or `WithMasterCheckpointHook` interfaces. The background of this survey is I'm doing some reworking of `CheckpointCoordinator`. I encountered a problem that the semantics of

Re: [DISCUSS] FLIP-76: Unaligned checkpoints

Thanks for the FLIP, Arvid. This is a good improvement for checkpoint under backpressure. Currently, if a job under backpressure, it almost can't complete the checkpoint. so +1 from my side. Best, Congxian zhijiang 于2019年10月10日周四 上午11:02写道： > Thanks for writing up this FLIP, Arvid! > > Many

Re: [DISCUSS] FLIP-68: Extend Core Table System with Modular Plugins

Jark has a good point. However, I think validation logic can put in place to restrict one instance per type. Maybe the doc needs to be specific on this. Thanks, Xuefu On Wed, Oct 9, 2019 at 7:41 PM Jark Wu wrote: > Thanks Bowen for the updating. > > I have some different opinions on the

Re: [SURVEY] Dropping non Credit-based Flow Control

Thanks for bringing this survey Piotr. Actually I was also trying to dropping the non credit-based code path from release-1.9, and now I think it is the proper time to do it motivated by [3]. The credit-based mode is as default from Flink 1.5 and it has been verified to be stable and reliable

[jira] [Created] (FLINK-14359) Create a module called flink-sql-connector-hbase to shade HBase

Jingsong Lee created FLINK-14359: Summary: Create a module called flink-sql-connector-hbase to shade HBase Key: FLINK-14359 URL: https://issues.apache.org/jira/browse/FLINK-14359 Project: Flink

Re: [DISCUSS] FLIP-76: Unaligned checkpoints

Thanks for writing up this FLIP, Arvid! Many users would expect this feature and also +1 from my side. Best, Zhijiang -- From:Piotr Nowojski Send Time:2019年10月7日(星期一) 10:13 To:dev Subject:Re: [DISCUSS] FLIP-76: Unaligned

Re: [DISCUSS] FLIP-68: Extend Core Table System with Modular Plugins

Thanks Bowen for the updating. I have some different opinions on the change. IIUC, in the previous design, the "name" is also the "id" or "type" to identify which module to load. Which means we can only load one instance of a module. In the new design, the "name" is just an alias to the module

Re: [DISCUSS] Drop Python 2 support for 1.10

Thanks everyone for your reply. So far all the reply tend to option 1 (dropping Python 2 support in 1.10) and will continue to hear if there are any other opinions. @Jincheng @Hequn, you are right, things become more complicate if dropping Python 2 support is performed after Python UDF has

[jira] [Created] (FLINK-14358) [Web UI] configuration tab for jobmanager has improper width for prop key

Steven Zhen Wu created FLINK-14358: -- Summary: [Web UI] configuration tab for jobmanager has improper width for prop key Key: FLINK-14358 URL: https://issues.apache.org/jira/browse/FLINK-14358

Re: Multiple Taskmanagers per node for standalone cluster

Thank you very much for the help, Xintong. Best, Ethan > On Oct 7, 2019, at 9:18 PM, Xintong Song wrote: > > I don't think using zookeeper should cause any problem on starting multiple > TMs per node. > > For standalone cluster, having one TM per node is usually the easiest way. It > is

Re: [DISCUSS] FLIP-73: Introducing Executors for job submission

Hi Kostas & Aljoscha, I'm drafting a plan exposing multi-layered clients. It is mainly about how we distinguish different layers and what clients we're going to expose. In FLIP-73 scope I'd like to ask a question that whether or not Executor becomes a public interface that can be made use of by

[jira] [Created] (FLINK-14357) Request for the ability to move checkpoints/savepoints

Mitch Wasson created FLINK-14357: Summary: Request for the ability to move checkpoints/savepoints Key: FLINK-14357 URL: https://issues.apache.org/jira/browse/FLINK-14357 Project: Flink Issue

[jira] [Created] (FLINK-14356) Support some special RowDeserializationSchema and RowSerializationSchema

jinfeng created FLINK-14356: --- Summary: Support some special RowDeserializationSchema and RowSerializationSchema Key: FLINK-14356 URL: https://issues.apache.org/jira/browse/FLINK-14356 Project: Flink

[jira] [Created] (FLINK-14355) Example code in state processor API docs doesn't compile

Mitch Wasson created FLINK-14355: Summary: Example code in state processor API docs doesn't compile Key: FLINK-14355 URL: https://issues.apache.org/jira/browse/FLINK-14355 Project: Flink

[jira] [Created] (FLINK-14354) Provide interfaces instead of abstract classes in org.apache.flink.state.api.functions

Mitch Wasson created FLINK-14354: Summary: Provide interfaces instead of abstract classes in org.apache.flink.state.api.functions Key: FLINK-14354 URL: https://issues.apache.org/jira/browse/FLINK-14354

Re: [DISCUSS] FLIP-64: Support for Temporary Objects in Table module

Hi Dawid, +1 for proposed changes On Wed, Oct 9, 2019 at 12:15 PM Dawid Wysakowicz wrote: > Sorry for a very delayed response. > > @Kurt Yes, this is the goal to have a function created like new > Function(...) also be wrapped into CatalogFunction. This would have to > be though a temporary

[jira] [Created] (FLINK-14353) Enable fork-reuse for table-planner

Chesnay Schepler created FLINK-14353: Summary: Enable fork-reuse for table-planner Key: FLINK-14353 URL: https://issues.apache.org/jira/browse/FLINK-14353 Project: Flink Issue Type:

Re: [DISCUSS] FLIP-68: Extend Core Table System with Modular Plugins

Thanks everyone for your review. After discussing with Timo and Dawid offline, as well as incorporating feedback from Xuefu and Jark on mailing list, I decided to make a few critical changes to the proposal. - renamed the keyword "type" to "kind". The community has plan to have "type" keyword in

[jira] [Created] (FLINK-14352) Dependencies section in Connect page of Table is broken

Jingsong Lee created FLINK-14352: Summary: Dependencies section in Connect page of Table is broken Key: FLINK-14352 URL: https://issues.apache.org/jira/browse/FLINK-14352 Project: Flink

[jira] [Created] (FLINK-14351) Refactor MetricRegistry delimiter retrieval into separate interface

Chesnay Schepler created FLINK-14351: Summary: Refactor MetricRegistry delimiter retrieval into separate interface Key: FLINK-14351 URL: https://issues.apache.org/jira/browse/FLINK-14351 Project:

[jira] [Created] (FLINK-14350) Introduce dedicated MetricScope

Chesnay Schepler created FLINK-14350: Summary: Introduce dedicated MetricScope Key: FLINK-14350 URL: https://issues.apache.org/jira/browse/FLINK-14350 Project: Flink Issue Type:

Re: [DISCUSS] FLIP-67: Global partitions lifecycle

Are there any other opinions in regards to the naming scheme? (local/global, promote) On 06/09/2019 15:16, Chesnay Schepler wrote: Hello, FLIP-36 (interactive programming) proposes a new

Re: [DISCUSS] FLIP-64: Support for Temporary Objects in Table module

Sorry for a very delayed response. @Kurt Yes, this is the goal to have a function created like new Function(...) also be wrapped into CatalogFunction. This would have to be though a temporary function as we cannot represent that as a set of properties. Similar to the

Re: [DISCUSS] FLIP-67: Global partitions lifecycle

While we could argue that it's a new interface so we aren't /technically /changing anything about the ShuffleMaster, I'd assume most people would just have the ShuffleMaster implement the new interface and call it a day. On 09/10/2019 09:57, Chesnay Schepler wrote: So should we enforce having

Re: [DISCUSS] FLIP-67: Global partitions lifecycle

So should we enforce having 2 instances now or defer this to a later date? I'd rather do this early since it changes 2 assumptions that ShuffleMaster can currently make: - every partition release is preceded by a registration of said partition - the release of partitions may rely on local data

Re: [VOTE] Release 1.9.1, release candidate #1

+1 from my side. - checked signatures and hashes - checked that all POM files point to the same version - verified that the source archives do not contains any binaries - build the source release with Scala 2.12 and Scala 2.11 successfully - manually verified the diff pom files between 1.9.0 and

[jira] [Created] (FLINK-14349) Create a Connector Descriptor for HBase so that user can connect HBase by TableEnvironment#connect

Zheng Hu created FLINK-14349: Summary: Create a Connector Descriptor for HBase so that user can connect HBase by TableEnvironment#connect Key: FLINK-14349 URL: https://issues.apache.org/jira/browse/FLINK-14349

Re: [VOTE] FLIP-74: Flink JobClient API

Given the ongoing FlinkForward Berlin event, I'm going to extend this vote thread with a bit of period, said until Oct. 11th(Friday). Best, tison. Zili Chen 于2019年10月7日周一 下午4:15写道： > Hi all, > > I would like to start the vote for FLIP-74[1], which is discussed and > reached a consensus in the