[jira] [Created] (FLINK-31764) Get rid of numberOfRequestedOverdraftMemorySegments in LocalBufferPool

2023-04-10 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-31764: -- Summary: Get rid of numberOfRequestedOverdraftMemorySegments in LocalBufferPool Key: FLINK-31764 URL: https://issues.apache.org/jira/browse/FLINK-31764 Project: Flink

[jira] [Created] (FLINK-31763) Ensure that the total number of requested buffers does not exceed poolSize + maxOverdraftBuffersPerGate

2023-04-10 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-31763: -- Summary: Ensure that the total number of requested buffers does not exceed poolSize + maxOverdraftBuffersPerGate Key: FLINK-31763 URL:

Re: [DISCUSS] FLIP-302: Support TRUNCATE TABLE statement

2023-04-10 Thread liu ron
Hi, xia It's a nice improvement to support TRUNCATE TABLE statement, making Flink more feature-rich. I think the truncate syntax is a command that will be executed in the client's process, rather than pulling up a Flink job to execute on the cluster. So on the user-facing exposed interface, I

Re: [VOTE] FLIP-292: Enhance COMPILED PLAN to support operator-level state TTL configuration

2023-04-10 Thread Benchao Li
+1 (binding) Shuo Cheng 于2023年4月11日周二 10:02写道: > + 1 (non-binding) > > Best Regards, > Shuo > > On Mon, Apr 10, 2023 at 6:06 PM Jane Chan wrote: > > > Hi developers, > > > > Thanks for all the feedback on FLIP-292: Enhance COMPILED PLAN to support > > operator-level state TTL configuration

Re: [VOTE] FLIP-292: Enhance COMPILED PLAN to support operator-level state TTL configuration

2023-04-10 Thread Shuo Cheng
+ 1 (non-binding) Best Regards, Shuo On Mon, Apr 10, 2023 at 6:06 PM Jane Chan wrote: > Hi developers, > > Thanks for all the feedback on FLIP-292: Enhance COMPILED PLAN to support > operator-level state TTL configuration [1]. > Based on the discussion [2], we have come to a consensus, so I

Re: [DISCUSS] FLIP-302: Support TRUNCATE TABLE statement

2023-04-10 Thread yuxia
Hi, Jim. Thanks for your explanation. Now, I got you. I think you raise a good question. As Flink doesn't manage the underlying storage, it's hard for Flink itself to do the real coordiantion. For me, it looks like Flink needs to introduce some common coordiantion which maybe dicussed in

Re: [VOTE] FLIP-292: Enhance COMPILED PLAN to support operator-level state TTL configuration

2023-04-10 Thread Jark Wu
+1 (binding) Best, Jark > 2023年4月10日 23:04,godfrey he 写道: > > +1 (binding) > > Best, > Godfrey > > Jing Ge 于2023年4月10日周一 18:42写道: >> >> +1 (binding) >> >> Best Regards, >> Jing >> >> On Mon, Apr 10, 2023 at 12:27 PM Lincoln Lee wrote: >> >>> +1 (binding) >>> >>> Best, >>> Lincoln Lee

[jira] [Created] (FLINK-31762) Subscribe multiple Kafka topics may cause partition assignment skew

2023-04-10 Thread Liam (Jira)
Liam created FLINK-31762: Summary: Subscribe multiple Kafka topics may cause partition assignment skew Key: FLINK-31762 URL: https://issues.apache.org/jira/browse/FLINK-31762 Project: Flink Issue

[jira] [Created] (FLINK-31761) Fix Some Typo And Improve lambda expressions.

2023-04-10 Thread Shilun Fan (Jira)
Shilun Fan created FLINK-31761: -- Summary: Fix Some Typo And Improve lambda expressions. Key: FLINK-31761 URL: https://issues.apache.org/jira/browse/FLINK-31761 Project: Flink Issue Type:

[jira] [Created] (FLINK-31760) COALESCE() with NULL arguments throws error

2023-04-10 Thread Mohsen Rezaei (Jira)
Mohsen Rezaei created FLINK-31760: - Summary: COALESCE() with NULL arguments throws error Key: FLINK-31760 URL: https://issues.apache.org/jira/browse/FLINK-31760 Project: Flink Issue Type:

Re: [DISCUSS] FLIP-302: Support TRUNCATE TABLE statement

2023-04-10 Thread Jim Hughes
Hi Yuxia, On Mon, Apr 10, 2023 at 10:35 AM yuxia wrote: > Hi, Jim. > > 1: I'm expecting all DynamicTableSinks to support. But it's hard to > support all at one shot. For the DynamicTableSinks that haven't implemented > SupportsTruncate interface, we'll throw exception > like 'The truncate

[jira] [Created] (FLINK-31759) Update some external connectors to use modified sql_connector_download_table shortcode

2023-04-10 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-31759: -- Summary: Update some external connectors to use modified sql_connector_download_table shortcode Key: FLINK-31759 URL: https://issues.apache.org/jira/browse/FLINK-31759

Re: [VOTE] FLIP-292: Enhance COMPILED PLAN to support operator-level state TTL configuration

2023-04-10 Thread godfrey he
+1 (binding) Best, Godfrey Jing Ge 于2023年4月10日周一 18:42写道: > > +1 (binding) > > Best Regards, > Jing > > On Mon, Apr 10, 2023 at 12:27 PM Lincoln Lee wrote: > > > +1 (binding) > > > > Best, > > Lincoln Lee > > > > > > Jane Chan 于2023年4月10日周一 18:06写道: > > > > > Hi developers, > > > > > > Thanks

[jira] [Created] (FLINK-31758) Some external connectors sql client jar has a wrong download url in document

2023-04-10 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-31758: -- Summary: Some external connectors sql client jar has a wrong download url in document Key: FLINK-31758 URL: https://issues.apache.org/jira/browse/FLINK-31758 Project:

Re: [DISCUSS] FLIP-302: Support TRUNCATE TABLE statement

2023-04-10 Thread yuxia
Hi, Jim. 1: I'm expecting all DynamicTableSinks to support. But it's hard to support all at one shot. For the DynamicTableSinks that haven't implemented SupportsTruncate interface, we'll throw exception like 'The truncate statement for the table is not supported as it hasn't implemented the

Re: [DISCUSS] FLIP-302: Support TRUNCATE TABLE statement

2023-04-10 Thread Jim Hughes
Hi Yuxia, Two questions: 1. Are you expecting all DynamicTableSinks to support Truncate? The FLIP could use some explanation for what supporting and not supporting the operation means. 2. How will truncate inoperate with streaming queries? That is, if I truncate an input to a streaming

Re: [DISCUSS] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-04-10 Thread Rui Fan
Hi all, Thanks Zakelly driving this proposal, and thank you all for the warm discussions. It's really a useful feature. I have a few questions about this FLIP. (1) The temporary segment will remain in the physical file for a short time, right? FLIP proposes to write segments instead of

Re: [VOTE] FLIP-292: Enhance COMPILED PLAN to support operator-level state TTL configuration

2023-04-10 Thread Jing Ge
+1 (binding) Best Regards, Jing On Mon, Apr 10, 2023 at 12:27 PM Lincoln Lee wrote: > +1 (binding) > > Best, > Lincoln Lee > > > Jane Chan 于2023年4月10日周一 18:06写道: > > > Hi developers, > > > > Thanks for all the feedback on FLIP-292: Enhance COMPILED PLAN to support > > operator-level state TTL

Re: [VOTE] FLIP-292: Enhance COMPILED PLAN to support operator-level state TTL configuration

2023-04-10 Thread Lincoln Lee
+1 (binding) Best, Lincoln Lee Jane Chan 于2023年4月10日周一 18:06写道: > Hi developers, > > Thanks for all the feedback on FLIP-292: Enhance COMPILED PLAN to support > operator-level state TTL configuration [1]. > Based on the discussion [2], we have come to a consensus, so I would like > to start a

Re: [External] [DISCUSS] FLIP-292: Support configuring state TTL at operator level for Table API & SQL programs

2023-04-10 Thread Jane Chan
Hi everyone, I started a vote for this FLIP [1], and the voting thread can be found at [2]. If you have any questions, please don't hesitate to join this discussion. [1] https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=240883951 [2]

[VOTE] FLIP-292: Enhance COMPILED PLAN to support operator-level state TTL configuration

2023-04-10 Thread Jane Chan
Hi developers, Thanks for all the feedback on FLIP-292: Enhance COMPILED PLAN to support operator-level state TTL configuration [1]. Based on the discussion [2], we have come to a consensus, so I would like to start a vote. The vote will last for at least 72 hours (Apr. 13th at 10:00 A.M. GMT)

Re: [DISCUSS] FLIP-278: Hybrid Source Connector

2023-04-10 Thread Ran Tao
Hi, devs. I want to reopen this discussion because some questions have been solved or need more discussions. In the previous discussion, there were some questions and problems. @Timo 1.about option prefix, we decide to use identifiers. e.g. ``` create table hybrid_source( f0 varchar, f1