Re: [DISCUSS] FLIP-293: Introduce Flink Jdbc Driver For Sql Gateway

2023-03-01 Thread Benchao Li
+1 for the FLIP, thanks Shammon for driving this. JDBC is quite useful in OLAP scenarios, supporting JDBC would enable Flink to be used with existing tools, such as Tableau. Regarding the JDBC interfaces listed in the FLIP, I think they looks good already. Besides `java.sql.Driver`, have you

[DISCUSS] Why does the Doc say "Flink requires at least Java 11 to build"?

2023-03-01 Thread Zhongpu Chen
I reported the same question at StackOverflow [1]. As I tested in my computer, Java 8 is enough to build Flink from source. [1] https://stackoverflow.com/questions/75601233/ -- Zhongpu Chen

[jira] [Created] (FLINK-31283) Correct the description of building from source with scala version

2023-03-01 Thread Yun Tang (Jira)
Yun Tang created FLINK-31283: Summary: Correct the description of building from source with scala version Key: FLINK-31283 URL: https://issues.apache.org/jira/browse/FLINK-31283 Project: Flink

Re: [DISCUSS] FLIP-296: Watermark options for table API & SQL

2023-03-01 Thread Jark Wu
Sorry, I forgot to remind you that Timo's concern about the changes to the CompiledPlan looks like is still not covered in the FLIP. Best, Jark On Wed, 1 Mar 2023 at 19:28, Jark Wu wrote: > Hi Kui, > > Thank you for the great proposal, I think this is already in a good shape. > > Just a kind

[DISCUSS] Whether the snapshot of all OperatorCoordinator should be executed at the beginning of the checkpoint

2023-03-01 Thread Ming Li
Hi, devs, At present, at the beginning of checkpoint, all OperatorCoordinator will first perform snapshot in JM, and operator will then perform snapshot according to the order of receiving checkpoint barrier. In this case, does the data stored in OperatorCoordinator really correspond to the

[jira] [Created] (FLINK-31281) PythonFunctionRunner doesn't extend AutoCloseable but implements close

2023-03-01 Thread Ran Tao (Jira)
Ran Tao created FLINK-31281: --- Summary: PythonFunctionRunner doesn't extend AutoCloseable but implements close Key: FLINK-31281 URL: https://issues.apache.org/jira/browse/FLINK-31281 Project: Flink

[jira] [Created] (FLINK-31282) Create and Close the zookeeper connection frequently

2023-03-01 Thread shenyue (Jira)
shenyue created FLINK-31282: --- Summary: Create and Close the zookeeper connection frequently Key: FLINK-31282 URL: https://issues.apache.org/jira/browse/FLINK-31282 Project: Flink Issue Type: Bug

RE: [DISCUSS] Why does the Doc say "Flink requires at least Java 11 to build"?

2023-03-01 Thread Zhongpu Chen
Joachim Sauer[1] gave a good answer to my question. [1] https://stackoverflow.com/a/75604355/3741571 On 2023/03/01 13:21:33 Zhongpu Chen wrote: > I reported the same question at StackOverflow [1]. As I tested in my > computer, Java 8 is enough to build Flink from source. > > [1]

Re: [DISCUSS] FLIP-296: Watermark options for table API & SQL

2023-03-01 Thread Jark Wu
Hi Kui, Thank you for the great proposal, I think this is already in a good shape. Just a kind reminder, according to the community guidelines[1], if there are unresponsive reviewers, a typical reasonable time to wait for responses is one week, but be pragmatic about it. Regarding the FLIP, I

Re: [DISCUSS] FLIP-296: Watermark options for table API & SQL

2023-03-01 Thread Timo Walther
Reg. 2: > event gap emit strategy [...] no matter in DataStream or SQL Jark raised a very good point. I thought we only expose what is contained in DataStream API already. If this strategy is not part of DataStream API, would like to exclude it from the FLIP. We need to be careful which

[jira] [Created] (FLINK-31284) Increase KerberosLoginProvider test coverage

2023-03-01 Thread Gabor Somogyi (Jira)
Gabor Somogyi created FLINK-31284: - Summary: Increase KerberosLoginProvider test coverage Key: FLINK-31284 URL: https://issues.apache.org/jira/browse/FLINK-31284 Project: Flink Issue Type:

Re: Contributing a Google Cloud Pub/Sub Lite source and sink?

2023-03-01 Thread Danny Cranmer
Hey Daniel, I have granted you access. Please try again. Thanks, Danny On Wed, Mar 1, 2023 at 6:48 PM Daniel Collins wrote: > Hello, > > It appears that I still do not have the ability to create Confluence pages? > Could someone possibly grant me access? > > -Daniel > > On Tue, Feb 28, 2023 at

Re: [VOTE] Flink minor version support policy for old releases

2023-03-01 Thread Thomas Weise
+1 (binding) Thanks, Thomas On Tue, Feb 28, 2023 at 6:53 AM Sergey Nuyanzin wrote: > +1 (non-binding) > > Thanks for driving this Danny. > > On Tue, Feb 28, 2023 at 9:41 AM Samrat Deb wrote: > > > +1 (non binding) > > > > Thanks for driving it > > > > Bests, > > Samrat > > > > On Tue, 28 Feb

Re: Contributing a Google Cloud Pub/Sub Lite source and sink?

2023-03-01 Thread Daniel Collins
Hello, It appears that I still do not have the ability to create Confluence pages? Could someone possibly grant me access? -Daniel On Tue, Feb 28, 2023 at 10:20 AM Daniel Collins wrote: > Thanks! My Jira username is `dpcollins-google`. > > -Daniel > > On Tue, Feb 28, 2023 at 10:19 AM Martijn

Re: [VOTE] Flink minor version support policy for old releases

2023-03-01 Thread Gyula Fóra
+1 (binding) Gyula On Wed, Mar 1, 2023 at 9:57 PM Thomas Weise wrote: > +1 (binding) > > Thanks, > Thomas > > On Tue, Feb 28, 2023 at 6:53 AM Sergey Nuyanzin > wrote: > > > +1 (non-binding) > > > > Thanks for driving this Danny. > > > > On Tue, Feb 28, 2023 at 9:41 AM Samrat Deb > wrote: > >

[DISCUSS] FLIP-299 Pub/Sub Lite Connector

2023-03-01 Thread Daniel Collins
Hello all, I'd like to start an official discuss thread for adding a Pub/Sub Lite Connector to Flink. We've had requests from our users to add flink support, and are willing to maintain and support this connector long term from the product team. The proposal is

Re: Contributing a Google Cloud Pub/Sub Lite source and sink?

2023-03-01 Thread Daniel Collins
Thanks Danny! I've written a FLIP doc and will send out a new email thread. On Wed, Mar 1, 2023 at 2:43 PM Danny Cranmer wrote: > Hey Daniel, I have granted you access. Please try again. > > Thanks, > Danny > > On Wed, Mar 1, 2023 at 6:48 PM Daniel Collins > > wrote: > > > Hello, > > > > It

[jira] [Created] (FLINK-31292) User HadoopUtils to get Configuration in CatalogContext

2023-03-01 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-31292: Summary: User HadoopUtils to get Configuration in CatalogContext Key: FLINK-31292 URL: https://issues.apache.org/jira/browse/FLINK-31292 Project: Flink

[jira] [Created] (FLINK-31293) Request memory segment from LocalBufferPool may hanging forever.

2023-03-01 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-31293: -- Summary: Request memory segment from LocalBufferPool may hanging forever. Key: FLINK-31293 URL: https://issues.apache.org/jira/browse/FLINK-31293 Project: Flink

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-03-01 Thread Weihua Hu
Hi, everyone, Thanks for your suggestions and ideas. Thanks Xintong for sharing the detailed backgrounds of SlotManager. *@Matthias 1. Did you do a proper test coverage analysis? Just as Xintong said, we already have a CI stage for fine grained resource managers. And I will make sure

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-03-01 Thread John Roesler
Thanks for the test plan, Weihua! Yes, it addresses my concerns. Thanks, John On Wed, Mar 1, 2023, at 22:38, Weihua Hu wrote: > Hi, everyone, > Thanks for your suggestions and ideas. > Thanks Xintong for sharing the detailed backgrounds of SlotManager. > > *@Matthias > > 1. Did you do a proper

[jira] [Created] (FLINK-31295) When kerbero authentication is enabled, hadoop_ Proxy cannot take effect.

2023-03-01 Thread HunterXHunter (Jira)
HunterXHunter created FLINK-31295: - Summary: When kerbero authentication is enabled, hadoop_ Proxy cannot take effect. Key: FLINK-31295 URL: https://issues.apache.org/jira/browse/FLINK-31295 Project:

[jira] [Created] (FLINK-31291) Document table.exec.sink.upsert-materialize to none

2023-03-01 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-31291: Summary: Document table.exec.sink.upsert-materialize to none Key: FLINK-31291 URL: https://issues.apache.org/jira/browse/FLINK-31291 Project: Flink Issue

[jira] [Created] (FLINK-31286) Python processes are still alive when shutting down a session cluster directly without stopping the jobs

2023-03-01 Thread Dian Fu (Jira)
Dian Fu created FLINK-31286: --- Summary: Python processes are still alive when shutting down a session cluster directly without stopping the jobs Key: FLINK-31286 URL: https://issues.apache.org/jira/browse/FLINK-31286

[jira] [Created] (FLINK-31287) Default value of 'changelog-producer.compaction-interval' can be zero

2023-03-01 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-31287: Summary: Default value of 'changelog-producer.compaction-interval' can be zero Key: FLINK-31287 URL: https://issues.apache.org/jira/browse/FLINK-31287 Project: Flink

[jira] [Created] (FLINK-31288) Disable overdraft buffer for batch shuffle

2023-03-01 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-31288: -- Summary: Disable overdraft buffer for batch shuffle Key: FLINK-31288 URL: https://issues.apache.org/jira/browse/FLINK-31288 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-31289) Default aggregate-function for field can be last_non_null_value

2023-03-01 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-31289: Summary: Default aggregate-function for field can be last_non_null_value Key: FLINK-31289 URL: https://issues.apache.org/jira/browse/FLINK-31289 Project: Flink

[jira] [Created] (FLINK-31290) Remove features in documentation

2023-03-01 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-31290: Summary: Remove features in documentation Key: FLINK-31290 URL: https://issues.apache.org/jira/browse/FLINK-31290 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-31294) CommitterOperator forgot to close Committer when closing.

2023-03-01 Thread ming li (Jira)
ming li created FLINK-31294: --- Summary: CommitterOperator forgot to close Committer when closing. Key: FLINK-31294 URL: https://issues.apache.org/jira/browse/FLINK-31294 Project: Flink Issue Type:

Re: [VOTE] Flink minor version support policy for old releases

2023-03-01 Thread Yu Li
+1 (binding) Best Regards, Yu On Thu, 2 Mar 2023 at 09:53, Jark Wu wrote: > +1 (binding) > > Best, > Jark > > > 2023年3月2日 05:03,Gyula Fóra 写道: > > > > +1 (binding) > > > > Gyula > > > > On Wed, Mar 1, 2023 at 9:57 PM Thomas Weise wrote: > > > >> +1 (binding) > >> > >> Thanks, > >> Thomas >

[jira] [Created] (FLINK-31296) Add JoinConditionEqualityTransferRule to stream optimizer

2023-03-01 Thread Aitozi (Jira)
Aitozi created FLINK-31296: -- Summary: Add JoinConditionEqualityTransferRule to stream optimizer Key: FLINK-31296 URL: https://issues.apache.org/jira/browse/FLINK-31296 Project: Flink Issue Type:

[jira] [Created] (FLINK-31285) FileSource should support reading files in order

2023-03-01 Thread Yaroslav Tkachenko (Jira)
Yaroslav Tkachenko created FLINK-31285: -- Summary: FileSource should support reading files in order Key: FLINK-31285 URL: https://issues.apache.org/jira/browse/FLINK-31285 Project: Flink

Re: [VOTE] Flink minor version support policy for old releases

2023-03-01 Thread Jark Wu
+1 (binding) Best, Jark > 2023年3月2日 05:03,Gyula Fóra 写道: > > +1 (binding) > > Gyula > > On Wed, Mar 1, 2023 at 9:57 PM Thomas Weise wrote: > >> +1 (binding) >> >> Thanks, >> Thomas >> >> On Tue, Feb 28, 2023 at 6:53 AM Sergey Nuyanzin >> wrote: >> >>> +1 (non-binding) >>> >>> Thanks

[jira] [Created] (FLINK-31276) VectorIndexerTest#testFitAndPredictWithHandleInvalid fails

2023-03-01 Thread Zhipeng Zhang (Jira)
Zhipeng Zhang created FLINK-31276: - Summary: VectorIndexerTest#testFitAndPredictWithHandleInvalid fails Key: FLINK-31276 URL: https://issues.apache.org/jira/browse/FLINK-31276 Project: Flink

[jira] [Created] (FLINK-31277) JM Deployment recovery logic inconsistent with health related restart

2023-03-01 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-31277: -- Summary: JM Deployment recovery logic inconsistent with health related restart Key: FLINK-31277 URL: https://issues.apache.org/jira/browse/FLINK-31277 Project: Flink

[jira] [Created] (FLINK-31278) exit code 137 (i.e. OutOfMemoryError) in core module

2023-03-01 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-31278: - Summary: exit code 137 (i.e. OutOfMemoryError) in core module Key: FLINK-31278 URL: https://issues.apache.org/jira/browse/FLINK-31278 Project: Flink Issue

Re: [VOTE] FLIP-291: Externalized Declarative Resource Management

2023-03-01 Thread Roman Khachatryan
+1 (binding) Thanks David, and everyone involved :) Regards, Roman On Wed, Mar 1, 2023 at 8:01 AM Gyula Fóra wrote: > +1 (binding) > > Looking forward to this :) > > Gyula > > On Wed, 1 Mar 2023 at 04:02, feng xiangyu wrote: > > > +1 (non-binding) > > > > ConradJam 于2023年3月1日周三 10:37写道: >

Re: [DISCUSS] FLIP-296: Watermark options for table API & SQL

2023-03-01 Thread Kui Yuan
Hi all, Thanks for all discussions! Anyone else have questions or suggestions? if not, I will start a vote thread later. Best Kui Yuan kui yuan 于2023年2月27日周一 20:21写道: > Hi Timo, > > Thanks for your advice. I totally agree with your suggestion of naming > convention, I will rename these

[DISCUSS] FLIP-293: Introduce Flink Jdbc Driver For Sql Gateway

2023-03-01 Thread Shammon FY
Hi devs, I'd like to start a discussion about FLIP-293: Introduce Flink Jdbc Driver For Sql Gateway[1]. FLIP-275[2] supports remote sql client based on gateway, users can interact with gateway by flink console. However, for users who create session clusters with Flink, they'd like to use Jdbc

[jira] [Created] (FLINK-31279) fix times using number and interval type bug

2023-03-01 Thread jackylau (Jira)
jackylau created FLINK-31279: Summary: fix times using number and interval type bug Key: FLINK-31279 URL: https://issues.apache.org/jira/browse/FLINK-31279 Project: Flink Issue Type: Bug

Re: [VOTE] FLIP-291: Externalized Declarative Resource Management

2023-03-01 Thread Shammon FY
+1 (non-binding) Best, Shammon On Wed, Mar 1, 2023 at 4:51 PM Roman Khachatryan wrote: > +1 (binding) > > Thanks David, and everyone involved :) > > Regards, > Roman > > > On Wed, Mar 1, 2023 at 8:01 AM Gyula Fóra wrote: > > > +1 (binding) > > > > Looking forward to this :) > > > > Gyula > >

[jira] [Created] (FLINK-31280) Make core surefire plugin configuration stricter

2023-03-01 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-31280: - Summary: Make core surefire plugin configuration stricter Key: FLINK-31280 URL: https://issues.apache.org/jira/browse/FLINK-31280 Project: Flink Issue

Re: [DISCUSS] FLIP-297: Improve Auxiliary Sql Statements

2023-03-01 Thread Ran Tao
Hi, Timo. thanks. I have copied the content of docs and updated the FLIP. Thanks for your advice about consistency(ILIKE). Because calcite already support parse ILIKE and exist SqlLibraryOperators.ILIKE(which means it's not std). It's will not difficult to support it, and we just need to support

Re: [DISCUSS] FLIP-293: Introduce Flink Jdbc Driver For Sql Gateway

2023-03-01 Thread Jingsong Li
Thanks Shammon for driving. Big +1 for this. I heard that many users want to use FlinkGateway + JDBC to do some queries, but at present, only Hive JDBC can be used. It is Hive dialect by default, and the experience is also different from FlinkSQL. We need to have our own JDBC. I took a look at