RE: Re: [DISCUSS] Future of Per-Job Mode

2022-01-28 Thread Ferenc Csaky
and dependencies via > "yarn.ship-files" config option. The only > limitation is that we could not ship and load the user dependencies with > user classloader, not the parent classloader. > FLINK-24897 is trying to fix this via supporting "usrlib" directory > automatically

RE: Re: Looking for Maintainers for Flink on YARN

2022-01-28 Thread Ferenc Csaky
Hi Konstantin, We at Cloudera will also help out with this. AFAIK there was a conversation about this in the past anyways. I will talk this through with the team next week and allocate resource accordingly. Regards, F On 2022/01/26 09:17:03 Konstantin Knauf wrote: > Hi everyone, > > We are

RE: [DISCUSS] Future of Per-Job Mode

2022-01-25 Thread Ferenc Csaky
Hi Konstantin, First of all, sorry for the delay. We at Cloudera are currently relying on per-job mode deploying Flink applications over YARN. Specifically, we allow users to upload connector jars and other artifacts. There are also some default jars that we need to ship. These are all stored

Re: [VOTE] Release flink-connector-hbase v3.0.0, release candidate 2

2023-09-05 Thread Ferenc Csaky
Hi, Thanks Martijn for initiating the release! +1 (non-binding) - checked signatures and checksums - checked source has no binaries - checked LICENSE and NOTICE files - approved web PR Cheers, Ferenc --- Original Message --- On Monday, September 4th, 2023 at 12:54, Samrat Deb

Re: Future of classical remoting in Pekko

2023-09-12 Thread Ferenc Csaky
Hi Matthew, Thanks for bringing this up! Cca half a year ago I started to work on an Akka Artery migration, there is a draft PR for that [1]. It might be an option to revive that work and point it against Pekko instead. Although I would highlight FLINK-29281 [2] which will replace the whole

Re: Future of classical remoting in Pekko

2023-09-13 Thread Ferenc Csaky
/1.18+Release --- Original Message --- On Tuesday, September 12th, 2023 at 17:43, He Pin wrote: > > > Hi Ferenc: > What's the ETA of the Flink 1.18? I think we should beable to collaborate on > this,and at work we are using Flink too. > > On 2023/09/12 15:16:

Re: [VOTE] FLIP-334: Decoupling autoscaler and kubernetes and support the Standalone Autoscaler

2023-09-13 Thread Ferenc Csaky
Looking forward to this! +1 (non-binding) Cheers, Ferenc --- Original Message --- On Wednesday, September 13th, 2023 at 12:33, Maximilian Michels wrote: > > > +1 (binding) > > On Wed, Sep 13, 2023 at 12:28 PM Gyula Fóra gyula.f...@gmail.com wrote: > > > +1 (binding) > > > >

Re: [RESULT][VOTE] Release flink-connector-hbase v3.0.0, release candidate #2

2023-11-02 Thread Ferenc Csaky
Hi Martijn! Is this work in progress? Thanks, Ferenc --- Original Message --- On Tuesday, September 12th, 2023 at 10:47, Martijn Visser wrote: > > > I'm happy to announce that we have unanimously approved this release. > > There are 7 approving votes, 3 of which are binding: >

Re: Future of classical remoting in Pekko

2023-09-19 Thread Ferenc Csaky
0) will > contain these > changes. > > On Wed, Sep 13, 2023 at 11:22 AM Ferenc Csaky ferenc.cs...@pm.me.invalid > > wrote: > > > The target release date for 1.18 is the end of Sept [1], but I'm not sure > > everything will come together by then. Maybe it will pushed

Re: Future of classical remoting in Pekko

2023-09-20 Thread Ferenc Csaky
--- On Wednesday, September 20th, 2023 at 14:26, Martijn Visser wrote: > > > Just chipping in that I don't think we should add Pekko changes in a > patch release, because I think the Pekko related changes don't fix a > bug. > > On Tue, Sep 19, 2023 at 9:06 PM F

Re: [ANNOUNCE] Release 1.18.0, release candidate #1

2023-10-03 Thread Ferenc Csaky
Thanks everyone for the efforts! Checked the following: - Downloaded artifacts - Built Flink from source - Verified checksums/signatures - Verified NOTICE, LICENSE files - Deployed dummy SELECT job via SQL gateway on standalone cluster, things seemed fine according to the log files +1

Re: [DISCUSS] Updating Flink HBase Connectors

2022-10-24 Thread Ferenc Csaky
Hi, just pinging this thread in case someone missed it and has any opinion about the discussed actions. Best, F --- Original Message --- On Tuesday, October 11th, 2022 at 23:29, Ferenc Csaky wrote: > > > Hi Martijn, > > Thank you for your comment. About HBa

Re: [VOTE] Externalized connector release details​

2022-10-12 Thread Ferenc Csaky
+1 from my side (non-binding) Best, F --- Original Message --- On Wednesday, October 12th, 2022 at 15:47, Martijn Visser wrote: > > > +1 (binding), I am indeed assuming that Chesnay meant the last two minor > versions as supported. > > Op wo 12 okt. 2022 om 20:18 schreef Danny

Re: [DISCUSS] Updating Flink HBase Connectors

2022-10-11 Thread Ferenc Csaky
> Best regards, > > Martijn > > Op ma 10 okt. 2022 om 16:24 schreef Ferenc Csaky > > Hi everyone, > > > > Now that the connector externalization effort ig going on, I think it is > > definitely work to revisit the currently supported HBase version

[DISCUSS] Updating Flink HBase Connectors

2022-10-10 Thread Ferenc Csaky
Hi everyone, Now that the connector externalization effort ig going on, I think it is definitely work to revisit the currently supported HBase versions for the Flink connector. Currently, ther is an HBase 1.4 and HBase 2.2 connector versions, although both of those versions are kind of

Re: [VOTE] Release flink-connector-hbase v3.0.0, release candidate #1

2022-12-08 Thread Ferenc Csaky
ger bundling hbase-client (it now only > bundles Flink classes). > > On 05/12/2022 13:24, Ferenc Csaky wrote: > > > Hi Martijn, > > > > +1 (non-binding) > > > > - Verified hashes/signatures > > - Maven repo content LGTM > > - No binaries in

Re: [VOTE] Release flink-connector-hbase v3.0.0, release candidate #1

2022-12-05 Thread Ferenc Csaky
Hi Martijn, +1 (non-binding) - Verified hashes/signatures - Maven repo content LGTM - No binaries in the source archive - Built source/tests pass - Tag exists in GH - Reviewed web PR Thanks, F --- Original Message --- On Friday, December 2nd, 2022 at 14:04, Martijn Visser wrote: >

Re: [ANNOUNCE] New Apache Flink Committer - Matyas Orhidi

2022-11-21 Thread Ferenc Csaky
Congrats Matyas! Best, F --- Original Message --- On Monday, November 21st, 2022 at 15:17, Márton Balassi wrote: > > > Hi everyone, > > On behalf of the PMC, I'm very happy to announce Matyas Orhidi as a new > Flink > committer. > > Matyas has over a decade of experience of the

Re: [DISCUSS] Updating Flink HBase Connectors

2022-11-21 Thread Ferenc Csaky
ijnvis...@apache.org > > wrote: > > > Hi Ferenc, > > > > I think you're good to go, since no comments were there. Do let us know if > > you need any help :) > > > > Thanks, > > > > Martijn > > > > On Mon, Oct 24, 2022 at 7:47 PM

Re: [VOTE] FLIP-271: Autoscaling

2022-11-29 Thread Ferenc Csaky
+1 (non-binding) --- Original Message --- On Tuesday, November 29th, 2022 at 15:39, Márton Balassi wrote: > > > +1 (binding) > > On Tue, Nov 29, 2022 at 6:13 AM Chenya Zhang chenyazhangche...@gmail.com > > wrote: > > > +1 (non-binding) > > > > On Sun, Nov 27, 2022 at 5:49 PM

Re: [DISCUSS] Retroactively externalize some connectors for 1.16

2022-12-01 Thread Ferenc Csaky
Hi! I think this would be a good idea. I was wondering that could we include the hbase connector to this group as well? The externalization PR [1] should be in a good shape now and Dec 9th as a release date sounds doable. WDYT? [1] https://github.com/apache/flink-connector-hbase/pull/2 Best,

Re: [DISCUSS] assign SQL Table properties from environment variables

2022-12-01 Thread Ferenc Csaky
Hello devs, I'd like to revive this discussion. There is also a ticket about this effort for some time [1] and this thing also affects us as well. Right now we have a custom solution that is similar to "environment variables", but it only can be used in parts of our downstream product. The

Re: [VOTE] FLIP-272: Generalized delegation token support

2022-11-21 Thread Ferenc Csaky
+1 (non-binding) Best, F --- Original Message --- On Friday, November 18th, 2022 at 16:11, Márton Balassi wrote: > > > +1 (binding) > > On Thu, Nov 17, 2022 at 9:06 AM Gabor Somogyi gabor.g.somo...@gmail.com > > wrote: > > > Hi All, > > > > I'm hereby opening a vote for

Re: [VOTE] Release flink-connector-hbase v3.0.0, release candidate #1

2023-01-24 Thread Ferenc Csaky
--- On Friday, December 9th, 2022 at 08:13, Martijn Visser wrote: > > > Thanks all for the check. This RC is cancelled and I'll create a new one > when the fixes are done. > > On Thu, Dec 8, 2022 at 1:22 PM Ferenc Csaky ferenc.cs...@pm.me.invalid > > wrote: >

Re: [ANNOUNCE] Flink 1.18 feature freeze

2023-08-07 Thread Ferenc Csaky
Hi, I would like to ask if releasing the external HBase connector and remove those modules from the core Flink repo before Flink 1.18 sounds feasible at this point or not? The connector source is ready for quite a while, I externalized the E2E tests a couple weeks before and CI is passing so

[DISCUSS] Persistent SQL Gateway

2023-06-22 Thread Ferenc Csaky
Hello devs, I would like to open a discussion about persistence possibilitis for the SQL Gateway. At Cloudera, we are happy to see the work already done on this project and looking for ways to utilize it on our platform as well, but currently it lacks some features that would be essential in

Re: [DISCUSS] Persistent SQL Gateway

2023-06-29 Thread Ferenc Csaky
d by SQL gateway. > > I don't know if it covers your usage scenario. Could you describe yours for > us to test and confirm? > > Best, > Shammon FY > > > On Tue, Jun 27, 2023 at 6:43 PM Ferenc Csaky ferenc.cs...@pm.me.invalid > > wrote: > > >

Re: [DISCUSS] Persistent SQL Gateway

2023-06-26 Thread Ferenc Csaky
this is something you are looking for? > > Best, > Jark > > > [1]: https://flink.apache.org/roadmap/#a-unified-sql-platform > [2]: > https://cwiki.apache.org/confluence/display/FLINK/FLIP-295%3A+Support+lazy+initialization+of+catalogs+and+persistence+of+catalog+configurations >

Re: [DISCUSS] Persistent SQL Gateway

2023-06-27 Thread Ferenc Csaky
oesn't tie to the SQL Gateway session. > Even if the session is closed, all the running jobs are not affected. > > Best, > Jark > > > > > On Tue, 27 Jun 2023 at 04:14, Ferenc Csaky ferenc.cs...@pm.me.invalid > > wrote: > > > Hi Jark, > > > > Th

[DISCUSS] Support the Ozone Filesystem

2024-02-08 Thread Ferenc Csaky
Hello devs, I would like to start a discussion regarding Apache Ozone FS support. The jira [1] is stale for quite a while, but supporting it with some limitations could be done with minimal effort. Ozone do not have truncate() impl, so it falls to the same category as Hadoop < 2.7 [2], on

Re: [VOTE] Release flink-connector-hbase v3.0.1, release candidate #2

2024-02-06 Thread Ferenc Csaky
+1 (non-binding) - Validated checksum - Verified signature - Verified no binaries in src archive - Built with Maven 3.8.6 + JDK11 - Verified web PR BR, Ferenc On Saturday, January 13th, 2024 at 04:59, Hang Ruan wrote: > > > +1 (non-binding) > > - Validated checksum hash > - Verified

Re: [DISCUSS] Drop support for HBase v1

2024-01-30 Thread Ferenc Csaky
Hi Martijn, thanks for starting the discussion. Let me link the older discussion regarding the same topic [1]. My opinion did not change, so +1. BR, Ferenc [1] https://lists.apache.org/thread/x7l2gj8g93r4v6x6953cyt6jrs8c4r1b On Monday, January 29th, 2024 at 09:37, Martijn Visser wrote:

Re: [DISCUSS] FLIP-316: Introduce SQL Driver

2023-11-20 Thread Ferenc Csaky
Hello devs, Is any active work happening on this FLIP? As far as I see there are blockers that needs to happen first to implement regarding artifact distribution. Is this work in halt completetly or some efforts are going into resolve the blockers first or something? Our platform would benefit

Re: [VOTE] FLIP-393: Make QueryOperations SQL serializable

2023-11-21 Thread Ferenc Csaky
+1 (non-binding) Lookgin forward to this! Best, Ferenc On Tuesday, November 21st, 2023 at 12:21, Martijn Visser wrote: > > > +1 (binding) > > Thanks for driving this. > > Best regards, > > Martijn > > On Tue, Nov 21, 2023 at 12:18 PM Benchao Li libenc...@apache.org wrote: > > > +1

Re: [DISCUSS] Connector releases for Flink 1.19

2024-04-17 Thread Ferenc Csaky
Thank you Danny and Sergey for pushing this! I can help with the HBase connector if necessary, will comment the details to the relevant Jira ticket. Best, Ferenc On Wednesday, April 17th, 2024 at 11:17, Danny Cranmer wrote: > > > Hello all, > > I have created a parent Jira to cover the

Re: [VOTE] FLIP-435: Introduce a New Materialized Table for Simplifying Data Pipelines

2024-04-17 Thread Ferenc Csaky
+1 (non-binding) Best, Ferenc On Wednesday, April 17th, 2024 at 10:26, Ahmed Hamdy wrote: > > > + 1 (non-binding) > > Best Regards > Ahmed Hamdy > > > On Wed, 17 Apr 2024 at 08:28, Yuepeng Pan panyuep...@apache.org wrote: > > > +1(non-binding). > > > > Best, > > Yuepeng Pan > > > >

Re: [DISCUSS] FLIP-446: Kubernetes Operator State Snapshot CRD

2024-04-16 Thread Ferenc Csaky
Thank you Mate for initiating this discussion. +1 for this idea. Some Qs: Can you specify the newly introduced configurations in more details? Currently, it is not fully clear to me what are the possible values of `kubernetes.operator.periodic.savepoint.mode`, is it optional, has a default value?

Re: [ANNOUNCE] New Apache Flink Committer - Zakelly Lan

2024-04-16 Thread Ferenc Csaky
Congratulations! Best, Ferenc On Tuesday, April 16th, 2024 at 16:28, Jeyhun Karimov wrote: > > > Congratulations Zakelly! > > Regards, > Jeyhun > > On Tue, Apr 16, 2024 at 6:35 AM Feifan Wang zoltar9...@163.com wrote: > > > Congratulations, Zakelly!—— > > > > Best

Re: [DISCUSS] FLIP-438: Make Flink's Hadoop and YARN configuration probing consistent

2024-04-18 Thread Ferenc Csaky
nd only if you really pay > close attention to the docs it is evident. I understand your point on added > complexity till Flink-3.0 but if we agree it should be made consistent, it > has to be done at some point of time right? > > Regards > Venkata krishnan > > > On Wed, Ap

Re: [ANNOUNCE] New Apache Flink PMC Member - Jing Ge

2024-04-12 Thread Ferenc Csaky
Congratulations, Jing! Best, Ferenc On Friday, April 12th, 2024 at 13:54, Ron liu wrote: > > > Congratulations, Jing! > > Best, > Ron > > Junrui Lee jrlee@gmail.com 于2024年4月12日周五 18:54写道: > > > Congratulations, Jing! > > > > Best, > > Junrui > > > > Aleksandr Pilipenko

Re: [ANNOUNCE] New Apache Flink PMC Member - Lincoln Lee

2024-04-12 Thread Ferenc Csaky
Congratulations, Lincoln! Best, Ferenc On Friday, April 12th, 2024 at 15:54, lorenzo.affe...@ververica.com.INVALID wrote: > > > Huge congrats! Well done! > On Apr 12, 2024 at 13:56 +0200, Ron liu ron9@gmail.com, wrote: > > > Congratulations, Lincoln! > > > > Best, > > Ron > > > >

Re: [VOTE] FLIP-446: Kubernetes Operator State Snapshot CRD

2024-04-24 Thread Ferenc Csaky
+1 (non-binding), looking forward to this! Best, Ferenc On Wednesday, April 24th, 2024 at 10:03, Mate Czagany wrote: > > > Hi everyone, > > I'd like to start a vote on the FLIP-446: Kubernetes Operator State > Snapshot CRD [1]. The discussion thread is here [2]. > > The vote will be

Re: [DISCUSS] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-03 Thread Ferenc Csaky
Hi Martijn, +1 for the proposal. > targeted for Flink 1.19 I guess you meant Flink 1.20 here. Also, I volunteer to take updating the HBase sink, feel free to assign that task to me. Best, Ferenc On Friday, May 3rd, 2024 at 10:20, Martijn Visser wrote: > > > Hi Peter, > > I'll add

Re: [VOTE] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-14 Thread Ferenc Csaky
+1 (non-binding) Thanks, Ferenc On Tuesday, 14 May 2024 at 08:51, weijie guo wrote: > > > Thanks Martijn for the effort! > > +1(binding) > > Best regards, > > Weijie > > > Martijn Visser martijnvis...@apache.org 于2024年5月14日周二 14:45写道: > > > Hi everyone, > > > > With no more

[DISCUSS] Merge "flink run" and "flink run-application" in Flink 2.0

2024-05-16 Thread Ferenc Csaky
/KubernetesDeploymentTarget.java [3] https://github.com/apache/flink/blob/48e5a39c9558083afa7589d2d8b054b625f61ee9/flink-kubernetes/src/main/java/org/apache/flink/kubernetes/KubernetesClusterDescriptor.java#L206 [4] https://github.com/ferenc-csaky/flink/commit/40b3e1b998c7a4273eaaff71d9162c9f1ee039c0

[DISCUSS] FLIP Suggestion: Externalize Kudu Connector from Bahir

2024-03-06 Thread Ferenc Csaky
Hello devs, Opening this thread to discuss a FLIP [1] about externalizing the Kudu connector, as recently the Apache Bahir project were moved to the attic [2]. Some details were discussed already in another thread [3]. I am proposing to externalize this connector and keep it maintainable, and

Re: [DISCUSS] Apache Bahir retired

2024-03-06 Thread Ferenc Csaky
IP process created by Martijn[1]. > > [1] https://issues.apache.org/jira/browse/FLINK-34515 > > Best regards, > Jing > > On Fri, Mar 1, 2024 at 5:25 PM Ferenc Csaky ferenc.cs...@pm.me.invalid > > wrote: > > > Hi, > > > > According to the curren

Re: [DISCUSS] FLIP Suggestion: Externalize Kudu Connector from Bahir

2024-03-08 Thread Ferenc Csaky
n is different > > with flink ? > > > > (2) About the connector config options, could you enumerate these options > > so that we can review they’re reasonable or not? > > > > (3) Metrics is also key part of connector, could you add the supported > > con

Re: [DISCUSS] FLIP Suggestion: Externalize Kudu Connector from Bahir

2024-03-19 Thread Ferenc Csaky
Hi, since there are no more comments for a while, if there are no more comments for another day, I will start a vote thread. Thanks, Ferenc On Thursday, March 14th, 2024 at 11:20, Ferenc Csaky wrote: > > > Hi, > > Gentle ping to see if there are any other concerns or th

Re: [DISCUSS] FLIP-436: Introduce "SHOW CREATE CATALOG" Syntax

2024-03-14 Thread Ferenc Csaky
Hi Yubin, Thank you for initiating this discussion! +1 for the proposal. I also think it makes sense to group the missing catalog related SQL syntaxes under this FLIP. Looking forward to these features! Best, Ferenc On Thursday, March 14th, 2024 at 08:31, Jane Chan wrote: > > > Hi

Re: [DISCUSS] FLIP Suggestion: Externalize Kudu Connector from Bahir

2024-03-14 Thread Ferenc Csaky
Hi, Gentle ping to see if there are any other concerns or things that seems missing from the FLIP. Best, Ferenc On Monday, March 11th, 2024 at 11:11, Ferenc Csaky wrote: > > > Hi Jing, > > Thank you for your comments! Updated the FLIP with reasoning on the proposed >

Re: [VOTE] Release 1.19.0, release candidate #2

2024-03-14 Thread Ferenc Csaky
+1 (non-binding) - Verified checksum and signature - Verified no binary in src - Built from src - Reviewed release note PR - Reviewed web PR - Tested a simple datagen query and insert to blackhole sink via SQL Gateway Best, Ferenc On Thursday, March 14th, 2024 at 12:14, Jane Chan wrote: >

[VOTE] FLIP-439: Externalize Kudu Connector from Bahir

2024-03-20 Thread Ferenc Csaky
Hello devs, I would like to start a vote about FLIP-439 [1]. The FLIP is about to externalize the Kudu connector from the recently retired Apache Bahir project [2] to keep it maintainable and make it up to date as well. Discussion thread [3]. The vote will be open for at least 72 hours (until

Re: [VOTE] FLIP-402: Extend ZooKeeper Curator configurations

2024-03-20 Thread Ferenc Csaky
+1 (non-binding), thanks for driving this! Best, Ferenc On Wednesday, March 20th, 2024 at 10:57, Yang Wang wrote: > > > +1 (binding) since ZK HA is still widely used. > > > Best, > Yang > > On Thu, Mar 14, 2024 at 6:27 PM Matthias Pohl > matthias.p...@aiven.io.invalid wrote: > > >

Re: [VOTE] FLIP-436: Introduce Catalog-related Syntax

2024-03-19 Thread Ferenc Csaky
+1 (non-binding). Best, Ferenc On Tuesday, March 19th, 2024 at 12:39, Jark Wu wrote: > > > +1 (binding) > > Best, > Jark > > On Tue, 19 Mar 2024 at 19:05, Yuepeng Pan panyuep...@apache.org wrote: > > > Hi, Yubin > > > > Thanks for driving it ! > > > > +1 non-binding. > > > > Best, >

Re: [DISCUSS] FLIP Suggestion: Externalize Kudu Connector from Bahir

2024-03-11 Thread Ferenc Csaky
:46 PM Yanquan Lv decq12y...@gmail.com wrote: > > > Hi Ferenc, +1 for this FLIP. > > > > Ferenc Csaky ferenc.cs...@pm.me.invalid 于2024年3月9日周六 01:49写道: > > > > > Thank you Jeyhun, Leonard, and Hang for your comments! Let me > > > address them from earliest to latest.

Re: [DISCUSS] FLIP-399: Flink Connector Doris

2024-03-11 Thread Ferenc Csaky
Hi, Thanks for driving this, +1 for the FLIP. Best, Ferenc On Monday, March 11th, 2024 at 15:17, Ahmed Hamdy wrote: > > > Hello, > Thanks for the proposal, +1 for the FLIP. > > Best Regards > Ahmed Hamdy > > > On Mon, 11 Mar 2024 at 15:12, wudi 676366...@qq.com.invalid wrote: > > >

[RESULT][VOTE] FLIP-439: Externalize Kudu Connector from Bahir

2024-03-25 Thread Ferenc Csaky
Hi everyone, I'm happy to announce that FLIP-439: Externalize Kudu Connector from Bahir [1] has been accepted with 12 approving votes, 6 of which are binding: [2]: - Mate Czagany (non-binding) - Gyula Fóra (binding) - Gabor Somogyi (binding) - Mátyás Őrhidi (binding) - Hang Ruan (non-binding) -

Re: [DISCUSS] Flink Website Menu Adjustment

2024-03-25 Thread Ferenc Csaky
Suggested changes makes sense, +1 for the proposed menus and order. Best, Ferenc On Monday, March 25th, 2024 at 14:50, Gyula Fóra wrote: > > > +1 for the proposal > > Gyula > > On Mon, Mar 25, 2024 at 12:49 PM Leonard Xu xbjt...@gmail.com wrote: > > > Thanks Zhongqiang for starting

Re: [DISCUSS] FLIP-XXX: Introduce Flink SQL variables

2024-03-28 Thread Ferenc Csaky
ps managed by a config setting? > > > > Cheers, > > > > Jim > > > > On Tue, Mar 26, 2024 at 6:59 AM Ferenc Csaky ferenc.cs...@pm.me.invalid > > wrote: > > > > > Hello devs, > > > > > > I would like to start a discuss

Re: [DISCUSS] FLIP-438: Make Flink's Hadoop and YARN configuration probing consistent

2024-04-03 Thread Ferenc Csaky
Hi Venkata, Thank you for opening the discussion about this! After taking a look at the YARN and Hadoop configurations, the reason why it was implemented this way is that, in case of YARN, every YARN-specific property is prefixed with "yarn.", so to get the final, YARN-side property it is enough

Re: [DISCUSS] FLIP-XXX: Introduce Flink SQL variables

2024-04-03 Thread Ferenc Csaky
en get out of their scopes? > > - Does the proposal support dynamic assignment of the variables or the > value of variables should be known at query compile time? > > - Can we somehow benefit from/leverage Calcite's parameterization feature > in this proposal? >

Re: [VOTE] FLIP-399: Flink Connector Doris

2024-04-09 Thread Ferenc Csaky
+1 (non-binding) Best, Ferenc On Tuesday, April 9th, 2024 at 10:32, Ahmed Hamdy wrote: > > > Hi Wudi, > > +1 (non-binding). > > Best Regards > Ahmed Hamdy > > > On Tue, 9 Apr 2024 at 09:21, Yuepeng Pan panyuep...@apache.org wrote: > > > Hi, Di. > > > > Thank you for driving it ! > >

[DISCUSS] FLIP-XXX: Introduce Flink SQL variables

2024-03-26 Thread Ferenc Csaky
Hello devs, I would like to start a discussion about FLIP-XXX: Introduce Flink SQL variables [1]. The main motivation behing this change is to be able to abstract Flink SQL from environment-specific configuration and provide a way to carry jobs between environments (e.g. dev-stage-prod) without

[DISCUSS] Apache Bahir retired

2024-02-22 Thread Ferenc Csaky
Hello devs, Just saw that the Bahir project is retired [1]. Any plans on what's happening with the Flink connectors that were part of this project? We specifically use the Kudu connector and integrate it to our platform at Cloudera, so we would be okay to maintain it. Would it be possible to

Re: [DISCUSS] Apache Bahir retired

2024-02-27 Thread Ferenc Csaky
] https://github.com/apache/bahir-flink/releases/tag/v1.1.0 > [3] https://github.com/apache/bahir-flink/blob/master/pom.xml#L116 > > > > > 2024年2月22日 下午6:37,Ferenc Csaky ferenc.cs...@pm.me.INVALID 写道: > > > > Hello devs, > > > > Just saw that the Ba

Re: Flink's treatment to "hadoop" and "yarn" configuration overrides seems unintuitive

2024-02-26 Thread Ferenc Csaky
th the right > behavior and get rid of this in 3.0 totally. > > Looking for more thoughts from others in the community to make sure that I > don't miss anything. Once the discussion settles, I can start a FLIP with > the new proposal. > > Thanks > Venkat > >

Re: Flink's treatment to "hadoop" and "yarn" configuration overrides seems unintuitive

2024-02-26 Thread Ferenc Csaky
Hi Venkata krishnan, Thanks for starting a discussion on this topic. I completely agree with you on that, this behavior can create confusion and cause debugging sessions that could be spared with aligning how Flink parses external properties. Personally, I find the Yarn props prefixing more

Re: [DISCUSS] Apache Bahir retired

2024-03-01 Thread Ferenc Csaky
/1vHF_uVe0FTYCb6PRVStovqDeqb_C_FKjt2P5xXa7uhE/edit On Thursday, February 29th, 2024 at 09:48, Ferenc Csaky wrote: > > > Thank you Marton and Martijn, I will proceed with the FLIP then. > > Best, > Ferenc > > > > > On Wednesday, February 28th, 2024 at 21:15, Martijn Visser > martijnvi

Re: [DISCUSS] Apache Bahir retired

2024-02-29 Thread Ferenc Csaky
[1] https://attic.apache.org/projects/bahir.html > > [2] https://lists.apache.org/thread/p31mz4x4dcvd43f026d5p05rpglzfyrt > > > > On Tue, Feb 27, 2024 at 10:09 AM Ferenc Csaky ferenc.cs...@pm.me.invalid > > wrote: > > > > > Thank you Leonard for sharing your t

Re: [DISCUSS] Support the Ozone Filesystem

2024-02-26 Thread Ferenc Csaky
Hi, gentle reminder on this thread, any opinions or thoughts? Regards, Ferenc On Thursday, February 8th, 2024 at 18:02, Ferenc Csaky wrote: > > > Hello devs, > > I would like to start a discussion regarding Apache Ozone FS support. The > jira [1] is stale

Re: [DISCUSS] Merge "flink run" and "flink run-application" in Flink 2.0

2024-05-28 Thread Ferenc Csaky
roduced, but maybe not that > important anymore, given that per-job mode is deprecated and likely removed > in 2.0. Therefore, +1 for the proposal. > > Best, > > Xintong > > > > On Thu, May 16, 2024 at 11:35 PM Ferenc Csaky ferenc.cs...@pm.me.invalid > > wrote: >

Re: [DISCUSS] Merge "flink run" and "flink run-application" in Flink 2.0

2024-06-07 Thread Ferenc Csaky
mprove the user > experience. > > Regards, > Jeyhun > > > > > > On Mon, Jun 3, 2024 at 1:50 PM Ferenc Csaky ferenc.cs...@pm.me.invalid > > wrote: > > > Hi Hang, > > > > Thank you for your inputs, both points make sense, updated the > >

Re: [DISCUSS] Merge "flink run" and "flink run-application" in Flink 2.0

2024-06-03 Thread Ferenc Csaky
l.com 于2024年5月29日周三 19:57写道: > > > Hi Ferenc, > > > > Thanks for the FLIP, +1 from me for the proposal. I think these changes > > would be a great solution to all the confusion that comes from these two > > action parameters. > > > > Best regards, > > Mate

[jira] [Created] (FLINK-33440) Bump flink version on flink-connectors-hbase

2023-11-02 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-33440: Summary: Bump flink version on flink-connectors-hbase Key: FLINK-33440 URL: https://issues.apache.org/jira/browse/FLINK-33440 Project: Flink Issue Type

[jira] [Created] (FLINK-33353) SQL fails because "TimestampType.kind" is not serialized

2023-10-24 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-33353: Summary: SQL fails because "TimestampType.kind" is not serialized Key: FLINK-33353 URL: https://issues.apache.org/jira/browse/FLINK-33353 Proj

[jira] [Created] (FLINK-27441) Scrollbar is missing for particular UI elements (Accumulators, Backpressure, Watermarks)

2022-04-28 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-27441: Summary: Scrollbar is missing for particular UI elements (Accumulators, Backpressure, Watermarks) Key: FLINK-27441 URL: https://issues.apache.org/jira/browse/FLINK-27441

[jira] [Created] (FLINK-29707) Fix possible comparator violation for "flink list"

2022-10-20 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-29707: Summary: Fix possible comparator violation for "flink list" Key: FLINK-29707 URL: https://issues.apache.org/jira/browse/FLINK-29707 Project: Flink

[jira] [Created] (FLINK-31085) Add schema option to confluent registry avro formats

2023-02-15 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-31085: Summary: Add schema option to confluent registry avro formats Key: FLINK-31085 URL: https://issues.apache.org/jira/browse/FLINK-31085 Project: Flink Issue

[jira] [Created] (FLINK-32174) Update Cloudera product and link in doc page

2023-05-24 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-32174: Summary: Update Cloudera product and link in doc page Key: FLINK-32174 URL: https://issues.apache.org/jira/browse/FLINK-32174 Project: Flink Issue Type

[jira] [Created] (FLINK-32660) Support external file systems in FileCatalogStore

2023-07-24 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-32660: Summary: Support external file systems in FileCatalogStore Key: FLINK-32660 URL: https://issues.apache.org/jira/browse/FLINK-32660 Project: Flink Issue Type

[jira] [Created] (FLINK-32811) Add port range support for taskmanager.data.bind-port

2023-08-08 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-32811: Summary: Add port range support for taskmanager.data.bind-port Key: FLINK-32811 URL: https://issues.apache.org/jira/browse/FLINK-32811 Project: Flink Issue

[jira] [Created] (FLINK-34388) Release Testing: Verify FLINK-28915 Support artifact fetching in Standalone and native K8s application mode

2024-02-06 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-34388: Summary: Release Testing: Verify FLINK-28915 Support artifact fetching in Standalone and native K8s application mode Key: FLINK-34388 URL: https://issues.apache.org/jira/browse

[jira] [Created] (FLINK-33542) Update HBase connector tests to JUnit5

2023-11-14 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-33542: Summary: Update HBase connector tests to JUnit5 Key: FLINK-33542 URL: https://issues.apache.org/jira/browse/FLINK-33542 Project: Flink Issue Type

[jira] [Created] (FLINK-35114) Remove old Table API implementations

2024-04-15 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-35114: Summary: Remove old Table API implementations Key: FLINK-35114 URL: https://issues.apache.org/jira/browse/FLINK-35114 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-34930) Move existing Kudu connector code from Bahir repo to dedicated repo

2024-03-25 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-34930: Summary: Move existing Kudu connector code from Bahir repo to dedicated repo Key: FLINK-34930 URL: https://issues.apache.org/jira/browse/FLINK-34930 Project: Flink

[jira] [Created] (FLINK-34929) Create "flink-connector-kudu" repository

2024-03-25 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-34929: Summary: Create "flink-connector-kudu" repository Key: FLINK-34929 URL: https://issues.apache.org/jira/browse/FLINK-34929 Project: Flink Issue

[jira] [Created] (FLINK-34931) Update Kudu connector DataStream Source/Sink implementation

2024-03-25 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-34931: Summary: Update Kudu connector DataStream Source/Sink implementation Key: FLINK-34931 URL: https://issues.apache.org/jira/browse/FLINK-34931 Project: Flink

[jira] [Created] (FLINK-34928) FLIP-439: Externalize Kudu Connector from Bahir

2024-03-25 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-34928: Summary: FLIP-439: Externalize Kudu Connector from Bahir Key: FLINK-34928 URL: https://issues.apache.org/jira/browse/FLINK-34928 Project: Flink Issue Type

[jira] [Created] (FLINK-34506) Do not copy "file://" schemed artifact in standalone application modes

2024-02-23 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-34506: Summary: Do not copy "file://" schemed artifact in standalone application modes Key: FLINK-34506 URL: https://issues.apache.org/jira/browse/FLINK-34506

[jira] [Created] (FLINK-34580) Job run via REST erases "pipeline.classpaths" config

2024-03-05 Thread Ferenc Csaky (Jira)
Ferenc Csaky created FLINK-34580: Summary: Job run via REST erases "pipeline.classpaths" config Key: FLINK-34580 URL: https://issues.apache.org/jira/browse/FLINK-34580 Project: Flink