[jira] [Created] (FLINK-25802) OverWindow in batch mode failed

2022-01-24 Thread Zoyo Pei (Jira)
Zoyo Pei created FLINK-25802: Summary: OverWindow in batch mode failed Key: FLINK-25802 URL: https://issues.apache.org/jira/browse/FLINK-25802 Project: Flink Issue Type: Bug Affects

[jira] [Created] (FLINK-25801) add cpu processor metric of taskmanager

2022-01-24 Thread Jira
王俊博 created FLINK-25801: --- Summary: add cpu processor metric of taskmanager Key: FLINK-25801 URL: https://issues.apache.org/jira/browse/FLINK-25801 Project: Flink Issue Type: Improvement

[DISCUSS] FLIP-212: Introduce Flink Kubernetes Operator

2022-01-24 Thread Thomas Weise
Hi, As promised in [1] we would like to start the discussion on the addition of a Kubernetes operator to the Flink project as FLIP-212: https://cwiki.apache.org/confluence/display/FLINK/FLIP-212%3A+Introduce+Flink+Kubernetes+Operator Please note that the FLIP is currently focussed on the overall

[jira] [Created] (FLINK-25800) Update wrong links in the datastream/execution_mode.md page.

2022-01-24 Thread RocMarshal (Jira)
RocMarshal created FLINK-25800: -- Summary: Update wrong links in the datastream/execution_mode.md page. Key: FLINK-25800 URL: https://issues.apache.org/jira/browse/FLINK-25800 Project: Flink

[jira] [Created] (FLINK-25799) Translate table/filesystem.md page into Chinese.

2022-01-24 Thread RocMarshal (Jira)
RocMarshal created FLINK-25799: -- Summary: Translate table/filesystem.md page into Chinese. Key: FLINK-25799 URL: https://issues.apache.org/jira/browse/FLINK-25799 Project: Flink Issue Type:

[jira] [Created] (FLINK-25798) Translate datastream/formats/text_files.md page into Chinese.

2022-01-24 Thread RocMarshal (Jira)
RocMarshal created FLINK-25798: -- Summary: Translate datastream/formats/text_files.md page into Chinese. Key: FLINK-25798 URL: https://issues.apache.org/jira/browse/FLINK-25798 Project: Flink

[jira] [Created] (FLINK-25797) Translate datastream/formats/parquet.md page into Chinese.

2022-01-24 Thread RocMarshal (Jira)
RocMarshal created FLINK-25797: -- Summary: Translate datastream/formats/parquet.md page into Chinese. Key: FLINK-25797 URL: https://issues.apache.org/jira/browse/FLINK-25797 Project: Flink Issue

[jira] [Created] (FLINK-25796) Avoid record copy for result partition of sort-shuffle if there are enough buffers for better performance

2022-01-24 Thread Yingjie Cao (Jira)
Yingjie Cao created FLINK-25796: --- Summary: Avoid record copy for result partition of sort-shuffle if there are enough buffers for better performance Key: FLINK-25796 URL:

[RESULT][VOTE] FLIP-204: Introduce Hash Lookup Join

2022-01-24 Thread Jing Zhang
Hi community, The voting time for FLIP-204: Introduce Hash Lookup Join[1][2][3] has passed. I'm closing the vote now. FLIP-204 has been accepted. There were 7 approving, 4 of which are binding: - Jark Wu (binding) - Jingsong Li (binding) - Wenlong (non-binding) - Yuan (non-binding) - Godfrey

Re:Re: Re: [VOTE] FLIP-204: Introduce Hash Lookup Join

2022-01-24 Thread zhangmang1
+1

Re: Re: [VOTE] FLIP-204: Introduce Hash Lookup Join

2022-01-24 Thread Jing Zhang
+1 (binding)

[jira] [Created] (FLINK-25795) Support Pulsar sink connector in Python DataStream API.

2022-01-24 Thread Ada Wong (Jira)
Ada Wong created FLINK-25795: Summary: Support Pulsar sink connector in Python DataStream API. Key: FLINK-25795 URL: https://issues.apache.org/jira/browse/FLINK-25795 Project: Flink Issue Type:

[jira] [Created] (FLINK-25794) Memory pages in LazyMemorySegmentPool should be clear after they are released to MemoryManager

2022-01-24 Thread Shammon (Jira)
Shammon created FLINK-25794: --- Summary: Memory pages in LazyMemorySegmentPool should be clear after they are released to MemoryManager Key: FLINK-25794 URL: https://issues.apache.org/jira/browse/FLINK-25794

Re: [DISCUSS] Stateful Functions 3.2.0 release?

2022-01-24 Thread Tzu-Li (Gordon) Tai
+1 On Mon, Jan 24, 2022 at 9:43 AM Igal Shilman wrote: > +1 and thanks for volunteering to be the release manager! > > Cheers, > Igal. > > On Mon, Jan 24, 2022 at 4:13 PM Seth Wiesman wrote: > > > +1 > > > > These are already a useful set of features to release to our users. > > > > Seth > > >

[jira] [Created] (FLINK-25793) Kinesis Data Streams sink is not limiting throughput to the destination and therefore exceeding rate limits

2022-01-24 Thread Zichen Liu (Jira)
Zichen Liu created FLINK-25793: -- Summary: Kinesis Data Streams sink is not limiting throughput to the destination and therefore exceeding rate limits Key: FLINK-25793 URL:

[jira] [Created] (FLINK-25792) Async Sink Base is too being flushed too frequently resulting in backpressure even when buffer is near empty

2022-01-24 Thread Zichen Liu (Jira)
Zichen Liu created FLINK-25792: -- Summary: Async Sink Base is too being flushed too frequently resulting in backpressure even when buffer is near empty Key: FLINK-25792 URL:

Re: [DISCUSS] Stateful Functions 3.2.0 release?

2022-01-24 Thread Igal Shilman
+1 and thanks for volunteering to be the release manager! Cheers, Igal. On Mon, Jan 24, 2022 at 4:13 PM Seth Wiesman wrote: > +1 > > These are already a useful set of features to release to our users. > > Seth > > On Mon, Jan 24, 2022 at 8:45 AM Till Rohrmann > wrote: > > > Hi everyone, > > >

[jira] [Created] (FLINK-25791) Make ObjectIdentifier json representation simpler

2022-01-24 Thread Francesco Guardiani (Jira)
Francesco Guardiani created FLINK-25791: --- Summary: Make ObjectIdentifier json representation simpler Key: FLINK-25791 URL: https://issues.apache.org/jira/browse/FLINK-25791 Project: Flink

[jira] [Created] (FLINK-25790) Support authentication via core-site.xml in GCS FileSystem plugin

2022-01-24 Thread Galen Warren (Jira)
Galen Warren created FLINK-25790: Summary: Support authentication via core-site.xml in GCS FileSystem plugin Key: FLINK-25790 URL: https://issues.apache.org/jira/browse/FLINK-25790 Project: Flink

Re: [DISCUSS] Host StatefulFunction JavaScript SDK on npm

2022-01-24 Thread Till Rohrmann
Reading the description of the ticket again, I think the comment might also simply relate to the fact that the ASF does not have its own npm account. So there is no official npm release channel. Note that this is not what we would need here. Cheers, Till On Mon, Jan 24, 2022 at 4:37 PM Chesnay

Re: [DISCUSS] Host StatefulFunction JavaScript SDK on npm

2022-01-24 Thread Chesnay Schepler
I looked at the 2018/2020 versions of the page and also couldn't find anything that relates to the comment. That's why this is so weird to me; it seems to be based on some knowledge that isn't written down explicitly. There aren't any limitations/requirements for (secondary) distribution

Re: [DISCUSS] Host StatefulFunction JavaScript SDK on npm

2022-01-24 Thread Till Rohrmann
Looking at the linked official release documentation, I think this comment is no longer valid. Moreover, I cannot find an explanation why some projects are allowed to publish on npm and others not. Cheers, Till On Mon, Jan 24, 2022 at 4:14 PM Chesnay Schepler wrote: > What is your explanation

Re: [DISCUSS] Host StatefulFunction JavaScript SDK on npm

2022-01-24 Thread Chesnay Schepler
What is your explanation for the comment in the ticket then? On 24/01/2022 16:07, Till Rohrmann wrote: I am not sure whether this is really a problem. There are other Apache projects that publish their artifacts on npm already [1, 2]. Also on the official release page [3] there it is written:

Re: [DISCUSS] Stateful Functions 3.2.0 release?

2022-01-24 Thread Seth Wiesman
+1 These are already a useful set of features to release to our users. Seth On Mon, Jan 24, 2022 at 8:45 AM Till Rohrmann wrote: > Hi everyone, > > We would like to kick off a new StateFun release 3.2.0. The new release > will include the new JavaScript SDK and some useful major features: > >

Re: [DISCUSS] Host StatefulFunction JavaScript SDK on npm

2022-01-24 Thread Till Rohrmann
I am not sure whether this is really a problem. There are other Apache projects that publish their artifacts on npm already [1, 2]. Also on the official release page [3] there it is written: > After uploading to the canonical distribution channel, the project (or anyone else) MAY redistribute

Re: [DISCUSS] Host StatefulFunction JavaScript SDK on npm

2022-01-24 Thread Igal Shilman
+1 for publishing to npm in addition to an official source release, would be very beneficial. Looking at other Apache projects that produce js artifacts[1] , it seems like they also publish to npm. [1] https://github.com/orgs/apache/repositories?q==all=javascript= Cheers, Igal. On Mon, Jan 24,

[jira] [Created] (FLINK-25789) Translate the formats/hadoop page into Chinese.

2022-01-24 Thread RocMarshal (Jira)
RocMarshal created FLINK-25789: -- Summary: Translate the formats/hadoop page into Chinese. Key: FLINK-25789 URL: https://issues.apache.org/jira/browse/FLINK-25789 Project: Flink Issue Type:

Re: Re: [VOTE] FLIP-204: Introduce Hash Lookup Join

2022-01-24 Thread godfrey he
+1 (binding) Thanks Jing! Best, Godfrey zst...@163.com 于2022年1月24日周一 20:03写道: > > +1 non-binging! > Thanks Jing for driving this! > Best, > Yuan > > > > > At 2022-01-24 15:32:18, "wenlong.lwl" wrote: > >+1 non-binding! > > > >Thanks for driving this, Jing! > > > >Best, > >Wenlong > > > >On

Re: [DISCUSS] Host StatefulFunction JavaScript SDK on npm

2022-01-24 Thread Chesnay Schepler
I'm concerned about a comment in https://issues.apache.org/jira/browse/INFRA-19733 stating that npm is not an approved release channel. I don't really know what to make of it and neither the current nor past versions of the linked legal page shed some light on it. As such it would be a good

Re: [DISCUSS] FLIP-211: Kerberos delegation token framework

2022-01-24 Thread David Morávek
> > Do we need to introduce a new RPC method or can we for example piggyback > on heartbeats? > Seems we can use the very same approach as _ResourceManagerPartitionTracker_ is using: - _TaskManagers_ periodically report which token they're using (eg. identified by some id). This involves adding a

[DISCUSS] Stateful Functions 3.2.0 release?

2022-01-24 Thread Till Rohrmann
Hi everyone, We would like to kick off a new StateFun release 3.2.0. The new release will include the new JavaScript SDK and some useful major features: * JavaScript SDK [1] * Flink version upgrade to 1.14.3 [2] * Support different remote functions module names [3] * Allow creating custom

Re: [DISCUSS] Host StatefulFunction JavaScript SDK on npm

2022-01-24 Thread Ingo Bürk
Hi Till, speaking as someone who regularly works with JavaScript/TypeScript, definitely a +1 from me to providing this on the npm registry to make it an easy installation for developers. Best Ingo On 24.01.22 15:37, Till Rohrmann wrote: Hi everyone, I would like to start a discussion

[jira] [Created] (FLINK-25788) Add show connectors command

2022-01-24 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-25788: --- Summary: Add show connectors command Key: FLINK-25788 URL: https://issues.apache.org/jira/browse/FLINK-25788 Project: Flink Issue Type: Bug

[DISCUSS] Host StatefulFunction JavaScript SDK on npm

2022-01-24 Thread Till Rohrmann
Hi everyone, I would like to start a discussion about hosting StatefulFunction's JavaScript SDK [1] on npm. With the upcoming Statefun 3.2.0 release, the JavaScript SDK will be officially supported. In order for users to easily use this SDK, it would be very convenient if we make this dependency

Re: [DISCUSS] Releasing Flink 1.13.6

2022-01-24 Thread Till Rohrmann
+1 for the 1.13.6 release and thanks for volunteering Konstantin. Cheers, Till On Mon, Jan 24, 2022 at 2:57 PM Konstantin Knauf wrote: > Thanks for starting the discussion and +1 to releasing. > > I am happy to manage the release aka learn how to do this. > > Cheers, > > Konstantin > > On Mon,

[RESULT][VOTE] Moving connectors from Flink to external connector repositories

2022-01-24 Thread Martijn Visser
Hi everyone, The voting time for "Moving connectors from Flink to external connector repositories" [1] has passed. I've closed the vote. There were 5 approving, 4 of which are binding: - Timo Walther (binding) - Till Rohrmann (binding) - Thomas Weise (binding) - Jingsong Li (binding) -

[RESULT][VOTE] Creating external connector repositories

2022-01-24 Thread Martijn Visser
Hi everyone, The voting time for "Creating external connector repositories" [1] has passed. I've closed the vote. There were 10 approving, 7 of which are binding: - Timo Walther (binding) - Till Rohrmann (binding) - Thomas Weise (binding) - Heng Du (non-binding) - Qingsheng Ren (non-binding) -

Re: [VOTE] Moving connectors from Flink to external connector repositories

2022-01-24 Thread Martijn Visser
Hi everyone, Thanks a lot for your votes. I am closing the vote now and will post the result in a separate email thread. Best regards, Martijn On Thu, 20 Jan 2022 at 04:15, Qingsheng Ren wrote: > +1 (non-binding) > > Thanks Martijn for driving this! > > Best, > > Qingsheng Ren > > > On Jan

Re: [VOTE] Creating external connector repositories

2022-01-24 Thread Martijn Visser
Hi everyone, Thanks a lot for your votes. I am closing the vote now and will post the result in a separate email thread. Best regards, Martijn On Thu, 20 Jan 2022 at 09:43, Zhu Zhu wrote: > +1 > > Thanks, > Zhu > > Jing Ge 于2022年1月20日周四 16:26写道: > > > +1 (non-binding) > > > > Thanks for

Re: [DISCUSS] FLIP-211: Kerberos delegation token framework

2022-01-24 Thread David Morávek
> > Could you point to a code where you think it could be added exactly? A > helping hand is welcome here  > I think you can take a look at _ResourceManagerPartitionTracker_ [1] which seems to have somewhat similar properties to the DTM. One topic that needs to be addressed there is how the RPC

[jira] [Created] (FLINK-25787) Adding endpoint support in Pubsub Source / Sink

2022-01-24 Thread Md Mehrab Alam (Jira)
Md Mehrab Alam created FLINK-25787: -- Summary: Adding endpoint support in Pubsub Source / Sink Key: FLINK-25787 URL: https://issues.apache.org/jira/browse/FLINK-25787 Project: Flink Issue

Re: [DISCUSS] Releasing Flink 1.13.6

2022-01-24 Thread Konstantin Knauf
Thanks for starting the discussion and +1 to releasing. I am happy to manage the release aka learn how to do this. Cheers, Konstantin On Mon, Jan 24, 2022 at 2:52 PM Martijn Visser wrote: > I would like to start a discussion on releasing Flink 1.13.6. Flink 1.13.5 > was the latest release on

[DISCUSS] Releasing Flink 1.13.6

2022-01-24 Thread Martijn Visser
I would like to start a discussion on releasing Flink 1.13.6. Flink 1.13.5 was the latest release on the 16th of December, which was the emergency release for the Log4j CVE [1]. Flink 1.13.4 was cancelled, leaving Flink 1.13.3 as the last real bugfix release. This one was released on the 19th of

[jira] [Created] (FLINK-25786) Adjust the generation of subpartition data storage order for sort-shuffle from random shuffle to random shift

2022-01-24 Thread Yingjie Cao (Jira)
Yingjie Cao created FLINK-25786: --- Summary: Adjust the generation of subpartition data storage order for sort-shuffle from random shuffle to random shift Key: FLINK-25786 URL:

[jira] [Created] (FLINK-25785) Update com.h2database:h2 to 2.0.206

2022-01-24 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-25785: -- Summary: Update com.h2database:h2 to 2.0.206 Key: FLINK-25785 URL: https://issues.apache.org/jira/browse/FLINK-25785 Project: Flink Issue Type:

[jira] [Created] (FLINK-25784) SerializedThrowable(De)Serializer out of sync

2022-01-24 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-25784: Summary: SerializedThrowable(De)Serializer out of sync Key: FLINK-25784 URL: https://issues.apache.org/jira/browse/FLINK-25784 Project: Flink Issue

[jira] [Created] (FLINK-25783) Translate azure_table_storage.md page into Chinese.

2022-01-24 Thread RocMarshal (Jira)
RocMarshal created FLINK-25783: -- Summary: Translate azure_table_storage.md page into Chinese. Key: FLINK-25783 URL: https://issues.apache.org/jira/browse/FLINK-25783 Project: Flink Issue Type:

[jira] [Created] (FLINK-25782) Translate datastream filesystem.md page into Chinese.

2022-01-24 Thread RocMarshal (Jira)
RocMarshal created FLINK-25782: -- Summary: Translate datastream filesystem.md page into Chinese. Key: FLINK-25782 URL: https://issues.apache.org/jira/browse/FLINK-25782 Project: Flink Issue

Re:Re: [VOTE] FLIP-204: Introduce Hash Lookup Join

2022-01-24 Thread zst...@163.com
+1 non-binging! Thanks Jing for driving this! Best, Yuan At 2022-01-24 15:32:18, "wenlong.lwl" wrote: >+1 non-binding! > >Thanks for driving this, Jing! > >Best, >Wenlong > >On Mon, 24 Jan 2022 at 16:02, Jingsong Li wrote: > >> +1 (binding) >> >> Thanks Jing! >> >> Best, >> Jingsong >> >> On

[jira] [Created] (FLINK-25781) Adjust the maximum number of buffers can be used per result partition for shuffle data read

2022-01-24 Thread Yingjie Cao (Jira)
Yingjie Cao created FLINK-25781: --- Summary: Adjust the maximum number of buffers can be used per result partition for shuffle data read Key: FLINK-25781 URL: https://issues.apache.org/jira/browse/FLINK-25781

Re: [DISCUSS] FLIP-211: Kerberos delegation token framework

2022-01-24 Thread Gabor Somogyi
> There is a separate JobMaster for each job within a Flink cluster and each JobMaster only has a partial view of the task managers Good point! I've had a deeper look and you're right. We definitely need to find another place. > Related per-cluster or per-job keytab: In the current code

Re: [DISCUSS] Future of Per-Job Mode

2022-01-24 Thread Matthias Pohl
Hi all, I agree with Xintong's comment: Reducing the number of deployment modes would help users. There is a clearer distinction between session mode and the two other deployment modes (i.e. application and job mode). The difference between application and job mode is not that easy to grasp for

[jira] [Created] (FLINK-25780) Reduce the maximum number of data output buffers for sort-shuffle

2022-01-24 Thread Yingjie Cao (Jira)
Yingjie Cao created FLINK-25780: --- Summary: Reduce the maximum number of data output buffers for sort-shuffle Key: FLINK-25780 URL: https://issues.apache.org/jira/browse/FLINK-25780 Project: Flink

[jira] [Created] (FLINK-25779) Define ConfigOption for properties map in Kinesis

2022-01-24 Thread Francesco Guardiani (Jira)
Francesco Guardiani created FLINK-25779: --- Summary: Define ConfigOption for properties map in Kinesis Key: FLINK-25779 URL: https://issues.apache.org/jira/browse/FLINK-25779 Project: Flink

[jira] [Created] (FLINK-25778) Define ConfigOption for properties map in Kafka

2022-01-24 Thread Francesco Guardiani (Jira)
Francesco Guardiani created FLINK-25778: --- Summary: Define ConfigOption for properties map in Kafka Key: FLINK-25778 URL: https://issues.apache.org/jira/browse/FLINK-25778 Project: Flink

[jira] [Created] (FLINK-25777) Generate documentation for Table factories (formats and connectors)

2022-01-24 Thread Francesco Guardiani (Jira)
Francesco Guardiani created FLINK-25777: --- Summary: Generate documentation for Table factories (formats and connectors) Key: FLINK-25777 URL: https://issues.apache.org/jira/browse/FLINK-25777

Re: [VOTE] FLIP-203: Incremental savepoints

2022-01-24 Thread Konstantin Knauf
Thanks, Piotr. Proposal looks good. +1 (binding) On Mon, Jan 24, 2022 at 11:20 AM David Morávek wrote: > +1 (non-binding) > > Best, > D. > > On Mon, Jan 24, 2022 at 10:54 AM Dawid Wysakowicz > wrote: > > > +1 (binding) > > > > Best, > > > > Dawid > > > > On 24/01/2022 09:56, Piotr Nowojski

[jira] [Created] (FLINK-25776) Sync netty bugfix version across the project

2022-01-24 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-25776: Summary: Sync netty bugfix version across the project Key: FLINK-25776 URL: https://issues.apache.org/jira/browse/FLINK-25776 Project: Flink Issue

[jira] [Created] (FLINK-25775) Document JavaScript SDK

2022-01-24 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-25775: - Summary: Document JavaScript SDK Key: FLINK-25775 URL: https://issues.apache.org/jira/browse/FLINK-25775 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-25774) Restrict the maximum number of buffers can be used per result partition for blocking shuffle

2022-01-24 Thread Yingjie Cao (Jira)
Yingjie Cao created FLINK-25774: --- Summary: Restrict the maximum number of buffers can be used per result partition for blocking shuffle Key: FLINK-25774 URL: https://issues.apache.org/jira/browse/FLINK-25774

Re: [VOTE] FLIP-203: Incremental savepoints

2022-01-24 Thread David Morávek
+1 (non-binding) Best, D. On Mon, Jan 24, 2022 at 10:54 AM Dawid Wysakowicz wrote: > +1 (binding) > > Best, > > Dawid > > On 24/01/2022 09:56, Piotr Nowojski wrote: > > Hi, > > > > As there seems to be no further questions about the FLIP-203 [1] I would > > propose to start a voting thread for

Re: [ANNOUNCE] flink-shaded 15.0 released

2022-01-24 Thread David Morávek
That's a great news Chesnay, thanks for driving this! This should unblock some ongoing Flink efforts +1 Best, D. On Mon, Jan 24, 2022 at 10:58 AM Chesnay Schepler wrote: > Hello everyone, > > we got a new flink-shaded release, with several nifty things: > > * updated version for ASM,

Re: [DISCUSS] FLIP-213: TaskManager's Flame Graphs

2022-01-24 Thread David Morávek
Hi Jacky, The link seems to be broken, here is the correct one [1]. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-213%3A+TaskManager%27s+Flame+Graphs Best, D. On Mon, Jan 24, 2022 at 9:48 AM Jacky Lau <281293...@qq.com.invalid> wrote: > Hi All, > I would like to start the

Re: [VOTE] FLIP-211: Kerberos delegation token framework

2022-01-24 Thread David Morávek
Hi Gabor, Thanks for driving this. This is headed in a right direction, but I feel that the FLIP still might need bit more work. -1 (non-binding) until the discussion thread is resolved [1]. [1] https://lists.apache.org/thread/cvwknd5fhohj0wfv8mfwn70jwpjvxrjj Best, D. On Mon, Jan 24, 2022

[jira] [Created] (FLINK-25773) Upgrade to flink-shaded 15.0

2022-01-24 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-25773: Summary: Upgrade to flink-shaded 15.0 Key: FLINK-25773 URL: https://issues.apache.org/jira/browse/FLINK-25773 Project: Flink Issue Type: Technical

Re: [DISCUSS] FLIP-211: Kerberos delegation token framework

2022-01-24 Thread David Morávek
Hi Gabor, There is actually a huge difference between JobManager (process) and JobMaster (job coordinator). The naming is unfortunately bit misleading here from historical reasons. There is a separate JobMaster for each job within a Flink cluster and each JobMaster only has a partial view of the

[ANNOUNCE] flink-shaded 15.0 released

2022-01-24 Thread Chesnay Schepler
Hello everyone, we got a new flink-shaded release, with several nifty things: * updated version for ASM, required for Java 17 * jackson extensions for optionals/datetime, which will be used by the Table API (and maybe REST API) * a relocated version of swagger, finally unblocking the

Re: [VOTE] FLIP-203: Incremental savepoints

2022-01-24 Thread Dawid Wysakowicz
+1 (binding) Best, Dawid On 24/01/2022 09:56, Piotr Nowojski wrote: Hi, As there seems to be no further questions about the FLIP-203 [1] I would propose to start a voting thread for it. For me there are still two unanswered questions, whether we want to support schema evolution and State

Re: Developing multiple Flink Pieplines

2022-01-24 Thread Caizhi Weng
Hi! If I should deploy these pipelines in one repository (one application where > I run the multiple services) or deploy each one individually? This depends on your use case. Running multiple jobs in one deployment is the session mode [1] which shares the job manager and task managers across all

Re: [VOTE] FLIP-211: Kerberos delegation token framework

2022-01-24 Thread Gyula Fóra
Hi Gabor, +1 (binding) from me This is a great effort and significant improvement to the Kerberos security story . Cheers Gyula On Fri, 21 Jan 2022 at 15:58, Gabor Somogyi wrote: > Hi devs, > > I would like to start the vote for FLIP-211 [1], which was discussed and > reached a consensus in

Re: [VOTE] FLIP-203: Incremental savepoints

2022-01-24 Thread Till Rohrmann
+1 (binding) Cheers, Till On Mon, Jan 24, 2022 at 9:57 AM Piotr Nowojski wrote: > Hi, > > As there seems to be no further questions about the FLIP-203 [1] I would > propose to start a voting thread for it. > > For me there are still two unanswered questions, whether we want to support > schema

Re: [VOTE] FLIP-211: Kerberos delegation token framework

2022-01-24 Thread Till Rohrmann
Hi Junfan, For FLIP votes, the votes of committers and PMC members are binding. All other votes are non-binding. More details for Flink's voting process can be found here [1]. [1] https://cwiki.apache.org/confluence/display/FLINK/Flink+Bylaws#FlinkBylaws-Voting Cheers, Till On Fri, Jan 21,

Re: [DISCUSS] Future of Per-Job Mode

2022-01-24 Thread Xintong Song
Sorry for joining the discussion late. I'm leaning towards deprecating the per-job mode soonish, and eventually dropping it in the long-term. - One less deployment mode makes it easier for users (especially newcomers) to understand. Deprecating the per-job mode sends the signal that it is legacy,

[VOTE] FLIP-203: Incremental savepoints

2022-01-24 Thread Piotr Nowojski
Hi, As there seems to be no further questions about the FLIP-203 [1] I would propose to start a voting thread for it. For me there are still two unanswered questions, whether we want to support schema evolution and State Processor API with native format snapshots or not. But I would propose to

[DISCUSS] FLIP-213: TaskManager's Flame Graphs

2022-01-24 Thread Jacky Lau
Hi All, I would like to start the discussion on FLIP-213

[jira] [Created] (FLINK-25772) GCS filessystem fails license checker

2022-01-24 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-25772: - Summary: GCS filessystem fails license checker Key: FLINK-25772 URL: https://issues.apache.org/jira/browse/FLINK-25772 Project: Flink Issue Type: Bug

Re: [VOTE] FLIP-204: Introduce Hash Lookup Join

2022-01-24 Thread wenlong.lwl
+1 non-binding! Thanks for driving this, Jing! Best, Wenlong On Mon, 24 Jan 2022 at 16:02, Jingsong Li wrote: > +1 (binding) > > Thanks Jing! > > Best, > Jingsong > > On Mon, Jan 24, 2022 at 3:48 PM Jark Wu wrote: > > > > +1 (binding) > > > > Thanks Jing for driving this! > > > > Best, > >

[jira] [Created] (FLINK-25771) CassandraConnectorITCase.testRetrialAndDropTables fails on AZP

2022-01-24 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-25771: - Summary: CassandraConnectorITCase.testRetrialAndDropTables fails on AZP Key: FLINK-25771 URL: https://issues.apache.org/jira/browse/FLINK-25771 Project: Flink

Re: [VOTE] FLIP-204: Introduce Hash Lookup Join

2022-01-24 Thread Jingsong Li
+1 (binding) Thanks Jing! Best, Jingsong On Mon, Jan 24, 2022 at 3:48 PM Jark Wu wrote: > > +1 (binding) > > Thanks Jing for driving this! > > Best, > Jark > > On Thu, 20 Jan 2022 at 10:22, Jing Zhang wrote: > > > Hi community, > > > > I'd like to start a vote on FLIP-204: Introduce Hash