Re: [VOTE] FLIP-446: Kubernetes Operator State Snapshot CRD

2024-04-25 Thread Robert Metzger
Ah, true -- now I remember. Thanks for fixing the wiki page +1 (binding) On Thu, Apr 25, 2024 at 4:40 PM Gyula Fóra wrote: > That's my fault @Robert Metzger , since the new FLIP > process and a lack of confluent access for non-committers this is a bit > tricky to get it sync :)

Re: [VOTE] FLIP-446: Kubernetes Operator State Snapshot CRD

2024-04-25 Thread Robert Metzger
In principle I'm +1 on the proposal, but I think the FLIP in the wiki is not in sync with the Google doc. For example in the Wiki FlinkStateSnapshotSpec.backoffLimit is missing. On Thu, Apr 25, 2024 at 3:27 PM Thomas Weise wrote: > +1 (binding) > > > On Wed, Apr 24, 2024 at 5:14 AM Yuepeng Pan

Re: [DISCUSS] FLIP-446: Kubernetes Operator State Snapshot CRD

2024-04-23 Thread Robert Metzger
from a > savepoint > >> in those cases, but if the user decides to move away from the deprecated > >> savepoint mechanisms, every savepoint will result in a new > >> FlinkStateSnapshot CR. So the only situation I expect this to be an > >> inconvenience is when the

Re: [DISCUSS] FLIP-446: Kubernetes Operator State Snapshot CRD

2024-04-19 Thread Robert Metzger
Hi Mate, thanks for proposing this, I'm really excited about your FLIP. I hope my questions make sense to you: 1. I would like to discuss the "FlinkStateSnapshot" name and the fact that users have to use either the savepoint or checkpoint spec inside the FlinkStateSnapshot. Wouldn't it be more

Re: [Vote] FLIP-438: Amazon SQS Sink Connector

2024-04-16 Thread Robert Metzger
+1 binding On Tue, Apr 16, 2024 at 2:05 PM Jeyhun Karimov wrote: > Thanks Priya for driving the FLIP. > > +1 (non-binding) > > Regards, > Jeyhun > > On Tue, Apr 16, 2024 at 12:37 PM Hong Liang wrote: > > > +1 (binding) > > > > Thanks Priya for driving this! This has been a requested feature

Re: [VOTE] FLIP-399: Flink Connector Doris

2024-04-09 Thread Robert Metzger
+1 (binding) On Tue, Apr 9, 2024 at 10:33 AM Ahmed Hamdy wrote: > Hi Wudi, > > +1 (non-binding). > > Best Regards > Ahmed Hamdy > > > On Tue, 9 Apr 2024 at 09:21, Yuepeng Pan wrote: > > > Hi, Di. > > > > Thank you for driving it ! > > > > +1 (non-binding). > > > > Best, > > Yuepeng Pan > > > >

Re: [External] Inquiry Regarding Azure Pipelines

2024-04-09 Thread Robert Metzger
cond commit? > > I would appreciate any clarification you can provide on this matter. Thank > you for your attention to this issue, and I look forward to your response. > > Best regards, > Yisha > > > > > 2024年4月4日 00:52,Robert Metzger 写道: > > > > Hi

Re: Inquiry Regarding Azure Pipelines

2024-04-03 Thread Robert Metzger
Hi Yisha, flinkbot is currently not active, so new PRs are not triggering any AZP builds. We hope to restore the service soon. AZP is still the source of truth for CI builds. On Wed, Apr 3, 2024 at 11:34 AM Yisha Zhou wrote: > Hi devs, > > I hope this email finds you well. I am writing to

Re: [DISCUSS] Planning Flink 1.20

2024-03-25 Thread Robert Metzger
Hi, thanks for starting the discussion. +1 for the proposed timeline and the three proposed release managers. I'm happy to join the release managers group as well, as a backup for Ufuk (unless there are objections about the number of release managers) On Mon, Mar 25, 2024 at 11:04 AM Ufuk

Re: [DISCUSS] Manual savepoint triggering in flink-kubernetes-operator

2024-03-12 Thread Robert Metzger
Have you guys considered making savepoints a first class citizen in the Kubernetes operator? E.g. to trigger a savepoint, you create a "FlinkSavepoint" CR, the K8s operator picks up that resource and tries to create a savepoint indefinitely until the savepoint has been successfully created. We

Re: [DISCUSS] FLINK-34440 Support Debezium Protobuf Confluent Format

2024-02-29 Thread Robert Metzger
. > > Another topic I had is Protobuf's field ids. Ideally in Flink it would be > nice if we are idiomatic about not renumbering them in incompatible ways, > similar to what's discussed on the Schema Registry issue here: > https://github.com/confluentinc/schema-registry/issues/255

Re: [DISCUSS] FLINK-34440 Support Debezium Protobuf Confluent Format

2024-02-27 Thread Robert Metzger
Hi all, +1 to support the format in Flink. @Kevin: Do you already have an implementation for this inhouse that you are looking to upstream, or would you start from scratch? I'm asking because my current employer, Confluent, has a Protobuf Schema registry implementation for Flink, and I could

Re: [VOTE] Accept Flink CDC into Apache Flink

2024-01-09 Thread Robert Metzger
+1 (binding) On Tue, Jan 9, 2024 at 9:54 AM Guowei Ma wrote: > +1 (binding) > Best, > Guowei > > > On Tue, Jan 9, 2024 at 4:49 PM Rui Fan <1996fan...@gmail.com> wrote: > > > +1 (non-binding) > > > > Best, > > Rui > > > > On Tue, Jan 9, 2024 at 4:41 PM Hang Ruan wrote: > > > > > +1

Re: [DISCUSS] Removal of unused e2e tests

2023-10-24 Thread Robert Metzger
I left a comment in FLINK-5. On Mon, Oct 23, 2023 at 5:18 AM Alexander Fedulov < alexander.fedu...@gmail.com> wrote: > FLINK-17375 [1] removed [2] run-pre-commit-tests.sh in Flink 1.12. Since > then the following tests are not executed anymore: > test_state_migration.sh >

[jira] [Created] (FLINK-33217) Flink SQL: UNNEST fails with on LEFT JOIN with NOT NULL type in array

2023-10-09 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-33217: -- Summary: Flink SQL: UNNEST fails with on LEFT JOIN with NOT NULL type in array Key: FLINK-33217 URL: https://issues.apache.org/jira/browse/FLINK-33217 Project

Re: [DISCUSS] FLIP 333 - Redesign Apache Flink website

2023-09-29 Thread Robert Metzger
There's now a PR (https://github.com/apache/flink-web/pull/676) and a preview available for this FLIP ( https://website-refresh.d193kg429zpv7e.amplifyapp.com/). On Fri, Jul 28, 2023 at 8:45 AM Mohan, Deepthi wrote: > Matthias, Markos, Martijn, thank you for your feedback. > > Markos, I've

Re: [VOTE] Apache Flink Stateful Functions Release 3.3.0, release candidate #2

2023-09-14 Thread Robert Metzger
I did a shallow pass over the release for it to get the +3 votes. Please verify other aspects of the release when voting ;) +1 (binding) - maven clean install on the source tgz (not on an M1 macbook because of protoc, but on x86 linux) (not on Java 17 either ;) ) - staging repo seem fine -

[jira] [Created] (FLINK-32439) Kubernetes operator is silently overwriting the "execution.savepoint.path" config

2023-06-26 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-32439: -- Summary: Kubernetes operator is silently overwriting the "execution.savepoint.path" config Key: FLINK-32439 URL: https://issues.apache.org/jira/browse/F

Re: [DISCUSS] FLIP-322 Cooldown period for adaptive scheduler

2023-06-15 Thread Robert Metzger
aling the job very frequently, > >> because TaskManagers are not all connecting at the same time. > >> > >> So, is it possible that every taskmanager connecting will produce a > >> scalling event and it'll be stacked with many scale up event which > >> cause

[jira] [Created] (FLINK-31840) NullPointerException in operators.window.slicing.SliceAssigners$AbstractSliceAssigner.assignSliceEnd

2023-04-18 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-31840: -- Summary: NullPointerException in operators.window.slicing.SliceAssigners$AbstractSliceAssigner.assignSliceEnd Key: FLINK-31840 URL: https://issues.apache.org/jira/browse

[jira] [Created] (FLINK-31834) Azure Warning: no space left on device

2023-04-18 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-31834: -- Summary: Azure Warning: no space left on device Key: FLINK-31834 URL: https://issues.apache.org/jira/browse/FLINK-31834 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-31810) RocksDBException: Bad table magic number on checkpoint rescale

2023-04-14 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-31810: -- Summary: RocksDBException: Bad table magic number on checkpoint rescale Key: FLINK-31810 URL: https://issues.apache.org/jira/browse/FLINK-31810 Project: Flink

Re: [VOTE] Release flink-connector-aws, 4.1.0 for Flink 1.17

2023-04-12 Thread Robert Metzger
+1 (binding) - tried out the kinesis sql binary with sql client - staging binaries look fine On Mon, Apr 3, 2023 at 10:12 PM Elphas Tori wrote: > +1 (non-binding) > > + verified hashes and signatures > + checked local build of website pull request and approved > > On 2023/04/03 16:19:00 Danny

Re: [VOTE] Release flink-connector-aws 4.1.0, release candidate #1

2023-03-22 Thread Robert Metzger
+1 (binding) Note, in the NOTICE files, the copyright year is still only until 2022. I don't think it's a blocker, but should be updated. + Checked the website update + checked the source archive for copied code (no licenses are listed in the root NOTICE file) + src archive contents build

Re: [VOTE] Release 1.17.0, release candidate #3

2023-03-21 Thread Robert Metzger
+1 (binding) + Started Flink locally with the changelog statebackend + rocksdb against minio + used the maven artifacts to develop a little, large-state sample job to test with the changelog statebackend + Opened this PR https://github.com/apache/flink/pull/22232 + Manually eyeballed the diff for

Re: [VOTE] Release flink-connector-dynamodb v3.0.0, release candidate #0

2022-12-02 Thread Robert Metzger
+1 (binding) - the source tgz archive contents look fine - staging repo contents are fine - verified web PR On Wed, Nov 30, 2022 at 9:26 AM Danny Cranmer wrote: > +1 (binding) > > - Validated hashes/signature > - Verified that no binaries exist in the source archive > - Build the source with

Re: [DISCUSS] Repeatable cleanup of checkpoint data

2022-11-25 Thread Robert Metzger
Yeah, at some point I've investigated performance issues with AWS K8s. They have somewhat strict rate limits on the K8s api server. You run into the rate limits by configuring a very high checkpoint frequency (I guess something like 500ms) and a high state.checkpoints.num-retained count (e.g.

[jira] [Created] (FLINK-30083) Bump maven-shade-plugin to 3.4.0

2022-11-18 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-30083: -- Summary: Bump maven-shade-plugin to 3.4.0 Key: FLINK-30083 URL: https://issues.apache.org/jira/browse/FLINK-30083 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-29779) Allow using MiniCluster with a PluginManager to use metrics reporters

2022-10-27 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-29779: -- Summary: Allow using MiniCluster with a PluginManager to use metrics reporters Key: FLINK-29779 URL: https://issues.apache.org/jira/browse/FLINK-29779 Project

Re: [DISCUSS] Issue tracking workflow

2022-10-25 Thread Robert Metzger
Thank you for starting this discussion Xintong! I would also prefer option 1. The ASF Jira is probably one of the largest, public Jira instances on the internet. Most other Jiras are internal within companies, so Atlassian is probably not putting a lot of effort into automatically detecting and

[ANNOUNCE] New Apache Flink PMC Member - Danny Cranmer

2022-10-10 Thread Robert Metzger
Hi everyone, I'm very happy and excited to announce that Danny Cranmer has joined the Flink PMC! Danny has been a committer since January 2021. He has been very active with all Amazon-related connectors and projects in Flink, such as DynamoDB, Kinesis (EFO, Firehose, ...) and the AsyncSinkBase.

[jira] [Created] (FLINK-29492) Kafka exactly-once sink causes OutOfMemoryError

2022-10-01 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-29492: -- Summary: Kafka exactly-once sink causes OutOfMemoryError Key: FLINK-29492 URL: https://issues.apache.org/jira/browse/FLINK-29492 Project: Flink Issue

[jira] [Created] (FLINK-29212) Properly load Hadoop native libraries in Flink docker iamges

2022-09-06 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-29212: -- Summary: Properly load Hadoop native libraries in Flink docker iamges Key: FLINK-29212 URL: https://issues.apache.org/jira/browse/FLINK-29212 Project: Flink

[jira] [Created] (FLINK-29122) Improve robustness of FileUtils.expandDirectory()

2022-08-26 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-29122: -- Summary: Improve robustness of FileUtils.expandDirectory() Key: FLINK-29122 URL: https://issues.apache.org/jira/browse/FLINK-29122 Project: Flink Issue

Re: [SUMMARY] Flink 1.16 release sync of 2022-08-02

2022-08-09 Thread Robert Metzger
Thanks. I had the old invite link in my calendar. I'll join next week again ;)

Re: [SUMMARY] Flink 1.16 release sync of 2022-08-02

2022-08-09 Thread Robert Metzger
Thanks for the summary. I tried joining the sync today, but nobody joined. On the Flink Slack, Martijn's status is set to vacation, so I guess the meeting didn't happen today? It seems that the pulsar blocker (FLINK-27399) is still open, but the PR seems to make progress. On Wed, Aug 3, 2022 at

Re: [VOTE] FLIP-252: Amazon DynamoDB Sink Connector

2022-07-21 Thread Robert Metzger
+1 On Wed, Jul 20, 2022 at 10:48 PM Konstantin Knauf wrote: > +1. Thanks! > > Am Mi., 20. Juli 2022 um 16:48 Uhr schrieb Tzu-Li (Gordon) Tai < > tzuli...@apache.org>: > > > +1 > > > > On Wed, Jul 20, 2022 at 6:13 AM Danny Cranmer > > wrote: > > > > > Hi there, > > > > > > After the discussion

Re: [DISCUSS] FLIP-252: Amazon DynamoDB Sink Connector

2022-07-20 Thread Robert Metzger
Thanks a lot for this nice proposal! DynamoDB seems to be a connector that Flink is still lacking, and with the Async Sink interface, it seems that we can implement this fairly easily. +1 to proceed to the formal vote for this FLIP! On Fri, Jul 15, 2022 at 7:51 PM Danny Cranmer wrote: > Hello

Re: [VOTE] FLIP-238: Introduce FLIP-27-based Data Generator Source

2022-07-19 Thread Robert Metzger
+1 On Wed, Jul 20, 2022 at 4:41 AM Rui Fan <1996fan...@gmail.com> wrote: > +1(non-binding) > > New Source can better support some features, such as > Unaligned Checkpoint, Watermark alignment, etc. > The data generator based on the new Source is very helpful > for daily testing. > > Very much

[jira] [Created] (FLINK-28303) Kafka SQL Connector loses data when restoring from a savepoint with a topic with empty partitions

2022-06-29 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-28303: -- Summary: Kafka SQL Connector loses data when restoring from a savepoint with a topic with empty partitions Key: FLINK-28303 URL: https://issues.apache.org/jira/browse/FLINK

Re: [VOTE] Release 1.15.1, release candidate #1

2022-06-28 Thread Robert Metzger
+1 (binding) - staging repo contents look fine - KEYS file ok - binaries start locally properly. WebUI accessible on Mac. On Mon, Jun 27, 2022 at 11:21 AM Qingsheng Ren wrote: > +1 (non-binding) > > - checked/verified signatures and hashes > - checked that all POM files point to the same

[jira] [Created] (FLINK-28265) Inconsistency in Kubernetes HA service: broken state handle

2022-06-27 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-28265: -- Summary: Inconsistency in Kubernetes HA service: broken state handle Key: FLINK-28265 URL: https://issues.apache.org/jira/browse/FLINK-28265 Project: Flink

[jira] [Created] (FLINK-28260) flink-runtime-web fails to execute "npm ci" on Apple Silicon (arm64) without rosetta

2022-06-27 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-28260: -- Summary: flink-runtime-web fails to execute "npm ci" on Apple Silicon (arm64) without rosetta Key: FLINK-28260 URL: https://issues.apache.org/jira/browse/F

[jira] [Created] (FLINK-28259) flink-parquet doesn't compile on M1 mac without rosetta

2022-06-27 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-28259: -- Summary: flink-parquet doesn't compile on M1 mac without rosetta Key: FLINK-28259 URL: https://issues.apache.org/jira/browse/FLINK-28259 Project: Flink

[jira] [Created] (FLINK-28232) Allow for custom pre-flight checks for SQL UDFs

2022-06-23 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-28232: -- Summary: Allow for custom pre-flight checks for SQL UDFs Key: FLINK-28232 URL: https://issues.apache.org/jira/browse/FLINK-28232 Project: Flink Issue

Re: [DISCUSS] Bi-Weekly Flink Community Sync Meeting

2022-06-02 Thread Robert Metzger
2 um 13:54 Uhr schrieb Jing Ge : > > > +1 > > Sounds good! Thanks Robert! > > > > On Tue, May 31, 2022 at 1:46 PM Márton Balassi > > > wrote: > > > > > Hi Robert, > > > > > > Thanks for the suggestion +1 from me. You already list

Re: [DISCUSS] Initializing Apache Flink Slack

2022-05-31 Thread Robert Metzger
I renamed the channel. On Tue, May 31, 2022 at 10:54 AM Xintong Song wrote: > Ok, then let's try it out. > > Best, > > Xintong > > > > On Tue, May 31, 2022 at 4:24 PM Robert Metzger > wrote: > > > +1 to merging #contribution-helps with #dev. > &

Re: [DISCUSS] Initializing Apache Flink Slack

2022-05-31 Thread Robert Metzger
I think for many Flink > developers) > > this will be one of the more interesting channels :) > > We have to see how this plays out in practice and we can make future > > decisions accordingly. > > > > Gyula > > > > > > On Tue, May 31, 2022 at

Re: [DISCUSS] Initializing Apache Flink Slack

2022-05-31 Thread Robert Metzger
; > > > Good idea, thanks! Is the channel #contribution-helps a good fit for > it? > > Or > > > should we just rename it to #development? For me, development is a > subset > > > of contribution. > > > > > > Best regards, > > > Jing &g

[DISCUSS] Bi-Weekly Flink Community Sync Meeting

2022-05-31 Thread Robert Metzger
Hi everyone, We currently have a bi-weekly release sync meeting on Google Meet every Tuesday at 9am CEST / 3pm China Standard Time / 7am UTC. I would like to propose extending the purpose of the meeting to a general "Flink Community Sync" meeting, to discuss current topics in the Flink community.

Re: [DISCUSS] Planning Flink 1.16 with the community

2022-05-31 Thread Robert Metzger
row. Looking forward to >> everyone >> who wants to participate. For those that are looking for the invite link, >> see https://cwiki.apache.org/confluence/display/FLINK/1.16+Release >> >> Best regards, >> >> Martijn >> >> Op ma 30 mei 2022 om 16:39 schreef

Re: [DISCUSS] Planning Flink 1.16 with the community

2022-05-30 Thread Robert Metzger
I assume we'll have the next release planning meeting tomorrow? I'm also bringing this up also as a reminder for other folks who might be interested in joining. On Wed, May 11, 2022 at 5:55 AM Xintong Song wrote: > I'd like to kindly remind that, if someone adds / modifies release notes of > a

Re: [DISCUSS] Initializing Apache Flink Slack

2022-05-30 Thread Robert Metzger
Thanks a lot for kicking this off. Is there a reason why we haven't set up a #development channel yet? I have a short question that is more suitable for that channel, compared to the dev@ list ;) On Mon, May 23, 2022 at 7:52 AM Xintong Song wrote: > Hi Kyle, > > I've sent an invitation to

Re: [VOTE] Creating an Apache Flink slack workspace

2022-05-17 Thread Robert Metzger
Thanks for starting the VOTE! +1 (binding) On Tue, May 17, 2022 at 10:29 AM Jark Wu wrote: > Thank Xintong for driving this work. > > +1 from my side (binding) > > Best, > Jark > > On Tue, 17 May 2022 at 16:24, Xintong Song wrote: > > > Hi everyone, > > > > As previously discussed in [1], I

Re: [Discuss] Creating an Apache Flink slack workspace

2022-05-17 Thread Robert Metzger
; > given the diversity of vendors in the Flink space, we may face similar > > > challenges. Perhaps their experience can help us with the initial > > > setup/guidelines. > > > > > > Cheers, > > > Austin > > > > > > [1]: https://ped

Re: [Discuss] Creating an Apache Flink slack workspace

2022-05-12 Thread Robert Metzger
t; >>>> customize the experience more towards Apache Flink. If we go for >> > Slack, >> > >>>> let's definitely try to archive it like Airflow did. If we do >> this, we >> > >>>> don't necessarily need infinite message retention in

Re: [Discuss] Creating an Apache Flink slack workspace

2022-05-10 Thread Robert Metzger
the invite link expires. It's not a nice solution, but it'll work. (1) https://the-asf.slack.com/archives/CBX4TSBQ8/p1652125017094159 On Mon, May 9, 2022 at 3:59 PM Robert Metzger wrote: > Thanks a lot for your answer. The onboarding experience to the ASF Slack > is indeed not ideal: &

Re: [Discuss] Creating an Apache Flink slack workspace

2022-05-09 Thread Robert Metzger
ASF instance of Slack, you can > only get there if you're a committer or if you're invited by a committer. > > On Mon, 9 May 2022 at 15:15, Robert Metzger wrote: > > > Sorry for joining this discussion late, and thanks for the summary > Xintong! > > > > Why are we c

Re: [Discuss] Creating an Apache Flink slack workspace

2022-05-09 Thread Robert Metzger
Sorry for joining this discussion late, and thanks for the summary Xintong! Why are we considering a separate slack instance instead of using the ASF Slack instance? The ASF instance is paid, so all messages are retained forever, and quite a few people are already on that Slack instance. There is

Re: Flink 1.15 Stabilisation Sync

2022-04-04 Thread Robert Metzger
Thanks a lot for the update. >From the burndown board [1] it seems that there's only one blocker left, which has already a fix in review [2]. Are we also planning to address the open Critical tickets before opening the first voting release candidate? When do you expect 1.15 to be out? [1]

[ANNOUNCE] New Apache Flink Committer - David Morávek

2022-03-04 Thread Robert Metzger
Hi everyone, On behalf of the PMC, I'm very happy to announce David Morávek as a new Flink committer. His first contributions to Flink date back to 2019. He has been increasingly active with reviews and driving major initiatives in the community. David brings valuable experience from being a

[ANNOUNCE] New Apache Flink Committer - Martijn Visser

2022-03-03 Thread Robert Metzger
Hi everyone, On behalf of the PMC, I'm very happy to announce Martijn Visser as a new Flink committer. Martijn is a very active Flink community member, driving a lot of efforts on the dev@flink mailing list. He also pushes projects such as replacing Google Analytics with Matomo, so that we can

Re: [DISCUSS] Disable "Automated Checks / Review Progress" GitHub integration

2022-02-25 Thread Robert Metzger
o remove it. > > > > > > > > On 17/02/2022 13:31, Konstantin Knauf wrote: > > > > > +1 > > > > > > > > > > On Thu, Feb 17, 2022 at 1:11 PM Robert Metzger < > rmetz...@apache.org> > > > > wrote: > >

[DISCUSS] Disable "Automated Checks / Review Progress" GitHub integration

2022-02-17 Thread Robert Metzger
Hi all, Some time ago, we added this "Automated Checks / Review Progress" [1] bot to the Flink PRs. I'm not aware of anybody using it, and I'm also not sure if it still works properly. Therefore, I propose to disable this bot. Please let me know if you disagree, otherwise, I'll soon disable it.

[ANNOUNCE] New Apache Flink Committers: Feng Wang, Zhipeng Zhang

2022-02-16 Thread Robert Metzger
Hi everyone, On behalf of the PMC, I'm very happy to announce two new Flink committers: Feng Wang and Zhipeng Zhang! Feng is one of the most active Flink evangelists in China, with plenty of public talks, blog posts and other evangelization activities. The PMC wants to recognize and value these

[ANNOUNCE] New Flink PMC members: Igal Shilman, Konstantin Knauf and Yun Gao

2022-02-16 Thread Robert Metzger
Hi all, I would like to formally announce a few new Flink PMC members on the dev@ list. The PMC has not done a good job of always announcing new PMC members (and committers) recently. I'll try to keep an eye on this in the future to improve the situation. Nevertheless, I'm very happy to announce

Re: Azure Pipelines are dealing with an incident, causing pipeline runs to fail

2022-02-09 Thread Robert Metzger
I filed a support request with Microsoft: https://developercommunity.visualstudio.com/t/Number-of-Microsoft-hosted-agents-droppe/1658827?from=email=21=newest On Wed, Feb 9, 2022 at 1:04 PM Martijn Visser wrote: > Unfortunately it looks like there are still failures. Will keep you posted > > On

[jira] [Created] (FLINK-25998) Flink akka runs into NoClassDefFoundError on shutdown

2022-02-07 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-25998: -- Summary: Flink akka runs into NoClassDefFoundError on shutdown Key: FLINK-25998 URL: https://issues.apache.org/jira/browse/FLINK-25998 Project: Flink

Re: [DISCUSS] FLIP-211: Kerberos delegation token framework

2022-01-28 Thread Robert Metzger
Hey Gabor, let me know your cwiki username, and I can give you write permissions. On Fri, Jan 28, 2022 at 4:05 PM Gabor Somogyi wrote: > Thanks for making the design better! No further thing to discuss from my > side. > > Started to reflect the agreement in the FLIP doc. > Since I don't have

Re: Flink native k8s integration vs. operator

2022-01-20 Thread Robert Metzger
Hi Alexis, The usage of Custom Resource Definitions (CRDs). The main reason given to > me was that such resources are global (for a given cluster) and that is not > desired. I know that ultimately a CR based on a CRD can be scoped to a > specific namespace, but customer is king… I don't think

[jira] [Created] (FLINK-25679) Build arm64 Linux images for Apache Flink

2022-01-17 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-25679: -- Summary: Build arm64 Linux images for Apache Flink Key: FLINK-25679 URL: https://issues.apache.org/jira/browse/FLINK-25679 Project: Flink Issue Type

[jira] [Created] (FLINK-25505) Fix NetworkBufferPoolTest, SystemResourcesCounterTest on Apple M1

2022-01-03 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-25505: -- Summary: Fix NetworkBufferPoolTest, SystemResourcesCounterTest on Apple M1 Key: FLINK-25505 URL: https://issues.apache.org/jira/browse/FLINK-25505 Project

[jira] [Created] (FLINK-25327) ApplicationMode "DELETE /cluster" REST call leads to exit code 2, instead of 0

2021-12-15 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-25327: -- Summary: ApplicationMode "DELETE /cluster" REST call leads to exit code 2, instead of 0 Key: FLINK-25327 URL: https://issues.apache.org/jira/browse/F

[jira] [Created] (FLINK-25316) BlobServer can get stuck during shutdown

2021-12-14 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-25316: -- Summary: BlobServer can get stuck during shutdown Key: FLINK-25316 URL: https://issues.apache.org/jira/browse/FLINK-25316 Project: Flink Issue Type: Bug

Re: [ANNOUNCE] Flink mailing lists archive service has migrated to Apache Archive service

2021-09-30 Thread Robert Metzger
@Matthias Pohl : I've also been annoyed by this 30 days limit, but I'm not aware of a way to globally change the default. I would ask in #asfinfra in the asf slack. On Thu, Sep 30, 2021 at 12:19 PM Till Rohrmann wrote: > Thanks for the hint with the managed search engines Matthias. I think this

[jira] [Created] (FLINK-24395) Checkpoint trigger time difference between log statement and web frontend

2021-09-28 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-24395: -- Summary: Checkpoint trigger time difference between log statement and web frontend Key: FLINK-24395 URL: https://issues.apache.org/jira/browse/FLINK-24395

[jira] [Created] (FLINK-24392) Upgrade presto s3 fs implementation to Trinio >= 348

2021-09-28 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-24392: -- Summary: Upgrade presto s3 fs implementation to Trinio >= 348 Key: FLINK-24392 URL: https://issues.apache.org/jira/browse/FLINK-24392 Project: Fl

Re: [VOTE] Drop Scala Shell

2021-09-21 Thread Robert Metzger
+1 On Mon, Sep 20, 2021 at 4:39 PM Seth Wiesman wrote: > +1 > > On Mon, Sep 20, 2021 at 6:04 AM Chesnay Schepler > wrote: > > > +1 > > > > On 20/09/2021 09:38, Martijn Visser wrote: > > > Hi all, > > > > > > I would like to start a vote on dropping the Scala Shell. This was > > > previously

[jira] [Created] (FLINK-24320) Show in the Job / Checkpoints / Configuration if checkpoints are incremental

2021-09-17 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-24320: -- Summary: Show in the Job / Checkpoints / Configuration if checkpoints are incremental Key: FLINK-24320 URL: https://issues.apache.org/jira/browse/FLINK-24320

[jira] [Created] (FLINK-24208) Allow idempotent savepoint triggering

2021-09-08 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-24208: -- Summary: Allow idempotent savepoint triggering Key: FLINK-24208 URL: https://issues.apache.org/jira/browse/FLINK-24208 Project: Flink Issue Type

[jira] [Created] (FLINK-24114) Make CompletedOperationCache.COMPLETED_OPERATION_RESULT_CACHE_DURATION_SECONDS configurable (at least for savepoint trigger operations)

2021-09-01 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-24114: -- Summary: Make CompletedOperationCache.COMPLETED_OPERATION_RESULT_CACHE_DURATION_SECONDS configurable (at least for savepoint trigger operations) Key: FLINK-24114 URL: https

[jira] [Created] (FLINK-24113) Introduce option in Application Mode to request cluster shutdown

2021-09-01 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-24113: -- Summary: Introduce option in Application Mode to request cluster shutdown Key: FLINK-24113 URL: https://issues.apache.org/jira/browse/FLINK-24113 Project: Flink

[jira] [Created] (FLINK-24037) Allow wildcards in ENABLE_BUILT_IN_PLUGINS

2021-08-28 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-24037: -- Summary: Allow wildcards in ENABLE_BUILT_IN_PLUGINS Key: FLINK-24037 URL: https://issues.apache.org/jira/browse/FLINK-24037 Project: Flink Issue Type

[jira] [Created] (FLINK-23925) HistoryServer: Archiving job with more than one attempt fails

2021-08-23 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-23925: -- Summary: HistoryServer: Archiving job with more than one attempt fails Key: FLINK-23925 URL: https://issues.apache.org/jira/browse/FLINK-23925 Project: Flink

[jira] [Created] (FLINK-23913) UnalignedCheckpointITCase fails with exit code 137 (kernel oom) on Azure VMs

2021-08-23 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-23913: -- Summary: UnalignedCheckpointITCase fails with exit code 137 (kernel oom) on Azure VMs Key: FLINK-23913 URL: https://issues.apache.org/jira/browse/FLINK-23913

[jira] [Created] (FLINK-23589) Support Avro Microsecond precision

2021-08-02 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-23589: -- Summary: Support Avro Microsecond precision Key: FLINK-23589 URL: https://issues.apache.org/jira/browse/FLINK-23589 Project: Flink Issue Type

[jira] [Created] (FLINK-23562) Update CI docker image to latest java version (1.8.0_292)

2021-07-30 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-23562: -- Summary: Update CI docker image to latest java version (1.8.0_292) Key: FLINK-23562 URL: https://issues.apache.org/jira/browse/FLINK-23562 Project: Flink

Re: [VOTE] Release 1.12.5, release candidate #3

2021-07-30 Thread Robert Metzger
one, > > Thanks Robert, I created a new one. > > all artifacts to be deployed to the Maven Central Repository [4], > > [4] > https://repository.apache.org/content/repositories/orgapacheflink-1444/ > > Best, > Jingsong > > On Thu, Jul 29, 2021 at 9:50 PM Robert

Re: [VOTE] Release 1.13.2, release candidate #3

2021-07-29 Thread Robert Metzger
Thanks a lot for creating this release candidate +1 (binding) - staging repository looks fine - Diff to 1.13.1 looks fine wrt to dependency changes: https://github.com/apache/flink/compare/release-1.13.1...release-1.13.2-rc3 - standalone mode works locally - I found this issue, which is not

[jira] [Created] (FLINK-23546) stop-cluster.sh produces warning on macOS 11.4

2021-07-29 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-23546: -- Summary: stop-cluster.sh produces warning on macOS 11.4 Key: FLINK-23546 URL: https://issues.apache.org/jira/browse/FLINK-23546 Project: Flink Issue

Re: [VOTE] Release 1.12.5, release candidate #3

2021-07-29 Thread Robert Metzger
we intend to release to maven central, to avoid complications in the release process. Since only the convenience binaries are affected by this, we don't need to cancel the release. We just need to create a new staging repository. On Thu, Jul 29, 2021 at 3:36 PM Robert Metzger wrote: >

Re: [VOTE] Release 1.12.5, release candidate #3

2021-07-29 Thread Robert Metzger
Thanks a lot for creating a release candidate! What is the difference between the two maven staging repos? https://repository.apache.org/content/repositories/orgapacheflink-1440/ and https://repository.apache.org/content/repositories/orgapacheflink-1441/ ? On Thu, Jul 29, 2021 at 1:52 PM Xingbo

Re: [VOTE] Release 1.11.4, release candidate #1

2021-07-29 Thread Robert Metzger
Thanks a lot for creating the release candidate! +1 (binding) Checks: - manually checked the diff [1]. License documentation seems to be properly maintained in all changes (mostly a jackson version dump, and some ES + Kinesis bumps) - checked standalone mode, job submission, logs locally. -

Re: [DISCUSS] FLIP-185: Shorter heartbeat timeout and interval default values

2021-07-20 Thread Robert Metzger
+1 to this change! When I was working on the reactive mode blog post [1] I also ran into this issue, leading to a poor "out of the box" experience when scaling down. For my experiments, I've chosen a timeout of 8 seconds, and the cluster has been running for 76 days (so far) on Kubernetes. I also

Re: [DISCUSS] Address deprecation warnings when upgrading dependencies

2021-07-15 Thread Robert Metzger
> > Maybe we could leverage sonar cloud infrastructure for this. They already > have built in rules for deprecation warnings [1]. Also they have a free > offering for public open-source repositories [2]. > Cool, I didn't know this. There are already quite a lot of Apache Projects there:

Re: [DISCUSS] Address deprecation warnings when upgrading dependencies

2021-07-14 Thread Robert Metzger
For implementing this in practice, we could also extend our CI pipeline a bit, and count the number of deprecation warnings while compiling Flink. We would hard-code the current number of deprecations and fail the build if that number increases. We could actually extend this and run a curated

[jira] [Created] (FLINK-23191) Azure: Upload CI logs to S3 as well

2021-06-30 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-23191: -- Summary: Azure: Upload CI logs to S3 as well Key: FLINK-23191 URL: https://issues.apache.org/jira/browse/FLINK-23191 Project: Flink Issue Type

[jira] [Created] (FLINK-23129) When cancelling any running job of multiple jobs in an application cluster, JobManager shuts down

2021-06-23 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-23129: -- Summary: When cancelling any running job of multiple jobs in an application cluster, JobManager shuts down Key: FLINK-23129 URL: https://issues.apache.org/jira/browse/FLINK

Re: CONTENTS DELETED in nabble frontend

2021-06-23 Thread Robert Metzger
I've set up the nabble archives back in the stone age of Flink, when the Apache archive didn't provide a very modern user experience. Since lists.apache.org exists, we don't really need nabble anymore. I'll open a pull request to replace the links to nabble to point to lists.apache.org on the

Re: [DISCUSS] Drop Mesos in 1.14

2021-06-22 Thread Robert Metzger
I'm adding Oleksandr from Criteo to this thread, they've mentioned in the past that they are using Flink on Mesos (IIRC the only company that seemed to be doing so) I'm personally fine with dropping Mesos support. On Tue, Jun 22, 2021 at 10:29 AM Chesnay Schepler wrote: > Last week I spent

  1   2   3   4   5   6   7   8   9   10   >