Re: [DISCUSS] A more restrictive JIRA workflow

2019-07-04 Thread Robert Metzger
This is the Jira ticket I opened https://issues.apache.org/jira/browse/INFRA-18644 a long time ago :) On Thu, Jul 4, 2019 at 10:47 AM Chesnay Schepler wrote: > @Robert what's the state here? > > On 24/06/2019 16:16, Robert Metzger wrote: > > Hey all, > > >

Re: [DISCUSS] Adopting a Code Style and Quality Guide

2019-07-08 Thread Robert Metzger
is also eliminates need for any special > editor > > / > > >> checkstyle configs as the code formatting is part of the build itself. > > >> > > >> The one Beam uses is https://github.com/diffplug/spotless with > > >> GoogleJavaFormat, it may be wort

Re: [DISCUSS] META-FLIP: Sticking (or not) to a strict FLIP voting process

2019-07-10 Thread Robert Metzger
Thanks for your summary Becket. Your list of items makes sense to me. I wonder if we should start working on some project Bylaws to write down how we want to work together. I really like your thoughts around "sticking to the process" to make us more efficient and approachable for new contributors.

Re: [DISCUSS] Create "flink-playgrounds" repository

2019-07-11 Thread Robert Metzger
+1 to create a repo. On Thu, Jul 11, 2019 at 11:10 AM Konstantin Knauf wrote: > Hi everyone, > > in the course of implementing FLIP-42 we are currently reworking the > Getting Started section of our documentation. As part of this, we are > adding docker-compose-based playgrounds to get started w

Re: [DISCUSS] Flink project bylaws

2019-07-11 Thread Robert Metzger
Thank you Becket for kicking off this discussion and creating a draft in the Wiki. I left some comments in the wiki. In my understanding this means, that a committer always needs a review and > +1 from another committer. As far as I know this is currently not always > the case (often committer au

Re: [DISCUSS] Create "flink-playgrounds" repository

2019-07-12 Thread Robert Metzger
> > > > "docs" but under "flink-quickstart" or so? > > > > > > Would that be equally cumbersome for users? > > > > > > > > > > > > Best, > > > > > > Stephan > > > > > > > >

Re: [DISCUSS] Create "flink-playgrounds" repository

2019-07-12 Thread Robert Metzger
The repo creation was faster than expected: https://github.com/apache/flink-playgrounds (it's not even listed here yet: https://gitbox.apache.org/repos/asf) On Fri, Jul 12, 2019 at 11:55 AM Robert Metzger wrote: > I will request the repo now, so that you can continue workin

Re: [DISCUSS] Create "flink-playgrounds" repository

2019-07-12 Thread Robert Metzger
hesnay Schepler wrote: > Wouldn't this qualify for releasing snapshot artifacts to users? (Which, > you know, shouldn't be done?) > > On 12/07/2019 11:55, Robert Metzger wrote: > > I will request the repo now, so that you can continue working on the > > document

Re: [DISCUSS] Adopting a Code Style and Quality Guide

2019-07-15 Thread Robert Metzger
I have received one review for the PR so far. I'll merge it in the next 24 hours unless there's further feedback. On Mon, Jul 8, 2019 at 6:04 PM Robert Metzger wrote: > I've converted the google document into a markdown-based pull request > here: https://github.com/apac

Re: [ANNOUNCE] Weekly Community Update 2019/28

2019-07-15 Thread Robert Metzger
As always, thank you for putting these nice summaries together! On Sun, Jul 14, 2019 at 7:34 PM Konstantin Knauf wrote: > Dear community, > > happy to share this weeks community update with Apache Flink 1.9, bylaws > for Apache Flink, Savepoints vs Checkpoints, Flink on ARM, and more. > > As alw

Re: [DISCUSS] Create a Flink ecosystem website

2019-07-17 Thread Robert Metzger
ebsite, we can ask Apache > infra team to prepare the VM for us, as that may also take some time. > > On Wed, Apr 24, 2019 at 11:57 PM Robert Metzger > wrote: > >> Hey all, >> >> quick update on this project: The frontend and backend code have been put >> toge

[ANNOUNCE] Jiangjie (Becket) Qin has been added as a committer to the Flink project

2019-07-18 Thread Robert Metzger
Hi all, I'm excited to announce that Jiangjie (Becket) Qin just became a Flink committer! Congratulations Becket! Best, Robert (on behalf of the Flink PMC)

[ANNOUNCE] JIRA permissions changed: Only committers can assign somebody to a ticket

2019-07-18 Thread Robert Metzger
Hi all, The permissions for the FLINK Jira project have been changed [1], to *only allow committers and PMC members to assign somebody to a Jira ticket.* Anybody with a Jira account can be assigned to a ticket. There is no need for "Contributor" permissions. This has been discussed in this maili

Re: [DISCUSS] A more restrictive JIRA workflow

2019-07-18 Thread Robert Metzger
them to my announcement. What do you think? [1] https://lists.apache.org/thread.html/4ed570c7110b7b55b5c3bd52bb61ff35d5bda88f47939d8e7f1844c4@%3Cdev.flink.apache.org%3E On Thu, Jul 4, 2019 at 1:21 PM Robert Metzger wrote: > This is the Jira ticket I opened > https://issues.apache.org/jira/brow

Re: [ANNOUNCE] JIRA permissions changed: Only committers can assign somebody to a ticket

2019-07-19 Thread Robert Metzger
d the email to the user@ list. It is okay for me if you do that :) On Thu, Jul 18, 2019 at 9:47 PM Bowen Li wrote: > shall we announce in user ML too? Users who are used to assign tickets to > themselves should also be aware of this change > > On Thu, Jul 18, 2019 at 3:06 AM Robert

Re: [DISCUSS] A more restrictive JIRA workflow

2019-07-19 Thread Robert Metzger
t; > > may have to bite the bullet and click 600 times in a row :) >>> > > >>> > > On 18/07/2019 12:32, Zili Chen wrote: >>> > > > Robert, >>> > > > >>> > > > Thanks for your effort. Rejecting contributor permission request >>> > >

Re: [DISCUSS] Flink project bylaws

2019-07-19 Thread Robert Metzger
rd -> pull request > > >>>>>> > > >>>>>> - > > >>>>>> Re: Chesnay > > >>>>>> > > >>>>>> The emeritus stuff seems like unnecessary noise. > &

[ANNOUNCE] Zhijiang Wang has been added as a committer to the Flink project

2019-07-22 Thread Robert Metzger
Hey all, We've added another committer to the Flink project: Zhijiang Wang. Congratulations Zhijiang! Best, Robert (on behalf of the Flink PMC)

Re: [DISCUSS] Setup a bui...@flink.apache.org mailing list for travis builds

2019-07-23 Thread Robert Metzger
+1 On Mon, Jul 22, 2019 at 10:27 AM Biao Liu wrote: > +1, make sense to me. > Mailing list seems to be a more "community" way. > > Timo Walther 于2019年7月22日周一 下午4:06写道: > > > +1 sounds good to inform people about instabilities or other issues > > > > Regards, > > Timo > > > > > > Am 22.07.19 um

Re: [DISCUSS] Create a Flink ecosystem website

2019-07-23 Thread Robert Metzger
off to you and Daryl — this turned out amazing! >>> >>> Marta >>> >>> On Thu, Jul 18, 2019 at 10:57 AM Congxian Qiu >>> wrote: >>> >>> > Robert and Daryl, thanks for the great work, I tried the website and >>> filed >&

[ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread Robert Metzger
Hi all, On behalf of the Flink PMC, I'm happy to announce that Kete Young is now part of the Apache Flink Project Management Committee (PMC). Kete has been a committer since February 2017, working a lot on Table API / SQL. He's currently co-managing the 1.9 release! Thanks a lot for your work for

Re: [DISCUSS] Setup a bui...@flink.apache.org mailing list for travis builds

2019-07-24 Thread Robert Metzger
> >> On Tue, Jul 23, 2019 at 1:59 PM Hequn Cheng > wrote: > >> > >> Hi Jark, > >> > >> Good idea. +1! > >> > >>> On Tue, Jul 23, 2019 at 6:23 PM Jark Wu wrote: > >>> > >>> Thank you all for your positiv

Re: [DISCUSS] Setup a bui...@flink.apache.org mailing list for travis builds

2019-07-24 Thread Robert Metzger
I've requested the creation of the list, and made Jark, Chesnay and me moderators of it. On Wed, Jul 24, 2019 at 1:12 PM Robert Metzger wrote: > @Jark: Yes, I will request the creation of a mailing list! > > On Tue, Jul 23, 2019 at 4:48 PM Hugo Louro wrote: > >> +1 >

Re: [DISCUSS] Setup a bui...@flink.apache.org mailing list for travis builds

2019-07-25 Thread Robert Metzger
The mailing list has been created, you can now subscribe to it. On Wed, Jul 24, 2019 at 1:43 PM Jark Wu wrote: > Thanks Robert for helping out that. > > Best, > Jark > > On Wed, 24 Jul 2019 at 19:16, Robert Metzger wrote: > > > I've requested the creation of

Re: [REMINDER] Please add entries for newly added dependencies to NOTICE file

2019-08-06 Thread Robert Metzger
The bot now warns if a pull request has been linked to an unassigned Jira ticket. (It also puts a warning if no docs, no zh-docs have been touched, or if a pom.xml file has been touched) On Mon, Apr 15, 2019 at 3:11 PM Robert Metzger wrote: > I will add such a feature to the bot! > &g

Re: [DISCUSS] Adopting a Code Style and Quality Guide

2019-08-07 Thread Robert Metzger
> > > >> > > > > >> It is super easy to use for contributors as they don't need to > keep > > > any > > > > >> particular coding style in mind and they can only focus on > > > functionality > > > > >> they want t

Re: [ANNOUNCE] Hequn becomes a Flink committer

2019-08-07 Thread Robert Metzger
Congratulations! On Wed, Aug 7, 2019 at 1:09 PM highfei2...@126.com wrote: > Congrats Hequn! > > Best, > Jeff Yang > > > Original Message > Subject: Re: [ANNOUNCE] Hequn becomes a Flink committer > From: Piotr Nowojski > To: JingsongLee > CC: Biao Liu ,Zhu Zhu ,Zili Chen ,Jeff

Re: [VOTE] Flink Project Bylaws

2019-08-12 Thread Robert Metzger
Thanks for starting the vote. How about putting a specific version in the wiki up for voting, or restricting edit access to the page to the PMC? There were already two changes (very minor) to the page since the vote has started: https://cwiki.apache.org/confluence/pages/viewpreviousversions.action?

Re: [DISCUSS] Repository split

2019-08-12 Thread Robert Metzger
Thanks a lot for starting the discussion Chesnay! I would like to throw in another aspect into the discussion: What if we consider this repo split as a first step towards making connectors, machine learning, gelly, table/SQL? independent projects within the ASF, with their own mailing lists, comm

Re: [VOTE] Flink Project Bylaws

2019-08-12 Thread Robert Metzger
gt; > That's a good suggestion. Will you help to change the permission on that > > page? > > > > Thanks, > > > > Jiangjie (Becket) Qin > > > > On Mon, Aug 12, 2019 at 2:41 PM Robert Metzger > > wrote: > > > > > Thanks for startin

Re: [DISCUSS] Flink project bylaws

2019-08-13 Thread Robert Metzger
1:00am? > >>>>>>>>>>>>> 3) Do we need a process do decide about removal of features > >>>>>>> (like > >>>>>>>>> the > >>>>>>>>>>>>> DataSet API

Re: [VOTE] Flink Project Bylaws

2019-08-13 Thread Robert Metzger
gt; > > >>>> +1 > > >>>> > > >>>> On Tue, Aug 13, 2019 at 12:22 PM Maximilian Michels > > > >>>> wrote: > > >>>> > > >>>>> +1 It's good that we formalize this. > > >>>

Re: [ANNOUNCE] Progress updates for Apache Flink 1.9.0 release

2019-08-13 Thread Robert Metzger
Hi all, I've opened a pull request for the release announcement. I'm looking forward to your review & feedback: https://github.com/apache/flink-web/pull/244 On Fri, Aug 9, 2019 at 6:27 PM Tzu-Li (Gordon) Tai wrote: > Hi, > > Update: voting on RC2 for Apache Flink 1.9.0 has started: > > http://a

Re: [DISCUSS] FLIP-39: Flink ML pipeline and ML libs

2019-08-14 Thread Robert Metzger
It seems that this FLIP doesn't have a Wiki page yet [1], even though it is already partially implemented [2] We should try to stick more to the FLIP process to manage the project more efficiently. [1] https://cwiki.apache.org/confluence/display/FLINK/Flink+Improvement+Proposals [2] https://issue

Re: [ANNOUNCE] Andrey Zagrebin becomes a Flink committer

2019-08-14 Thread Robert Metzger
Congratulations! Very happy to have you onboard :) On Wed, Aug 14, 2019 at 4:06 PM Kostas Kloudas wrote: > Congratulations Andrey! > Well deserved! > > Kostas > > On Wed, Aug 14, 2019 at 4:04 PM Yun Tang wrote: > > > > Congratulations Andrey. > > > > Best > > Yun Tang > > __

Re: [VOTE] Apache Flink Release 1.9.0, release candidate #2

2019-08-14 Thread Robert Metzger
Has anybody verified the inclusion of all bundled dependencies into the NOTICE files? I'm asking because we had some issues with that in the last release(s). On Wed, Aug 14, 2019 at 5:31 PM Aljoscha Krettek wrote: > +1 > > I did some testing on a Google Cloud Dataproc cluster (it gives you a >

Re: [DISCUSS] Update our Roadmap

2019-08-16 Thread Robert Metzger
Flink 1.9 is feature freezed and almost released. I guess it makes sense to update the roadmap on the website again. Who feels like having a good overview of what's coming up? On Tue, May 7, 2019 at 4:33 PM Fabian Hueske wrote: > Yes, that's a very good proposal Jark. > +1 > > Best, Fabian > >

Re: [DISCUSS] Reducing build times

2019-08-18 Thread Robert Metzger
Hi all, I wanted to understand the impact of the hardware we are using for running our tests. Each travis worker has 2 virtual cores, and 7.5 gb memory [1]. They are using Google Cloud Compute Engine *n1-standard-2* instances. Running a full "mvn clean verify" takes *03:32 h* on such a machine typ

Re: [DISCUSS] Update our Roadmap

2019-08-19 Thread Robert Metzger
provide support, if needed. > > Marta > > On Sun, Aug 18, 2019 at 4:46 PM Stephan Ewen wrote: > > > I could help with that. > > > > On Fri, Aug 16, 2019 at 2:36 PM Robert Metzger > > wrote: > > > > > Flink 1.9 is feature freezed and almost r

Re: [DISCUSS] Reducing build times

2019-08-19 Thread Robert Metzger
ackaged and most of > the end-to-end tests use the shade plugin to package the jars for testing. > > Aljoscha > > > On 18. Aug 2019, at 19:52, Robert Metzger wrote: > > > > Hi all, > > > > I wanted to understand the impact of the hardware we are using for >

Re: [DISCUSS] Flink project bylaws

2019-08-22 Thread Robert Metzger
et) Qin > > On Tue, Aug 13, 2019 at 1:29 PM Robert Metzger > wrote: > > > Hi Becket, > > I've applied the proposed change to the document: > > > > > https://cwiki.apache.org/confluence/pages/diffpagesbyversion.action?pageId=120731026&selectedPageVersi

Re: Watermarks not propagated to WebUI?

2019-08-26 Thread Robert Metzger
Jan, will you be able to test this issue on the now-released Flink 1.9 with the new UI? What parallelism is needed to reproduce the issue? On Thu, Aug 15, 2019 at 1:59 PM Chesnay Schepler wrote: > I remember an issue regarding the watermark fetch request from the WebUI > exceeding some HTTP si

Re: [DISCUSS] Flink project bylaws

2019-08-28 Thread Robert Metzger
t; Jiangjie (Becket) Qin > > On Thu, Aug 22, 2019 at 12:11 PM Robert Metzger > wrote: > > > I have started a Wiki page (editable by all) for collecting ideas for > > Bylaws changes, so that we can batch changes together and then vote on > > them: > > > https:/

Re: [DISCUSS] Repository split

2019-09-03 Thread Robert Metzger
Thanks a lot for your summary Chesnay. I agree with you that we have no consensus in the community for splitting up the repository immediately, and I agree with you that we should have a separate discussion about reducing the build time (which is already making good progress). Also, I will keep th

Re: [DISCUSS] Reducing build times

2019-09-03 Thread Robert Metzger
s etc.), nice docker support, plenty of free build resources for open source projects, ...) Best, Robert On Mon, Aug 19, 2019 at 5:12 PM Robert Metzger wrote: > Hi all, > > I have summarized all arguments mentioned so far + some additional > research into a Wiki page here: > http

Re: [DISCUSS] Reducing build times

2019-09-04 Thread Robert Metzger
ensure that contributor builds are still running in a reasonable time? > > As an example of this happening on Travis, contributors currently cannot > run all e2e tests since they timeout, but on apache we have a larger > timeout. > > On 03/09/2019 18:57, Robert Metzger wrote: >

Re: [DISCUSS] Reducing build times

2019-09-05 Thread Robert Metzger
ng experiments here; > I would prefer if we only activate it once things are confirmed to be > working. > > For observation purposes, we could also add it to flink-ci with > notifications to people who are interested in this experiment. > This wouldn't impact CiBot. >

Re: [DISCUSS] FLIP-322 Cooldown period for adaptive scheduler

2023-06-15 Thread Robert Metzger
ldown timeout is to avoid rescaling the job very frequently, > >> because TaskManagers are not all connecting at the same time. > >> > >> So, is it possible that every taskmanager connecting will produce a > >> scalling event and it'll be stacked with many scale

Re: [VOTE] Apache Flink Stateful Functions Release 3.3.0, release candidate #2

2023-09-14 Thread Robert Metzger
I did a shallow pass over the release for it to get the +3 votes. Please verify other aspects of the release when voting ;) +1 (binding) - maven clean install on the source tgz (not on an M1 macbook because of protoc, but on x86 linux) (not on Java 17 either ;) ) - staging repo seem fine - statef

Re: [DISCUSS] FLIP 333 - Redesign Apache Flink website

2023-09-29 Thread Robert Metzger
There's now a PR (https://github.com/apache/flink-web/pull/676) and a preview available for this FLIP ( https://website-refresh.d193kg429zpv7e.amplifyapp.com/). On Fri, Jul 28, 2023 at 8:45 AM Mohan, Deepthi wrote: > Matthias, Markos, Martijn, thank you for your feedback. > > Markos, I've addres

Re: [DISCUSS] Removal of unused e2e tests

2023-10-24 Thread Robert Metzger
I left a comment in FLINK-5. On Mon, Oct 23, 2023 at 5:18 AM Alexander Fedulov < alexander.fedu...@gmail.com> wrote: > FLINK-17375 [1] removed [2] run-pre-commit-tests.sh in Flink 1.12. Since > then the following tests are not executed anymore: > test_state_migration.sh > test_state_evolution

Re: [VOTE] Accept Flink CDC into Apache Flink

2024-01-09 Thread Robert Metzger
+1 (binding) On Tue, Jan 9, 2024 at 9:54 AM Guowei Ma wrote: > +1 (binding) > Best, > Guowei > > > On Tue, Jan 9, 2024 at 4:49 PM Rui Fan <1996fan...@gmail.com> wrote: > > > +1 (non-binding) > > > > Best, > > Rui > > > > On Tue, Jan 9, 2024 at 4:41 PM Hang Ruan wrote: > > > > > +1 (non-binding

Re: [DISCUSS] Drop connectors for Elasticsearch 2.x and 5.x

2020-02-10 Thread Robert Metzger
Thanks for starting this discussion! +1 to drop both On Mon, Feb 10, 2020 at 2:45 PM Dawid Wysakowicz wrote: > Hi all, > > As described in this https://issues.apache.org/jira/browse/FLINK-11720 > ticket our elasticsearch 5.x connector does not work out of the box on > some systems and requires

Re: [VOTE] Release flink-shaded 10.0, release candidate #3

2020-02-14 Thread Robert Metzger
+1 (binding) - Checked some artifacts in the staging repo - checked license documentation - source release is binary free On Fri, Feb 14, 2020 at 8:01 AM Dian Fu wrote: > +1 (non-binding) > > - Verified the signature and checksum > - Checked the release note that all the tickets included in th

Re: [DISCUSS] Remove transfer.sh from CI setup

2020-02-15 Thread Robert Metzger
I agree that we need to fix this. We could either misuse the "build artifact" feature of azure pipelines to publish the logs, or we set up something simple for Flink (like running an instance of https://github.com/lachs0r/0x0 or https://github.com/dutchcoders/transfer.sh :) ) On Fri, Feb 14, 2020

Re: [DISCUSS] Migrate build infrastructure from Travis CI to Azure Pipelines

2020-02-17 Thread Robert Metzger
gt; >> Thanks for bring up this topic. The 2 ARM machines(16cores) which I > >> donated is just for POC test. We(Huawei) can donate more once moving to > >> official Azure pipeline. :) > >> > >> Robert Metzger 于2019年12月6日周五 上午3:25写道: > >> > >

Re: Hotfixes on the master

2020-02-17 Thread Robert Metzger
documentation addition to what is provided in the commit > > message? > > > > Counting hotfixes by contributor, the top of the list looks as I would > > expect. > > > > Greg > > > > Note: this summary is rather naive and includes non-squashed hotfix &

Re: [DISCUSS] Remove transfer.sh from CI setup

2020-02-17 Thread Robert Metzger
Tracking this here: https://issues.apache.org/jira/browse/FLINK-16122 On Sat, Feb 15, 2020 at 8:12 PM Robert Metzger wrote: > I agree that we need to fix this. > > We could either misuse the "build artifact" feature of azure pipelines to > publish the logs, or we set u

Re: [DISCUSS] Drop connectors for Elasticsearch 2.x and 5.x

2020-02-18 Thread Robert Metzger
The ES5 connector is causing some problems on the CI system. It would be nice if we could make a decision here soon. I don't want to invest time into fixing it, if we are going to remove it. I'm still in favor of removing it. If we see that there's demand for the 5.x connector after the 1.11 relea

Re: Hotfixes on the master

2020-02-19 Thread Robert Metzger
he commits are not unrelated and the feature commits use > parts of the hotfix commits, then it makes the cherry-picking more tricky > and the commits should have the JIRA issue tag. But I would be fine with > trying it out. > > Cheers, > Till > > On Mon, Feb 17, 2020 at 3:56

Re: [DISCUSS] Drop connectors for Elasticsearch 2.x and 5.x

2020-02-20 Thread Robert Metzger
. > > > > On 18/02/2020 13:03, Aljoscha Krettek wrote: > > > Wouldn't removing the ES 2.x connector be enough because we can then > > > update the ES 5.x connector? It seems there are some users that still > > > want to use that one. > > > > >

Re: [DISCUSS] Migrate build infrastructure from Travis CI to Azure Pipelines

2020-02-28 Thread Robert Metzger
AND+component+%3D+%22Build+System+%2F+Azure+Pipelines%22> " component. On Mon, Feb 17, 2020 at 12:23 PM Robert Metzger wrote: > @Leonard: On Azure, I'm not splitting the execution of the end to end > tests anymore. We won't have the overhead of compiling the same prof

Re: Flink dev blog

2020-03-02 Thread Robert Metzger
I would be excited to read such a blog (can I request topics? :) ) We could start very low key by using our wiki's blog feature: https://cwiki.apache.org/confluence/pages/viewrecentblogposts.action?key=FLINK On Mon, Mar 2, 2020 at 8:26 PM Stephan Ewen wrote: > Great idea, but I also second Seth

Re: Flink dev blog

2020-03-03 Thread Robert Metzger
; > > > >>>> I like the idea. +1 from my side. > > > >>>> > > > >>>> Potential topics: > > > >>>> - Scheduling > > > >>>> - Cluster partitions > > > >>>> - Memory configura

Re: Flink dev blog

2020-03-05 Thread Robert Metzger
gt; >>>> some more advanced features, like a deep tech dive for > > power > > > > > > users. > > > > > > > > >>>> > > > > > > > > >>>> I’m not opposing the deep tech di

Re: [DISCUSS] Disable "Squash and merge" button for Flink repository on GitHub

2020-03-05 Thread Robert Metzger
+1 for disabling this feature for now. Thanks a lot for spotting this! On Thu, Mar 5, 2020 at 3:54 PM Zhijiang wrote: > +1 for disabling "Squash and merge" if feasible to do that. > > The possible benefit to use this button is for saving some efforts to > squash some intermediate "[fixup]" comm

Re: Flink dev blog

2020-03-09 Thread Robert Metzger
gt; > > On Thu, 5 Mar 2020 at 23:04, Zhijiang > > .invalid> > > > > wrote: > > > > > > > > > Thanks for this proposal Arvid! > > > > > +1 and looking forward to the wiki structure and more following > > blogs. > &g

Re: [DISCUSS] Extend (or maintain) "shell" script support for Windows

2020-03-10 Thread Robert Metzger
I'm wondering whether we should file a ticket to remove the *.bat files in bin/ ? On Tue, Mar 10, 2020 at 12:46 PM Aljoscha Krettek wrote: > Since there was no-one that said we should keep the windows scripts and > no-one responded on the user ML thread I'll close the Jira issues/PRs > about ext

[DISCUSS] Drop Bucketing Sink

2020-03-12 Thread Robert Metzger
Hi all, I'm currently investigating a failing end to end test for the bucketing sink [1]. The bucketing sink has been deprecated in the 1.9 release [2], because we have the new StreamingFileSink [3] for quite a while. Before putting any effort into fixing the end to end test for the sink, I wanted

Re: [DISCUSS] Drop Bucketing Sink

2020-03-16 Thread Robert Metzger
gt; > > > > >> > This e2e test really fails frequently. +1 to drop bucketing sink, > > it > > > is > > > >> > not worth paying more efforts since deprecated. > > > >> > > > > >> > Best, > > > >

Re: [DISCUSS] Extend (or maintain) "shell" script support for Windows

2020-03-19 Thread Robert Metzger
sion > > > today. Maybe we should remove them? Like what we do for other legacy > > codes. > > > > > > Thank you~ > > > > > > Xintong Song > > > > > > > > > > > > On Tue, Mar 10, 2020 at 10:01 PM Aljoscha Krettek > > >

[Dev Blog] Migrating Flink's CI Infrastructure from Travis CI to Azure Pipelines

2020-03-23 Thread Robert Metzger
Hi all, I have just published the first post to the dev blog: https://cwiki.apache.org/confluence/display/FLINK/2020/03/22/Migrating+Flink%27s+CI+Infrastructure+from+Travis+CI+to+Azure+Pipelines . I'm looking forward to your feedback and questions on the article :) Best, Robert

[DISCUSS] Switch to Azure Pipelines as the primary CI tool / switch off Travis

2020-03-23 Thread Robert Metzger
Hey devs, I would like to discuss whether it makes sense to fully switch to Azure Pipelines and phase out our Travis integration. More information on our Azure integration can be found here: https://cwiki.apache.org/confluence/display/FLINK/2020/03/22/Migrating+Flink%27s+CI+Infrastructure+from+Tra

Re: [DISCUSS] Switch to Azure Pipelines as the primary CI tool / switch off Travis

2020-03-25 Thread Robert Metzger
25T05:31:52.7412964Z [INFO] < > org.apache.flink:flink-end-to-end-tests-common-kafka > > >>>> 2020-03-25T05:31:52.7413854Z [INFO] Building > flink-end-to-end-tests-common-kafka 1.11-SNAPSHOT [39/46] > >>>> 2020-03-25T05:31:52.7414689Z [INFO]

Re: [DISCUSS] Switch to Azure Pipelines as the primary CI tool / switch off Travis

2020-03-25 Thread Robert Metzger
from the .travis.yml with a push/pr condition. > > On 25/03/2020 15:03, Robert Metzger wrote: > > Thank you for the feedback so far. > > > > Responses to the items Chesnay raised: > > > > - by virtue of maintaining the past 2 releases we will have to maintain > any

Re: [DISCUSS] Drop Bucketing Sink

2020-03-26 Thread Robert Metzger
ce it has been removed. On Tue, Mar 17, 2020 at 10:35 AM Kostas Kloudas wrote: > Thanks Robert for all this, > > I think that we should also post a thread in the user ML so that users > can also comment on the topic. > > What do you think? > > Kostas > > On Mon, Mar

Re: [VOTE] Apache Flink Stateful Functions Release 2.0.0, release candidate #4

2020-03-30 Thread Robert Metzger
While checking the release, I found a 77 MB statefun-parent-2.0.0-source-release.zip file in the maven staging repo: https://repository.apache.org/content/repositories/orgapacheflink-1343/org/apache/flink/statefun-parent/2.0.0/ It seems that the file contains all ruby dependencies in docs/ from je

Re: [VOTE] Apache Flink Stateful Functions Release 2.0.0, release candidate #4

2020-03-30 Thread Robert Metzger
actually, only the pom file since that's the parent > module > > which only has pom packaging. > > I'm looking into it. > > > > On Tue, Mar 31, 2020 at 2:23 PM Robert Metzger > > wrote: > > > >> While checking the release, I found a

Re: [VOTE] Apache Flink Stateful Functions Release 2.0.0, release candidate #4

2020-03-31 Thread Robert Metzger
> wrote: > > > Sounds good, I'll post a new link to this vote thread, which will have > the > > problem fixed in a new maven staging repository. > > > > On Tue, Mar 31, 2020 at 2:51 PM Robert Metzger > > wrote: > > > >> Thank you for loo

Re: [ANNOUNCE] New Committers and PMC member

2020-04-01 Thread Robert Metzger
Welcome & congratulations to all of you! On Wed, Apr 1, 2020 at 10:58 AM Jingsong Li wrote: > Congratulations! Konstantin, Dawid, Zhijiang. Well deserved. > > Best, > Jingsong Lee > > On Wed, Apr 1, 2020 at 4:52 PM Stephan Ewen wrote: > > > Hi all! > > > > Happy to announce that over the last

Re: [VOTE] Apache Flink Stateful Functions Release 2.0.0, release candidate #6

2020-04-06 Thread Robert Metzger
Thanks a lot for preparing another RC! +1 (binding) - source archive looks fine (no binaries, copied sources are properly reported) - staging repository looks fine (bundled binaries seem documented, versions are correct) - *mvn clean install *(mvn clean verify fails, "install" is required) w/ e2e

Re: [DISCUSS] FLIP-121: Support Cython Optimizing Python User Defined Function

2020-04-06 Thread Robert Metzger
a lot of > optimizations in master[2], Cython can further greatly improve the > performance of Python UDF. > > Robert Metzger, Jincheng Sun and I have discussed offline and have drafted > the FLIP-121[3]. It includes the following items: > > - Introduces Cython implementation of

Re: [DISCUSS] Consolidated log4j2-properties file

2020-04-07 Thread Robert Metzger
I also like the idea of getting rid of all those copies of the same file across our codebase. How about setting the log level in the log4j config file in flink-test-utils-junit/src/main/resources to INFO, and using a separate log4j config for local maven runs? (we pass a different log4j file in th

Re: [DISCUSS] Creating a new repo to host Flink benchmarks

2020-04-09 Thread Robert Metzger
+1 on creating the repo. On Thu, Apr 9, 2020 at 5:54 PM Till Rohrmann wrote: > I think it is a good idea to make the benchmarks available to the community > via a repo under the Apache project and to make updating it part of the > release process. Hence +1 for the proposal. > > Cheers, > Till >

Re: [PROPOSAL] Google Season of Docs 2020.

2020-04-17 Thread Robert Metzger
Thanks a lot for volunteering to drive an application for the Flink project! Last year, we discussed finishing the chinese translation as a potential project. I believe there's still a need for this. Since the work on the project starts pretty far in the future (September), the translation project

Re: [DISCUSS] Switch to Azure Pipelines as the primary CI tool / switch off Travis

2020-04-17 Thread Robert Metzger
numbers. > > > > Best Regards, > > Yu > > > > [1] > > > https://github.com/apache/flink/pulls?q=is%3Apr+created%3A%3E%3D2020-01-01 > > [2] > > > > > https://dev.azure.com/rmetzger/Flink/_pipeline/analytics/stageawareoutcome?definitionId=4 >

Re: [DISCUSS] Integration of training materials into Apache Flink

2020-04-19 Thread Robert Metzger
@David: I'm happy to create a component in JIRA. How about calling the component "Documentation / Training"? On Sat, Apr 18, 2020 at 11:14 AM Tzu-Li (Gordon) Tai wrote: > I can help create the flink-training repository. > > Before I do that though, I'd like to wait a bit on [1] over the next fe

Re: [DISCUSS] Integration of training materials into Apache Flink

2020-04-20 Thread Robert Metzger
ut calling the component "Documentation / Training"? >> >> >> Sounds good. Thanks! >> >> *David Anderson* | Training Coordinator >> >> Follow us @VervericaData >> -- >> Join Flink Forward - The Apache Flink Conference >> Stream

Re: [ANNOUNCE] New Apache Flink PMC Member - Hequn Chen

2020-04-20 Thread Robert Metzger
Congratulations! On Mon, Apr 20, 2020 at 2:05 PM Canbin Zheng wrote: > Congratulations Hequn! > > Regards, > Canbin Zheng > > wenlong.lwl 于2020年4月20日周一 下午8:02写道: > > > Congratulations Hequn! > > > > Bests, > > Wenlong > > > > On Mon, 20 Apr 2020 at 17:56, Yuan Mei wrote: > > > > > Congrats! >

[DISCUSS] Adding support for Hadoop 3 and removing flink-shaded-hadoop

2020-04-21 Thread Robert Metzger
Hi all, for the upcoming 1.11 release, I started looking into adding support for Hadoop 3[1] for Flink. I have explored a little bit already into adding a shaded hadoop 3 into “flink-shaded”, and some mechanisms for switching between Hadoop 2 and 3 dependencies in the Flink build. However, Chesna

Re: [DISCUSS] Switch to Azure Pipelines as the primary CI tool / switch off Travis

2020-04-23 Thread Robert Metzger
FYI: I have moved the Flink PR and master builds from my personal Azure account to a PMC controlled account: https://dev.azure.com/apache-flink/apache-flink/_build On Fri, Apr 17, 2020 at 8:28 PM Robert Metzger wrote: > Thanks a lot for bringing up this topic again. > The reason why

Re: Flink dev blog

2020-04-23 Thread Robert Metzger
> > On Mon, 9 Mar 2020 at 17:51, tison wrote: > > > Thanks for your reply Robert. That sounds great. > > > > Best, > > tison. > > > > > > Robert Metzger 于2020年3月9日周一 下午5:46写道: > > > > > Hey Tison, > > > > > > only

Re: [VOTE] Release 1.9.3, release candidate #1

2020-04-23 Thread Robert Metzger
+1 (binding) - for license documentation, I checked the diff between 1.9.2 and 1.9.3: https://github.com/apache/flink/compare/release-1.9.2...release-1.9.3-rc1 - Kafka dependency changed from 0.10.2.1 to 0.10.2.2 --> License doc was updated in PR https://github.com/apache/flink/pull/11617/files

Re: [DISCUSS] Intermediary releases of the flink-docker images

2020-04-27 Thread Robert Metzger
Thanks for starting the thread! I would consider the docker images of Flink convenience binary releases that can happen any time. I believe a simplified, but formal release process would be appropriate (preview / staging images for the community to validate & vote, then release to docker hub). On

Re: [DISCUSS] Should max/min be part of the hierarchy of config option?

2020-04-27 Thread Robert Metzger
Thanks for starting this discussion. I believe the different options are a lot about personal taste, there are no objective arguments why one option is better than the other. I agree with your proposal to simply go with the "max-xyz" pattern, as this is the style of the majority of the current con

Re: [DISCUSS] Stateful Functions - in which form to contribute? (same or different repository)

2019-10-16 Thread Robert Metzger
+1 for separate repositories. This is also good for the community to collect some experience for a potential repository split effort at some later point. On Wed, Oct 16, 2019 at 12:01 PM vino yang wrote: > Hi, > > Fast release cycles seems a good viewpoint to support keeping it in a > separate r

Re: [VOTE] Accept Stateful Functions into Apache Flink

2019-10-21 Thread Robert Metzger
+1 (binding) On Mon, Oct 21, 2019 at 12:06 PM Stephan Ewen wrote: > This is the official vote whether to accept the Stateful Functions code > contribution to Apache Flink. > > The current Stateful Functions code, documentation, and website can be > found here: > https://statefun.io/ > https://gi

Re: [ARM support] Travis ARM CI is now in Alpha Release

2019-10-22 Thread Robert Metzger
Hey Xiyuan, thanks a lot for checking out Travis ARM-based offering. As part of the "Reducing build times" discussion, we have considered moving away from Travis to Azure Pipelines. What I want to say is that Travis might not be important for the Flink community in the long run. I think running th

Re: [DISCUSS] Reducing build times

2019-11-01 Thread Robert Metzger
ty can have the full > access to the ARM resources as well. > > Thanks. > > [1 ] > > https://docs.microsoft.com/zh-cn/azure/devops/pipelines/agents/v2-linux?view=azure-devops > > Robert Metzger 于2019年9月5日周四 下午8:54写道: > > > I do have a working Azure setup, yes

[ANNOUNCE] Launch of flink-packages.org: A website to foster the Flink Ecosystem

2019-11-18 Thread Robert Metzger
Hi all, I would like to announce that Ververica, with the permission of the Flink PMC, is launching a website called flink-packages.org. This goes back to an effort proposed earlier in 2019 [1] The idea of the site is to help developers building extensions / connectors / API etc. for Flink to get

  1   2   3   4   5   6   7   8   9   10   >