Python SDK: BigTableIO

Hey guys, We have been using Beam for quite a few months now, so we (my colleague Robert & I) thought it might be cool to contribute a bit as well. The challenge we want to take up is writing the BigTableIO for the Python SDK (which is not yet in the works according to the website

Re: Python SDK: BigTableIO

Sink interface is deprecated so I > suggest > > not to use that). I would be happy to review any PRs related to this. > > > > Thanks, > > Cham > > > > On Sun, May 28, 2017 at 2:30 AM Matthias Baetens < > > matthias.baet...@datatonic.com> wrote: &

Re: [Proposal] Apache Beam Swag Store

that > > > >> > > would restrict going to another vendor or something. > > > >> > > > > > >> > > Dan > > > >> > > > > > >> > > > > > >> > > > On Oct 25, 2017, at 8:51 AM, Griselda Cu

Re: "Radically modular data ingestion APIs in Apache Beam" @ Strata - slides available

Hey Eugene, Apologies for picking this up so late, but I could help uploading your video to the Beam channel. Are you able to send me the raw file and do you have sign-off to go ahead with sharing it on YouTube? Thanks. Matthias On Sat, 14 Apr 2018 at 21:45 Eugene Kirpichov

Re: I'm back and ready to help grow our community!

Same here - shame on me. Congratulations on the graduation Gris, very happy to have you back! On Tue, 22 May 2018 at 09:19 Ismaël Mejía wrote: > I missed somehow this email thread. > Congratulations Gris and welcome back! > > On Fri, May 18, 2018 at 5:34 AM Jesse Anderson

Re: [FYI] New Apache Beam Swag Store!

in 1 week. Each company or user will need to pay for their own swag. >>>>- If you are hosting an event or representing Beam at one, reach >>>>out to me or the beam-events-meetups slack channel, I'll be happy to >>>> review >>>>

Re: "Radically modular data ingestion APIs in Apache Beam" @ Strata - slides available

> Thank you. Here is the raw file on Google Drive: > https://drive.google.com/file/d/1gUoe6UrpNNO3ijYSgTvD5GBy-14Zx6dT/view?usp=sharing > > And yes, I have permission from O'Reilly/Strata to use this file whichever > way I want, so it's ok to share on YouTube. > > On Fri, Ma

Apache Beam Summit in Europe

Hi Beam Community, We are planning to have an Apache Beam Summit in Europe, pretty similar to what we hosted earlier in California on March 15th this year. If you'd be interested in attending, helping with organization or speaking, please answer this Google form

Re: [ANNOUNCEMENT] New committers, May 2018 edition!

Great news, congrats all! On Fri, 1 Jun 2018 at 08:32 Holden Karau wrote: > Congrats all! > > On Fri, Jun 1, 2018 at 12:12 AM Ismaël Mejía wrote: > >> Congratulations! >> >> On Fri, Jun 1, 2018 at 8:26 AM Pei HE wrote: >> > >> > Congrats! >> > >> > On Fri, Jun 1, 2018 at 2:12 PM, Charles Chen

Re: "Radically modular data ingestion APIs in Apache Beam" @ Strata - slides available

lease submit a PR for this? > > On Thu, May 31, 2018 at 8:03 AM Matthias Baetens > wrote: > > > > Hey Eugene, hi all! > > > > Happy to say your talk is now on the Beam YouTube channel and can be > watched here. > > It'd be great to see more of these on

Re: [Proposal] Apache Beam Swag Store

We are very close to launching the store --- we should have news next week! On Fri, 1 Jun 2018 at 15:43 Ismaël Mejía wrote: > Any news on this ? > On Tue, Nov 7, 2017 at 1:46 AM Matthias Baetens > wrote: > > > > +1 > > Awesome stuff, thanks for the effort Gris! >

Re: [FYI] New Apache Beam Swag Store!

gt;>> > >>> > That's nice! >>> > >>> > More colors are appreciated :) >>> > >>> > --Mikhail >>> > >>> > >>> > On Sun, Jun 10, 2018 at 8:20 PM Kenneth Knowles >>> wrote: >>> >>

[YouTube channel] Add video: Apache Beam meetup London 2: use case in finance + IO in Beam and Splittable DoFns

Hi all, This is a proposal to launch the Apache Beam YouTube channel and at the same time add the first video to the channel. We would like to use the channel to centralize all videos / recordings related to Apache Beam and make it a community driven channel, so people have a one stop shop for

Re: [YouTube channel] Add video: Apache Beam meetup London 2: use case in finance + IO in Beam and Splittable DoFns

wrote: >>> >>>> +1 to the proposal >>>> >>>> @Matthias could you share more about the dynamics in how people in the >>>> community would be able to add videos and who would be owning the curation >>>> of the channel? >>>> >>&g

Re: [YouTube channel] Add video: Apache Beam meetup London 2: use case in finance + IO in Beam and Splittable DoFns

gmail.com> wrote: > How can people get access to the channel? > > Thanks, Gaurav > > On Wed, Feb 21, 2018 at 1:34 PM, Matthias Baetens < > matthias.baet...@datatonic.com> wrote: > >> Hi all, >> >> This is a proposal to launch the Apache Beam Yo

Beam Summit London 2018

Hi everyone, We are happy to invite you to the first Beam Summit in London. The summit will be held in London at Level39 on *October 1 and 2.* You can register to attend for free on the Eventbrite page

Re: [Proposal] Track non-code contributions in Jira

I fully agree and think it is a great idea. I think that, next to visibility and keeping track of everything that is going on in the community, the other goal would be documenting best practices for future use. I am also not sure, though, if JIRA is the best place to do so, as Austin raised.

Re: Beam Summit London 2018

on similar topic! >> Cheers, >> Pascal >> >> On Tue, Aug 21, 2018 at 1:59 PM, Matthias Baetens < >> baetensmatth...@gmail.com> wrote: >> >>> Hi everyone, >>> >>> We are happy to invite you to the first Beam Summit in London. >&

Re: Apache Beam Summit in Europe

minute, it would be great if you could fill this out (retweets are, of course, greatly appreciated as well). For the dates, we are thinking of: - 28-29/09 - 1-2/10 or 3-4/10 - 15-16/10 Happy to hear your preferences and comments. Best, Matthias On Thu, 31 May 2018 at 07:15 Matthias Baetens wrote

Re: [YouTube channel] Add video: Apache Beam meetup London 2: use case in finance + IO in Beam and Splittable DoFns

Are we good to go? Thanks, Matthias On Feb 23, 2018 19:12, "Matthias Baetens" <matthias.baet...@datatonic.com> wrote: > I have written a first proposal here > <https://docs.google.com/document/d/10RNWSU7wGyIOkOvlRbw47wsgkxX2-7G1OKmSlINREus/edit?usp=sharing>, &

Re: [YouTube channel] Add video: Apache Beam meetup London 2: use case in finance + IO in Beam and Splittable DoFns

s have done in different conferences, e.g. some of > the public available talks from the past by Frances/Tyler/others are > worth to be included so they can be easily found. (of course not sure > if we need approval from the speakers/confs to add a link to a > playlist (tbd). > > > On T

[YouTube channel] Add video: Apache Beam meetup London 3: Apache Beam meet up 3: Streaming SQL + Beam for ML use case + Beam in production

JIhZEvY1e>, with the following content: - How to launch and monitor your Beam pipelines in production by Victor Kotai - Using Beam to enable Machine Learning and predict congestion in London by Matthias Baetens - Foundations of Streaming SQL or: how I learned to ❤ streams & tables by Tyler Akidau Pl

Re: Beam Summit community feedback

Hey Max, Great stuff, thank you for sharing this. In case anyone has feedback on the summit as a whole, please feel free to fill out the survey as well. Thank you! Best regards, Matthias On Tue, 9 Oct 2018 at 10:48 Maximilian Michels wrote: > Thanks

Re: [ANNOUNCE] New committer announcement, Euphoria edition

Congrats David!!! On Thu, Nov 1, 2018, 16:04 Kenneth Knowles wrote: > Hi all, > > Please join me and the rest of the Beam PMC in welcoming a new committer: > > - David Morávek: of, but not limited to, the new Euphoria API > > Through his work with us merging the Euphoria API, community

Re: Agenda for the Beam Summit London 2018

u all soon! >>> Cheers, >>> Pascal >>> >>> On Sat, 29 Sep 2018, 18:13 Andrew Psaltis, >>> wrote: >>> >>>> Fantastic @Matthias . >>>> >>>> On Sat, Sep 29, 2018 at 7:07 AM Matthias Baetens < >>>>

Re: Agenda for the Beam Summit London 2018

Thanks a lot Thomas. I will announce the blogpost on the mailinglist for everyone to benefit :)! On Fri, 2 Nov 2018 at 14:19 Thomas Weise wrote: > Wow, great work! I just merged your PR. > > > On Fri, Nov 2, 2018 at 12:44 AM Matthias Baetens < > baetensmatth...@gmail.com>

Recordings and presentations from Beam Summit London 2018

Hi everyone, Very happy to be sharing the great materials from the speakers and contributors at the Beam Summit we had in London last month in the *new blogpost* on the website: https://beam.apache.org/blog/2018/10/31/beam-summit-aftermath.html You can find the full list of presentations and

Re: [Call for items] November Beam Newsletter

Looks great, thanks for the effort and for including the Summit blogpost, Rose! On Thu, 8 Nov 2018 at 22:55 Rose Nguyen wrote: > Hi Beamers: > > Time to sync with the community on all the awesome stuff we've been doing! > > *Add the highlights from October to now (or planned events and talks)

Re: [ANNOUNCEMENT] New Beam chair: Kenneth Knowles

Thank you for all the mentoring and work for the Apache Beam project, Davor. Welcome as a chair in the project Kenn, congratulations! On Thu, Sep 20, 2018, 22:58 Reuven Lax wrote: > Congratulations Kenn! > > On Thu, Sep 20, 2018 at 2:31 PM Griselda Cuevas wrote: > >> Thank you so much Davor

Re: Beam Summits!

Great stuff, thanks for the overview, Austin. For EU, there are things to say for both Stockholm and Berlin, but I think it makes sense to do it on the back of another conference (larger chance of people being in town with the same interest). I like Thomas comment - we will attract more people

Re: 2019 Beam Events

Great stuff, Gris! Looking forward to what 2019 will bring! The Beam meetup in London will have a new get together early next year as well :-) https://www.meetup.com/London-Apache-Beam-Meetup/ On Tue, 4 Dec 2018 at 23:50 Austin Bennett wrote: > Already got that process kicked off with the NY

Re: Stand at FOSDEM 2019

Hey Max, Great idea. I'd be very keen to join. I'll look at my calendar over the weekend to see if this would work. Are you going yourself? Cheers, Matthias On Thu, 29 Nov 2018 at 11:06 Maximilian Michels wrote: > Hi, > > For everyone who might be attending FOSDEM19: What do you think about >

Re: Bay Area Apache Beam Kickoff!

Awesome effort awesome - good luck on the first meetup! :) On Tue, 20 Nov 2018 at 01:37 Austin Bennett wrote: > We have our first meetup scheduled for December 12th in San Francisco. > > Andrew Pilloud, a software engineer at Google and Beam committer, will > demo the latest feature in Beam

Re: JB's back

Good to have you back JB! On Wed, Nov 21, 2018, 06:06 Kenneth Knowles wrote: > Yes, welcome back! > > On Tue, Nov 20, 2018 at 9:51 PM Ahmet Altay wrote: > >> Welcome back! >> >> On Tue, Nov 20, 2018 at 9:11 PM, Jean-Baptiste Onofré >> wrote: >> >>> Hi guys, >>> >>> Sorry to have been quiet

Re: Beam Summits!

@Reza Rokni : I was planning to reach out to you for the Asian edition of the Summit - do you think Singapore would make sense? On Mon, 7 Jan 2019 at 07:25, Matthias Baetens wrote: > Hey Austin, > > Yes, it would be good to get going soon. We started approx. 3 months > before th

Re: Beam Summits!

ntioned planning London wound up with a tight time window. >> If shooting for April in SF, seems the clock might be starting to tick. >> Any advice for how much time needed? And guidance on getting whatever >> formal needed through Apache - and does this also necessarily involv

Re: [ANNOUNCE] New committer announcement: Michael Luckey

Welcome, Michael! :) On Mon, 4 Mar 2019 at 18:03, Joana Filipa Bernardo Carrasqueira < joanafil...@google.com> wrote: > Congratulations Michael!! Welcome! > > On Thu, Feb 28, 2019 at 3:55 PM Daniel Oliveira > wrote: > >> Congrats Michael! >> >> On Thu, Feb 28, 2019 at 3:12 AM Maximilian Michels

Beam Summit Europe 2019: CfP

Hi everyone, As you might already know, the *Beam Summit Europe 2019* will take place in *Berlin* this year on *19-20 June*! Of course, we would love to have you there. That is why we are opening the *Call for Speakers .* We are looking for people

Re: Apache Beam Newsletter - February/March 2019

Adding my 2 cents: +1 for adding News to the repository. I agree with Alexey in that News is different from blogpost (tend to be bigger and might have technical content and/or debriefs from events). Tying newsletter to releases also don't fully make sense from an event point of view - these don't

Re: [Announcement] New Website for Beam Summits

Awesome Aizhamal! Great work and thanks for your continued efforts on this :) Looking forward to the summit. On Mon, 18 Mar 2019 at 23:17, Aizhamal Nurmamat kyzy wrote: > Hello everybody! > > We are thrilled to announce the launch of beamsummit.org dedicated to > Beam Summits! > > The current

Beam meetup London at Revolut 03/04/2019

Hi everyone, On Wednesday 03/04, we will have the next Beam meetup in London at the Revolut offices. Robert Bradshaw will do a deep dive on portability, while Revolut will present its use-case on using Beam for fraud detection. More info and RSVP on the meetup page

Re: hi from DevRel land

It's great to have you on board, Rez! To join in on what Kenn was saying: great to have worked on challenging problems with you in the past, it's going to be very helpful to have your experience added to the project! -Matthias On Thu, Mar 14, 2019, 04:06 Connell O'Callaghan wrote: > Welcome on

Re: Another another new contributor! :)

Welcome, good to have you Kyle! On Fri, 8 Feb 2019 at 00:43, Joana Filipa Bernardo Carrasqueira < joanafil...@google.com> wrote: > Welcome to the community Kyle! > > > On Thu, Feb 7, 2019 at 1:22 AM Alexey Romanenko > wrote: > >> Welcome, Kyle! >> Great to have more people on SparkRunner side!

Re: Beam Meetups Feb 2019

Wow, that is awesome, Joana! Great job to everyone involved! :-) On Fri, 8 Feb 2019 at 22:42, Joana Filipa Bernardo Carrasqueira < joanafil...@google.com> wrote: > Hi all, > > I would like to take a moment to acknowledge the fact that yesterday we > had nearly 300 people at the Beam Meetup at

Re: Beam Python streaming pipeline on Flink Runner

reads including pubsub are not yet supported for > portable runners. > > Thanks, > Ankur > > On Thu, Jan 31, 2019 at 2:44 PM Matthias Baetens < > baetensmatth...@gmail.com> wrote: > >> Hi everyone, >> >> Last few days I have been trying to run a streaming

Beam Python streaming pipeline on Flink Runner

Hi everyone, Last few days I have been trying to run a streaming pipeline (code on Github ) on a Flink Runner. I am running a Flink cluster locally (v1.5.6 ) I have built the SDK Harness Container: *./gradlew

Beam Summit volunteering team

Hi everyone, As you might know, the Beam Summit is currently organised by a small team of people committing their free time to make this happen. We are looking to make this group larger in the future and particularly could use some help on website maintenance,

Re: [Announcement] New Website for Beam Summits

:lgaj...@apache.org>> wrote: >>> > >>> > Looks great! Thanks for doing this! :) >>> > >>> > Łukasz >>> > >>> > wt., 19 mar 2019 o 12:30 Maximilian Michels >> > <mailto:m...@apache.org>> n

Beam Summit Europe: speakers and schedule online!

Hi everyone, Happy to share that the speakers and schedule are now online on the website. Make sure you register on Eventbrite if you want to attend and follow out Twitter channel

Re: Hello from Hannah Jiang

Welcome to the community! On Thu, Apr 25, 2019, 18:55 Griselda Cuevas wrote: > Welcome Hannah! - Very excited to see you in the Beam community :) > > On Tue, 23 Apr 2019 at 12:59, Hannah Jiang wrote: > >> Hi everyone >> >> I joined Google recently and would work on Python portability part. I

Meetups in London, Stockholm + recordings

Hi everyone, Happy to announce 2 meetups for the next week(s): - *London *is having its second meetup of the year on *01/05/2019 in Level39, Canary Wharf

Re: [Discuss] Ideas for Apache Beam presence in social media

gt; On Tue, Oct 22, 2019, 12:51 AM Matthias Baetens > wrote: > >> Thanks Thomas. >> >> Happy to help on the doc side when I find some time :) I'll give you a >> ping when I have the PR ready! >> >> On Mon, Oct 14, 2019, 20:07 Thomas Weise wrote: >>

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

In case I'm not too late: [ ] Beaver [ ] Hedgehog [ ] Lemur [ ] Owl [ ] Salmon [ ] Trout [ ] Robot dinosaur [X ] Firefly [ ] Cuttlefish [X ] Dumbo Octopus [ ] Angler fish I like angler fish a lot, but I think no one will join any meetups since they're scary as hell haha On Sun, Nov 24, 2019,

Re: Beam Summit Videos in youtube

Hi Chad, Apologies for the delay here. We are post-processing the videos into something that is more watchable, but happy to share the raw videos if that is something you are interested in. Which sessions specifically can we help with? :) Best regards, Matthias On Mon, 7 Oct 2019 at 10:00,

Re: Feedback on how we use Apache Beam in my company

This is great, Pierre! Thank you for sharing, very interesting. Would you and your team be interested to talk about your use case at a meetup (or Summit) in the future? :) All the best, Matthias On Wed, 9 Oct 2019 at 15:59, Etienne Chauchot wrote: > Very nice ! > > Thanks > > ccing dev list >

Re: [Discuss] Ideas for Apache Beam presence in social media

Hi all, Picking up this thread, since I wanted to use this facility and help drive this if necessary. I saw the sheet has now comment access enabled. Did we decide / document the desired process on the website? I am happy to testdrive that process and submit a PR if successful. Many thanks,

Re: Please comment on draft comms strategy by Oct 16

To make things more concrete, we could start by giving the YouTube channel more structure & drafting Tweets to go out on the different channels. Is this something you'd be able to help out with? Thanks! Matthias On Sun, 16 Feb 2020 at 10:29, Matthias Baetens wrote: > Hey Maria, > &g

Re: Please comment on draft comms strategy by Oct 16

Hey Maria, Great work!! This provides a nice overview of all the channels and how they contribute to the overall project. I will comment on the sections I am most familiar with: - Website / blog: +1 for reducing the number of outlets to 1. The Beam Summit website repository could use a clean-up

Beam Summit North America 2019 - recordings

Hi everyone, It's our pleasure to share the recordings from the Beam Summit North America 2019. Please find them in the YouTube playlist on the Apache Beam channel

New Dates For Beam Summit Digital 2020

, Austin Bennett, Matthias Baetens, Alex Van Boxel

Re: Beam summit update on blog?

+1 totally. I was thinking a retweet of the Beam Summit recording on the Apache Beam channel would be helpful as well - but I'm happy to look into doing a blogpost as well! On Tue, Sep 22, 2020, 04:25 Ahmet Altay wrote: > Would it make sense to publish a blog post and a tweet about the Beam >

Re: Beam summit update on blog?

Sure! I'm out on holidays at the moment, but will pick it up sometime next week - we can brainstorm a bit and see how we can get something done together if you'd like! :) On Tue, 22 Sep 2020 at 20:31, Ahmet Altay wrote: > > > On Mon, Sep 21, 2020 at 10:05 PM Matthias Baetens < &g

Re: Companies using Beam?

Oops, just saw you linked it earlier Aizhamal. Is it still open for input? On Mon, 25 May 2020 at 09:20, Matthias Baetens wrote: > I think this is a great idea. We could support the page with relevant > Meetup / Summit talks as well. > > Is there a place where we the website redes

Re: Companies using Beam?

I think this is a great idea. We could support the page with relevant Meetup / Summit talks as well. Is there a place where we the website redesign is being planned and where we can contribute ideas or discuss the structure of such a page? On Fri, 1 May 2020 at 20:00, Aizhamal Nurmamat kyzy

Re: October 2020, Beam Community Update

This is really awesome indeed, Brittany :) If I could only read Alexey's mind, but my hunch is that this could come in blogpost format on the website (as well) and sharing it on the Twitter handle? On Tue, 3 Nov 2020 at 20:54, Pablo Estrada wrote: > Hi Alexey, > Do you have any other place in