Re: October 2020, Beam Community Update

[Matthias Baetens]

This is really awesome indeed, Brittany :)

If I could only read Alexey's mind, but my hunch is that this could come in
blogpost format on the website (as well) and sharing it on the Twitter
handle?

On Tue, 3 Nov 2020 at 20:54, Pablo Estrada  wrote:

> Hi Alexey,
> Do you have any other place in mind? I don't think Brittany has current
> plans to publish this elsewhere, but if you have any good ideas, I imagine
> she could consider them : )
> Best
> -P.
>
> On Tue, Nov 3, 2020 at 8:23 AM Alexey Romanenko 
> wrote:
>
>> Thanks for doing this!
>>
>> Is it going to be published somewhere else than only the mailing lists?
>>
>> On 31 Oct 2020, at 00:03, Brittany Hermann  wrote:
>>
>> Hi everyone,
>>
>> Attached is the October 2020 Beam Community Update. The purpose of this
>> newsletter is purely community focused - giving folks the visibility to the
>> insights of the health and growth of the community. This newsletter will
>> not cover project releases or feature updates. Please let me know if you
>> have any questions and feedback is welcome!
>>
>>
>> https://docs.google.com/document/d/1_t6xKoOQVwgn2edmRVh1ViudmbnNM3BwZyguKAwwjfA/edit?usp=sharing
>>
>>
>>
>>
>>
>>

Re: Beam summit update on blog?

[Matthias Baetens]

Sure! I'm out on holidays at the moment, but will pick it up sometime next
week - we can brainstorm a bit and see how we can get something done
together if you'd like! :)

On Tue, 22 Sep 2020 at 20:31, Ahmet Altay  wrote:

>
>
> On Mon, Sep 21, 2020 at 10:05 PM Matthias Baetens <
> baetensmatth...@gmail.com> wrote:
>
>> +1 totally. I was thinking a retweet of the Beam Summit recording on the
>> Apache Beam channel would be helpful as well - but I'm happy to look into
>> doing a blogpost as well!
>>
>
> Great, thank you Matthias. I did not help much with this summit so I am
> probably lacking context. But I am happy to help with a post as much as I
> can.
>
>
>>
>> On Tue, Sep 22, 2020, 04:25 Ahmet Altay  wrote:
>>
>>> Would it make sense to publish a blog post and a tweet about the Beam
>>> Summit 2020 with some highlights and links to videos? There are many hours
>>> of video content. This is great and a social media shareable post / tweet
>>> could help with promoting this content.
>>>
>>> Ahmet
>>>
>>

Re: Beam summit update on blog?

[Matthias Baetens]

+1 totally. I was thinking a retweet of the Beam Summit recording on the
Apache Beam channel would be helpful as well - but I'm happy to look into
doing a blogpost as well!

On Tue, Sep 22, 2020, 04:25 Ahmet Altay  wrote:

> Would it make sense to publish a blog post and a tweet about the Beam
> Summit 2020 with some highlights and links to videos? There are many hours
> of video content. This is great and a social media shareable post / tweet
> could help with promoting this content.
>
> Ahmet
>

Re: Companies using Beam?

[Matthias Baetens]

Oops, just saw you linked it earlier Aizhamal. Is it still open for input?

On Mon, 25 May 2020 at 09:20, Matthias Baetens 
wrote:

> I think this is a great idea. We could support the page with relevant
> Meetup / Summit talks as well.
>
> Is there a place where we the website redesign is being planned and where
> we can contribute ideas or discuss the structure of such a page?
>
> On Fri, 1 May 2020 at 20:00, Aizhamal Nurmamat kyzy 
> wrote:
>
>> Another example of similar pages:
>> https://www.instaclustr.com/resource-type/case-studies/. The whole
>> resources section is very useful. It would be good for Beam to have links
>> to webinars, meetups, books, whitepapers, etc. from the website where new
>> users land.
>> Simpler example: https://flink.apache.org/poweredby.html . It shows
>> snippets and links to external (mostly) resources. Seems easier to manage.
>>
>>
>> On Fri, May 1, 2020 at 6:28 AM Kenneth Knowles  wrote:
>>
>>> +1 to a "Powered By" style page. These are pretty common. Like
>>> https://calcite.apache.org/docs/powered_by.html
>>>
>>> I think applying a designer's skills might result in something a bit
>>> cooler looking...
>>>
>>> Kenn
>>>
>>> On Thu, Apr 30, 2020 at 9:24 AM Austin Bennett <
>>> whatwouldausti...@gmail.com> wrote:
>>>
>>>> A first pass, something like:
>>>>
>>>> https://druid.apache.org/druid-powered
>>>> https://spark.apache.org/powered-by.html
>>>>
>>>> or even as simple as:
>>>> https://github.com/apache/airflow#who-uses-apache-airflow
>>>>
>>>> Would go a long way in the sorts of very high-level conversations I'm
>>>> having around technology adoption/standardization.
>>>>
>>>> Getting into more specifics/testimonials/case-studies is also great,
>>>> but I wouldn't expect those to get looked at by most, until passing the
>>>> first bar of seeming to having a significant adoption.
>>>>
>>>> @Aizhamal Nurmamat kyzy   - happy to contribute
>>>> as I can.
>>>>
>>>> On Tue, Apr 28, 2020 at 10:13 PM Jean-Baptiste Onofre 
>>>> wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> We already have some testimonials on Beam home page (I did the one
>>>>> about Beam use at Talend).
>>>>>
>>>>> It makes sense to have a dedicated section as it gives ideas about use
>>>>> case and production system running with Beam.
>>>>>
>>>>> Regards
>>>>> JB
>>>>>
>>>>> > Le 28 avr. 2020 à 23:42, Austin Bennett 
>>>>> a écrit :
>>>>> >
>>>>> > Hi All,
>>>>> >
>>>>> > Have we considered getting onto our website or our our GitHub repo
>>>>> the ability for individuals to share that their company is using Beam?
>>>>> Seeing - what I believe to be a reasonable list of - companies 
>>>>> productively
>>>>> using Beam would be helpful to point others to.  For instance, a common
>>>>> question I get is whether anyone or who is using?  I'm not sure that's the
>>>>> best metric or datapoint in many cases for adoption, but a heuristic that
>>>>> some rely upon.
>>>>> >
>>>>> > Naturally, we could ask for a roll-call, esp. via user list, but
>>>>> imagining  a persistent web-list would be of interest.
>>>>> >
>>>>> > Cheers,
>>>>> > Austin
>>>>> >
>>>>> >
>>>>> > P.S.  If putting such a list into our repo, that would also get some
>>>>> people to submit PRs (so more contributors!) :-)
>>>>> >
>>>>> >
>>>>>
>>>>>

Re: Companies using Beam?

[Matthias Baetens]

I think this is a great idea. We could support the page with relevant
Meetup / Summit talks as well.

Is there a place where we the website redesign is being planned and where
we can contribute ideas or discuss the structure of such a page?

On Fri, 1 May 2020 at 20:00, Aizhamal Nurmamat kyzy 
wrote:

> Another example of similar pages:
> https://www.instaclustr.com/resource-type/case-studies/. The whole
> resources section is very useful. It would be good for Beam to have links
> to webinars, meetups, books, whitepapers, etc. from the website where new
> users land.
> Simpler example: https://flink.apache.org/poweredby.html . It shows
> snippets and links to external (mostly) resources. Seems easier to manage.
>
>
> On Fri, May 1, 2020 at 6:28 AM Kenneth Knowles  wrote:
>
>> +1 to a "Powered By" style page. These are pretty common. Like
>> https://calcite.apache.org/docs/powered_by.html
>>
>> I think applying a designer's skills might result in something a bit
>> cooler looking...
>>
>> Kenn
>>
>> On Thu, Apr 30, 2020 at 9:24 AM Austin Bennett <
>> whatwouldausti...@gmail.com> wrote:
>>
>>> A first pass, something like:
>>>
>>> https://druid.apache.org/druid-powered
>>> https://spark.apache.org/powered-by.html
>>>
>>> or even as simple as:
>>> https://github.com/apache/airflow#who-uses-apache-airflow
>>>
>>> Would go a long way in the sorts of very high-level conversations I'm
>>> having around technology adoption/standardization.
>>>
>>> Getting into more specifics/testimonials/case-studies is also great, but
>>> I wouldn't expect those to get looked at by most, until passing the first
>>> bar of seeming to having a significant adoption.
>>>
>>> @Aizhamal Nurmamat kyzy   - happy to contribute as
>>> I can.
>>>
>>> On Tue, Apr 28, 2020 at 10:13 PM Jean-Baptiste Onofre 
>>> wrote:
>>>
 Hi,

 We already have some testimonials on Beam home page (I did the one
 about Beam use at Talend).

 It makes sense to have a dedicated section as it gives ideas about use
 case and production system running with Beam.

 Regards
 JB

 > Le 28 avr. 2020 à 23:42, Austin Bennett 
 a écrit :
 >
 > Hi All,
 >
 > Have we considered getting onto our website or our our GitHub repo
 the ability for individuals to share that their company is using Beam?
 Seeing - what I believe to be a reasonable list of - companies productively
 using Beam would be helpful to point others to.  For instance, a common
 question I get is whether anyone or who is using?  I'm not sure that's the
 best metric or datapoint in many cases for adoption, but a heuristic that
 some rely upon.
 >
 > Naturally, we could ask for a roll-call, esp. via user list, but
 imagining  a persistent web-list would be of interest.
 >
 > Cheers,
 > Austin
 >
 >
 > P.S.  If putting such a list into our repo, that would also get some
 people to submit PRs (so more contributors!) :-)
 >
 >

New Dates For Beam Summit Digital 2020

[Matthias Baetens]

Dear Beam community,

A few weeks ago, we announced the dates for the Beam Digital Summit and we
know the community received this news with excitement. This is a great
opportunity to create and share content about streaming analytics and the
solutions that teams around the world have created using Apache Beam and
its ecosystem.

We have chosen August 24-28th as the new dates. While this has been a
difficult decision, we think it’s the right decision to ensure we produce
the best possible event. We encourage you to send your talk proposals,
anything from use cases, lightning talks, or workshop ideas.

Based on this change, the CFP will remain open until June 15th. We would
love to hear about what you are doing with Beam, how to improve it, and how
to strengthen our community.

We thank you for your understanding! See you soon!

-Griselda Cuevas, Brittany Hermann, Maximilian Michels, Austin Bennett,
Matthias Baetens, Alex Van Boxel

Re: Please comment on draft comms strategy by Oct 16

[Matthias Baetens]

To make things more concrete, we could start by giving the YouTube channel
more structure & drafting Tweets to go out on the different channels. Is
this something you'd be able to help out with?

Thanks!
Matthias

On Sun, 16 Feb 2020 at 10:29, Matthias Baetens 
wrote:

> Hey Maria,
>
> Great work!! This provides a nice overview of all the channels and how
> they contribute to the overall project.
>
> I will comment on the sections I am most familiar with:
> - Website / blog: +1 for reducing the number of outlets to 1. The Beam
> Summit website repository could use a clean-up and this can be part of that
> effort.
> - Workshops: Pablo & Austin have done some great work in this space, but
> even more dedicated time & attention to this would greatly benefit the
> project - and as Pablo raised this might be separate from project
> transparency but directly contribute to increased usage.
> -- For topics/format, it's split up in how to use and how to contribute.
> How to use I would split up in a beginner training ("set-up and write your
> first pipeline"), advanced training ("use some of the more exotic Beam
> features / optimise your pipeline") and office hours (solve specific
> problems people have which can feedback to the development team as well in
> terms of missing features or potential improvement of documentation). Imho,
> classroom style with an intro to Beam and concepts / advanced topics,
> combined with do-it-yourself where people actually do some coding with
> something to walk away is good for onboarding. A more fun and game-like
> set-up can be done for users that already use Beam where we can accommodate
> discussions or have them solve a specific use-case in groups.
> - +1 for increased distribution of the talks. We should actively engage
> the speakers as well to share it on their personal channels, and surface
> the talks on the website and Twitter handles. Also a curated list as
> blogpost would be a great addition.
>
> I think a more consistent feedback mechanism and maybe idea box at events
> might also benefit the community.
>
> Cheers,
> Matthias
>
>
> On Wed, 15 Jan 2020 at 22:46, Austin Bennett 
> wrote:
>
>> Hi Kenn,
>>
>> We had workshop on this very topic (how to contribute to Beam) at our
>> Berlin Summit:  https://www.youtube.com/watch?v=PtPslSdAPcM There's is
>> certainly room for me (or anyone) to cleanup and formalize that a bit
>> more.  Though, the views of that are relatively small, which either indeed
>> points to a lack of appetite and/or that it wasn't well publicized (I
>> suspect both).
>>
>> Cheers,
>> Austin
>>
>> On Thu, Jan 9, 2020 at 6:53 PM Kenneth Knowles  wrote:
>>
>>> Wow, this is great work. I looked at the graphical maps when you sent
>>> them but forgot to reply on thread. They really distill a lot of
>>> possibilities and help to think about the current state.
>>>
>>> These three action items seem good and doable. Thanks for highlighting
>>> those. The only one that isn't obvious to me is "workshop on how to
>>> contribute to Beam". Is there enough appetite / audience to make this a
>>> workshop? What forms could this take? A live coding demonstration in a
>>> normal talk slot at an OSS or data conference seems like a possibility.
>>> Whatever we do, we should record and distribute for sure, because when
>>> someone wants to contribute, they need to find the resources at that moment.
>>>
>>> Kenn
>>>
>>> On Wed, Jan 8, 2020 at 1:01 PM María Cruz  wrote:
>>>
>>>> Hi everyone,
>>>> I'm writing to send an update about the communication strategy for
>>>> Beam. In a nutshell, I have 3 proposed changes (copied from the md file
>>>> here:
>>>> https://github.com/macruzbar/beam/blob/master/Communication-strategy-DRAFT.md
>>>> ).
>>>>
>>>> While all the channels are connected to a specific function in the
>>>> short, medium, and long term, some areas have redundancies, and some other
>>>> areas could use more exposure. In order to continue to grow the project,
>>>> there are 3 proposals we need to focus on (click on the link on each
>>>> section to read more):
>>>>
>>>> 1. Blog post categories, frequency and distribution.
>>>> <https://github.com/macruzbar/beam/blob/master/Communication-strategy-DRAFT.md#proposal-1-blog-post-categories-frequency-and-distribution>
>>>>  Reduce
>>>> to one blogging space (on Beam Website). Incorporate 3 categories to the
>>>> blog

Re: Please comment on draft comms strategy by Oct 16

[Matthias Baetens]

Hey Maria,

Great work!! This provides a nice overview of all the channels and how they
contribute to the overall project.

I will comment on the sections I am most familiar with:
- Website / blog: +1 for reducing the number of outlets to 1. The Beam
Summit website repository could use a clean-up and this can be part of that
effort.
- Workshops: Pablo & Austin have done some great work in this space, but
even more dedicated time & attention to this would greatly benefit the
project - and as Pablo raised this might be separate from project
transparency but directly contribute to increased usage.
-- For topics/format, it's split up in how to use and how to contribute.
How to use I would split up in a beginner training ("set-up and write your
first pipeline"), advanced training ("use some of the more exotic Beam
features / optimise your pipeline") and office hours (solve specific
problems people have which can feedback to the development team as well in
terms of missing features or potential improvement of documentation). Imho,
classroom style with an intro to Beam and concepts / advanced topics,
combined with do-it-yourself where people actually do some coding with
something to walk away is good for onboarding. A more fun and game-like
set-up can be done for users that already use Beam where we can accommodate
discussions or have them solve a specific use-case in groups.
- +1 for increased distribution of the talks. We should actively engage the
speakers as well to share it on their personal channels, and surface the
talks on the website and Twitter handles. Also a curated list as blogpost
would be a great addition.

I think a more consistent feedback mechanism and maybe idea box at events
might also benefit the community.

Cheers,
Matthias


On Wed, 15 Jan 2020 at 22:46, Austin Bennett 
wrote:

> Hi Kenn,
>
> We had workshop on this very topic (how to contribute to Beam) at our
> Berlin Summit:  https://www.youtube.com/watch?v=PtPslSdAPcM There's is
> certainly room for me (or anyone) to cleanup and formalize that a bit
> more.  Though, the views of that are relatively small, which either indeed
> points to a lack of appetite and/or that it wasn't well publicized (I
> suspect both).
>
> Cheers,
> Austin
>
> On Thu, Jan 9, 2020 at 6:53 PM Kenneth Knowles  wrote:
>
>> Wow, this is great work. I looked at the graphical maps when you sent
>> them but forgot to reply on thread. They really distill a lot of
>> possibilities and help to think about the current state.
>>
>> These three action items seem good and doable. Thanks for highlighting
>> those. The only one that isn't obvious to me is "workshop on how to
>> contribute to Beam". Is there enough appetite / audience to make this a
>> workshop? What forms could this take? A live coding demonstration in a
>> normal talk slot at an OSS or data conference seems like a possibility.
>> Whatever we do, we should record and distribute for sure, because when
>> someone wants to contribute, they need to find the resources at that moment.
>>
>> Kenn
>>
>> On Wed, Jan 8, 2020 at 1:01 PM María Cruz  wrote:
>>
>>> Hi everyone,
>>> I'm writing to send an update about the communication strategy for Beam.
>>> In a nutshell, I have 3 proposed changes (copied from the md file here:
>>> https://github.com/macruzbar/beam/blob/master/Communication-strategy-DRAFT.md
>>> ).
>>>
>>> While all the channels are connected to a specific function in the
>>> short, medium, and long term, some areas have redundancies, and some other
>>> areas could use more exposure. In order to continue to grow the project,
>>> there are 3 proposals we need to focus on (click on the link on each
>>> section to read more):
>>>
>>> 1. Blog post categories, frequency and distribution.
>>> 
>>>  Reduce
>>> to one blogging space (on Beam Website). Incorporate 3 categories to the
>>> blog: Apache Beam summit, Apache Beam use cases, and Your journey as a
>>> contributor.
>>>
>>> 2. Develop more in-person and digital workshops.
>>> 
>>>  Two
>>> workshop types: how to use Beam, and how to contribute to Beam.
>>>
>>> 3. Increase distribution of tech talks.
>>> 
>>>
>>>- Embed tech talks in the Beam website, and the Beam Summit website,
>>>- Share talks on @ApacheBeam Twitter handle
>>>- Curate a list of talks by topic, and write blog posts to share
>>>curated talks (1 blog every 3 months),
>>>- Distribute copy via email to users@ and dev@ mailing lists.
>>>- Create playlists on YouTube channel. Create one view for
>>>subscribed users (featuring latest content), and one for non-subscribed
>>>users 

Beam Summit North America 2019 - recordings

[Matthias Baetens]

Hi everyone,

It's our pleasure to share the recordings from the Beam Summit North
America 2019.
Please find them in the YouTube playlist

on the Apache Beam channel
.

Best regards,
Matthias

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

[Matthias Baetens]

In case I'm not too late:

[ ] Beaver
[ ] Hedgehog
[ ] Lemur
[ ] Owl
[ ] Salmon
[ ] Trout
[ ] Robot dinosaur
[X ] Firefly
[ ] Cuttlefish
[X ] Dumbo Octopus
[ ] Angler fish

I like angler fish a lot, but I think no one will join any meetups since
they're scary as hell haha


On Sun, Nov 24, 2019, 04:27 Kenneth Knowles  wrote:

> David - if you can reconfigure the form so it is not anonymous (at least
> to me) then I may be up for including those results in the tally. I don't
> want to penalize those who voted via the form. But since there are now two
> voting channels we have to dedupe or discard the form results. And I need
> to be able to see which votes are PMC. Even if advisory, it does need to
> move to a concluding vote, and PMC votes could be a tiebreaker of sorts.
>
> Kenn
>
> On Sat, Nov 23, 2019 at 7:17 PM Kenneth Knowles  wrote:
>
>> On Fri, Nov 22, 2019 at 10:24 AM Robert Bradshaw 
>> wrote:
>>
>>> On Thu, Nov 21, 2019 at 7:05 PM David Cavazos 
>>> wrote:
>>>


 I created this Google Form
 
 if everyone is okay with it to make it easier to both vote and view the
 results :)

>>>
>>> Generally decisions, especially votes, for apache projects are supposed
>>> to happen on-list. I suppose this is more an advisory vote, but still
>>> probably makes sense to keep it here. .
>>>
>>
>> Indeed. Someone suggested a Google form before I started this, but I
>> deliberately didn't use it. It doesn't add much and it puts the vote off
>> list onto opaque and mutable third party infrastructure.
>>
>> If you voted on the form, please repeat it on thread so I can count it.
>>
>> Kenn
>>
>>
>>
>> import collections, pprint, re, requests
>>> thread = requests.get('
>>> https://lists.apache.org/api/thread.lua?id=ff60eabbf8349ba6951633869000356c2c2feb48bbff187cf3c60039@%3Cdev.beam.apache.org%3E').json(
>>> )
>>> counts = collections.defaultdict(int)
>>> for email in thread['emails']:
>>>   body = requests.get('https://lists.apache.org/api/email.lua?id=%s' %
>>> email['mid']).json()['body']
>>>   for vote in re.findall(r'\n\s*\[\s*[xX]\s*\]\s*([a-zA-Z ]+)', body):
>>> counts[vote] += 1
>>>   pprint.pprint(sorted(counts.items(), key=lambda kv: kv[-1]))
>>>
>>> ...
>>>
>>> [('Beaver', 1),
>>>
>>>  ('Capybara', 2),
>>>
>>>  ('Trout', 2),
>>>
>>>  ('Salmon', 4),
>>>
>>>  ('Dumbo Octopus', 7),
>>>
>>>  ('Robot dinosaur', 9),
>>>
>>>  ('Hedgehog', 10),
>>>
>>>  ('Cuttlefish', 11),
>>>
>>>  ('Angler fish', 12),
>>>
>>>  ('Lemur', 14),
>>>
>>>  ('Owl', 15),
>>>
>>>  ('Firefly', 17)]
>>>
>>>
>>>

 On Thu, Nov 21, 2019 at 6:18 PM Vinay Mayar 
 wrote:

> [ ] Beaver
> [ ] Hedgehog
> [ ] Lemur
> [ ] Owl
> [ ] Salmon
> [ ] Trout
> [ ] Robot dinosaur
> [ ] Firefly
> [ ] Cuttlefish
> [x] Dumbo Octopus
> [ ] Angler fish
>
> On Thu, Nov 21, 2019 at 6:14 PM Chamikara Jayalath <
> chamik...@google.com> wrote:
>
>> [X] Beaver
>> [ ] Hedgehog
>> [ ] Lemur
>> [X] Owl
>> [ ] Salmon
>> [ ] Trout
>> [ ] Robot dinosaur
>> [ ] Firefly
>> [X ] Cuttlefish
>> [X ] Dumbo Octopus
>> [ X] Angler fish
>>
>> Thanks,
>> Cham
>>
>> On Thu, Nov 21, 2019 at 1:43 PM Michał Walenia <
>> michal.wale...@polidea.com> wrote:
>>
>>> [X] Beaver
>>> [ ] Hedgehog
>>> [X] Lemur
>>> [X] Owl
>>> [ ] Salmon
>>> [ ] Trout
>>> [X] Robot dinosaur
>>> [X] Firefly
>>> [ ] Cuttlefish
>>> [ ] Dumbo Octopus
>>> [ ] Angler fish
>>>
>>> On Thu, Nov 21, 2019 at 1:11 PM Aizhamal Nurmamat kyzy <
>>> aizha...@apache.org> wrote:
>>>
 [ ] Beaver
 [X] Hedgehog
 [ ] Lemur
 [ ] Owl
 [ ] Salmon
 [ ] Trout
 [ ] Robot dinosaur
 [ ] Firefly
 [X] Cuttlefish
 [ ] Dumbo Octopus
 [ ] Angler fish

 On Thu, Nov 21, 2019 at 11:21 AM Robert Burke 
 wrote:

> [ X] Beaver
> [] Hedgehog
> [ x] Lemur
> [ X] Owl
> [ ] Salmon
> [ ] Trout
> [ ] Robot dinosaur
> [X ] Firefly
> [ X] Cuttlefish
> [x ] Dumbo Octopus
> [X ] Angler fish
>
> On Thu, Nov 21, 2019, 9:33 AM Łukasz Gajowy <
> lukasz.gaj...@gmail.com> wrote:
>
>> [ ] Beaver
>> [ ] Hedgehog
>> [x] Lemur
>> [x] Owl
>> [ ] Salmon
>> [ ] Trout
>> [x] Robot dinosaur!
>> [ ] Firefly
>> [ ] Cuttlefish
>> [ ] Dumbo Octopus
>> [ ] Angler fish
>>
>> czw., 21 lis 2019 o 00:44 Augustin Lafanechere <
>> augustin.lafanech...@kapten.com> napisał(a):
>>
>>> [ ] Beaver
>>> [ ] Hedgehog
>>> [ ] Lemur
>>> [ ] Owl
>>> [x] Salmon

Re: [Discuss] Ideas for Apache Beam presence in social media

[Matthias Baetens]

Awesome Aizhamal :) Lmk if I can be of any help!

On Mon, Oct 28, 2019, 11:14 Aizhamal Nurmamat kyzy 
wrote:

> Thank you Matthias,
>
> I was supposed to write up the documentation.. sorry this got slipped
> through the cracks. I will prepare the PR until the end of the week.
>
> On Tue, Oct 22, 2019, 12:51 AM Matthias Baetens 
> wrote:
>
>> Thanks Thomas.
>>
>> Happy to help on the doc side when I find some time :) I'll give you a
>> ping when I have the PR ready!
>>
>> On Mon, Oct 14, 2019, 20:07 Thomas Weise  wrote:
>>
>>> Matthias,
>>>
>>> The process is already in use, but it would be nice to have it
>>> documented also.
>>>
>>> I gave you edit access to the spreadsheet, since working with the
>>> comments is cumbersome and sheets does not have suggestions.
>>>
>>> Thanks
>>>
>>>
>>> On Fri, Oct 11, 2019 at 11:59 PM Matthias Baetens <
>>> baetensmatth...@gmail.com> wrote:
>>>
>>>> Hi all,
>>>>
>>>> Picking up this thread, since I wanted to use this facility and help
>>>> drive this if necessary.
>>>>
>>>> I saw the sheet has now comment access enabled. Did we decide /
>>>> document the desired process on the website? I am happy to testdrive that
>>>> process and submit a PR if successful.
>>>>
>>>> Many thanks,
>>>> Matthias
>>>>
>>>> On Tue, 13 Aug 2019 at 01:49, Thomas Weise  wrote:
>>>>
>>>>> Yes, everyone should have comment access for this to make sense. Sorry
>>>>> for the confusion.
>>>>>
>>>>>
>>>>> On Mon, Aug 12, 2019 at 5:30 PM Kenneth Knowles 
>>>>> wrote:
>>>>>
>>>>>> Thanks for setting this up. It is nice to start building up a system
>>>>>> for this so everyone can participate.
>>>>>>
>>>>>> Regarding Jira versus notifications, how are people with only view
>>>>>> access to make suggestions for tweets? When I suggested gdocs, I meant 
>>>>>> for
>>>>>> everyone to have "comment" access, so then anyone can subscribe to all
>>>>>> comments, which would include suggestions. This allows anyone to suggest
>>>>>> tweets and anyone to subscribe to suggestions.
>>>>>>
>>>>>> Kenn
>>>>>>
>>>>>> On Wed, Aug 7, 2019 at 4:07 PM Aizhamal Nurmamat kyzy <
>>>>>> aizha...@google.com> wrote:
>>>>>>
>>>>>>> Thanks Thomas, changed the doc to view only and granted you and
>>>>>>> Ahmet edit access.
>>>>>>> @all - please send requests for access with your google accounts. I
>>>>>>> will update the thread once I document the process and submit the PR to 
>>>>>>> the
>>>>>>> website.
>>>>>>>
>>>>>>> Thank you,
>>>>>>> Aizhamal
>>>>>>>
>>>>>>> On Wed, Aug 7, 2019 at 3:12 PM Thomas Weise  wrote:
>>>>>>>
>>>>>>>> I was able to subscribe now.
>>>>>>>>
>>>>>>>> Reminder for others that the spreadsheet of interest can be found
>>>>>>>> here: s.apache.org/beam-tweets
>>>>>>>>
>>>>>>>> Aizhamal,
>>>>>>>>
>>>>>>>> Can you help with a couple changes to bring this closer to how
>>>>>>>> similar gdoc resources are handled?
>>>>>>>>
>>>>>>>> * Make the document view only. *PMC members* that care to help
>>>>>>>> with this can request edit access.
>>>>>>>> * Document the process for other contributors. Maybe here?
>>>>>>>> https://beam.apache.org/contribute/
>>>>>>>>
>>>>>>>> Thanks!
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On Wed, Aug 7, 2019 at 2:39 PM Ahmet Altay 
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> I am able to subscribe to notifications now. Thomas does it work
>>>>>>>>> for you?
>>>>>>>>>
>>>>>>>>> On Wed, 

Re: [Discuss] Ideas for Apache Beam presence in social media

[Matthias Baetens]

Hi all,

Picking up this thread, since I wanted to use this facility and help drive
this if necessary.

I saw the sheet has now comment access enabled. Did we decide / document
the desired process on the website? I am happy to testdrive that process
and submit a PR if successful.

Many thanks,
Matthias

On Tue, 13 Aug 2019 at 01:49, Thomas Weise  wrote:

> Yes, everyone should have comment access for this to make sense. Sorry for
> the confusion.
>
>
> On Mon, Aug 12, 2019 at 5:30 PM Kenneth Knowles  wrote:
>
>> Thanks for setting this up. It is nice to start building up a system for
>> this so everyone can participate.
>>
>> Regarding Jira versus notifications, how are people with only view access
>> to make suggestions for tweets? When I suggested gdocs, I meant for
>> everyone to have "comment" access, so then anyone can subscribe to all
>> comments, which would include suggestions. This allows anyone to suggest
>> tweets and anyone to subscribe to suggestions.
>>
>> Kenn
>>
>> On Wed, Aug 7, 2019 at 4:07 PM Aizhamal Nurmamat kyzy <
>> aizha...@google.com> wrote:
>>
>>> Thanks Thomas, changed the doc to view only and granted you and Ahmet
>>> edit access.
>>> @all - please send requests for access with your google accounts. I will
>>> update the thread once I document the process and submit the PR to the
>>> website.
>>>
>>> Thank you,
>>> Aizhamal
>>>
>>> On Wed, Aug 7, 2019 at 3:12 PM Thomas Weise  wrote:
>>>
 I was able to subscribe now.

 Reminder for others that the spreadsheet of interest can be found here:
 s.apache.org/beam-tweets

 Aizhamal,

 Can you help with a couple changes to bring this closer to how similar
 gdoc resources are handled?

 * Make the document view only. *PMC members* that care to help with
 this can request edit access.
 * Document the process for other contributors. Maybe here?
 https://beam.apache.org/contribute/

 Thanks!



 On Wed, Aug 7, 2019 at 2:39 PM Ahmet Altay  wrote:

> I am able to subscribe to notifications now. Thomas does it work for
> you?
>
> On Wed, Aug 7, 2019 at 2:23 PM Aizhamal Nurmamat kyzy <
> aizha...@apache.org> wrote:
>
>> Hi all,
>>
>> I set the access to 'anyone can edit'. Let me know if notifications
>> work now.
>>
>> Thanks,
>>
>> On Wed, Aug 7, 2019 at 2:00 PM Ahmet Altay  wrote:
>>
>>> You are probably right and it is an access issue.
>>>
>>> Aizhamal, could you give us edit access? And we can see if
>>> notifications work after that.
>>>
>>> On Wed, Aug 7, 2019 at 1:41 PM Thomas Weise  wrote:
>>>
 The use of JIRA was also suggested before, but why do the
 notifications not work? I wasn't able to subscribe and I suspect that 
 was
 due to not having sufficient access to the spreadsheet?



 On Wed, Aug 7, 2019 at 1:26 PM Ahmet Altay 
 wrote:

> As far as I understand we have not resolved this discussion and
> the sticking issue is that there is no good way of subscribing to 
> changes
> (i.e. proposals for tweets) for interested parties. The method 
> suggested in
> this thread (e.g. Tools and then Notification rules.) does not work 
> for
> some reason for a few of us including myself.
>
> Could we try to use any of our existing tools? For example, could
> the proposals be done in the form of filing a new JIRA issue under a
> specific component. All of us should be able to get notifications for 
> that.
> And then we can follow the lazy consensus and alternative approval 
> options
> as written down by Robert (1 week or 3 PMC +1s).
>
> Ahmet
>
> On Mon, Jun 24, 2019 at 3:47 AM Robert Bradshaw <
> rober...@google.com> wrote:
>
>> On Fri, Jun 21, 2019 at 1:02 PM Thomas Weise 
>> wrote:
>> >
>> > From what I understand, spreadsheets (not docs) provide the
>> functionality that we need:
>> https://support.google.com/docs/answer/91588
>> >
>> > Interested PMC members can subscribe and react to changes in
>> the spreadsheet.
>> >
>> > Lazy consensus requires a minimum wait. How much should that be?
>>
>> 72 hours is a pretty typical minimum, but I'd go a bit longer. A
>> week?
>> I'd want at least two pairs of eyes though, so if it's a PMC
>> member
>> that proposes the message someone else on the PMC should approve
>> before it goes out on an official channel.
>>
>> > Should there be an alternative approval option (like minimum
>> number of +1s) for immediate post (in case it is time sensitive)?
>>
>> +1. I'd say three is probably sufficient, 

Re: Feedback on how we use Apache Beam in my company

[Matthias Baetens]

This is great, Pierre! Thank you for sharing, very interesting.

Would you and your team be interested to talk about your use case at a
meetup (or Summit) in the future? :)

All the best,
Matthias

On Wed, 9 Oct 2019 at 15:59, Etienne Chauchot  wrote:

> Very nice !
>
> Thanks
>
> ccing dev list
>
> Etienne
> On 09/10/2019 16:55, Pierre Vanacker wrote:
>
> Hi Apache Beam community,
>
>
>
> We’ve been working with Apache Beam in production for a few years now in
> my company (Dailymotion).
>
>
>
> If you’re interested to know how we use Apache Beam in combination with
> Google Dataflow, we shared this experience in the following article :
> https://medium.com/dailymotion/realtime-data-processing-with-apache-beam-and-google-dataflow-at-dailymotion-7d1b994dc816
>
>
>
> Thanks to the developers for your great work !
>
>
>
> Regards,
>
>
>
> Pierre
>
>

Re: Beam Summit Videos in youtube

[Matthias Baetens]

Hi Chad,

Apologies for the delay here. We are post-processing the videos into
something that is more watchable, but happy to share the raw videos if that
is something you are interested in.
Which sessions specifically can we help with? :)

Best regards,
Matthias

On Mon, 7 Oct 2019 at 10:00, Maximilian Michels  wrote:

> Hi Chad,
>
> We're working on this. Sorry this is taking so long. Last time we hired
> a company and we had the edited recordings the day after. This time, we
> are going through a more manual process.
>
> I'll check back about the progress.
>
> Cheers,
> Max
>
> On 05.10.19 07:51, Chad Dombrova wrote:
> > Hi Max,
> > Any progress on this?  There are a few talks I really want to review!
> >
> > -chad
> >
> >
> > On Wed, Sep 18, 2019 at 12:56 PM Maximilian Michels  > > wrote:
> >
> > Hi Rahul,
> >
> > The Beam Summit committee is working on this at the moment. Stay
> tuned.
> >
> > Thanks,
> > Max
> >
> > On 18.09.19 11:39, rahul patwari wrote:
> >  > Hi,
> >  >
> >  > The videos of Beam Summit that has happened recently have
> > disappeared
> >  > from YouTube Apache Beam channel.
> >  >
> >  > Is uploading the videos a WIP?
> >  >
> >  > Thanks,
> >  > Rahul
> >  >
> >  >
> >
>

Re: [Announcement] New Website for Beam Summits

[Matthias Baetens]

I added the blogpost from our previous summit to the website as well so
people have an overview of the presentations and videos of everything that
happened there!
- M

On Tue, 2 Apr 2019 at 01:13, Joana Filipa Bernardo Carrasqueira <
joanafil...@google.com> wrote:

> Hi Alexey,
>
> We will use this website as a platform moving forward, and you will all
> the information related to future Beam Summits. At the moment, we don't
> have plans to include previous events (summit last year) but as we move
> forward, the Beam Summits will all be featured on that website.
>
>
> On Thu, Mar 21, 2019 at 8:42 AM Alexey Romanenko 
> wrote:
>
>> Great initiative, thanks for creating this!
>>
>> Btw, are any plans to add there information about previous Beam-related
>> events, especially London Beam summit last year?
>>
>> On 20 Mar 2019, at 19:30, David Morávek  wrote:
>>
>> This is great! Thanks for all of the hard work you're putting into this.
>>
>> D.
>>
>> On Wed, Mar 20, 2019 at 1:38 PM Maximilian Michels 
>> wrote:
>>
>>> Not a bug, it's a feature ;)
>>>
>>> On 20.03.19 07:23, Kenneth Knowles wrote:
>>> > Very nice. I appreciate the emphasis on coffee [1] [2] [3] though I
>>> > suspect there may be a rendering bug.
>>> >
>>> > Kenn
>>> >
>>> > [1] https://beamsummit.org/schedule/2019-06-19?sessionId=1
>>> > [2] https://beamsummit.org/schedule/2019-06-19?sessionId=3
>>> > [3] https://beamsummit.org/schedule/2019-06-19?sessionId=4
>>> >
>>> > On Tue, Mar 19, 2019 at 4:43 AM Łukasz Gajowy >> > <mailto:lgaj...@apache.org>> wrote:
>>> >
>>> > Looks great! Thanks for doing this! :)
>>> >
>>> > Łukasz
>>> >
>>> > wt., 19 mar 2019 o 12:30 Maximilian Michels >> > <mailto:m...@apache.org>> napisał(a):
>>> >
>>> > Great stuff! Looking forward to seeing many Beam folks in
>>> Berlin.
>>> >
>>> > In case you want to speak at Beam Summit Europe, the Call for
>>> > Papers is
>>> > open until April 1:
>>> https://sessionize.com/beam-summit-europe-2019
>>> >
>>> > -Max
>>> >
>>> > On 19.03.19 09:49, Matthias Baetens wrote:
>>> >  > Awesome Aizhamal! Great work and thanks for your continued
>>> > efforts on
>>> >  > this :) Looking forward to the summit.
>>> >  >
>>> >  > On Mon, 18 Mar 2019 at 23:17, Aizhamal Nurmamat kyzy
>>> >  > mailto:aizha...@google.com>
>>> > <mailto:aizha...@google.com <mailto:aizha...@google.com>>>
>>> wrote:
>>> >  >
>>> >  > Hello everybody!
>>> >  >
>>> >  >
>>> >  > We are thrilled to announce the launch of
>>> beamsummit.org
>>> > <http://beamsummit.org>
>>> >  > <http://beamsummit.org> dedicated to Beam Summits!
>>> >  >
>>> >  >
>>> >  > The current version of the website provides information
>>> > about the
>>> >  > upcoming Beam Summit in Europe on June 19-20th, 2019. We
>>> > will update
>>> >  > it for the upcoming summits in Asia and North America
>>> > accordingly.
>>> >  > You can access all necessary information about the
>>> > conference theme,
>>> >  > speakers and sessions, the abstract submission timeline
>>> > and the
>>> >  > registration process, the conference venues and much
>>> more
>>> > that you
>>> >  > will find useful until and during the Beam Summits 2019.
>>> >  >
>>> >  >
>>> >  > We are working to make the website easy to use, so that
>>> > anyone who
>>> >  > is organizing a Beam event can rely on it. You can find
>>> > the code for
>>> >  > it in Github
>>> > <https://github.com/matthiasa4/beam-summit-website>.
>>> >  >
>>> >  > The pages will be updated on a regular basis, but we
>>> also
>>> > love
>>> >  > hearing thoughts from our community! Let us know if you
>>> > have any
>>> >  > questions, comments or suggestions, and help us improve.
>>> > Also, if
>>> >  > you are thinking of organizing a Beam event, please feel
>>> > free to
>>> >  > reach out <mailto:cont...@beamsummit.org
>>> > <mailto:cont...@beamsummit.org>>for support, and to use the
>>> >  > code in GitHub as well.
>>> >  >
>>> >  >
>>> >  > We sincerely hope that you like the new Beam Summit
>>> > website and will
>>> >  > find it useful for accessing information. Enjoy browsing
>>> > around!
>>> >  >
>>> >  >
>>> >  > Thanks,
>>> >  >
>>> >  > Aizhamal
>>> >  >
>>> >
>>>
>>
>>
>
> --
>
> *Joana Carrasqueira*
>
> Cloud Developer Relations Events Manager
>
> +1 415-602-2507
>
> 1160 N Mathilda Ave, Sunnyvale, CA 94089
>
>
>

Beam Summit volunteering team

[Matthias Baetens]

Hi everyone,

As you might know, the Beam Summit is currently organised by a small team
 of people committing their free time to make
this happen. We are looking to make this group larger in the future and
particularly could use some help on website maintenance, development and
design.

This is a call for all volunteers interested, please ping over your details
and what you would like to do - this can go for meetups as well.

Many thanks,
Matthias on behalf of the Beam Summit organising team

Beam Summit Europe: speakers and schedule online!

[Matthias Baetens]

Hi everyone,

Happy to share that the speakers  and
schedule  are now online on the website.

Make sure you register on Eventbrite
 if you want to attend and
follow out Twitter channel  for
announcements regarding the speakers over the next few weeks!

Best regards,
Matthias

Re: Hello from Hannah Jiang

[Matthias Baetens]

Welcome to the community!

On Thu, Apr 25, 2019, 18:55 Griselda Cuevas  wrote:

> Welcome Hannah! - Very excited to see you in the Beam community :)
>
> On Tue, 23 Apr 2019 at 12:59, Hannah Jiang  wrote:
>
>> Hi everyone
>>
>> I joined Google recently and would work on Python portability part. I am
>> happy to be part of the community. Looking forward to working with all of
>> you together.
>>
>> I have a minor request, can admin please give me access to JIRA?
>>
>> Thanks,
>> Hannah
>>
>>
>>

Meetups in London, Stockholm + recordings

[Matthias Baetens]

Hi everyone,

Happy to announce 2 meetups for the next week(s):
- *London *is having its second meetup of the year on *01/05/2019 in
Level39, Canary Wharf
*
: https://www.meetup.com/London-Apache-Beam-Meetup/events/260526077 with
talks from Lyft, Datatonic and Google.
- *Stockholm* is having its second meetup in its lifetime on *06/05/2019 at
Spotify
:
*
https://www.meetup.com/Apache-Beam-Stockholm/events/260634514 with talks
from Spotify, EQT and Google.

The recording of the 6th meetup in London at Revolut is up on YouTube
 now.

Last but not least: start following the Beam Summit handle on Twitter
 for the latest information on the Beam
Summit  in Berlin (19-20 June 2019) and get your
ticket on Eventbrite
!

Best regards,
Matthias

Beam meetup London at Revolut 03/04/2019

[Matthias Baetens]

Hi everyone,

On Wednesday 03/04, we will have the next Beam meetup in London at the
Revolut offices.

Robert Bradshaw will do a deep dive on portability, while Revolut will
present its use-case on using Beam for fraud detection.

More info and RSVP on the meetup page https://www.meetup.com/London-Apache-Beam-Meetup/events/259496271>.

Looking forward to seeing you there!
Best regards,
Matthias

Re: [Announcement] New Website for Beam Summits

[Matthias Baetens]

Awesome Aizhamal! Great work and thanks for your continued efforts on this
:) Looking forward to the summit.

On Mon, 18 Mar 2019 at 23:17, Aizhamal Nurmamat kyzy 
wrote:

> Hello everybody!
>
> We are thrilled to announce the launch of beamsummit.org dedicated to
> Beam Summits!
>
> The current version of the website provides information about the upcoming
> Beam Summit in Europe on June 19-20th, 2019. We will update it for the
> upcoming summits in Asia and North America accordingly. You can access all
> necessary information about the conference theme, speakers and sessions,
> the abstract submission timeline and the registration process, the
> conference venues and much more that you will find useful until and during
> the Beam Summits 2019.
>
> We are working to make the website easy to use, so that anyone who is
> organizing a Beam event can rely on it. You can find the code for it in
> Github .
>
> The pages will be updated on a regular basis, but we also love hearing
> thoughts from our community! Let us know if you have any questions,
> comments or suggestions, and help us improve. Also, if you are thinking of
> organizing a Beam event, please feel free to reach out
>  for support, and to use the code in GitHub as
> well.
>
> We sincerely hope that you like the new Beam Summit website and will find
> it useful for accessing information. Enjoy browsing around!
>
> Thanks,
> Aizhamal
>

Re: Apache Beam Newsletter - February/March 2019

[Matthias Baetens]

Adding my 2 cents:
+1 for adding News to the repository.
I agree with Alexey in that News is different from blogpost (tend to be
bigger and might have technical content and/or debriefs from events).
Tying newsletter to releases also don't fully make sense from an event
point of view - these don't tend to be scheduled 3 months in advance unless
they are very big. A cadence of once every other month like Pablo suggested
makes sense from that point of view.

On Wed, 13 Mar 2019 at 17:02, Ahmet Altay  wrote:

> Related to release notes, I do agree with cleaninp up the JIRA (as a
> community) and including the dependency changes. I find those information
> useful.
>
> If the proposal here is to loosely align newsletter timelines with release
> times, I agree with that. If it is a proposal to merge release notes with
> the newsletter, I will be worried it will make the release process more
> difficult than it is today. Simply because we will need more things to
> happen for a release to be completed.
>
> On Wed, Mar 13, 2019 at 2:37 AM Etienne Chauchot 
> wrote:
>
>> Hi,
>> +1 on the process
>> +1 on the new News section
>>
>> I also think that matching the newsletter pace with the release pace
>> makes it clearer for users. Also, as a general obvious comment, newsletter
>> have the interest of providing the ongoing work compared to release notes
>> that provide only the work that was done.
>>
>> Etienne
>>
>> Le mardi 12 mars 2019 à 21:50 -0700, Kenneth Knowles a écrit :
>>
>>
>>
>> On Tue, Mar 12, 2019 at 9:04 PM Thomas Weise  wrote:
>>
>> The release blog is already on the radar for improvement [1].
>>
>> I don't think there is a need to separate out the release blogs. That's
>> if they provide content that is valuable to users (IMO that's not exactly
>> the case today).
>>
>>
>> The case I am thinking about is a user searching the web for an issue and
>> figuring out what version it was fixed in. Dep upgrades being a primary
>> thing to notice.
>>
>>
>> If release blogs are just reformatted JIRA reports, then maybe we can
>> skip them altogether (release notes are already linked from download page).
>>
>>
>> One reason is that Jira remains mutable and I am not so sure of the SEO,
>> in terms of helping users figure out if an upgrade might solve their
>> problem.
>>
>>
>> In that case I would much rather like to see the original JIRA report
>> cleaned up as part of the release process.
>>
>>
>> Either way, this seems worthwhile. I think release managers often do this
>> anyhow. How could we formalize it? Do we need to? My favorite form of
>> formal process is just to get more eyes on some LGTM.
>>
>>
>> On the other hand, if release blogs are assembled similar to the
>> newsletter that we discuss here, through broader contributor input and with
>> the aim to provide more meaningful content to users, then I don't see why
>> we need to put them into a different area.
>>
>>
>> Same answer: people searching for issue resolution. I wonder if our
>> release notes should be a static copy/paste of the Jira list, deleting
>> things that really make no sense and editing everything else to be
>> meaningful. But I get the idea that we don't really need a separate area.
>>
>> What if newsletters matched releases, and could be drafted throughout the
>> 6 week period, with folks really trying to give a narrative to what they
>> contributed to a release?
>>
>> Kenn
>>
>>
>> Overall, given proposed newsletter cadence of 2 months and existing
>> release cadence, we would probably still end up with a monthly piece of
>> news.
>>
>> Thanks,
>> Thomas
>>
>>
>>
>> https://lists.apache.org/thread.html/224908775d8807eecc53e45f14f99d6a439beb8bb5165e3a813bf82d@%3Cdev.beam.apache.org%3E
>>
>>
>> On Tue, Mar 12, 2019 at 9:27 AM Rose Nguyen  wrote:
>>
>> Once every 2 months works. We include both big and small items. It'll
>> provide the focus Thomas mentions but still catches the frequency that
>> Pablo suggested for relevancy. To Alexey's point, it's difficult to
>> navigate the more recent non-release blog posts (<1 year) because they are
>> sprinkled in.
>>
>> A compromise for all of our points is to move the release notes to a
>> separate section, and have a single section that's blog/news.
>>
>> And thanks for wanting to contribute, Aizhamal! Teaming up with you will
>> make things run smoothly.
>>
>> On Tue, Mar 12, 2019 at 3:58 AM Alexey Romanenko <
>> aromanenko@gmail.com> wrote:
>>
>> +1 for “News” section. Though, I’d propose to exclude “release notes”
>> posts from “Blog” section list (since now we have quite regular releases,
>> it makes blog posts list not very readable for users) and move them to new
>> created News section. Also, this section could include the posts about
>> other Beam events, like meet-ups, conferences, project updates, etc. I’d
>> keep “Blog” section for more technical posts.
>>
>> On 12 Mar 2019, at 06:31, Pablo Estrada  wrote:
>>
>> I agree that the newsletter fits well as a blog post. I think 

Re: hi from DevRel land

[Matthias Baetens]

It's great to have you on board, Rez! To join in on what Kenn was saying:
great to have worked on challenging problems with you in the past, it's
going to be very helpful to have your experience added to the project!

-Matthias

On Thu, Mar 14, 2019, 04:06 Connell O'Callaghan  wrote:

> Welcome on board Reza!!!
>
> On Wed, Mar 13, 2019 at 8:41 PM Joana Filipa Bernardo Carrasqueira <
> joanafil...@google.com> wrote:
>
>> Welcome Reza!
>>
>> On Wed, Mar 13, 2019 at 3:12 PM David Cavazos 
>> wrote:
>>
>>> Welcome Reza!
>>>
>>> On Wed, Mar 13, 2019 at 9:48 AM Mark Liu  wrote:
>>>
 Welcome Reza!

 On Wed, Mar 13, 2019 at 8:09 AM Etienne Chauchot 
 wrote:

> Welcome onboard Reza
>
> Etienne
>
> Le mardi 12 mars 2019 à 09:10 -0700, Rose Nguyen a écrit :
>
> Welcome, Reza! Really excited to have you!
>
> On Tue, Mar 12, 2019 at 9:00 AM Reza Ardeshir Rokni 
> wrote:
>
> Thanx folks!
>
> Oppsy on the link, here it is again:
>
> https://stackoverflow.com/questions/54422510/how-to-solve-duplicate-values-exception-when-i-create-pcollectionviewmapstring/54623618#54623618
>
> On Tue, 12 Mar 2019 at 23:32, Teja MVSR  wrote:
>
> Hi Reza,
>
> I am also interested to contribute towards documentation. Please let
> me know if I can be of any help.
>
> Thanks and Regards,
> Teja.
>
> On Tue, Mar 12, 2019, 11:30 AM Kenneth Knowles  wrote:
>
> This is great news.
>
> For the benefit of the list, I want to say how nice it has been when I
> have had a chance to work with you. I've learned a great deal real and
> complex use cases through those opportunities. I'm really excited that
> you'll be helping out Beam in this new role.
>
> Kenn
>
> On Tue, Mar 12, 2019 at 7:21 AM Valentyn Tymofieiev <
> valen...@google.com> wrote:
>
> Hi Reza!
>
> Welcome to Beam. Very nice to have you onboard. Btw, the link seems
> broken.
>
> Thanks,
> Valentyn
>
> On Tue, Mar 12, 2019 at 6:04 AM Reza Ardeshir Rokni 
> wrote:
>
> Hi Folks,
>
> Just wanted to say hi to the good folks in the Beam community in my
> new capacity as a Developer advocate for Beam/Dataflow @ Google. :-)
>
> At the moment I am working on a couple of blogs around the Timer and
> State API as well as some work on general patterns that I hope to
> contribute as documentation to the Beam site. An example of the patterns
> can be seen here:  LINK
>
> Hope to be adding many more in 2019 and really looking forward to
> being able to contribute to Beam in anyway that I can!
>
> Cheers
> Reza
>
>
>
>
>>
>> --
>>
>> *Joana Carrasqueira*
>>
>> Cloud Developer Relations Events Manager
>>
>> 415-602-2507 Mobile
>>
>> 1160 N Mathilda Ave, Sunnyvale, CA 94089
>>
>>
>>

Re: [ANNOUNCE] New committer announcement: Michael Luckey

[Matthias Baetens]

Welcome, Michael! :)

On Mon, 4 Mar 2019 at 18:03, Joana Filipa Bernardo Carrasqueira <
joanafil...@google.com> wrote:

> Congratulations Michael!! Welcome!
>
> On Thu, Feb 28, 2019 at 3:55 PM Daniel Oliveira 
> wrote:
>
>> Congrats Michael!
>>
>> On Thu, Feb 28, 2019 at 3:12 AM Maximilian Michels 
>> wrote:
>>
>>> Welcome, it's great to have you onboard Michael!
>>>
>>> On 28.02.19 11:46, Michael Luckey wrote:
>>> > Thanks to all of you for the warm welcome. Really happy to be part of
>>> > this great community!
>>> >
>>> > michel
>>> >
>>> > On Thu, Feb 28, 2019 at 8:39 AM David Morávek >> > > wrote:
>>> >
>>> > Congrats Michael! 
>>> >
>>> > D.
>>> >
>>> >  > On 28 Feb 2019, at 03:27, Ismaël Mejía >> > > wrote:
>>> >  >
>>> >  > Congratulations Michael, and thanks for all the contributions!
>>> >  >
>>> >  >> On Wed, Feb 27, 2019 at 6:30 PM Ankur Goenka <
>>> goe...@google.com
>>> > > wrote:
>>> >  >>
>>> >  >> Congratulations Michael!
>>> >  >>
>>> >  >>> On Wed, Feb 27, 2019 at 2:25 PM Thomas Weise
>>> > mailto:thomas.we...@gmail.com>> wrote:
>>> >  >>>
>>> >  >>> Congrats Michael!
>>> >  >>>
>>> >  >>>
>>> >   On Wed, Feb 27, 2019 at 12:41 PM Gleb Kanterov
>>> > mailto:g...@spotify.com>> wrote:
>>> >  
>>> >   Congratulations and welcome!
>>> >  
>>> >  > On Wed, Feb 27, 2019 at 8:57 PM Connell O'Callaghan
>>> > mailto:conne...@google.com>> wrote:
>>> >  >
>>> >  > Excellent thank you for sharing Kenn!!!
>>> >  >
>>> >  > Michael congratulations for this recognition of your
>>> > contributions to advancing BEAM
>>> >  >
>>> >  >> On Wed, Feb 27, 2019 at 11:52 AM Kenneth Knowles
>>> > mailto:k...@apache.org>> wrote:
>>> >  >>
>>> >  >> Hi all,
>>> >  >>
>>> >  >> Please join me and the rest of the Beam PMC in welcoming a
>>> > new committer: Michael Luckey
>>> >  >>
>>> >  >> Michael has been contributing to Beam since early 2017. He
>>> > has fixed many build and developer environment issues, noted and
>>> > root-caused breakages on master, generously reviewed many others'
>>> > changes to the build. In consideration of Michael's contributions,
>>> > the Beam PMC trusts Michael with the responsibilities of a Beam
>>> > committer [1].
>>> >  >>
>>> >  >> Thank you, Michael, for your contributions.
>>> >  >>
>>> >  >> Kenn
>>> >  >>
>>> >  >> [1]
>>> >
>>> https://beam.apache.org/contribute/become-a-committer/#an-apache-beam-committer
>>> >  
>>> >  
>>> >  
>>> >   --
>>> >   Cheers,
>>> >   Gleb
>>> >
>>>
>>
>
> --
>
> *Joana Carrasqueira*
>
> Cloud Developer Relations Events Manager
>
> 415-602-2507 Mobile
>
> 1160 N Mathilda Ave, Sunnyvale, CA 94089
>
>
>

Beam Summit Europe 2019: CfP

[Matthias Baetens]

Hi everyone,

As you might already know, the *Beam Summit Europe 2019* will take place in
*Berlin* this year on *19-20 June*!

Of course, we would love to have you there. That is why we are opening
the *Call
for Speakers .*

We are looking for people to share use-cases for Beam, do a technical deep
dive or deliver a workshop on Beam. We have a few standard slots, but don't
hesitate to do a proposal in case you have something different in mind.

Stay tuned for more announcements - we are working hard on the website,
which should be up and running soon. And of course, don't hesitate to reach
out if you have any questions or suggestions!

Looking forward to seeing you in person later this year.

Best regards,
The Beam Summit organising team

Re: Beam Meetups Feb 2019

[Matthias Baetens]

Wow, that is awesome, Joana! Great job to everyone involved! :-)

On Fri, 8 Feb 2019 at 22:42, Joana Filipa Bernardo Carrasqueira <
joanafil...@google.com> wrote:

> Hi all,
>
> I would like to take a moment to acknowledge the fact that yesterday we
> had nearly 300 people at the Beam Meetup at Lyft!
>
> It was a remarkable event with great presentations and engagement from the
> audience! It's great to see the community growing!
>
> [image: Lyft.jpg]
>
> For those in the Seattle area on Feb 21st, we will host another Beam
> Meetup so help us spreading the word! Check the details here
> .
>
> Have a great weekend!
>
> --
>
> *Joana Carrasqueira*
>
> Cloud Developer Relations Events Manager
>
> 415-602-2507 Mobile
>
> 1160 N Mathilda Ave, Sunnyvale, CA 94089
>
>
>

Re: Another another new contributor! :)

[Matthias Baetens]

Welcome, good to have you Kyle!

On Fri, 8 Feb 2019 at 00:43, Joana Filipa Bernardo Carrasqueira <
joanafil...@google.com> wrote:

> Welcome to the community Kyle!
>
>
> On Thu, Feb 7, 2019 at 1:22 AM Alexey Romanenko 
> wrote:
>
>> Welcome, Kyle!
>> Great to have more people on SparkRunner side!
>>
>> Btw, feel free to join “beam-spark” channel on Slack.
>>
>> Alexey
>>
>> On 7 Feb 2019, at 08:44, Reza Ardeshir Rokni  wrote:
>>
>> Welcome!
>>
>> On Tue, 5 Feb 2019 at 23:34, Kenneth Knowles  wrote:
>>
>>> Welcome Kyle!
>>>
>>> On Tue, Feb 5, 2019 at 4:34 AM Maximilian Michels 
>>> wrote:
>>>
 Welcome Kyle! Excited to see the Spark Runner moving towards
 portability!

 On 05.02.19 01:14, Connell O'Callaghan wrote:
 > Welcome Kyle!
 >
 > On Mon, Feb 4, 2019 at 3:18 PM Ahmet Altay >>> > > wrote:
 >
 > Welcome!
 >
 > On Mon, Feb 4, 2019 at 3:13 PM Rui Wang >>> > > wrote:
 >
 > Welcome!
 >
 > -Rui
 >
 > On Mon, Feb 4, 2019 at 2:50 PM Kyle Weaver <
 kcwea...@google.com
 > > wrote:
 >
 > Hello Beam developers,
 >
 > My name is Kyle Weaver (alias "ibzib" on Github/Slack).
 Like
 > Brian, I recently switched roles at Google (I previously
 > worked on Prow, Kubernetes' CI system). My goal in the
 > coming weeks is to help begin implementing portability
 > support for the Spark runner. I look forward to
 > collaborating with all of you!
 >
 > Kyle
 >
 > Kyle Weaver |  Software Engineer |
 kcwea...@google.com
 >  | +1650203
 >
 >

>>>
>>
>
> --
>
> *Joana Carrasqueira*
>
> Cloud Developer Relations Events Manager
>
> 415-602-2507 Mobile
>
> 1160 N Mathilda Ave, Sunnyvale, CA 94089
>
>
>

Re: Beam Python streaming pipeline on Flink Runner

[Matthias Baetens]

Hey Ankur,

Thanks for the swift reply. Should I change this in the capability matrix
<https://s.apache.org/apache-beam-portability-support-table> then?

Many thanks.
Best,
Matthias

On Thu, 31 Jan 2019 at 09:31, Ankur Goenka  wrote:

> Hi Matthias,
>
> Unfortunately, unbounded reads including pubsub are not yet supported for
> portable runners.
>
> Thanks,
> Ankur
>
> On Thu, Jan 31, 2019 at 2:44 PM Matthias Baetens <
> baetensmatth...@gmail.com> wrote:
>
>> Hi everyone,
>>
>> Last few days I have been trying to run a streaming pipeline (code on
>> Github <https://github.com/matthiasa4/beam-demo>) on a Flink Runner.
>>
>> I am running a Flink cluster locally (v1.5.6
>> <https://flink.apache.org/downloads.html>)
>> I have built the SDK Harness Container: *./gradlew
>> :beam-sdks-python-container:docker*
>> and started the JobServer: *./gradlew
>> :beam-runners-flink_2.11-job-server:runShadow
>> -PflinkMasterUrl=localhost:8081.*
>>
>> I run my pipeline with: *env/bin/python streaming_pipeline.py
>> --runner=PortableRunner --job_endpoint=localhost:8099 --output xxx
>> --input_subscription xxx --output_subscription xxx*
>>
>> All this is running inside a Ubuntu (Bionic) in a Virtualbox.
>>
>> The job submits fine, but unfortunately fails after a few seconds with
>> the error attached.
>>
>> Anything I am missing or doing wrong?
>>
>> Many thanks.
>> Best,
>> Matthias
>>
>>
>>

Beam Python streaming pipeline on Flink Runner

[Matthias Baetens]

Hi everyone,

Last few days I have been trying to run a streaming pipeline (code on Github
) on a Flink Runner.

I am running a Flink cluster locally (v1.5.6
)
I have built the SDK Harness Container: *./gradlew
:beam-sdks-python-container:docker*
and started the JobServer: *./gradlew
:beam-runners-flink_2.11-job-server:runShadow
-PflinkMasterUrl=localhost:8081.*

I run my pipeline with: *env/bin/python streaming_pipeline.py
--runner=PortableRunner --job_endpoint=localhost:8099 --output xxx
--input_subscription xxx --output_subscription xxx*

All this is running inside a Ubuntu (Bionic) in a Virtualbox.

The job submits fine, but unfortunately fails after a few seconds with the
error attached.

Anything I am missing or doing wrong?

Many thanks.
Best,
Matthias
TimerException{java.lang.RuntimeException: Failed to finish remote bundle}
at 
org.apache.flink.streaming.runtime.tasks.SystemProcessingTimeService$RepeatedTriggerTask.run(SystemProcessingTimeService.java:335)
at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: Failed to finish remote bundle
at 
org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator$SdkHarnessDoFnRunner.finishBundle(ExecutableStageDoFnOperator.java:624)
at 
org.apache.beam.runners.flink.metrics.DoFnRunnerWithMetricsUpdate.finishBundle(DoFnRunnerWithMetricsUpdate.java:87)
at 
org.apache.beam.runners.core.SimplePushbackSideInputDoFnRunner.finishBundle(SimplePushbackSideInputDoFnRunner.java:118)
at 
org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator.invokeFinishBundle(DoFnOperator.java:679)
at 
org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator.checkInvokeFinishBundleByTime(DoFnOperator.java:673)
at 
org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator.lambda$open$1(DoFnOperator.java:378)
at 
org.apache.flink.streaming.runtime.tasks.SystemProcessingTimeService$RepeatedTriggerTask.run(SystemProcessingTimeService.java:330)
... 7 more
Caused by: java.util.concurrent.ExecutionException: java.lang.RuntimeException: 
Error received from SDK harness for instruction 5: Traceback (most recent call 
last):
  File 
"/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 148, in _execute
response = task()
  File 
"/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 183, in 
self._execute(lambda: worker.do_instruction(work), work)
  File 
"/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 256, in do_instruction
request.instruction_id)
  File 
"/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
 line 272, in process_bundle
bundle_processor.process_bundle(instruction_id)
  File 
"/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 489, in process_bundle
].process_encoded(data.data)
  File 
"/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/bundle_processor.py",
 line 126, in process_encoded
self.output(decoded_value)
  File "apache_beam/runners/worker/operations.py", line 182, in 
apache_beam.runners.worker.operations.Operation.output
def output(self, windowed_value, output_index=0):
  File "apache_beam/runners/worker/operations.py", line 183, in 
apache_beam.runners.worker.operations.Operation.output
cython.cast(Receiver, self.receivers[output_index]).receive(windowed_value)
  File "apache_beam/runners/worker/operations.py", line 89, in 
apache_beam.runners.worker.operations.ConsumerSet.receive
cython.cast(Operation, consumer).process(windowed_value)
  File "apache_beam/runners/worker/operations.py", line 497, in 
apache_beam.runners.worker.operations.DoOperation.process
with self.scoped_process_state:
  File "apache_beam/runners/worker/operations.py", line 498, in 
apache_beam.runners.worker.operations.DoOperation.process
self.dofn_receiver.receive(o)
  File "apache_beam/runners/common.py", line 678, in 
apache_beam.runners.common.DoFnRunner.receive
self.process(windowed_value)
  File "apache_beam/runners/common.py", line 684, in 
apache_beam.runners.common.DoFnRunner.process

Re: Beam Summits!

[Matthias Baetens]

@Reza Rokni : I was planning to reach out to you for the
Asian edition of the Summit - do you think Singapore would make sense?

On Mon, 7 Jan 2019 at 07:25, Matthias Baetens 
wrote:

> Hey Austin,
>
> Yes, it would be good to get going soon. We started approx. 3 months
> before the event like Thomas mentioned. It is important though to kick-off
> two things at the same time:
> 1) Drafting and getting the proposal approved
> 2) Kicking off the practical organisation
>
> If we would have treated 1) as a blocker for 2), we would've gotten in
> trouble. I was not very involved in the proposal discussions, Gris and
> Ahmet did a great deal of work there and I think they'd be happy to help
> out with any questions you might have; but the proposal would definitely be
> a good basis to start from.
>
> With 2) I have some more info I could share.
> We started by assembling a core team of people we knew were going to do
> the bulk of the organising work (ideally a mix of 'community' forces, a PMC
> member, and employees from companies who seem very keen to join forces)
> Then there is the actual organisational part (which you can divide and
> conquer with the team):
>
>- Fixing the date(s) of your conference (this needs to go into the
>proposal as well, so one of the first things to decide
>- Estimating the budget and finding sponsoring companies: this will
>decide what is possible and what is not
>- Finding a venue that is convenient and fits your needs (how many
>people are you expecting? we could maybe do a small poll on the mailing
>lists and Twitter to see conference interest for this year). Ideally, your
>venue is flexible for change as well (extendable rooms, ...). This goes
>hand in hand with:
>   - Catering / food / coffee
>   - Video crew for recording the sessions
>- Opening a CfP: this is something you probably want to do as soon as
>possible. It will decide largely the content of the summit and what
>sessions you will be able to offer to your audience. If will also be
>crucial in communication later on.
>- This goes hand in hand with constructing your agenda. Draft what you
>   are aiming for and share this with everyone (speakers included) so they 
> can
>   help you build the schedule. This will change a lot (up until the day of
>   the event if people cancel)
>   - Start collecting the speaker presentations
>- Open attendee registrations as soon as possible: this will allow you
>to estimate the number of attendees
>   - A small website could be useful to have an overview of the
>   speakers and schedule, combined with registrating functionality (e.g.
>   https://devfest.gdg.london or use https://splashthat.com)
>- Starting the buzz (communications wise): think about mailing list,
>social media (Twitter, LinkedIn mostly), blogposts, local communities that
>might be interested, reach out to people that frequent your meetup, ask
>sponsoring companies to use their channels, ...
>   - Also think about marketing of the summit (slide branding, banners
>   for social media, ...)
>- Gather a team of people to help out on the day itself and list out
>the on-the-day(s) tasks to divide the work. Have clear responsibilities for
>everyone and have someone to keep the overview. Learning from our summit:
>have someone dedicated to take care of the speakers (welcome them, make
>sure they are comfortable for the talk, make sure they have everything they
>need. A seperate room for speakers is a luxury, but a good one to have).
>- Other things like:
>   - Swag
>   - Speaker gifts
>   - Photographer
>   - Social media branding (ask speakers to use hashtags, ...)
>   - Have a debrief questionnaire
>
> Overall, try to keep closely in sync with your organising team
> (fortnightly calls or weekly when getting closer to the event). A shared
> tracker for you, team (and community - they can give feedback), might be
> useful as well (find ours here
> <https://docs.google.com/spreadsheets/d/1pNoeLD0JBImc1-gja209mSuTVLNna_b1gmQ1r-_Z5t0/edit>
> )
>
> I will share some additional materials later with you. Happy to have a
> quick call to answer additional questions and help out where needed :)
> Best,
> Matthias
>
>
>
>
> On Sun, 6 Jan 2019 at 22:55, Thomas Weise  wrote:
>
>> For the event in SF in April it would be necessary to get going soon.
>>
>> For the type of information that will be required, you could take a look
>> at the proposal from the London event [1].  It was created with ~ 3 months
>> lead time. Note the draft mistakenly used "Apache" in the event name -
&

Re: Beam Summits!

[Matthias Baetens]

dausti...@gmail.com> wrote:
>
>> Hi Matthias, etc,
>>
>> Trying to get thoughts on formalizing a process for getting proposals
>> together.  I look forward to the potential day that there are many people
>> that want (rather than just willing) to host a summit in a given region in
>> a given year.  Perhaps too forward looking.
>>
>> Also, you mentioned planning London wound up with a tight time window.
>> If shooting for April in SF, seems  the clock might be starting to tick.
>> Any advice for how much time needed?  And guidance on getting whatever
>> formal needed through Apache - and does this also necessarily involve a
>> Beam PMC or community vote (probably more related to the first paragraph)?
>>
>> Thanks,
>> Austin
>>
>> On Thu, Dec 20, 2018, 1:09 AM Matthias Baetens > wrote:
>>
>>> Great stuff, thanks for the overview, Austin.
>>>
>>> For EU, there are things to say for both Stockholm and Berlin, but I
>>> think it makes sense to do it on the back of another conference (larger
>>> chance of people being in town with the same interest). I like Thomas
>>> comment - we will attract more people from the US if we don't let it
>>> conflict with the big events there. +1 for doing it around the time of
>>> Berlin Buzzwords.
>>>
>>> For Asia, I'd imagine Singapore would be an option as well. I'll reach
>>> out to some people that are based there to get a grasp on the size of the
>>> community there.
>>>
>>> Best,
>>> -M
>>>
>>>
>>>
>>> On Thu, 20 Dec 2018 at 05:08, Thomas Weise  wrote:
>>>
>>>> I think for EU there is a proposal to have it next to Berlin Buzzwords
>>>> in June. That would provide better spacing and avoid conflict with
>>>> ApacheCon.
>>>>
>>>> Thomas
>>>>
>>>>
>>>> On Wed, Dec 19, 2018 at 3:09 PM Suneel Marthi 
>>>> wrote:
>>>>
>>>>> How about Beam Summit in Berlin on Sep 6 immediately following Flink
>>>>> Forward Berlin on the previous 2 days.
>>>>>
>>>>> Same may be for Asia also following Flink Forward Asia where and
>>>>> whenever it happens.
>>>>>
>>>>> On Wed, Dec 19, 2018 at 6:06 PM Austin Bennett <
>>>>> whatwouldausti...@gmail.com> wrote:
>>>>>
>>>>>> Hi All,
>>>>>>
>>>>>> I really enjoyed Beam Summit in London (Thanks Matthias!), and there
>>>>>> was much enthusiasm for continuations.  We had selected that location in 
>>>>>> a
>>>>>> large part due to the growing community there, and we have users in a
>>>>>> variety of locations.  In our 2019 calendar,
>>>>>> https://docs.google.com/spreadsheets/d/1CloF63FOKSPM6YIuu8eExjhX6xrIiOp5j4zPbSg3Apo/
>>>>>> shared in the past weeks, 3 Summits are tentatively slotted for this 
>>>>>> year.
>>>>>> Wanting to start running this by the group to get input.
>>>>>>
>>>>>> * Beam Summit NA, in San Francisco, approx 3 April 2019 (following
>>>>>> Flink Forward).  I can organize.
>>>>>> * Beam Summit Europe, in Stockholm, this was the runner up in voting
>>>>>> falling behind London.  Or perhaps Berlin?  October-ish 2019
>>>>>> * Beam Summit Asia, in Tokyo ??
>>>>>>
>>>>>> What are general thoughts on locations/dates?
>>>>>>
>>>>>> Looking forward to convening in person soon.
>>>>>>
>>>>>> Cheers,
>>>>>> Austin
>>>>>>
>>>>>

Re: Beam Summits!

[Matthias Baetens]

Great stuff, thanks for the overview, Austin.

For EU, there are things to say for both Stockholm and Berlin, but I think
it makes sense to do it on the back of another conference (larger chance of
people being in town with the same interest). I like Thomas comment - we
will attract more people from the US if we don't let it conflict with the
big events there. +1 for doing it around the time of Berlin Buzzwords.

For Asia, I'd imagine Singapore would be an option as well. I'll reach out
to some people that are based there to get a grasp on the size of the
community there.

Best,
-M



On Thu, 20 Dec 2018 at 05:08, Thomas Weise  wrote:

> I think for EU there is a proposal to have it next to Berlin Buzzwords in
> June. That would provide better spacing and avoid conflict with ApacheCon.
>
> Thomas
>
>
> On Wed, Dec 19, 2018 at 3:09 PM Suneel Marthi  wrote:
>
>> How about Beam Summit in Berlin on Sep 6 immediately following Flink
>> Forward Berlin on the previous 2 days.
>>
>> Same may be for Asia also following Flink Forward Asia where and whenever
>> it happens.
>>
>> On Wed, Dec 19, 2018 at 6:06 PM Austin Bennett <
>> whatwouldausti...@gmail.com> wrote:
>>
>>> Hi All,
>>>
>>> I really enjoyed Beam Summit in London (Thanks Matthias!), and there was
>>> much enthusiasm for continuations.  We had selected that location in a
>>> large part due to the growing community there, and we have users in a
>>> variety of locations.  In our 2019 calendar,
>>> https://docs.google.com/spreadsheets/d/1CloF63FOKSPM6YIuu8eExjhX6xrIiOp5j4zPbSg3Apo/
>>> shared in the past weeks, 3 Summits are tentatively slotted for this year.
>>> Wanting to start running this by the group to get input.
>>>
>>> * Beam Summit NA, in San Francisco, approx 3 April 2019 (following Flink
>>> Forward).  I can organize.
>>> * Beam Summit Europe, in Stockholm, this was the runner up in voting
>>> falling behind London.  Or perhaps Berlin?  October-ish 2019
>>> * Beam Summit Asia, in Tokyo ??
>>>
>>> What are general thoughts on locations/dates?
>>>
>>> Looking forward to convening in person soon.
>>>
>>> Cheers,
>>> Austin
>>>
>>

Re: 2019 Beam Events

[Matthias Baetens]

Great stuff, Gris! Looking forward to what 2019 will bring!

The Beam meetup in London will have a new get together early next year as
well :-)
https://www.meetup.com/London-Apache-Beam-Meetup/


On Tue, 4 Dec 2018 at 23:50 Austin Bennett 
wrote:

> Already got that process kicked off with the NY and LA meet ups, now that
> SF is about to be inagurated goal will be to get these moving as well.
>
> For anyone that is in (or goes to) those areas:
> https://www.meetup.com/New-York-Apache-Beam/
> https://www.meetup.com/Los-Angeles-Apache-Beam/
>
> Please reach out to get involved!
>
>
>
> On Tue, Dec 4, 2018 at 3:13 PM Griselda Cuevas  wrote:
>
>> +1 to Pablo's suggestion, if there's interest in "Founding a Meetup group
>> in a particular city, let's create the Meetup page and start getting sign
>> ups. Joana will be reaching out with a comprenhexive list of how to get
>> started and we're hoping to compile a high level calendar of
>> launches/announcements to feed into your meetup.
>>
>> G
>>
>> On Tue, 4 Dec 2018 at 12:04, Daniel Salerno 
>> wrote:
>>
>>> =)
>>> What good news!
>>> Okay, I'll set up the group and try to get interested.
>>> Thank you
>>>
>>>
>>> Em ter, 4 de dez de 2018 às 17:19, Pablo Estrada 
>>> escreveu:
>>>
 FWIW, for some of these places that have interest (e.g. Brazil,
 Israel), it's possible to create a group in meetup.com, and start
 gauging interest, and looking for organizers.
 Once a group of people with interest exists, it's easier to get
 interest / sponsorship to bring speakers.
 So if you are willing to create the group in meetup, Daniel, we can
 monitor it and try to plan something as it grows : )
 Best
 -P.

 On Tue, Dec 4, 2018 at 10:55 AM Daniel Salerno 
 wrote:

>
> It's a shame that there are no events in Brazil ...
>
> =(
>
> Em ter, 4 de dez de 2018 às 13:12, OrielResearch Eila Arich-Landkof <
> e...@orielresearch.org> escreveu:
>
>> agree 
>>
>> On Tue, Dec 4, 2018 at 5:41 AM Chaim Turkel  wrote:
>>
>>> Israel would be nice to have one
>>> chaim
>>> On Tue, Dec 4, 2018 at 12:33 AM Griselda Cuevas 
>>> wrote:
>>> >
>>> > Hi Beam Community,
>>> >
>>> > I started curating industry conferences, meetups and events that
>>> are relevant for Beam, this initial list I came up with. I'd love your 
>>> help
>>> adding others that I might have overlooked. Once we're satisfied with 
>>> the
>>> list, let's re-share so we can coordinate proposal submissions, 
>>> attendance
>>> and community meetups there.
>>> >
>>> >
>>> > Cheers,
>>> >
>>> > G
>>> >
>>> >
>>> >
>>>
>>> --
>>>
>>>
>>> Loans are funded by
>>> FinWise Bank, a Utah-chartered bank located in Sandy,
>>> Utah, member FDIC, Equal
>>> Opportunity Lender. Merchant Cash Advances are
>>> made by Behalf. For more
>>> information on ECOA, click here
>>> . For important information
>>> about
>>> opening a new
>>> account, review Patriot Act procedures here
>>> .
>>> Visit Legal
>>>  to
>>> review our comprehensive program terms,
>>> conditions, and disclosures.
>>>
>>
>>
>> --
>> Eila
>> www.orielresearch.org
>> https://www.meetu
>> p.co
>> 
>> m/Deep-Learning-In-Production/
>> 
>>
>>
>> --

Re: Stand at FOSDEM 2019

[Matthias Baetens]

Hey Max,

Great idea. I'd be very keen to join. I'll look at my calendar over the
weekend to see if this would work.
Are you going yourself?

Cheers,
Matthias

On Thu, 29 Nov 2018 at 11:06 Maximilian Michels  wrote:

> Hi,
>
> For everyone who might be attending FOSDEM19: What do you think about
> taking a slot for Beam at the Apache stand?
>
> A slot is 2-3 hours. It is a great way to spread the word about Beam. We
> wouldn't have to prepare much, just bring some merch.
>
> There is still plenty of space:
> https://cwiki.apache.org/confluence/display/COMDEV/FOSDEM+2019
>
> Cheers,
> Max
>
> PS: FOSDEM is an open-source conference in Brussels, Feb 2-3, 2019
>
--

Re: JB's back

[Matthias Baetens]

Good to have you back JB!

On Wed, Nov 21, 2018, 06:06 Kenneth Knowles  wrote:

> Yes, welcome back!
>
> On Tue, Nov 20, 2018 at 9:51 PM Ahmet Altay  wrote:
>
>> Welcome back!
>>
>> On Tue, Nov 20, 2018 at 9:11 PM, Jean-Baptiste Onofré 
>> wrote:
>>
>>> Hi guys,
>>>
>>> Sorry to have been quiet recently.
>>>
>>> After some rushy things and having been sick last week, I'm back on Beam.
>>>
>>> With Alexey, Etienne and Ismaël, we are working on the Spark runner and
>>> I'm also resuming several works I was holding on the IOs.
>>>
>>> Regards
>>> JB
>>> --
>>> Jean-Baptiste Onofré
>>> jbono...@apache.org
>>> http://blog.nanthrax.net
>>> Talend - http://www.talend.com
>>>
>>
>> --

Re: Bay Area Apache Beam Kickoff!

[Matthias Baetens]

Awesome effort awesome - good luck on the first meetup! :)

On Tue, 20 Nov 2018 at 01:37 Austin Bennett 
wrote:

> We have our first meetup scheduled for December 12th in San Francisco.
>
> Andrew Pilloud, a software engineer at Google and Beam committer, will
> demo the latest feature in Beam SQL: a standalone SQL shell. The talk cover
> why SQL is a good fit for streaming data processing, the technical details
> of the Beam SQL engine, and a peek into our future plans.
>
> Kenn Knowles, a founding PMC Member and incoming PMC Chair for the Apache
> Beam project, as well as computer scientist and engineer at Google will
> share about all things Beam. Where it is, where its been, where its going.
>
> More info:
> https://www.meetup.com/San-Francisco-Apache-Beam/events/256348972/
>
> For those in/around town (or that can be) come join in the fun!
>
>
>
>
> --

Re: [Call for items] November Beam Newsletter

[Matthias Baetens]

Looks great, thanks for the effort and for including the Summit blogpost,
Rose!

On Thu, 8 Nov 2018 at 22:55 Rose Nguyen  wrote:

> Hi Beamers:
>
> Time to sync with the community on all the awesome stuff we've been doing!
>
> *Add the highlights from October to now (or planned events and talks) that
> you want to share by 11/14 11:59 p.m. PDT.*
>
> We will collect the notes via Google docs but send out the final version
> directly to the user mailing list. If you do not know how to format
> something, it is OK to just put down the info and I will edit. I'll ship
> out the newsletter on 11/15.
>
> [1]
> https://docs.google.com/document/d/1kKQ4a9RdptB6NwYlqmI9tTcdLAUzDnWi2dkvUi0J_Ww
> --
> Rose Thị Nguyễn
>
--

Recordings and presentations from Beam Summit London 2018

[Matthias Baetens]

Hi everyone,

Very happy to be sharing the great materials from the speakers and
contributors at the Beam Summit we had in London last month in the *new
blogpost* on the website:
https://beam.apache.org/blog/2018/10/31/beam-summit-aftermath.html

You can find the full list of presentations and recordings of the sessions
there, or you can head over to our YouTube channel
.

Thanks for everyone who helped, contributed, was a speaker or sponsor at
the event.

Best,
Matthias
--

Re: Agenda for the Beam Summit London 2018

[Matthias Baetens]

Thanks a lot Thomas. I will announce the blogpost on the mailinglist for
everyone to benefit :)!

On Fri, 2 Nov 2018 at 14:19 Thomas Weise  wrote:

> Wow, great work! I just merged your PR.
>
>
> On Fri, Nov 2, 2018 at 12:44 AM Matthias Baetens <
> baetensmatth...@gmail.com> wrote:
>
>> Hey Kenn, JB,
>>
>> Correct! I uploaded all the videos and drafted an 'aftermath' blogpost
>> for which I submitted a PR yesterday night (took a bit longer than expected
>> since the structure changed). I was going to share all of it as soon as the
>> PR is merged, so any help there is greatly appreciated!
>>
>> Many thanks,
>> Matthias
>>
>> On Fri, Nov 2, 2018, 05:38 Jean-Baptiste Onofré  wrote:
>>
>>> There's already a website pr with the videos afair.
>>>
>>> Regards
>>>
>>> JB
>>> Le 2 nov. 2018, à 06:37, Kenneth Knowles  a écrit:
>>>>
>>>> I see that the videos are on our Youtube channel now. Any chance of a
>>>> blog post to highlight this? (and anything else about the summit)
>>>>
>>>> Kenn
>>>>
>>>> On Mon, Oct 1, 2018 at 1:39 AM Alexey Romanenko <
>>>> aromanenko@gmail.com> wrote:
>>>>
>>>>> I wish to all to have a great summit in London!
>>>>> Unfortunately, I can’t be there, so, if the talks will be recorded and
>>>>> available on-line later then it would be amazing!
>>>>>
>>>>> On 30 Sep 2018, at 12:37, Pascal Gula  wrote:
>>>>>
>>>>> Hi,
>>>>> Do any of you plan to meet on Sunday evening for dinner?
>>>>> See you all soon!
>>>>> Cheers,
>>>>> Pascal
>>>>>
>>>>> On Sat, 29 Sep 2018, 18:13 Andrew Psaltis, 
>>>>> wrote:
>>>>>
>>>>>> Fantastic @Matthias .
>>>>>>
>>>>>> On Sat, Sep 29, 2018 at 7:07 AM Matthias Baetens <
>>>>>> baetensmatth...@gmail.com> wrote:
>>>>>>
>>>>>>> Looking forward to have you all.
>>>>>>>
>>>>>>> @Andrew: we are trying to cover as much sessions with recording as
>>>>>>> possible. Stay tuned and check the Beam YouTube channel after the event!
>>>>>>>
>>>>>>> On Fri, 28 Sep 2018 at 19:51 Danny Angus  wrote:
>>>>>>>
>>>>>>>>
>>>>>>>> How exciting, can't wait to join you guys on Monday!
>>>>>>>> :-)
>>>>>>>> D.
>>>>>>>>
>>>>>>>> On 2018/09/27 22:03:16, Griselda Cuevas  wrote:
>>>>>>>> > Hi Beam Community,
>>>>>>>> >
>>>>>>>> > We have finalized the agenda for the Beam Summit London 2018,
>>>>>>>> it's here:
>>>>>>>> >
>>>>>>>> https://www.linkedin.com/feed/update/urn:li:activity:6450125487321735168/
>>>>>>>> >
>>>>>>>> >
>>>>>>>> > We had a great amount of talk proposals, thank you so much to
>>>>>>>> everyone who
>>>>>>>> > submitted one! We also sold out the event, so we're very excited
>>>>>>>> to see the
>>>>>>>> > community growing.
>>>>>>>> >
>>>>>>>> >
>>>>>>>> > See you around,
>>>>>>>> >
>>>>>>>> > Gris on behalf of the Organizing Committee
>>>>>>>> >
>>>>>>>>
>>>>>>> --
>>>>>>>
>>>>>>>
>>>>>>
>>>>> --
>>
>>
> --

Re: Agenda for the Beam Summit London 2018

[Matthias Baetens]

Hey Kenn, JB,

Correct! I uploaded all the videos and drafted an 'aftermath' blogpost for
which I submitted a PR yesterday night (took a bit longer than expected
since the structure changed). I was going to share all of it as soon as the
PR is merged, so any help there is greatly appreciated!

Many thanks,
Matthias

On Fri, Nov 2, 2018, 05:38 Jean-Baptiste Onofré  wrote:

> There's already a website pr with the videos afair.
>
> Regards
>
> JB
> Le 2 nov. 2018, à 06:37, Kenneth Knowles  a écrit:
>>
>> I see that the videos are on our Youtube channel now. Any chance of a
>> blog post to highlight this? (and anything else about the summit)
>>
>> Kenn
>>
>> On Mon, Oct 1, 2018 at 1:39 AM Alexey Romanenko 
>> wrote:
>>
>>> I wish to all to have a great summit in London!
>>> Unfortunately, I can’t be there, so, if the talks will be recorded and
>>> available on-line later then it would be amazing!
>>>
>>> On 30 Sep 2018, at 12:37, Pascal Gula  wrote:
>>>
>>> Hi,
>>> Do any of you plan to meet on Sunday evening for dinner?
>>> See you all soon!
>>> Cheers,
>>> Pascal
>>>
>>> On Sat, 29 Sep 2018, 18:13 Andrew Psaltis, 
>>> wrote:
>>>
>>>> Fantastic @Matthias .
>>>>
>>>> On Sat, Sep 29, 2018 at 7:07 AM Matthias Baetens <
>>>> baetensmatth...@gmail.com> wrote:
>>>>
>>>>> Looking forward to have you all.
>>>>>
>>>>> @Andrew: we are trying to cover as much sessions with recording as
>>>>> possible. Stay tuned and check the Beam YouTube channel after the event!
>>>>>
>>>>> On Fri, 28 Sep 2018 at 19:51 Danny Angus  wrote:
>>>>>
>>>>>>
>>>>>> How exciting, can't wait to join you guys on Monday!
>>>>>> :-)
>>>>>> D.
>>>>>>
>>>>>> On 2018/09/27 22:03:16, Griselda Cuevas  wrote:
>>>>>> > Hi Beam Community,
>>>>>> >
>>>>>> > We have finalized the agenda for the Beam Summit London 2018, it's
>>>>>> here:
>>>>>> >
>>>>>> https://www.linkedin.com/feed/update/urn:li:activity:6450125487321735168/
>>>>>> >
>>>>>> >
>>>>>> > We had a great amount of talk proposals, thank you so much to
>>>>>> everyone who
>>>>>> > submitted one! We also sold out the event, so we're very excited to
>>>>>> see the
>>>>>> > community growing.
>>>>>> >
>>>>>> >
>>>>>> > See you around,
>>>>>> >
>>>>>> > Gris on behalf of the Organizing Committee
>>>>>> >
>>>>>>
>>>>> --
>>>>>
>>>>>
>>>>
>>> --

Re: [ANNOUNCE] New committer announcement, Euphoria edition

[Matthias Baetens]

Congrats David!!!

On Thu, Nov 1, 2018, 16:04 Kenneth Knowles  wrote:

> Hi all,
>
> Please join me and the rest of the Beam PMC in welcoming a new committer:
>
>  - David Morávek: of, but not limited to, the new Euphoria API
>
> Through his work with us merging the Euphoria API, community outreach,
> and other contributions to Beam, the PMC trusts David with the
> responsibilities of a Beam committer [1].
>
> Kenn
>
> [1] https://beam.apache.org/contribute/become-a-committer/#an-apache-beam-
> committer
>
> --

Re: Beam Summit community feedback

[Matthias Baetens]

Hey Max,

Great stuff, thank you for sharing this.
In case anyone has feedback on the summit as a whole, please feel free to
fill out the survey  as well.

Thank you!
Best regards,
Matthias

On Tue, 9 Oct 2018 at 10:48 Maximilian Michels  wrote:

> Thanks for the pointer to the thread. I didn't know there already had
> been a discussion. It is possible to look at Kubernetes support solely
> from a Runner perspective, still we have to provide the basic knobs in
> Beam to make deployment easy.
>
> The approach Henning described here and in the thread (Approach 2:
>
> https://lists.apache.org/thread.html/209ddf4d701c8c915e3b411e99773f491a6cd830807d636b47e8@%3Cdev.beam.apache.org%3E)
>
> where the backend and the SDK harness are started concurrently with
> fixed endpoints would be the way to go. In the Proto we already have the
> "EXTERNAL" environment for that.
>
> On 08.10.18 20:18, Thomas Weise wrote:
> > Related thread:
> >
> >
> https://lists.apache.org/thread.html/d6b6fde764796de31996db9bb5f9de3e7aaf0ab29b99d0adb52ac508@%3Cdev.beam.apache.org%3E
> >
> > Kubernetes is otherwise more of a runner deployment concern. There are
> > efforts in the Flink community underway to make deployment on Kubernetes
> > easier.
> >
> > Max: thanks for taking notes!
> >
> >
> > On Mon, Oct 8, 2018 at 10:43 AM Henning Rohde  > > wrote:
> >
> > Regarding the Kubernetes/Docker story: the current idea for that
> > setup is to use a per-job pod for the user/sdk containers + runner
> > container, so that running (and scaling) a job will go with the
> > grain of that ecosystem. The Beam code on each worker thus wouldn't
> > do any container management. This is also how Dataflow essentially
> > works. The process-based option assumes that the runner environment
> > is what the SDK needs, which is generally not the case.
> >
> > Henning
> >
> > On Sun, Oct 7, 2018 at 1:40 PM Alex Van Boxel  > > wrote:
> >
> > Hey Max, I've build quit some experience with *Kubernetes* over
> > the years. The problem you describe seems like a custom operator
> > story. The thing is I don't know enough of the runner and
> > bootstrapping story. After the summit I'm quite eager to dive
> > into a beam problem, so if you like to collaborate on that topic
> > let me know.
> >
> >   _/
> > _/ Alex Van Boxel
> >
> >
> > On Fri, Oct 5, 2018 at 4:05 PM Maximilian Michels
> > mailto:m...@apache.org>> wrote:
> >
> > Hi,
> >
> > What do you think about collecting some of the feedback from
> > the
> > community at Beam Summit last week? Here's what I've come
> > across:
> >
> >
> > * The Kubernetes / Docker Story
> >
> > Multiple users reported that they would like a
> > Beam-Kubernetes story.
> > What is the best way to deploy Beam with Kubernetes? Will
> > there be
> > built-in support?
> >
> > Especially with regards to the portability, there are some
> > unsolved
> > problems, e.g. how to start Beam containerized and bootstrap
> > the SDK
> > Harness container from within a container? For local testing
> > with the
> > JobServer we support that via mounting the Docker socket,
> > but this will
> > be too fragile in production scenarios. Now that we have
> > process-based
> > execution, we could just use that inside the main container.
> >
> > Deployment is a very important topic for users and we should
> > try to
> > reduce complexity as much as possible.
> >
> > * External SDKs / Scio
> >
> > Users have asked why Scio is not part of the main
> > repository. Generally,
> > I don't think that has to be the case, same for the Runners
> > which are
> > not part of the main repo. However, it does raise the
> > question, what
> > will be the future model for maintaining SDKs/IOs/Runners?
> > How do we
> > ensure easy development and a consistent quality of
> > internal/external
> > components?
> >
> > * Documenting Timers & State
> >
> > These two have excellent blog posts but are not part of the
> > official
> > documentation. Since they are part of the model, it would be
> > good to
> > eventually update the docs.
> >
> > * Better Debuggability of pipelines
> >
> > Even a simple WordCount in Beam leads to a quite complex
> > Flink execution
> > graph (due to the the involved I/O logic). How can 

Re: [ANNOUNCEMENT] New Beam chair: Kenneth Knowles

[Matthias Baetens]

Thank you for all the mentoring and work for the Apache Beam project, Davor.

Welcome as a chair in the project Kenn, congratulations!

On Thu, Sep 20, 2018, 22:58 Reuven Lax  wrote:

> Congratulations Kenn!
>
> On Thu, Sep 20, 2018 at 2:31 PM Griselda Cuevas  wrote:
>
>> Thank you so much Davor for all the work you put into the project since
>> its inception.
>> Congrats Kenn on becoming the new Chair!
>>
>> On Thu, 20 Sep 2018 at 12:54, Neelesh Salian 
>> wrote:
>>
>>> Congratulation Kenn!
>>> Thank you for your continued leadership , Davor.
>>>
>>> On Wed, Sep 19, 2018 at 12:54 PM Davor Bonaci  wrote:
>>>
 Hi everyone --
 It is with great pleasure that I announce that at today's meeting of
 the Foundation's Board of Directors, the Board has appointed Kenneth
 Knowles as the second chair of the Apache Beam project.

 Kenn has served on the PMC since its inception, and is very active and
 effective in growing the community. His exemplary posts have been cited in
 other projects. I'm super happy to have Kenn accepted the nomination, and
 I'm confident that he'll serve with distinction.

 As for myself, I'm not going anywhere. I'm still around and will be as
 active as I have recently been. Thrilled to be able to pass the baton to
 such a key member of this community and to have less administrative work to
 do ;-).

 Please join me in welcoming Kenn to his new role, and I ask that you
 support him as much as possible. As always, please let me know if you have
 any questions.

 Davor

>>>
>>>
>>> --
>>> Regards,
>>> Neelesh S. Salian
>>>
>>> --

Re: [Proposal] Track non-code contributions in Jira

[Matthias Baetens]

I fully agree and think it is a great idea.

I think that, next to visibility and keeping track of everything that is
going on in the community, the other goal would be documenting best
practices for future use.

I am also not sure, though, if JIRA is the best place to do so, as Austin
raised.
Introducing (yet) another tool on the other hand, might also not be ideal.
Has anyone else experience with this from other Apache projects?

On Fri, 24 Aug 2018 at 06:04 Austin Bennett 
wrote:

> Certainly tracking and managing these are important -- though, is Jira the
> best tool for these things?
>
> I do see it useful to put in Jira tickets in for my director to have
> conversations on specific topics with people, for consensus building, etc
> etc.  So, I have seen it work even for non-coding tasks.
>
> It seems like much of #s 2-6 mentioned requires project management applied
> to those specific domains and is applicable elsewhere, wondering what
> constitutes "pure" project management in #1 (as it applies here)...?  In
> that light I'm just getting picky about taxonomy :-)
>
>
>
>
>
> On Thu, Aug 23, 2018 at 3:10 PM Alan Myrvold  wrote:
>
>> I like the idea of recognizing non-code contributions. These other
>> efforts have been very helpful.
>>
>> On Thu, Aug 23, 2018 at 3:07 PM Griselda Cuevas  wrote:
>>
>>> Hi Beam Community,
>>>
>>> I'd like to start tracking non-code contributions for Beam, specially
>>> around these six categories:
>>> 1) Project Management
>>> 2) Community Management
>>> 3) Advocacy
>>> 4) Events & Meetups
>>> 5) Documentation
>>> 6) Training
>>>
>>> The proposal would be to create six boards in Jira, one per proposed
>>> category, and as part of this initiative also clean the already existing
>>> "Project Management" component, i.e. making sure all issues there are still
>>> relevant.
>>>
>>> After this, I'd also create a landing page in the website that talks
>>> about all types of contributions to the project.
>>>
>>> The reason for doing this is mainly to give visibility to some of the
>>> great work our community does beyond code pushes in Github. Initiatives
>>> around Beam are starting to spark around the world, and it'd be great to
>>> become an Apache project recognized for our outstanding community
>>> recognition.
>>>
>>> What are your thoughts?
>>> G
>>>
>>> Gris
>>>
>> --

Re: Beam Summit London 2018

[Matthias Baetens]

Hi Pascal, Javier,

Thanks for your interest in submitting a talk!
@Pascal: I am happy to check for you if what you have in mind is already
being covered in another talk submitted, and happy to help you find a good
topic to talk about :)

@Javier: it will depend on the type and subject of the session. If you are
planning to do an advanced workshop, it makes sense to allocate more time
(>1h). If it is a business case also covering architecture and technical, I
think longer sessions should be possible as well (~1h including Q). If
your talk turns out to have to much content, we can always look at ways to
split it up into 2 stand-alone sessions if that would make sense.

Best,
Matthias

On Tue, 21 Aug 2018 at 19:45 javier ramirez 
wrote:

> Hi,
>
> What'd be the duration of the talks? So I can scope the contents of my
> proposal.
>
> Looking forward to the summit!
>
> J
>
> On Tue, 21 Aug 2018, 14:47 Pascal Gula,  wrote:
>
>> Hi Matthias,
>> we (Peat / Plantix) might be interested by submitting a talk and I would
>> like to know if we can get access to the list of already submitted "Title"
>> to avoid submitting on similar topic!
>> Cheers,
>> Pascal
>>
>> On Tue, Aug 21, 2018 at 1:59 PM, Matthias Baetens <
>> baetensmatth...@gmail.com> wrote:
>>
>>> Hi everyone,
>>>
>>> We are happy to invite you to the first Beam Summit in London.
>>>
>>> The summit will be held in London at Level39
>>> <https://goo.gl/maps/LAC4haDzSzR2> on *October 1 and 2.*
>>> You can register to attend for free on the Eventbrite page
>>> <https://www.eventbrite.com/e/beam-summit-london-2018-tickets-49100625292>
>>> .
>>>
>>> If you are interested in talking, please check our CfP form
>>> <https://goo.gl/forms/nrZOCC1JwEfLtKfA2> and submit a talk!
>>>
>>> If you or your company is interested in helping out or sponsoring the
>>> summit (to keep it free), you can check out the sponsor booklet
>>> <https://drive.google.com/file/d/1RnZ52rGaB6BR-EKneBcabdMcg9Pl7z9M/view?usp=sharing>
>>> .
>>>
>>> We will soon launch a blogpost with more details and announce the agenda
>>> closer to date.
>>>
>>> Thanks to everyone who helped make this happen, looking forward to
>>> welcoming you all in London!
>>>
>>> The Events & Meetups Group
>>>
>>> --
>>>
>>>
>>
>>
>>
>> --
>>
>> Pascal Gula
>> Senior Data Engineer / Scientist+49 (0)176 34232684 
>> <+49%20176%2034232684>www.plantix.net <http://plantix.net/>
>>  PEAT GmbHKastanienallee 4
>> 10435 Berlin // Germany 
>> <https://maps.google.com/?q=Kastanienallee+4%0D%0A10435+Berlin+//+Germany=gmail=g>
>>  <https://play.google.com/store/apps/details?id=com.peat.GartenBank>Download 
>> the App! <https://play.google.com/store/apps/details?id=com.peat.GartenBank>
>>
>> --

Beam Summit London 2018

[Matthias Baetens]

Hi everyone,

We are happy to invite you to the first Beam Summit in London.

The summit will be held in London at Level39
 on *October 1 and 2.*
You can register to attend for free on the Eventbrite page
.

If you are interested in talking, please check our CfP form
 and submit a talk!

If you or your company is interested in helping out or sponsoring the
summit (to keep it free), you can check out the sponsor booklet

.

We will soon launch a blogpost with more details and announce the agenda
closer to date.

Thanks to everyone who helped make this happen, looking forward to
welcoming you all in London!

The Events & Meetups Group

--

Re: Apache Beam Summit in Europe

[Matthias Baetens]

Hi everyone!

Thanks for filling out the survey. We are currently looking into the
practicalities (venue, dates, ...).
To get a better grasp of the size of the audience, Alex has been so kind to
start a poll on Twitter:
https://twitter.com/alexvb/status/1014531906564775937. If you have a spare
minute, it would be great if you could fill this out (retweets are, of
course, greatly appreciated as well).

For the dates, we are thinking of:
- 28-29/09
- 1-2/10 or 3-4/10
- 15-16/10

Happy to hear your preferences and comments.
Best,
Matthias

On Thu, 31 May 2018 at 07:15 Matthias Baetens 
wrote:

> Hi Beam Community,
>
> We are planning to have an Apache Beam Summit in Europe, pretty similar to
> what we hosted earlier in California on March 15th this year.
> If you'd be interested in attending, helping with organization or
> speaking, please answer this Google form
> <https://docs.google.com/forms/d/e/1FAIpQLSeBoxWIOumjGijU_kTccLqGqS9PrQU1RqRVp9Cla5F4HLO1DQ/viewform>
> !
>
> Cheers,
> Matthias & the events and meetups folks
> --
>
>
--

Re: [FYI] New Apache Beam Swag Store!

[Matthias Baetens]

Hey Robert,

I have requested to include this in the webshop or send me the sizes via
e-mail. I'll let you know if I get an update on this!

Cheers,
Matthias

On Thu, 14 Jun 2018 at 23:22 Robert Burke  wrote:

> Would it be possible to get the brand of the shirts & sweaters, and the
> sizing information? The vendor should have that available. The pages have a
> lot of fabric and cut description, but not the measurements.
> Sizes fit varies dramatically on the brand, and if I get a hoodie,
> anything from a Medium to and XL can fit my arms and torso properly.
>
> On Wed, 13 Jun 2018 at 11:10 Griselda Cuevas  wrote:
>
>> Thanks All!
>>
>> To close the loop on the suggestions, I'll order more t-shirts in black
>> so we have some options.
>>
>> G
>>
>> On Wed, 13 Jun 2018 at 08:39, Ismaël Mejía  wrote:
>>
>>> Great ! Thanks Gris and Matthias for putting this in place.
>>> Hope to get that hoodie soon. As a suggestion, more colors too, and
>>> eventually a t-shirt just with the big B logo.
>>> On Mon, Jun 11, 2018 at 6:50 PM Mikhail Gryzykhin 
>>> wrote:
>>> >
>>> > That's nice!
>>> >
>>> > More colors are appreciated :)
>>> >
>>> > --Mikhail
>>> >
>>> >
>>> > On Sun, Jun 10, 2018 at 8:20 PM Kenneth Knowles 
>>> wrote:
>>> >>
>>> >> Sweet! Agree with Raghu :-)
>>> >>
>>> >> Kenn
>>> >>
>>> >> On Sun, Jun 10, 2018 at 6:06 AM Matthias Baetens <
>>> baetensmatth...@gmail.com> wrote:
>>> >>>
>>> >>> Great news, big thanks for all the work, Gris! Looking forward to
>>> people wearing this around the globe ;)
>>> >>>
>>> >>> On Sat, 9 Jun 2018 at 01:28 Ankur Goenka  wrote:
>>> >>>>
>>> >>>> Awesome!
>>> >>>>
>>> >>>>
>>> >>>> On Fri, Jun 8, 2018 at 4:24 PM Pablo Estrada 
>>> wrote:
>>> >>>>>
>>> >>>>> Nice : D
>>> >>>>>
>>> >>>>> On Fri, Jun 8, 2018, 3:43 PM Raghu Angadi 
>>> wrote:
>>> >>>>>>
>>> >>>>>> Woo-hoo! This is terrific.
>>> >>>>>>
>>> >>>>>> If we are increasing color choices I would like black or
>>> charcoal... Beam logo would really pop on a dark background.
>>> >>>>>>
>>> >>>>>> On Fri, Jun 8, 2018 at 3:32 PM Griselda Cuevas 
>>> wrote:
>>> >>>>>>>
>>> >>>>>>> Hi Beam Community,
>>> >>>>>>>
>>> >>>>>>> I just want to share with you the exciting news about our brand
>>> new Apache Beam Swag Store!
>>> >>>>>>>
>>> >>>>>>> You can find it here: https://store-beam.myshopify.com/
>>> >>>>>>>
>>> >>>>>>> How does it work?
>>> >>>>>>>
>>> >>>>>>> You can just select the items you want and check-out. Our Vendor
>>> ships to anywhere in the world and normally can have swag to be delivered
>>> within 1 week. Each company or user will need to pay for their own swag.
>>> >>>>>>> If you are hosting an event or representing Beam at one, reach
>>> out to me or the beam-events-meetups slack channel, I'll be happy to review
>>> your event and see if we can sponsor the swag. We'll have codes for this
>>> occasions thanks to Google, who has sponsored an initial inventory.
>>> >>>>>>>
>>> >>>>>>> If you have feedback, ideas on new swag, questions or
>>> suggestions, reach out to me and/or Matthias Baetens.
>>> >>>>>>>
>>> >>>>>>> Happy Friday!
>>> >>>>>>> G
>>> >>>>>>>
>>> >>>>>>>
>>> >>>>> --
>>> >>>>> Got feedback? go/pabloem-feedback
>>> <https://goto.google.com/pabloem-feedback>
>>> >>>
>>> >>> --
>>> >>>
>>>
>> --

Re: [FYI] New Apache Beam Swag Store!

[Matthias Baetens]

Great news, big thanks for all the work, Gris! Looking forward to people
wearing this around the globe ;)

On Sat, 9 Jun 2018 at 01:28 Ankur Goenka  wrote:

> Awesome!
>
>
> On Fri, Jun 8, 2018 at 4:24 PM Pablo Estrada  wrote:
>
>> Nice : D
>>
>> On Fri, Jun 8, 2018, 3:43 PM Raghu Angadi  wrote:
>>
>>> Woo-hoo! This is terrific.
>>>
>>> If we are increasing color choices I would like black or charcoal...
>>> Beam logo would really pop on a dark background.
>>>
>>> On Fri, Jun 8, 2018 at 3:32 PM Griselda Cuevas  wrote:
>>>
>>>> Hi Beam Community,
>>>>
>>>> I just want to share with you the exciting news about our brand new
>>>> Apache Beam Swag Store!
>>>>
>>>> You can find it here: https://store-beam.myshopify.com/
>>>>
>>>> *How does it work?*
>>>>
>>>>- You can just select the items you want and check-out. Our Vendor
>>>>ships to anywhere in the world and normally can have swag to be 
>>>> delivered
>>>>within 1 week. Each company or user will need to pay for their own swag.
>>>>- If you are hosting an event or representing Beam at one, reach
>>>>out to me or the beam-events-meetups slack channel, I'll be happy to 
>>>> review
>>>>your event and see if we can sponsor the swag. We'll have codes for this
>>>>occasions thanks to Google, who has sponsored an initial inventory.
>>>>
>>>> If you have feedback, ideas on new swag, questions or suggestions,
>>>> reach out to me and/or Matthias Baetens.
>>>>
>>>> Happy Friday!
>>>> G
>>>>
>>>>
>>>> --
>> Got feedback? go/pabloem-feedback
>> <https://goto.google.com/pabloem-feedback>
>>
> --

Re: [Proposal] Apache Beam Swag Store

[Matthias Baetens]

We are very close to launching the store --- we should have news next week!

On Fri, 1 Jun 2018 at 15:43 Ismaël Mejía  wrote:

> Any news on this ?
> On Tue, Nov 7, 2017 at 1:46 AM Matthias Baetens
>  wrote:
> >
> > +1
> > Awesome stuff, thanks for the effort Gris!
> >
> > On Mon, Nov 6, 2017 at 5:31 AM, Griselda Cuevas  >
> > wrote:
> >
> > > Excellent - we're getting approval from the trademark@ folks. I'll
> update
> > > the thread when I have news.
> > >
> > >
> > >
> > > On 5 November 2017 at 14:04, Ted Yu  wrote:
> > >
> > > > +1
> > > >  Original message From: Jacob Marble <
> > > jmar...@kochava.com>
> > > > Date: 11/5/17  1:50 PM  (GMT-08:00) To: dev@beam.apache.org
> Subject: Re:
> > > > [Proposal] Apache Beam Swag Store
> > > > I think this is a great idea, ready to order mine. :)
> > > >
> > > > Jacob
> > > >
> > > > On Sat, Oct 28, 2017 at 11:19 AM, Jean-Baptiste Onofré <
> j...@nanthrax.net>
> > > > wrote:
> > > >
> > > > > It sounds good. Please let us know trademark update.
> > > > >
> > > > > Thanks
> > > > > Regards
> > > > > JB
> > > > >
> > > > > On Oct 28, 2017, 20:15, at 20:15, Griselda Cuevas
> > > > 
> > > > > wrote:
> > > > > >Thanks for the feedback all, I'll send this idea to the trademark@
> > > > > >folks
> > > > > >and wait for validation. Once we have it I'll look into building
> the
> > > > > >store
> > > > > >possibly embedded in the website.
> > > > > >
> > > > > >Enjoy the weekend.
> > > > > >G
> > > > > >
> > > > > >5
> > > > > >
> > > > > >
> > > > > >
> > > > > >On 27 October 2017 at 11:53, Tyler Akidau
>  > > >
> > > > > >wrote:
> > > > > >
> > > > > >> One additional note: for the logos w/ the name below them,
> would be
> > > > > >nice to
> > > > > >> not have quite so much whitespace between the logo and the name.
> > > > > >Otherwise,
> > > > > >> trademark validation aside, this looks great.
> > > > > >>
> > > > > >> On Fri, Oct 27, 2017 at 10:15 AM Griselda Cuevas
> > > > > >
> > > > > >> wrote:
> > > > > >>
> > > > > >> > Hi Dan - thanks for bringing this up to my attention. I
> haven't
> > > > > >raised
> > > > > >> this
> > > > > >> > up to the tradema...@apache.org people. Can I just reach out
> to
> > > > > >them to
> > > > > >> > get
> > > > > >> > the proposal or should one of the PMCs do this?
> > > > > >> >
> > > > > >> >
> > > > > >> >
> > > > > >> > Gris Cuevas Zambrano
> > > > > >> >
> > > > > >> > g...@google.com
> > > > > >> >
> > > > > >> > Open Source Strategy
> > > > > >> >
> > > > > >> > 345 Spear Street, San Francisco, 94105
> > > > > >> > <https://maps.google.com/?q=345+Spear+Street,+San+Francisco,
> > > > > >> +94105=gmail=g>
> > > > > >> >
> > > > > >> >
> > > > > >> >
> > > > > >> > On 26 October 2017 at 18:30, Daniel Kulp 
> > > wrote:
> > > > > >> >
> > > > > >> > >
> > > > > >> > > Have you run this through tradema...@apache.org yet?
> > > > > >> > >
> > > > > >> > > I bring this up for two reasons:
> > > > > >> > >
> > > > > >> > > 1) We would need to make sure the appearance and such of the
> > > logo
> > > > > >is
> > > > > >> > > “correct”
> > > > > >> > >
> > > > > >> > > 2).A few years ago, Apache did have a partnership with a
> company
> > > > > >that
> &

Re: [ANNOUNCEMENT] New committers, May 2018 edition!

[Matthias Baetens]

Great news, congrats all!

On Fri, 1 Jun 2018 at 08:32 Holden Karau  wrote:

> Congrats all!
>
> On Fri, Jun 1, 2018 at 12:12 AM Ismaël Mejía  wrote:
>
>> Congratulations!
>>
>> On Fri, Jun 1, 2018 at 8:26 AM Pei HE  wrote:
>> >
>> > Congrats!
>> >
>> > On Fri, Jun 1, 2018 at 2:12 PM, Charles Chen  wrote:
>> > > Congratulations everyone!
>> > >
>> > >
>> > > On Thu, May 31, 2018, 10:14 PM Pablo Estrada 
>> wrote:
>> > >>
>> > >> Thanks to the PMC! Very humbled and excited to keep taking part in
>> this
>> > >> great community.
>> > >> :)
>> > >> -P.
>> > >>
>> > >>
>> > >> On Thu, May 31, 2018, 10:10 PM Tim 
>> wrote:
>> > >>>
>> > >>> Congratulations!
>> > >>>
>> > >>>
>> > >>> Tim
>> > >>>
>> > >>> On 1 Jun 2018, at 07:05, Andrew Psaltis 
>> wrote:
>> > >>>
>> > >>> Congrats!
>> > >>>
>> > >>> On Fri, Jun 1, 2018 at 12:26 AM, Thomas Weise 
>> wrote:
>> > 
>> >  Congrats!
>> > 
>> > 
>> >  On Thu, May 31, 2018 at 9:25 PM, Alan Myrvold > >
>> >  wrote:
>> > >
>> > > Congrats Gris+Pablo+Jason. Well deserved.
>> > >
>> > > On Thu, May 31, 2018 at 9:15 PM Jason Kuster <
>> jasonkus...@google.com>
>> > > wrote:
>> > >>
>> > >> Thank you to Davor and the PMC; I'm excited to be able to help
>> Beam in
>> > >> this new capacity. Bring on the PRs. :D
>> > >>
>> > >> On Thu, May 31, 2018 at 8:55 PM Xin Wang > >
>> > >> wrote:
>> > >>>
>> > >>> Congrats!
>> > >>>
>> > >>> - Xin Wang
>> > >>>
>> > >>> 2018-06-01 11:52 GMT+08:00 Rui Wang :
>> > 
>> >  Congrats!
>> > 
>> >  -Rui
>> > 
>> >  On Thu, May 31, 2018 at 8:23 PM Jean-Baptiste Onofré
>> >   wrote:
>> > >
>> > > Congrats !
>> > >
>> > > Regards
>> > > JB
>> > >
>> > > On 01/06/2018 04:08, Davor Bonaci wrote:
>> > > > Please join me and the rest of Beam PMC in welcoming the
>> > > > following
>> > > > contributors as our newest committers. They have
>> significantly
>> > > > contributed to the project in different ways, and we look
>> forward
>> > > > to
>> > > > many more contributions in the future.
>> > > >
>> > > > * Griselda Cuevas
>> > > > * Pablo Estrada
>> > > > * Jason Kuster
>> > > >
>> > > > (Apologizes for a delayed announcement, and the lack of the
>> usual
>> > > > paragraph summarizing individual contributions.)
>> > > >
>> > > > Congratulations to all three! Welcome!
>> > >>>
>> > >>>
>> > >>>
>> > >>>
>> > >>> --
>> > >>> Thanks,
>> > >>> Xin
>> > >>
>> > >>
>> > >>
>> > >> --
>> > >> ---
>> > >> Jason Kuster
>> > >> Apache Beam / Google Cloud Dataflow
>> > >>
>> > >> See something? Say something. go/jasonkuster-feedback
>> > 
>> > 
>> > >>>
>> > >> --
>> > >> Got feedback? go/pabloem-feedback
>>
> --
> Twitter: https://twitter.com/holdenkarau
>
--

Re: "Radically modular data ingestion APIs in Apache Beam" @ Strata - slides available

[Matthias Baetens]

Hey Ismaël,

That totally makes sense, I will work on this on the weekend and send a PR.

Cheers,
Matthias

On Thu, 31 May 2018 at 09:45 Ismaël Mejía  wrote:

> Great !
>
> Matthias I think it makes sense to have these guidelines in the beam
> site better than a google doc. Can you please submit a PR for this?
>
> On Thu, May 31, 2018 at 8:03 AM Matthias Baetens
>  wrote:
> >
> > Hey Eugene, hi all!
> >
> > Happy to say your talk is now on the Beam YouTube channel and can be
> watched here.
> > It'd be great to see more of these on the channel so we can start
> sharing this on meetups, conferences and other places and see this grow, so
> don't hesitate to reach out to me (directly) if you want you video on the
> channel. Find more about the process / guidelines here.
> >
> > Best,
> > Matthias
> >
> > On Mon, 14 May 2018 at 22:19 Eugene Kirpichov 
> wrote:
> >>
> >> Hi Matthias,
> >>
> >> Thank you. Here is the raw file on Google Drive:
> https://drive.google.com/file/d/1gUoe6UrpNNO3ijYSgTvD5GBy-14Zx6dT/view?usp=sharing
> >> And yes, I have permission from O'Reilly/Strata to use this file
> whichever way I want, so it's ok to share on YouTube.
> >>
> >> On Fri, May 11, 2018 at 12:13 PM Matthias Baetens <
> baetensmatth...@gmail.com> wrote:
> >>>
> >>> Hey Eugene,
> >>>
> >>> Apologies for picking this up so late, but I could help uploading your
> video to the Beam channel.
> >>> Are you able to send me the raw file and do you have sign-off to go
> ahead with sharing it on YouTube?
> >>>
> >>> Thanks.
> >>> Matthias
> >>>
> >>> On Sat, 14 Apr 2018 at 21:45 Eugene Kirpichov 
> wrote:
> >>>>
> >>>> Hi all,
> >>>>
> >>>> The video is now available. I got it from my Strata account and I
> have permission to use and share it freely, so I published it on my own
> YouTube page (where there's nothing else...). Perhaps it makes sense to add
> to the Beam YouTube channel, but AFAIK only a PMC member can do that.
> >>>>
> >>>> https://www.youtube.com/watch?v=NIn9E5TVoCA
> >>>>
> >>>>
> >>>> On Tue, Mar 13, 2018 at 3:33 AM James  wrote:
> >>>>>
> >>>>> Very informative, thanks!
> >>>>>
> >>>>> On Fri, Mar 9, 2018 at 4:49 PM Etienne Chauchot <
> echauc...@apache.org> wrote:
> >>>>>>
> >>>>>> Great !
> >>>>>>
> >>>>>> Thanks for sharing.
> >>>>>>
> >>>>>> Etienne
> >>>>>>
> >>>>>>
> >>>>>> Le jeudi 08 mars 2018 à 19:49 +, Eugene Kirpichov a écrit :
> >>>>>>
> >>>>>> Hey all,
> >>>>>>
> >>>>>> The slides for my yesterday's talk at Strata San Jose
> https://conferences.oreilly.com/strata/strata-ca/public/schedule/detail/63696
> have been posted on the talk page. They may be of interest both to users
> and IO authors.
> >>>>>>
> >>>>>> Thanks.
> >>>
> >>> --
> >>>
> >
> > --
> >
>
--

Apache Beam Summit in Europe

[Matthias Baetens]

Hi Beam Community,

We are planning to have an Apache Beam Summit in Europe, pretty similar to
what we hosted earlier in California on March 15th this year.
If you'd be interested in attending, helping with organization or speaking,
please answer this Google form

!

Cheers,
Matthias & the events and meetups folks
--

Re: "Radically modular data ingestion APIs in Apache Beam" @ Strata - slides available

[Matthias Baetens]

Hey Eugene, hi all!

Happy to say your talk is now on the Beam YouTube channel and can be
watched here <https://youtu.be/bhj4Bjczb8I>.
It'd be great to see more of these on the channel so we can start sharing
this on meetups, conferences and other places and see this grow, so don't
hesitate to reach out to me (directly) if you want you video on the
channel. Find more about the process / guidelines here
<https://drive.google.com/open?id=10RNWSU7wGyIOkOvlRbw47wsgkxX2-7G1OKmSlINREus>
.

Best,
Matthias

On Mon, 14 May 2018 at 22:19 Eugene Kirpichov  wrote:

> Hi Matthias,
>
> Thank you. Here is the raw file on Google Drive:
> https://drive.google.com/file/d/1gUoe6UrpNNO3ijYSgTvD5GBy-14Zx6dT/view?usp=sharing
>
> And yes, I have permission from O'Reilly/Strata to use this file whichever
> way I want, so it's ok to share on YouTube.
>
> On Fri, May 11, 2018 at 12:13 PM Matthias Baetens <
> baetensmatth...@gmail.com> wrote:
>
>> Hey Eugene,
>>
>> Apologies for picking this up so late, but I could help uploading your
>> video to the Beam channel.
>> Are you able to send me the raw file and do you have sign-off to go ahead
>> with sharing it on YouTube?
>>
>> Thanks.
>> Matthias
>>
>> On Sat, 14 Apr 2018 at 21:45 Eugene Kirpichov 
>> wrote:
>>
>>> Hi all,
>>>
>>> The video is now available. I got it from my Strata account and I have
>>> permission to use and share it freely, so I published it on my own YouTube
>>> page (where there's nothing else...). Perhaps it makes sense to add to the
>>> Beam YouTube channel, but AFAIK only a PMC member can do that.
>>>
>>> https://www.youtube.com/watch?v=NIn9E5TVoCA
>>>
>>>
>>> On Tue, Mar 13, 2018 at 3:33 AM James  wrote:
>>>
>>>> Very informative, thanks!
>>>>
>>>> On Fri, Mar 9, 2018 at 4:49 PM Etienne Chauchot 
>>>> wrote:
>>>>
>>>>> Great !
>>>>>
>>>>> Thanks for sharing.
>>>>>
>>>>> Etienne
>>>>>
>>>>
>>>>> Le jeudi 08 mars 2018 à 19:49 +, Eugene Kirpichov a écrit :
>>>>>
>>>>> Hey all,
>>>>>
>>>>> The slides for my yesterday's talk at Strata San Jose
>>>>> https://conferences.oreilly.com/strata/strata-ca/public/schedule/detail/63696
>>>>>  have
>>>>> been posted on the talk page. They may be of interest both to users and IO
>>>>> authors.
>>>>>
>>>>> Thanks.
>>>>>
>>>>> --
>>
>>
> --

Re: I'm back and ready to help grow our community!

[Matthias Baetens]

Same here - shame on me. Congratulations on the graduation Gris, very happy
to have you back!

On Tue, 22 May 2018 at 09:19 Ismaël Mejía  wrote:

> I missed somehow this email thread.
> Congratulations Gris and welcome back!
>
> On Fri, May 18, 2018 at 5:34 AM Jesse Anderson 
> wrote:
>
> > Congrats!
>
> > On Thu, May 17, 2018, 6:44 PM Robert Burke  wrote:
>
> >> Congrats & welcome back!
>
> >> On Thu, May 17, 2018, 5:44 PM Huygaa Batsaikhan 
> wrote:
>
> >>> Welcome back, Gris! Congratulations!
>
> >>> On Thu, May 17, 2018 at 4:24 PM Robert Bradshaw 
> wrote:
>
>  Congratulations, Gris! And welcome back!
>  On Thu, May 17, 2018 at 3:30 PM Robin Qiu  wrote:
>
>  > Congratulations! Welcome back!
>
>  > On Thu, May 17, 2018 at 3:23 PM Reuven Lax 
> wrote:
>
>  >> Congratulations! Good to see you back!
>
>  >> Reuven
>
>  >> On Thu, May 17, 2018 at 2:24 PM Griselda Cuevas 
> wrote:
>
>  >>> Hi Everyone,
>
>
>  >>> I was absent from the mailing list, slack channel and our Beam
>  community for the past six weeks, the reason was that I took a leave
> to
>  focus on finishing my Masters Degree, which I finally did on May 15th.
>
>
>  >>> I graduated as a Masters of Engineering in Operations Research
> with a
>  concentration in Data Science from UC Berkeley. I'm glad to be part of
> this
>  community and I'd like to share this accomplishment with you so I'm
> adding
>  two pictures of that day :)
>
>
>  >>> Given that I've seen so many new folks around, I'd like to use
> this
>  opportunity to re-introduce myself. I'm Gris Cuevas and I work at
> Google.
>  Now that I'm back, I'll continue to work on supporting our community
> in two
>  main streams: Contribution Experience & Events, Meetups, and
> Conferences.
>
>
>  >>> It's good to be back and I look forward to collaborating with you.
>
>
>  >>> Cheers,
>
>  >>> Gris
>
--

Re: "Radically modular data ingestion APIs in Apache Beam" @ Strata - slides available

[Matthias Baetens]

Hey Eugene,

Apologies for picking this up so late, but I could help uploading your
video to the Beam channel.
Are you able to send me the raw file and do you have sign-off to go ahead
with sharing it on YouTube?

Thanks.
Matthias

On Sat, 14 Apr 2018 at 21:45 Eugene Kirpichov  wrote:

> Hi all,
>
> The video is now available. I got it from my Strata account and I have
> permission to use and share it freely, so I published it on my own YouTube
> page (where there's nothing else...). Perhaps it makes sense to add to the
> Beam YouTube channel, but AFAIK only a PMC member can do that.
>
> https://www.youtube.com/watch?v=NIn9E5TVoCA
>
>
> On Tue, Mar 13, 2018 at 3:33 AM James  wrote:
>
>> Very informative, thanks!
>>
>> On Fri, Mar 9, 2018 at 4:49 PM Etienne Chauchot 
>> wrote:
>>
>>> Great !
>>>
>>> Thanks for sharing.
>>>
>>> Etienne
>>>
>>
>>> Le jeudi 08 mars 2018 à 19:49 +, Eugene Kirpichov a écrit :
>>>
>>> Hey all,
>>>
>>> The slides for my yesterday's talk at Strata San Jose
>>> https://conferences.oreilly.com/strata/strata-ca/public/schedule/detail/63696
>>>  have
>>> been posted on the talk page. They may be of interest both to users and IO
>>> authors.
>>>
>>> Thanks.
>>>
>>> --

[YouTube channel] Add video: Apache Beam meetup London 3: Apache Beam meet up 3: Streaming SQL + Beam for ML use case + Beam in production

[Matthias Baetens]

Hi all,

We would like to add this
<https://www.youtube.com/watch?v=z5DYDb_C3QA=youtu.be> video to the
Apache Beam YouTube channel.

It is a recording of the third Beam meetup in London
<https://www.meetup.com/nl-NL/London-Apache-Beam-Meetup/events/247868648/?_cookie-check=5Gt56wWJIhZEvY1e>,
with the following content:
- How to launch and monitor your Beam pipelines in production by Victor
Kotai
- Using Beam to enable Machine Learning and predict congestion in London by
Matthias Baetens
- Foundations of Streaming SQL or: how I learned to ❤ streams & tables by
Tyler Akidau

Please let me know if there are any questions or comments, or if this looks
good to go!

Best regards,
Matthias
--

Re: [YouTube channel] Add video: Apache Beam meetup London 2: use case in finance + IO in Beam and Splittable DoFns

[Matthias Baetens]

Hey Ismaël,

Thanks for the feedback. I think that is a great idea tbh. When getting to
know Beam it was more of a coincidence bumping into these and having one
repository with all of them is kind of what I was looking to do with the
Beam YouTube channel.
Either linking them on the page or some other way would improve this
journey greatly, but I don't know about the legal aspects of these things,
happy to have some guidance here!
I'll do an effort of compiling a list (Gris has a similar knowledge repo
with other resources) when I have some time!

I have now posted the first recording
<http://bit.ly/SecondApacheBeamMeetupLondonrecording> of our second meetup
to the channel!

Best,
Matthias


On Thu, Mar 8, 2018 at 9:40 AM, Ismaël Mejía <ieme...@gmail.com> wrote:

> +1
>
> I was wondering if we can also add a playlist that links to
> presentations Beamers have done in different conferences, e.g. some of
> the public available talks from the past by Frances/Tyler/others are
> worth to be included so they can be easily found. (of course not sure
> if we need approval from the speakers/confs to add a link to a
> playlist (tbd).
>
>
> On Thu, Mar 8, 2018 at 12:54 AM, Matthias Baetens
> <matthias.baet...@datatonic.com> wrote:
> > Are we good to go?
> > Thanks,
> > Matthias
> >
> > On Feb 23, 2018 19:12, "Matthias Baetens" <matthias.baetens@datatonic.
> com>
> > wrote:
> >>
> >> I have written a first proposal here, combining different sources of
> >> input. Happy to have feedback and work on this together.
> >>
> >> Cheers,
> >> Matthias
> >>
> >> On Fri, Feb 23, 2018 at 6:34 PM, Kenneth Knowles <k...@google.com>
> wrote:
> >>>
> >>> Yes, question for the thread/proposal :-)
> >>>
> >>> On Fri, Feb 23, 2018 at 9:39 AM, Davor Bonaci <da...@apache.org>
> wrote:
> >>>>
> >>>> (That's not the question for Matthias, it is for the PMC. Thankfully,
> JB
> >>>> volunteered to help formalize things.)
> >>>>
> >>>> On Fri, Feb 23, 2018 at 7:56 AM, Kenneth Knowles <k...@google.com>
> wrote:
> >>>>>
> >>>>> +1 to the proposal, and same question as Gris.
> >>>>>
> >>>>> On Wed, Feb 21, 2018 at 9:17 AM, Griselda Cuevas <g...@google.com>
> >>>>> wrote:
> >>>>>>
> >>>>>> +1 to the proposal
> >>>>>>
> >>>>>> @Matthias could you share more about the dynamics in how people in
> the
> >>>>>> community would be able to add videos and who would be owning the
> curation
> >>>>>> of the channel?
> >>>>>>
> >>>>>> G
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>> On 21 February 2018 at 09:08, Matthias Baetens
> >>>>>> <matthias.baet...@datatonic.com> wrote:
> >>>>>>>
> >>>>>>> Hi Gaurav,
> >>>>>>>
> >>>>>>> Thanks for pointing that out. The channel can be found here.
> >>>>>>> No videos there yet though, waiting for approval to publish the
> first
> >>>>>>> one!
> >>>>>>>
> >>>>>>> Cheers,
> >>>>>>> Matthias
> >>>>>>>
> >>>>>>> On Wed, Feb 21, 2018 at 12:55 AM, Gaurav Thakur
> >>>>>>> <gaurav2...@gmail.com> wrote:
> >>>>>>>>
> >>>>>>>> How can people get access to the channel?
> >>>>>>>>
> >>>>>>>> Thanks, Gaurav
> >>>>>>>>
> >>>>>>>> On Wed, Feb 21, 2018 at 1:34 PM, Matthias Baetens
> >>>>>>>> <matthias.baet...@datatonic.com> wrote:
> >>>>>>>>>
> >>>>>>>>> Hi all,
> >>>>>>>>>
> >>>>>>>>> This is a proposal to launch the Apache Beam YouTube channel and
> at
> >>>>>>>>> the same time add the first video to the channel.
> >>>>>>>>>
> >>>>>>>>> We would like to use the channel to centralize all videos /
> >>>>>>>>> recordings related to Apache Beam and make it a community driven
> channel, so
> >>>>>>&

Re: [YouTube channel] Add video: Apache Beam meetup London 2: use case in finance + IO in Beam and Splittable DoFns

[Matthias Baetens]

Are we good to go?
Thanks,
Matthias

On Feb 23, 2018 19:12, "Matthias Baetens" <matthias.baet...@datatonic.com>
wrote:

> I have written a first proposal here
> <https://docs.google.com/document/d/10RNWSU7wGyIOkOvlRbw47wsgkxX2-7G1OKmSlINREus/edit?usp=sharing>,
> combining different sources of input. Happy to have feedback and work on
> this together.
>
> Cheers,
> Matthias
>
> On Fri, Feb 23, 2018 at 6:34 PM, Kenneth Knowles <k...@google.com> wrote:
>
>> Yes, question for the thread/proposal :-)
>>
>> On Fri, Feb 23, 2018 at 9:39 AM, Davor Bonaci <da...@apache.org> wrote:
>>
>>> (That's not the question for Matthias, it is for the PMC. Thankfully, JB
>>> volunteered to help formalize things.)
>>>
>>> On Fri, Feb 23, 2018 at 7:56 AM, Kenneth Knowles <k...@google.com> wrote:
>>>
>>>> +1 to the proposal, and same question as Gris.
>>>>
>>>> On Wed, Feb 21, 2018 at 9:17 AM, Griselda Cuevas <g...@google.com>
>>>> wrote:
>>>>
>>>>> +1 to the proposal
>>>>>
>>>>> @Matthias could you share more about the dynamics in how people in the
>>>>> community would be able to add videos and who would be owning the curation
>>>>> of the channel?
>>>>>
>>>>> G
>>>>>
>>>>>
>>>>>
>>>>> On 21 February 2018 at 09:08, Matthias Baetens <
>>>>> matthias.baet...@datatonic.com> wrote:
>>>>>
>>>>>> Hi Gaurav,
>>>>>>
>>>>>> Thanks for pointing that out. The channel can be found here
>>>>>> <https://www.youtube.com/channel/UChNnb_YO_7B0HlW6FhAXZZQ>.
>>>>>> No videos there yet though, waiting for approval to publish the first
>>>>>> one!
>>>>>>
>>>>>> Cheers,
>>>>>> Matthias
>>>>>>
>>>>>> On Wed, Feb 21, 2018 at 12:55 AM, Gaurav Thakur <gaurav2...@gmail.com
>>>>>> > wrote:
>>>>>>
>>>>>>> How can people get access to the channel?
>>>>>>>
>>>>>>> Thanks, Gaurav
>>>>>>>
>>>>>>> On Wed, Feb 21, 2018 at 1:34 PM, Matthias Baetens <
>>>>>>> matthias.baet...@datatonic.com> wrote:
>>>>>>>
>>>>>>>> Hi all,
>>>>>>>>
>>>>>>>> This is a proposal to launch the Apache Beam YouTube channel and at
>>>>>>>> the same time add the first video to the channel.
>>>>>>>>
>>>>>>>> We would like to use the channel to centralize all videos /
>>>>>>>> recordings related to Apache Beam and make it a community driven 
>>>>>>>> channel,
>>>>>>>> so people have a one stop shop for learnings about Beam.
>>>>>>>>
>>>>>>>> The first video would be the recording of the second Beam meetup in
>>>>>>>> London:
>>>>>>>> Apache Beam meetup London 2: use case in finance + IO in Beam and
>>>>>>>> Splittable DoFns. The video can be seen on the channel if you have 
>>>>>>>> login
>>>>>>>> details (it is currently set to private).
>>>>>>>>
>>>>>>>> Please let me know if there are any questions or comments!
>>>>>>>>
>>>>>>>> Best regards,
>>>>>>>> Matthias
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>>
>>>>>>
>>>>>> *Matthias Baetens*
>>>>>>
>>>>>>
>>>>>> *datatonic | data power unleashed*
>>>>>>
>>>>>> office +44 203 668 3680 <+44%2020%203668%203680>  |  mobile +44 74
>>>>>> 918 20646
>>>>>>
>>>>>> Level24 | 1 Canada Square | Canary Wharf | E14 5AB London
>>>>>> <https://maps.google.com/?q=1+Canada+Square+%7C+Canary+Wharf+%7C+E14+5AB+London=gmail=g>
>>>>>>
>>>>>>
>>>>>> We've been announced
>>>>>> <https://blog.google/topics/google-cloud/investing-vibrant-google-cloud-ecosystem-new-programs-and-partnerships/>
>>>>>>  as
>>>>>> one of the top global Google Cloud Machine Learning partners.
>>>>>>
>>>>>
>>>>>
>>>>
>>>
>>
>
>
> --
>
>
> *Matthias Baetens*
>
>
> *datatonic | data power unleashed*
>
> office +44 203 668 3680  |  mobile +44 74 918 20646
>
> Level24 | 1 Canada Square | Canary Wharf | E14 5AB London
>
>
> We've been announced
> <https://blog.google/topics/google-cloud/investing-vibrant-google-cloud-ecosystem-new-programs-and-partnerships/>
>  as
> one of the top global Google Cloud Machine Learning partners.
>

Re: [YouTube channel] Add video: Apache Beam meetup London 2: use case in finance + IO in Beam and Splittable DoFns

[Matthias Baetens]

I have written a first proposal here
<https://docs.google.com/document/d/10RNWSU7wGyIOkOvlRbw47wsgkxX2-7G1OKmSlINREus/edit?usp=sharing>,
combining different sources of input. Happy to have feedback and work on
this together.

Cheers,
Matthias

On Fri, Feb 23, 2018 at 6:34 PM, Kenneth Knowles <k...@google.com> wrote:

> Yes, question for the thread/proposal :-)
>
> On Fri, Feb 23, 2018 at 9:39 AM, Davor Bonaci <da...@apache.org> wrote:
>
>> (That's not the question for Matthias, it is for the PMC. Thankfully, JB
>> volunteered to help formalize things.)
>>
>> On Fri, Feb 23, 2018 at 7:56 AM, Kenneth Knowles <k...@google.com> wrote:
>>
>>> +1 to the proposal, and same question as Gris.
>>>
>>> On Wed, Feb 21, 2018 at 9:17 AM, Griselda Cuevas <g...@google.com>
>>> wrote:
>>>
>>>> +1 to the proposal
>>>>
>>>> @Matthias could you share more about the dynamics in how people in the
>>>> community would be able to add videos and who would be owning the curation
>>>> of the channel?
>>>>
>>>> G
>>>>
>>>>
>>>>
>>>> On 21 February 2018 at 09:08, Matthias Baetens <
>>>> matthias.baet...@datatonic.com> wrote:
>>>>
>>>>> Hi Gaurav,
>>>>>
>>>>> Thanks for pointing that out. The channel can be found here
>>>>> <https://www.youtube.com/channel/UChNnb_YO_7B0HlW6FhAXZZQ>.
>>>>> No videos there yet though, waiting for approval to publish the first
>>>>> one!
>>>>>
>>>>> Cheers,
>>>>> Matthias
>>>>>
>>>>> On Wed, Feb 21, 2018 at 12:55 AM, Gaurav Thakur <gaurav2...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> How can people get access to the channel?
>>>>>>
>>>>>> Thanks, Gaurav
>>>>>>
>>>>>> On Wed, Feb 21, 2018 at 1:34 PM, Matthias Baetens <
>>>>>> matthias.baet...@datatonic.com> wrote:
>>>>>>
>>>>>>> Hi all,
>>>>>>>
>>>>>>> This is a proposal to launch the Apache Beam YouTube channel and at
>>>>>>> the same time add the first video to the channel.
>>>>>>>
>>>>>>> We would like to use the channel to centralize all videos /
>>>>>>> recordings related to Apache Beam and make it a community driven 
>>>>>>> channel,
>>>>>>> so people have a one stop shop for learnings about Beam.
>>>>>>>
>>>>>>> The first video would be the recording of the second Beam meetup in
>>>>>>> London:
>>>>>>> Apache Beam meetup London 2: use case in finance + IO in Beam and
>>>>>>> Splittable DoFns. The video can be seen on the channel if you have login
>>>>>>> details (it is currently set to private).
>>>>>>>
>>>>>>> Please let me know if there are any questions or comments!
>>>>>>>
>>>>>>> Best regards,
>>>>>>> Matthias
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>>
>>>>> *Matthias Baetens*
>>>>>
>>>>>
>>>>> *datatonic | data power unleashed*
>>>>>
>>>>> office +44 203 668 3680 <+44%2020%203668%203680>  |  mobile +44 74
>>>>> 918 20646
>>>>>
>>>>> Level24 | 1 Canada Square | Canary Wharf | E14 5AB London
>>>>> <https://maps.google.com/?q=1+Canada+Square+%7C+Canary+Wharf+%7C+E14+5AB+London=gmail=g>
>>>>>
>>>>>
>>>>> We've been announced
>>>>> <https://blog.google/topics/google-cloud/investing-vibrant-google-cloud-ecosystem-new-programs-and-partnerships/>
>>>>>  as
>>>>> one of the top global Google Cloud Machine Learning partners.
>>>>>
>>>>
>>>>
>>>
>>
>


-- 


*Matthias Baetens*


*datatonic | data power unleashed*

office +44 203 668 3680  |  mobile +44 74 918 20646

Level24 | 1 Canada Square | Canary Wharf | E14 5AB London


We've been announced
<https://blog.google/topics/google-cloud/investing-vibrant-google-cloud-ecosystem-new-programs-and-partnerships/>
as
one of the top global Google Cloud Machine Learning partners.

Re: [YouTube channel] Add video: Apache Beam meetup London 2: use case in finance + IO in Beam and Splittable DoFns

[Matthias Baetens]

Hi Gaurav,

Thanks for pointing that out. The channel can be found here
<https://www.youtube.com/channel/UChNnb_YO_7B0HlW6FhAXZZQ>.
No videos there yet though, waiting for approval to publish the first one!

Cheers,
Matthias

On Wed, Feb 21, 2018 at 12:55 AM, Gaurav Thakur <gaurav2...@gmail.com>
wrote:

> How can people get access to the channel?
>
> Thanks, Gaurav
>
> On Wed, Feb 21, 2018 at 1:34 PM, Matthias Baetens <
> matthias.baet...@datatonic.com> wrote:
>
>> Hi all,
>>
>> This is a proposal to launch the Apache Beam YouTube channel and at the
>> same time add the first video to the channel.
>>
>> We would like to use the channel to centralize all videos / recordings
>> related to Apache Beam and make it a community driven channel, so people
>> have a one stop shop for learnings about Beam.
>>
>> The first video would be the recording of the second Beam meetup in
>> London:
>> Apache Beam meetup London 2: use case in finance + IO in Beam and
>> Splittable DoFns. The video can be seen on the channel if you have login
>> details (it is currently set to private).
>>
>> Please let me know if there are any questions or comments!
>>
>> Best regards,
>> Matthias
>>
>
>


-- 


*Matthias Baetens*


*datatonic | data power unleashed*

office +44 203 668 3680  |  mobile +44 74 918 20646

Level24 | 1 Canada Square | Canary Wharf | E14 5AB London


We've been announced
<https://blog.google/topics/google-cloud/investing-vibrant-google-cloud-ecosystem-new-programs-and-partnerships/>
as
one of the top global Google Cloud Machine Learning partners.

[YouTube channel] Add video: Apache Beam meetup London 2: use case in finance + IO in Beam and Splittable DoFns

[Matthias Baetens]

Hi all,

This is a proposal to launch the Apache Beam YouTube channel and at the
same time add the first video to the channel.

We would like to use the channel to centralize all videos / recordings
related to Apache Beam and make it a community driven channel, so people
have a one stop shop for learnings about Beam.

The first video would be the recording of the second Beam meetup in London:
Apache Beam meetup London 2: use case in finance + IO in Beam and
Splittable DoFns. The video can be seen on the channel if you have login
details (it is currently set to private).

Please let me know if there are any questions or comments!

Best regards,
Matthias

Re: [Proposal] Apache Beam Swag Store

[Matthias Baetens]

+1
Awesome stuff, thanks for the effort Gris!

On Mon, Nov 6, 2017 at 5:31 AM, Griselda Cuevas <g...@google.com.invalid>
wrote:

> Excellent - we're getting approval from the trademark@ folks. I'll update
> the thread when I have news.
>
>
>
> On 5 November 2017 at 14:04, Ted Yu <yuzhih...@gmail.com> wrote:
>
> > +1
> >  Original message From: Jacob Marble <
> jmar...@kochava.com>
> > Date: 11/5/17  1:50 PM  (GMT-08:00) To: dev@beam.apache.org Subject: Re:
> > [Proposal] Apache Beam Swag Store
> > I think this is a great idea, ready to order mine. :)
> >
> > Jacob
> >
> > On Sat, Oct 28, 2017 at 11:19 AM, Jean-Baptiste Onofré <j...@nanthrax.net>
> > wrote:
> >
> > > It sounds good. Please let us know trademark update.
> > >
> > > Thanks
> > > Regards
> > > JB
> > >
> > > On Oct 28, 2017, 20:15, at 20:15, Griselda Cuevas
> > <g...@google.com.INVALID>
> > > wrote:
> > > >Thanks for the feedback all, I'll send this idea to the trademark@
> > > >folks
> > > >and wait for validation. Once we have it I'll look into building the
> > > >store
> > > >possibly embedded in the website.
> > > >
> > > >Enjoy the weekend.
> > > >G
> > > >
> > > >5
> > > >
> > > >
> > > >
> > > >On 27 October 2017 at 11:53, Tyler Akidau <taki...@google.com.invalid
> >
> > > >wrote:
> > > >
> > > >> One additional note: for the logos w/ the name below them, would be
> > > >nice to
> > > >> not have quite so much whitespace between the logo and the name.
> > > >Otherwise,
> > > >> trademark validation aside, this looks great.
> > > >>
> > > >> On Fri, Oct 27, 2017 at 10:15 AM Griselda Cuevas
> > > ><g...@google.com.invalid>
> > > >> wrote:
> > > >>
> > > >> > Hi Dan - thanks for bringing this up to my attention. I haven't
> > > >raised
> > > >> this
> > > >> > up to the tradema...@apache.org people. Can I just reach out to
> > > >them to
> > > >> > get
> > > >> > the proposal or should one of the PMCs do this?
> > > >> >
> > > >> >
> > > >> >
> > > >> > Gris Cuevas Zambrano
> > > >> >
> > > >> > g...@google.com
> > > >> >
> > > >> > Open Source Strategy
> > > >> >
> > > >> > 345 Spear Street, San Francisco, 94105
> > > >> > <https://maps.google.com/?q=345+Spear+Street,+San+Francisco,
> > > >> +94105=gmail=g>
> > > >> >
> > > >> >
> > > >> >
> > > >> > On 26 October 2017 at 18:30, Daniel Kulp <dk...@apache.org>
> wrote:
> > > >> >
> > > >> > >
> > > >> > > Have you run this through tradema...@apache.org yet?
> > > >> > >
> > > >> > > I bring this up for two reasons:
> > > >> > >
> > > >> > > 1) We would need to make sure the appearance and such of the
> logo
> > > >is
> > > >> > > “correct”
> > > >> > >
> > > >> > > 2).A few years ago, Apache did have a partnership with a company
> > > >that
> > > >> > > would produce various swag things and then donate a portion back
> > > >to
> > > >> > > Apache.   I don’t know what the state of that agreement is and
> > > >whether
> > > >> > that
> > > >> > > would restrict going to another vendor or something.
> > > >> > >
> > > >> > > Dan
> > > >> > >
> > > >> > >
> > > >> > > > On Oct 25, 2017, at 8:51 AM, Griselda Cuevas
> > > ><g...@google.com.INVALID
> > > >> >
> > > >> > > wrote:
> > > >> > > >
> > > >> > > > Hi Everyone,
> > > >> > > >
> > > >> > > > I'd like to propose the creation of an online swag store for
> > > >Apache
> > > >> > Beam
> > > >> > > where anyone could order swag from a wide selection and get it
> > > >deliver
> > > >> to
> > > >> > > their home or office. I got in touch with a provider who could
> > > >include
> > > >> > this
> > > >> > > service as part of an order I'm placing to send swag for the
> > > >Meetups
> > > >> > we're
> > > >> > > organizing this year. What do you think?
> > > >> > > >
> > > >> > > > I'd also like to get your feedback on the swag I'm requesting
> > > >(you
> > > >> can
> > > >> > > see it in the pdf I attached), what do you think of the colors,
> > > >design,
> > > >> > > etc.?
> > > >> > > >
> > > >> > > > Lastly, I'll be ordering swag for Meetup organized this year
> so
> > > >if
> > > >> > > you're hosting one or speaking at one get in touch with me to
> > > >send
> > > >> some!
> > > >> > > >
> > > >> > > > Cheers,
> > > >> > > > G
> > > >> > >
> > > >> > > --
> > > >> > > Daniel Kulp
> > > >> > > dk...@apache.org - http://dankulp.com/blog
> > > >> > > Talend Community Coder - http://coders.talend.com
> > > >> > >
> > > >> > >
> > > >> >
> > > >>
> > >
> >
>



-- 


*Matthias Baetens*


*datatonic | data power unleashed*

office +44 203 668 3680  |  mobile +44 74 918 20646

Level24 | 1 Canada Square | Canary Wharf | E14 5AB London


We've been announced
<https://blog.google/topics/google-cloud/investing-vibrant-google-cloud-ecosystem-new-programs-and-partnerships/>
as
one of the top global Google Cloud Machine Learning partners.

Re: Python SDK: BigTableIO

[Matthias Baetens]

Hi Cham, Stephan,

Thanks a lot for the input, really useful to get started.

We'll probably start with implementing the Source (looks the most
straightforward).
I made a working document
<https://docs.google.com/document/d/1iXeQvIAsGjp9orleDy0o5ExU-eMqWesgvtt231UoaPg/edit?usp=sharing>
to
organise and track our progress a bit, happy to discuss or receive feedback
there as well. We made a JIRA issue
<https://issues.apache.org/jira/browse/BEAM-2395> as well; should we get
assigned to it?

About writing the Sink: are there any examples of how this was done
previously where we can get some inspiration from? I think it would be good
to discuss this in more detail once we finish writing the Source.

Matthias
ᐧ

On Tue, May 30, 2017 at 7:28 PM, Stephen Sisk <s...@google.com.invalid>
wrote:

> Hey Matthias,
>
> to add on to what Chamikara mentioned, we have lots of info in the generic
> IO authoring guide [1], the Python IO authoring guide [2] and the
> PTransform Style Guide[3].  The PTransform style guide doesn't sound like
> it applies, but it has a lot of specific tips from lessons we've learned in
> the past from I/O work.
>
> If you plan on contributing it back to the community, I'd also suggest
> opening up a JIRA issue & updating the beam website (eg [4]) that you're
> working on this (those steps are pretty trivial.)
>
> We've recently been trying out using branches when we add new I/Os since
> the PRs tend to get bigger than we like for a since PR.
>
> Please feel free to email the dev mailing list if you have questions! We
> are excited and happy to help out with thinking about design/etc... (eg, as
> cham hinted at, should you use a Source vs. use regular ParDo transforms?)
>
> S
>
> [1] https://beam.apache.org/documentation/io/authoring-overview/
> [2] https://beam.apache.org/documentation/sdks/python-custom-io/
> [3] https://beam.apache.org/contribute/ptransform-style-guide/
> [4] https://github.com/apache/beam-site/pull/250
>
> On Sun, May 28, 2017 at 5:32 PM Chamikara Jayalath <chamik...@apache.org>
> wrote:
>
> > Thanks for offering to help. I would suggest to look into existing Java
> > BigTableIO connector and currently available Python client library for
> > Cloud BigTable to see how feasible it is to develop an efficient BigTable
> > connector at this point. From Python SDK's perspective you can use
> > iobase.BoundedSource API (wrapped by a PTrasnform) to develop a read
> > PTransform with support for dynamic/static splitting. Sinks are usually
> > developed as PTransforms (iobase.Sink interface is deprecated so I
> suggest
> > not to use that). I would be happy to review any PRs related to this.
> >
> > Thanks,
> > Cham
> >
> > On Sun, May 28, 2017 at 2:30 AM Matthias Baetens <
> > matthias.baet...@datatonic.com> wrote:
> >
> > > Hey guys,
> > >
> > > We have been using Beam for quite a few months now, so we (my colleague
> > > Robert & I) thought it might be cool to contribute a bit as well.
> > >
> > > The challenge we want to take up is writing the BigTableIO for the
> Python
> > > SDK (which is not yet in the works according to the website
> > > <
> > >
> > https://github.com/apache/beam-site/blob/asf-site/src/
> documentation/io/built-in.md
> > > >.
> > > I have searched JIRA for the BigTableIO issue and did not find it, so I
> > > suppose this is the first step we take.
> > >
> > > Any pointers or feedback more than welcome!
> > >
> > > Best,
> > >
> > > Matthias
> > >
> >
>



-- 


*Matthias Baetens*


*datatonic | data power unleashed*

office +44 203 668 3680  |  mobile +44 74 918 20646

Level24 | 1 Canada Square | Canary Wharf | E14 5AB London


We've been announced
<https://blog.google/topics/google-cloud/investing-vibrant-google-cloud-ecosystem-new-programs-and-partnerships/>
as
one of the top global Google Cloud Machine Learning partners.

Python SDK: BigTableIO

[Matthias Baetens]

Hey guys,

We have been using Beam for quite a few months now, so we (my colleague
Robert & I) thought it might be cool to contribute a bit as well.

The challenge we want to take up is writing the BigTableIO for the Python
SDK (which is not yet in the works according to the website
.
I have searched JIRA for the BigTableIO issue and did not find it, so I
suppose this is the first step we take.

Any pointers or feedback more than welcome!

Best,

Matthias