Re: Release 0.6.0

Thank you Kenn. Currently I am waiting for BEAM-649 and BEAM-1611. I will start again, once both of them are resolved. Ahmet On Fri, Mar 3, 2017 at 4:04 PM, Kenneth Knowles wrote: > Hi all, > > BEAM-1619 is resolved. BEAM-1611 is in PR and I'll update again when it is > confirmed and merged. >

Re: Splittable DoFn for Python SDK

+1 Thank you, this is a great and clean API proposal. Ahmet On Fri, Mar 3, 2017 at 5:16 PM, Chamikara Jayalath wrote: > Hi All, > > I've put together a document that proposes a Splittable DoFn API for Python > SDK. > > https://docs.google.com/document/d/1h_zprJrOilivK2xfvl4L42vaX4DMYGfH > 1YDmi

Splittable DoFn for Python SDK

Hi All, I've put together a document that proposes a Splittable DoFn API for Python SDK. https://docs.google.com/document/d/1h_zprJrOilivK2xfvl4L42vaX4DMYGfH1YDmi-s_ozM/edit?usp=sharing Splittable DoFn framework [1] is currently being implemented for Java SDK [2] and will unlock many use-cases t

Re: Release 0.6.0

Hi all, BEAM-1619 is resolved. BEAM-1611 is in PR and I'll update again when it is confirmed and merged. Kenn On Fri, Mar 3, 2017 at 10:47 AM, Thomas Groh wrote: > Hey everyone; > > The submission of Surgery for the Dataflow Runner in the Java SDK has > broken all streaming jobs that use Side

Re: Introduction

Welcome Chinmay! Just in case you don't already know the whole layout, the JIRA component for the Apex runner is https://issues.apache.org/jira/browse/BEAM/component/12331007/ Kenn On Fri, Mar 3, 2017 at 6:53 AM, Chinmay Kolhatkar wrote: > Hi JB, > > Thanks for the welcome! > > My Apache jira

Re: Let's make Beam transforms comply with PTransform Style Guide

It sounds like a great idea in general, though there are actually not that many issues remaining - I fixed a bunch, and have PRs out for two more (ParDo and BigQueryIO). The remaining ones are: [image: Bug - A problem which impairs or prevents the functions of the product.] BEAM-1355

Re: Let's make Beam transforms comply with PTransform Style Guide

Here's a crazy idea: what if we had a virtual fixit/hackathon to knock these out (similar to the virtual meet-up, but with an agenda)? I find communal hacking sessions towards a common goal are a good way to get to know each other and get a lot done. Would there be any interest in this? On Wed, Ma

Re: Release 0.6.0

Hey everyone; The submission of Surgery for the Dataflow Runner in the Java SDK has broken all streaming jobs that use Side Inputs in that runner. I'm working on a fix, ETA later today. I'd like to block the release on that. Sorry for the late notification. https://issues.apache.org/jira/browse/

Re: Introduction

Hi JB, Thanks for the welcome! My Apache jira username is "chinmay". You can search by full name as "Chinmay Kolhatkar" and corresponding email id is "chin...@apache.org". Thanks, Chinmay. On Fri, Mar 3, 2017 at 6:07 PM, Jean-Baptiste Onofré wrote: > Hi Chinmay, > > Welcome aboard ! > > I tr

Re: Metrics for Beam IOs.

Hi guys, In this thread, we discussed about two main topics: 1. The metrics we should collect and where (IO, PTransform, ...). 2. How we use/dump the metrics. Today, for instance, with the Spark runner, it's already possible to use a sink by providing a metrics.properties containing something

Re: Introduction

Hi JB, My Apache jira username is "chinmay" and corresponding email id is " chin...@apache.org". Thanks, Chinmay. On Fri, Mar 3, 2017 at 6:07 PM, Jean-Baptiste Onofré wrote: > Hi Chinmay, > > Welcome aboard ! > > I tried to add you in the contributor group, but I don't find chinmay Jira > ID

Re: Introduction

Hi Chinmay, Welcome aboard ! I tried to add you in the contributor group, but I don't find chinmay Jira ID (and there are several Chinmay ;)). What's your e-mail and can you check your Jira ID ? Thanks, Regards JB On 03/03/2017 12:35 PM, Chinmay Kolhatkar wrote: Hi Everyone, I'm a committ

Introduction

Hi Everyone, I'm a committer in Apache Apex project and I'm interested in working on Apex Runner improvements and also in other parts of Apache Beam in general. Could you please add me to the contributor's list? My Jira ID is @chinmay. Thanks in Advance! Looking forward to work with you all... :

Re: [BEAM-135] Utilities for "batching" elements in a DoFn

Hi all, @Kenn: I have enhanced my streaming test in https://github.com/echauchot/beam/tree/BEAM-135-BATCHING-PARDO in particular to check that BatchingParDo doesn't mess up windows. It seems that it actually does :) The input collection contains 10 elements timestamped at 1s interval and it