Happy half-birthday! As one of the new comers of the Python SDK, it would be great to have it in the main branch. We are getting closer to that goal everyday.
Thanks, Ahmet On Mon, Aug 1, 2016 at 10:02 AM, Jean-Baptiste Onofré <[email protected]> wrote: > Fully agree with Dan. > > Regards > JB > > > On 08/01/2016 06:56 PM, Dan Halperin wrote: > >> +1 (binding? ;) >> >> On this part of the email: >> >> This half birthday is also a good chance to take a step back and reflect >>>> >>> on >>> >>>> our goals for this year -- TLP graduation and the first stable release. >>>> Where are we on this path? What can we do better to accomplish these >>>> high-level goals? >>>> >>> >> I think we really want to finish as many backwards-incompatible changes as >> possible. Here's a seed for that list. >> >> >> >> - DoFn setup/teardown >> - new DoFn proposal >> - Continuing to move google-specific IO from SDK into >> google-cloud-platform IO module >> - Any changes to fundamental style (PTransform.apply rename? Removing >> the .Bound wrappers in various transforms?) >> >> I'd also really like to see Gearpump runner (maybe also Apex) and Python >> SDK in the main branch. >> >> Thanks, >> Dan >> >> >> On Mon, Aug 1, 2016 at 8:36 AM, Aljoscha Krettek <[email protected]> >> wrote: >> >> +1 >>> >>> This sounds very good, I can't come up with anything that you missed. >>> >>> On Mon, 1 Aug 2016 at 08:00 Jean-Baptiste Onofré <[email protected]> >>> wrote: >>> >>> Happy half birthday ;) >>>> >>>> Very good idea Frances !! >>>> >>>> And the numbers are impressive indeed. >>>> >>>> Maybe, we can add kind of teasing about new incoming PRs like: Cassandra >>>> IO (PR submitted), MongDB IO (PR submitted), MQTT IO, JDBC IO, Socket IO >>>> (I'm working on these IOs), XML/JSON DSLs . >>>> >>>> Regards >>>> JB >>>> >>>> On 08/01/2016 04:36 PM, Frances Perry wrote: >>>> >>>>> Hi Beamers! >>>>> >>>>> It’s been six months today since Beam was accepted into incubation. >>>>> >>>> It’s >>> >>>> thrilling how far we’ve come since then! >>>>> >>>>> I’d like to volunteer to put together a post on the Beam blog >>>>> >>>> summarizing >>> >>>> our progress since February. Here’s a starting point... What am I >>>>> >>>> missing >>> >>>> that we should include? What makes you proud? >>>>> >>>>> By the numbers: >>>>> >>>>> * 48,238 lines of preexisting code donated by Cloudera, dataArtisans, >>>>> >>>> and >>> >>>> Google. >>>>> >>>>> * 761 pull requests from 45 contributors. >>>>> >>>>> * 498 Jira issues opened and 245 resolved. >>>>> >>>>> * 1 incubating release (and another 1 in progress). >>>>> >>>>> * 4200 hours of automated tests. >>>>> >>>>> * 161 subscribers / 606 messages on user@. >>>>> >>>>> * 217 subscribers / 1205 messages on dev@. >>>>> >>>>> There’s been a lot of technical progress, including: >>>>> >>>>> * Refactoring of the entire codebase, examples, and tests to be truly >>>>> runner-independent. >>>>> >>>>> * New functionality in the Apache Flink runner for timestamps/windows >>>>> >>>> in >>> >>>> batch and bounded sources and side inputs in streaming mode. >>>>> >>>>> * Work in progress to upgrade the Apache Spark runner to use Spark 2.0. >>>>> >>>>> * Several new runners from the wider Apache community -- Apache >>>>> >>>> Gearpump >>> >>>> has its own feature branch, Apache Apex has a PR, and conversations are >>>>> starting on Apache Storm and others. >>>>> >>>>> * New SDKs/DSLs -- the Python SDK from Google is in, and there are >>>>> >>>> plans >>> >>>> to >>>> >>>>> add the Scio DSL from Spotify. >>>>> >>>>> * Support for new IO connectors -- Apache Kafka and JMS are in, with >>>>> >>>> Amazon >>>> >>>>> Kinesis in PR. >>>>> >>>>> And community-wise, we’ve: >>>>> >>>>> * Started building a vibrant developer community, with detailed design >>>>> discussions on features like DoFn reuse semantics, serialization >>>>> technology, and an API for accessing state. >>>>> >>>>> * Started building a user community with improvements to the website >>>>> >>>> and >>> >>>> documentation. >>>>> >>>>> * Had multiple talks on Beam at venues including ApacheCon, Hadoop >>>>> >>>> Summit, >>>> >>>>> Kafka Summit, JBCN Barcelona, QCon, and Strata. >>>>> >>>>> * Presented at multiple existing meetups and are starting to organize >>>>> >>>> some >>>> >>>>> of our own. >>>>> >>>>> This half birthday is also a good chance to take a step back and >>>>> >>>> reflect >>> >>>> on >>>> >>>>> our goals for this year -- TLP graduation and the first stable release. >>>>> Where are we on this path? What can we do better to accomplish these >>>>> high-level goals? >>>>> >>>>> Frances >>>>> >>>>> >>>> -- >>>> Jean-Baptiste Onofré >>>> [email protected] >>>> http://blog.nanthrax.net >>>> Talend - http://www.talend.com >>>> >>>> >>> >> > -- > Jean-Baptiste Onofré > [email protected] > http://blog.nanthrax.net > Talend - http://www.talend.com >
