Fully agree with Dan.
Regards
JB
On 08/01/2016 06:56 PM, Dan Halperin wrote:
+1 (binding? ;)
On this part of the email:
This half birthday is also a good chance to take a step back and reflect
on
our goals for this year -- TLP graduation and the first stable release.
Where are we on this path? What can we do better to accomplish these
high-level goals?
I think we really want to finish as many backwards-incompatible changes as
possible. Here's a seed for that list.
- DoFn setup/teardown
- new DoFn proposal
- Continuing to move google-specific IO from SDK into
google-cloud-platform IO module
- Any changes to fundamental style (PTransform.apply rename? Removing
the .Bound wrappers in various transforms?)
I'd also really like to see Gearpump runner (maybe also Apex) and Python
SDK in the main branch.
Thanks,
Dan
On Mon, Aug 1, 2016 at 8:36 AM, Aljoscha Krettek <[email protected]>
wrote:
+1
This sounds very good, I can't come up with anything that you missed.
On Mon, 1 Aug 2016 at 08:00 Jean-Baptiste Onofré <[email protected]> wrote:
Happy half birthday ;)
Very good idea Frances !!
And the numbers are impressive indeed.
Maybe, we can add kind of teasing about new incoming PRs like: Cassandra
IO (PR submitted), MongDB IO (PR submitted), MQTT IO, JDBC IO, Socket IO
(I'm working on these IOs), XML/JSON DSLs .
Regards
JB
On 08/01/2016 04:36 PM, Frances Perry wrote:
Hi Beamers!
It’s been six months today since Beam was accepted into incubation.
It’s
thrilling how far we’ve come since then!
I’d like to volunteer to put together a post on the Beam blog
summarizing
our progress since February. Here’s a starting point... What am I
missing
that we should include? What makes you proud?
By the numbers:
* 48,238 lines of preexisting code donated by Cloudera, dataArtisans,
and
Google.
* 761 pull requests from 45 contributors.
* 498 Jira issues opened and 245 resolved.
* 1 incubating release (and another 1 in progress).
* 4200 hours of automated tests.
* 161 subscribers / 606 messages on user@.
* 217 subscribers / 1205 messages on dev@.
There’s been a lot of technical progress, including:
* Refactoring of the entire codebase, examples, and tests to be truly
runner-independent.
* New functionality in the Apache Flink runner for timestamps/windows
in
batch and bounded sources and side inputs in streaming mode.
* Work in progress to upgrade the Apache Spark runner to use Spark 2.0.
* Several new runners from the wider Apache community -- Apache
Gearpump
has its own feature branch, Apache Apex has a PR, and conversations are
starting on Apache Storm and others.
* New SDKs/DSLs -- the Python SDK from Google is in, and there are
plans
to
add the Scio DSL from Spotify.
* Support for new IO connectors -- Apache Kafka and JMS are in, with
Amazon
Kinesis in PR.
And community-wise, we’ve:
* Started building a vibrant developer community, with detailed design
discussions on features like DoFn reuse semantics, serialization
technology, and an API for accessing state.
* Started building a user community with improvements to the website
and
documentation.
* Had multiple talks on Beam at venues including ApacheCon, Hadoop
Summit,
Kafka Summit, JBCN Barcelona, QCon, and Strata.
* Presented at multiple existing meetups and are starting to organize
some
of our own.
This half birthday is also a good chance to take a step back and
reflect
on
our goals for this year -- TLP graduation and the first stable release.
Where are we on this path? What can we do better to accomplish these
high-level goals?
Frances
--
Jean-Baptiste Onofré
[email protected]
http://blog.nanthrax.net
Talend - http://www.talend.com
--
Jean-Baptiste Onofré
[email protected]
http://blog.nanthrax.net
Talend - http://www.talend.com
