Update to today
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/045e0040 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/tree/045e0040 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/diff/045e0040 Branch: refs/heads/asf-site Commit: 045e0040d1c82eac90661b45d37f136cf6f6a08c Parents: 4244fe2 Author: Dan Halperin <[email protected]> Authored: Wed Aug 3 12:00:43 2016 -0700 Committer: Dan Halperin <[email protected]> Committed: Wed Aug 3 12:00:43 2016 -0700 ---------------------------------------------------------------------- _posts/2016-08-03-six-months.md | 43 ++++++++++++++++++++++++++++++++++++ _posts/2016-08-04-six-months.md | 43 ------------------------------------ 2 files changed, 43 insertions(+), 43 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/045e0040/_posts/2016-08-03-six-months.md ---------------------------------------------------------------------- diff --git a/_posts/2016-08-03-six-months.md b/_posts/2016-08-03-six-months.md new file mode 100644 index 0000000..1141eaf --- /dev/null +++ b/_posts/2016-08-03-six-months.md @@ -0,0 +1,43 @@ +--- +layout: post +title: "Apache Beam: Six Months in Incubation" +date: 2016-08-03 00:00:01 -0700 +excerpt_separator: <!--more--> +categories: blog +authors: + - fjp +--- + +Itâs been just over six months since Apache Beam was formally accepted into incubation with the [Apache Software Foundation](http://www.apache.org). As a community, weâve been hard at work getting Beam off the ground. + +<!--more--> + +Looking just at raw numbers for those first six months, thatâs: + +* 48,238 lines of preexisting code donated by Cloudera, dataArtisans, and Google. +* 761 pull requests from 45 contributors. +* 498 Jira issues opened and 245 resolved. +* 1 incubating release (and another 1 in progress). +* 4,200 hours of automated tests. +* 161 subscribers / 606 messages on user@. +* 217 subscribers / 1205 messages on dev@. +* 277 stars and 174 forks on GitHub. + +And behind those numbers, thereâs been a ton of technical progress, including: + +* Refactoring of the entire codebase, examples, and tests to be truly runner-independent. +* New functionality in the Apache Flink runner for timestamps/windows in batch and bounded sources and side inputs in streaming mode. +* Work in progress to upgrade the Apache Spark runner to use Spark 2.0. +* Several new runners from the wider Apache community -- Apache Gearpump has its own feature branch, Apache Apex has a PR, and conversations are starting on Apache Storm and others. +* New SDKs/DSLs for exposing the Beam model -- the Python SDK from Google is in on a feature branch, and there are plans to add the Scio DSL from Spotify. +* Support for additional data sources and sinks -- Apache Kafka and JMS are in, there are PRs for Amazon Kinesis, Apache Cassandra, and MongoDB, and more connectors are being planned. + +But perhaps most importantly, weâre committed to building an involved, welcoming community. So far, weâve: + +* Started building a vibrant developer community, with detailed design discussions on features like DoFn reuse semantics, serialization technology, and an API for accessing state. +* Started building a user community with an active mailing list and improvements to the website and documentation. +* Had multiple talks on Beam at venues including ApacheCon, Hadoop Summit, Kafka Summit, JBCN Barcelona, and Strata. +* Presented at multiple existing meetups and are starting to organize some of our own. + +While itâs nice to reflect back on all weâve done, weâre working full _stream_ ahead towards a stable release and graduation from incubator. And weâd love your help -- join the [mailing lists](http://beam.incubator.apache.org/use/mailing-lists/), check out the [contribution guide](http://beam.incubator.apache.org/contribute/contribution-guide/), and grab a [starter task](https://issues.apache.org/jira/browse/BEAM-520?jql=project%20%3D%20BEAM%20AND%20resolution%20%3D%20Unresolved%20AND%20labels%20in%20(newbie%2C%20starter)) from Jira! + http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/045e0040/_posts/2016-08-04-six-months.md ---------------------------------------------------------------------- diff --git a/_posts/2016-08-04-six-months.md b/_posts/2016-08-04-six-months.md deleted file mode 100644 index c4ed246..0000000 --- a/_posts/2016-08-04-six-months.md +++ /dev/null @@ -1,43 +0,0 @@ ---- -layout: post -title: "Apache Beam: Six Months in Incubation" -date: 2016-08-04 00:00:01 -0700 -excerpt_separator: <!--more--> -categories: blog -authors: - - fjp ---- - -Itâs been just over six months since Apache Beam was formally accepted into incubation with the [Apache Software Foundation](http://www.apache.org). As a community, weâve been hard at work getting Beam off the ground. - -<!--more--> - -Looking just at raw numbers for those first six months, thatâs: - -* 48,238 lines of preexisting code donated by Cloudera, dataArtisans, and Google. -* 761 pull requests from 45 contributors. -* 498 Jira issues opened and 245 resolved. -* 1 incubating release (and another 1 in progress). -* 4,200 hours of automated tests. -* 161 subscribers / 606 messages on user@. -* 217 subscribers / 1205 messages on dev@. -* 277 stars and 174 forks on GitHub. - -And behind those numbers, thereâs been a ton of technical progress, including: - -* Refactoring of the entire codebase, examples, and tests to be truly runner-independent. -* New functionality in the Apache Flink runner for timestamps/windows in batch and bounded sources and side inputs in streaming mode. -* Work in progress to upgrade the Apache Spark runner to use Spark 2.0. -* Several new runners from the wider Apache community -- Apache Gearpump has its own feature branch, Apache Apex has a PR, and conversations are starting on Apache Storm and others. -* New SDKs/DSLs for exposing the Beam model -- the Python SDK from Google is in on a feature branch, and there are plans to add the Scio DSL from Spotify. -* Support for additional data sources and sinks -- Apache Kafka and JMS are in, there are PRs for Amazon Kinesis, Apache Cassandra, and MongoDB, and more connectors are being planned. - -But perhaps most importantly, weâre committed to building an involved, welcoming community. So far, weâve: - -* Started building a vibrant developer community, with detailed design discussions on features like DoFn reuse semantics, serialization technology, and an API for accessing state. -* Started building a user community with an active mailing list and improvements to the website and documentation. -* Had multiple talks on Beam at venues including ApacheCon, Hadoop Summit, Kafka Summit, JBCN Barcelona, and Strata. -* Presented at multiple existing meetups and are starting to organize some of our own. - -While itâs nice to reflect back on all weâve done, weâre working full _stream_ ahead towards a stable release and graduation from incubator. And weâd love your help -- join the [mailing lists](http://beam.incubator.apache.org/use/mailing-lists/), check out the [contribution guide](http://beam.incubator.apache.org/contribute/contribution-guide/), and grab a [starter task](https://issues.apache.org/jira/browse/BEAM-520?jql=project%20%3D%20BEAM%20AND%20resolution%20%3D%20Unresolved%20AND%20labels%20in%20(newbie%2C%20starter)) from Jira! -
