Regenerate website
Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/0b678294 Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/0b678294 Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/0b678294 Branch: refs/heads/asf-site Commit: 0b678294a57237842a57e7afa86c31f5c8eb1e55 Parents: 0c8e759 Author: Davor Bonaci <da...@google.com> Authored: Wed May 17 04:14:58 2017 -0700 Committer: Davor Bonaci <da...@google.com> Committed: Wed May 17 04:14:58 2017 -0700 ---------------------------------------------------------------------- .../2017/05/17/beam-first-stable-release.html | 308 +++++++++++++++++++ content/blog/index.html | 16 + content/feed.xml | 148 ++++++--- content/index.html | 10 +- 4 files changed, 442 insertions(+), 40 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/beam-site/blob/0b678294/content/blog/2017/05/17/beam-first-stable-release.html ---------------------------------------------------------------------- diff --git a/content/blog/2017/05/17/beam-first-stable-release.html b/content/blog/2017/05/17/beam-first-stable-release.html new file mode 100644 index 0000000..fabace3 --- /dev/null +++ b/content/blog/2017/05/17/beam-first-stable-release.html @@ -0,0 +1,308 @@ +<!DOCTYPE html> +<html lang="en"> + <head> + <meta charset="utf-8"> + <meta http-equiv="X-UA-Compatible" content="IE=edge"> + <meta name="viewport" content="width=device-width, initial-scale=1"> + <title>Apache Beam publishes the first stable release</title> + <meta name="description" content="The Apache Beam community is pleased to announce the availability of version 2.0.0. This is the first stable release of Apache Beam, signifying a statement f..."> + <link href="https://fonts.googleapis.com/css?family=Roboto:100,300,400"; rel="stylesheet"> + <link rel="stylesheet" href="/css/site.css"> + <script src="https://ajax.googleapis.com/ajax/libs/jquery/2.2.0/jquery.min.js";></script> + <script src="/js/bootstrap.min.js"></script> + <script src="/js/language-switch.js"></script> + <link rel="canonical" href="https://beam.apache.org/blog/2017/05/17/beam-first-stable-release.html"; data-proofer-ignore> + <link rel="shortcut icon" type="image/x-icon" href="/images/favicon.ico"> + <link rel="alternate" type="application/rss+xml" title="Apache Beam" href="https://beam.apache.org/feed.xml";> + <script> + (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){ + (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o), + m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m) + })(window,document,'script','//www.google-analytics.com/analytics.js','ga'); + ga('create', 'UA-73650088-1', 'auto'); + ga('send', 'pageview'); + </script> +</head> + + <body class="body "> + <nav class="header navbar navbar-fixed-top"> + <div class="navbar-header"> + <a href="/" class="navbar-brand" > + <img alt="Brand" style="height: 25px" src="/images/beam_logo_navbar.png"> + </a> + <button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target="#navbar" aria-expanded="false" aria-controls="navbar"> + <span class="sr-only">Toggle navigation</span> + <span class="icon-bar"></span> + <span class="icon-bar"></span> + <span class="icon-bar"></span> + </button> + </div> + <div id="navbar" class="navbar-collapse collapse"> + <ul class="nav navbar-nav"> + <li class="dropdown"> + <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-haspopup="true" aria-expanded="false">Get Started <span class="caret"></span></a> + <ul class="dropdown-menu"> + <li><a href="/get-started/beam-overview/">Beam Overview</a></li> + <li><a href="/get-started/quickstart-java/">Quickstart - Java</a></li> + <li><a href="/get-started/quickstart-py/">Quickstart - Python</a></li> + <li role="separator" class="divider"></li> + <li class="dropdown-header">Example Walkthroughs</li> + <li><a href="/get-started/wordcount-example/">WordCount</a></li> + <li><a href="/get-started/mobile-gaming-example/">Mobile Gaming</a></li> + <li role="separator" class="divider"></li> + <li class="dropdown-header">Resources</li> + <li><a href="/get-started/downloads">Downloads</a></li> + <li><a href="/get-started/support">Support</a></li> + </ul> + </li> + <li class="dropdown"> + <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-haspopup="true" aria-expanded="false">Documentation <span class="caret"></span></a> + <ul class="dropdown-menu"> + <li><a href="/documentation">Using the Documentation</a></li> + <li role="separator" class="divider"></li> + <li class="dropdown-header">Beam Concepts</li> + <li><a href="/documentation/programming-guide/">Programming Guide</a></li> + <li><a href="/documentation/resources/">Additional Resources</a></li> + <li role="separator" class="divider"></li> + <li class="dropdown-header">Pipeline Fundamentals</li> + <li><a href="/documentation/pipelines/design-your-pipeline/">Design Your Pipeline</a></li> + <li><a href="/documentation/pipelines/create-your-pipeline/">Create Your Pipeline</a></li> + <li><a href="/documentation/pipelines/test-your-pipeline/">Test Your Pipeline</a></li> + <li><a href="/documentation/io/io-toc/">Pipeline I/O</a></li> + <li role="separator" class="divider"></li> + <li class="dropdown-header">SDKs</li> + <li><a href="/documentation/sdks/java/">Java SDK</a></li> + <li><a href="/documentation/sdks/javadoc/2.0.0/" target="_blank">Java SDK API Reference <img src="/images/external-link-icon.png" + width="14" height="14" + alt="External link."></a> + </li> + <li><a href="/documentation/sdks/python/">Python SDK</a></li> + <li><a href="/documentation/sdks/pydoc/2.0.0/" target="_blank">Python SDK API Reference <img src="/images/external-link-icon.png" + width="14" height="14" + alt="External link."></a> + </li> + <li role="separator" class="divider"></li> + <li class="dropdown-header">Runners</li> + <li><a href="/documentation/runners/capability-matrix/">Capability Matrix</a></li> + <li><a href="/documentation/runners/direct/">Direct Runner</a></li> + <li><a href="/documentation/runners/apex/">Apache Apex Runner</a></li> + <li><a href="/documentation/runners/flink/">Apache Flink Runner</a></li> + <li><a href="/documentation/runners/spark/">Apache Spark Runner</a></li> + <li><a href="/documentation/runners/dataflow/">Cloud Dataflow Runner</a></li> + </ul> + </li> + <li class="dropdown"> + <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-haspopup="true" aria-expanded="false">Contribute <span class="caret"></span></a> + <ul class="dropdown-menu"> + <li><a href="/contribute">Get Started Contributing</a></li> + <li role="separator" class="divider"></li> + <li class="dropdown-header">Guides</li> + <li><a href="/contribute/contribution-guide/">Contribution Guide</a></li> + <li><a href="/contribute/testing/">Testing Guide</a></li> + <li><a href="/contribute/release-guide/">Release Guide</a></li> + <li><a href="/contribute/ptransform-style-guide/">PTransform Style Guide</a></li> + <li role="separator" class="divider"></li> + <li class="dropdown-header">Technical References</li> + <li><a href="/contribute/design-principles/">Design Principles</a></li> + <li><a href="/contribute/work-in-progress/">Ongoing Projects</a></li> + <li><a href="/contribute/source-repository/">Source Repository</a></li> + <li role="separator" class="divider"></li> + <li class="dropdown-header">Promotion</li> + <li><a href="/contribute/presentation-materials/">Presentation Materials</a></li> + <li><a href="/contribute/logos/">Logos and Design</a></li> + <li role="separator" class="divider"></li> + <li><a href="/contribute/maturity-model/">Maturity Model</a></li> + <li><a href="/contribute/team/">Team</a></li> + </ul> + </li> + + <li><a href="/blog">Blog</a></li> + </ul> + <ul class="nav navbar-nav navbar-right"> + <li class="dropdown"> + <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-haspopup="true" aria-expanded="false"><img src="https://www.apache.org/foundation/press/kit/feather_small.png"; alt="Apache Logo" style="height:20px;"><span class="caret"></span></a> + <ul class="dropdown-menu dropdown-menu-right"> + <li><a href="http://www.apache.org/";>ASF Homepage</a></li> + <li><a href="http://www.apache.org/licenses/";>License</a></li> + <li><a href="http://www.apache.org/security/";>Security</a></li> + <li><a href="http://www.apache.org/foundation/thanks.html";>Thanks</a></li> + <li><a href="http://www.apache.org/foundation/sponsorship.html";>Sponsorship</a></li> + <li><a href="https://www.apache.org/foundation/policies/conduct";>Code of Conduct</a></li> + </ul> + </li> + </ul> + </div><!--/.nav-collapse --> +</nav> + + <div class="body__contained"> + + +<article class="post" itemscope itemtype="http://schema.org/BlogPosting";> + + <header class="post-header"> + <h1 class="post-title" itemprop="name headline">Apache Beam publishes the first stable release</h1> + <p class="post-meta"><time datetime="2017-05-17T01:00:01-07:00" itemprop="datePublished">May 17, 2017</time> ⢠Davor Bonaci [<a href="https://twitter.com/BonaciDavor";>@BonaciDavor</a>] & Dan Halperin +</p> + </header> + + <div class="post-content" itemprop="articleBody"> + <p>The Apache Beam community is pleased to <a href="https://blogs.apache.org/foundation/entry/the-apache-software-foundation-announces12";>announce the availability of version 2.0.0</a>. This is the first stable release of Apache Beam, signifying a statement from the community that it intends to maintain API stability with all releases for the foreseeable future, and making Beam suitable for enterprise deployment.</p> + +<!--more--> + +<p>This first stable release is the third important milestone for the Apache Beam community. Beam joined the Apache Incubator in February 2016 and graduated as a top-level project of The Apache Software Foundation in December. Through these fifteen months of concentrated effort, a slightly chaotic codebase, merged from multiple organizations, has been developed into a generalized framework for data processing that is truly engine- and environment-independent. Apache Beam has evolved and improved through three incubating and three post-incubation releases, culminating in the stable release announced today as version 2.0.0.</p> + +<p>In the five months since graduation, Apache Beam has seen a significant growth, both in terms of adoption and community contribution. Apache Beam is <a href="https://blogs.apache.org/foundation/entry/the-apache-software-foundation-announces12";>in use</a> at Google Cloud, PayPal, and Talend, among others.</p> + +<p>Apache Beam, version 2.0.0 improves user experience across the project, focusing on seamless portability across execution environments, including engines, operating systems, on-premise clusters, cloud providers, and data storage systems. Other highlights include:</p> + +<ul> + <li>API stability and future compatibility within this major version.</li> + <li>Stateful data processing paradigms that unlock efficient, data-dependent computations.</li> + <li>Support for user-extensible file systems, with built-in support for Hadoop Distributed File System, among others.</li> + <li>A metrics subsystem for deeper insight into pipeline execution.</li> +</ul> + +<p>Many contributors made this release possible, by participating in different roles: contributing code, writing documentation, testing release candidates, supporting users, or helping in some other way. The following is a partial list of contributors â 76 individuals contributed code to the project since the previous release, assembled from source history:</p> + +<ul> + <li>Ahmet Altay</li> + <li>Eric Anderson</li> + <li>Raghu Angadi</li> + <li>Sourabh Bajaj</li> + <li>Péter GergÅ Barna</li> + <li>Chen Bin</li> + <li>Davor Bonaci</li> + <li>Robert Bradshaw</li> + <li>Ben Chambers</li> + <li>Etienne Chauchot</li> + <li>Chang Chen</li> + <li>Charles Chen</li> + <li>Craig Citro</li> + <li>Lukasz Cwik</li> + <li>Márton Elek</li> + <li>Pablo Estrada</li> + <li>Josh Forman-Gornall</li> + <li>Maria GarcÃa Herrero</li> + <li>Jins George</li> + <li>Damien Gouyette</li> + <li>Thomas Groh</li> + <li>Dan Halperin</li> + <li>Pei He</li> + <li>Hadar Hod</li> + <li>Chamikara Jayalath</li> + <li>Rekha Joshi</li> + <li>Uwe Jugel</li> + <li>Sung Junyoung</li> + <li>Holden Karau</li> + <li>Vikas Kedigehalli</li> + <li>Eugene Kirpichov</li> + <li>Tibor Kiss</li> + <li>Kenneth Knowles</li> + <li>Vassil Kolarov</li> + <li>Chinmay Kolhatkar</li> + <li>Aljoscha Krettek</li> + <li>Dipti Kulkarni</li> + <li>Radhika Kulkarni</li> + <li>Jason Kuster</li> + <li>Reuven Lax</li> + <li>Stas Levin</li> + <li>Julien Lhermitte</li> + <li>Jingsong Li</li> + <li>Neville Li</li> + <li>Mark Liu</li> + <li>Michael Luckey</li> + <li>Andrew Martin</li> + <li>Ismaël MejÃa</li> + <li>Devon Meunier</li> + <li>Neda Mirian</li> + <li>Anil Muppalla</li> + <li>Gergely Novak</li> + <li>Jean-Baptiste Onofré</li> + <li>Melissa Pashniak</li> + <li>peay</li> + <li>David Rieber</li> + <li>Rahul Sabbineni</li> + <li>Kobi Salant</li> + <li>Amit Sela</li> + <li>Mark Shalda</li> + <li>Stephen Sisk</li> + <li>Yuya Tajima</li> + <li>Wesley Tanaka</li> + <li>JiJun Tang</li> + <li>Valentyn Tymofieiev</li> + <li>David Volquartz</li> + <li>Huafeng Wang</li> + <li>Thomas Weise</li> + <li>Rafal Wojdyla</li> + <li>Yangping Wu</li> + <li>wyp</li> + <li>James Xu</li> + <li>Mingmin Xu</li> + <li>Ted Yu</li> + <li>Borisa Zivkovic</li> + <li>Aviem Zur</li> +</ul> + +<p>Apache Beam, version 2.0.0, is making its debut at Apache: Big Data, taking place this week in Miami, FL, with four sessions featuring Apache Beam. Apache Beam will also be highlighted at numerous face-to-face meetups and conferences, including the Future of Data San Jose meetup, Strata Data Conference London, Berlin Buzzwords, and DataWorks Summit San Jose.</p> + +<p>Weâd like to invite everyone to try out Apache Beam today and consider joining our vibrant community. We welcome feedback, contribution and participation through our mailing lists, issue tracker, pull requests, and events.</p> + + </div> + +</article> + + </div> + <footer class="footer"> + <div class="footer__contained"> + <div class="footer__cols"> + <div class="footer__cols__col"> + <div class="footer__cols__col__logo"> + <img src="/images/beam_logo_circle.svg" class="footer__logo" alt="Beam logo"> + </div> + <div class="footer__cols__col__logo"> + <img src="/images/apache_logo_circle.svg" class="footer__logo" alt="Apache logo"> + </div> + </div> + <div class="footer__cols__col footer__cols__col--md"> + <div class="footer__cols__col__title">Start</div> + <div class="footer__cols__col__link"><a href="/get-started/beam-overview/">Overview</a></div> + <div class="footer__cols__col__link"><a href="/get-started/quickstart-java/">Quickstart (Java)</a></div> + <div class="footer__cols__col__link"><a href="/get-started/quickstart-py/">Quickstart (Python)</a></div> + <div class="footer__cols__col__link"><a href="/get-started/downloads/">Downloads</a></div> + </div> + <div class="footer__cols__col footer__cols__col--md"> + <div class="footer__cols__col__title">Docs</div> + <div class="footer__cols__col__link"><a href="/documentation/programming-guide/">Concepts</a></div> + <div class="footer__cols__col__link"><a href="/documentation/pipelines/design-your-pipeline/">Pipelines</a></div> + <div class="footer__cols__col__link"><a href="/documentation/runners/capability-matrix/">Runners</a></div> + </div> + <div class="footer__cols__col footer__cols__col--md"> + <div class="footer__cols__col__title">Community</div> + <div class="footer__cols__col__link"><a href="/contribute/">Contribute</a></div> + <div class="footer__cols__col__link"><a href="/contribute/team/">Team</a></div> + <div class="footer__cols__col__link"><a href="/contribute/presentation-materials/">Media</a></div> + </div> + <div class="footer__cols__col footer__cols__col--md"> + <div class="footer__cols__col__title">Resources</div> + <div class="footer__cols__col__link"><a href="/blog/">Blog</a></div> + <div class="footer__cols__col__link"><a href="/get-started/support/">Support</a></div> + <div class="footer__cols__col__link"><a href="https://github.com/apache/beam";>GitHub</a></div> + </div> + </div> + </div> + <div class="footer__bottom"> + © + <a href="http://www.apache.org";>The Apache Software Foundation</a> + | <a href="/privacy_policy">Privacy Policy</a> + | <a href="/feed.xml">RSS Feed</a> + <br><br> + Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are + either registered trademarks or trademarks of The Apache Software + Foundation. All other products or name brands are trademarks of their + respective holders, including The Apache Software Foundation. + </div> +</footer> + + </body> +</html> http://git-wip-us.apache.org/repos/asf/beam-site/blob/0b678294/content/blog/index.html ---------------------------------------------------------------------- diff --git a/content/blog/index.html b/content/blog/index.html index 5ccca0a..862b27d 100644 --- a/content/blog/index.html +++ b/content/blog/index.html @@ -141,6 +141,22 @@ <p>This is the blog for the Apache Beam project. This blog contains news and updates for the project.</p> +<h3 id="a-classpost-link-hrefblog20170517beam-first-stable-releasehtmlapache-beam-publishes-the-first-stable-releasea"><a class="post-link" href="/blog/2017/05/17/beam-first-stable-release.html">Apache Beam publishes the first stable release</a></h3> +<p><i>May 17, 2017 ⢠Davor Bonaci [<a href="https://twitter.com/BonaciDavor";>@BonaciDavor</a>] & Dan Halperin +</i></p> + +<p>The Apache Beam community is pleased to <a href="https://blogs.apache.org/foundation/entry/the-apache-software-foundation-announces12";>announce the availability of version 2.0.0</a>. This is the first stable release of Apache Beam, signifying a statement from the community that it intends to maintain API stability with all releases for the foreseeable future, and making Beam suitable for enterprise deployment.</p> + +<!-- Render a "read more" button if the post is longer than the excerpt --> + +<p> +<a class="btn btn-default btn-sm" href="/blog/2017/05/17/beam-first-stable-release.html" role="button"> +Read more <span class="glyphicon glyphicon-menu-right" aria-hidden="true"></span> +</a> +</p> + +<hr /> + <h3 id="a-classpost-link-hrefblog20170316python-sdk-releasehtmlpython-sdk-released-in-apache-beam-060a"><a class="post-link" href="/blog/2017/03/16/python-sdk-release.html">Python SDK released in Apache Beam 0.6.0</a></h3> <p><i>Mar 16, 2017 ⢠Ahmet Altay </i></p> http://git-wip-us.apache.org/repos/asf/beam-site/blob/0b678294/content/feed.xml ---------------------------------------------------------------------- diff --git a/content/feed.xml b/content/feed.xml index 1a32bd5..021ea40 100644 --- a/content/feed.xml +++ b/content/feed.xml @@ -9,6 +9,119 @@ <generator>Jekyll v3.2.0</generator> <item> + <title>Apache Beam publishes the first stable release</title> + <description><p>The Apache Beam community is pleased to <a href="https://blogs.apache.org/foundation/entry/the-apache-software-foundation-announces12">announce the availability of version 2.0.0</a>. This is the first stable release of Apache Beam, signifying a statement from the community that it intends to maintain API stability with all releases for the foreseeable future, and making Beam suitable for enterprise deployment.</p> + +<!--more--> + +<p>This first stable release is the third important milestone for the Apache Beam community. Beam joined the Apache Incubator in February 2016 and graduated as a top-level project of The Apache Software Foundation in December. Through these fifteen months of concentrated effort, a slightly chaotic codebase, merged from multiple organizations, has been developed into a generalized framework for data processing that is truly engine- and environment-independent. Apache Beam has evolved and improved through three incubating and three post-incubation releases, culminating in the stable release announced today as version 2.0.0.</p> + +<p>In the five months since graduation, Apache Beam has seen a significant growth, both in terms of adoption and community contribution. Apache Beam is <a href="https://blogs.apache.org/foundation/entry/the-apache-software-foundation-announces12">in use</a> at Google Cloud, PayPal, and Talend, among others.</p> + +<p>Apache Beam, version 2.0.0 improves user experience across the project, focusing on seamless portability across execution environments, including engines, operating systems, on-premise clusters, cloud providers, and data storage systems. Other highlights include:</p> + +<ul> + <li>API stability and future compatibility within this major version.</li> + <li>Stateful data processing paradigms that unlock efficient, data-dependent computations.</li> + <li>Support for user-extensible file systems, with built-in support for Hadoop Distributed File System, among others.</li> + <li>A metrics subsystem for deeper insight into pipeline execution.</li> +</ul> + +<p>Many contributors made this release possible, by participating in different roles: contributing code, writing documentation, testing release candidates, supporting users, or helping in some other way. The following is a partial list of contributors â 76 individuals contributed code to the project since the previous release, assembled from source history:</p> + +<ul> + <li>Ahmet Altay</li> + <li>Eric Anderson</li> + <li>Raghu Angadi</li> + <li>Sourabh Bajaj</li> + <li>Péter GergÅ Barna</li> + <li>Chen Bin</li> + <li>Davor Bonaci</li> + <li>Robert Bradshaw</li> + <li>Ben Chambers</li> + <li>Etienne Chauchot</li> + <li>Chang Chen</li> + <li>Charles Chen</li> + <li>Craig Citro</li> + <li>Lukasz Cwik</li> + <li>Márton Elek</li> + <li>Pablo Estrada</li> + <li>Josh Forman-Gornall</li> + <li>Maria GarcÃa Herrero</li> + <li>Jins George</li> + <li>Damien Gouyette</li> + <li>Thomas Groh</li> + <li>Dan Halperin</li> + <li>Pei He</li> + <li>Hadar Hod</li> + <li>Chamikara Jayalath</li> + <li>Rekha Joshi</li> + <li>Uwe Jugel</li> + <li>Sung Junyoung</li> + <li>Holden Karau</li> + <li>Vikas Kedigehalli</li> + <li>Eugene Kirpichov</li> + <li>Tibor Kiss</li> + <li>Kenneth Knowles</li> + <li>Vassil Kolarov</li> + <li>Chinmay Kolhatkar</li> + <li>Aljoscha Krettek</li> + <li>Dipti Kulkarni</li> + <li>Radhika Kulkarni</li> + <li>Jason Kuster</li> + <li>Reuven Lax</li> + <li>Stas Levin</li> + <li>Julien Lhermitte</li> + <li>Jingsong Li</li> + <li>Neville Li</li> + <li>Mark Liu</li> + <li>Michael Luckey</li> + <li>Andrew Martin</li> + <li>Ismaël MejÃa</li> + <li>Devon Meunier</li> + <li>Neda Mirian</li> + <li>Anil Muppalla</li> + <li>Gergely Novak</li> + <li>Jean-Baptiste Onofré</li> + <li>Melissa Pashniak</li> + <li>peay</li> + <li>David Rieber</li> + <li>Rahul Sabbineni</li> + <li>Kobi Salant</li> + <li>Amit Sela</li> + <li>Mark Shalda</li> + <li>Stephen Sisk</li> + <li>Yuya Tajima</li> + <li>Wesley Tanaka</li> + <li>JiJun Tang</li> + <li>Valentyn Tymofieiev</li> + <li>David Volquartz</li> + <li>Huafeng Wang</li> + <li>Thomas Weise</li> + <li>Rafal Wojdyla</li> + <li>Yangping Wu</li> + <li>wyp</li> + <li>James Xu</li> + <li>Mingmin Xu</li> + <li>Ted Yu</li> + <li>Borisa Zivkovic</li> + <li>Aviem Zur</li> +</ul> + +<p>Apache Beam, version 2.0.0, is making its debut at Apache: Big Data, taking place this week in Miami, FL, with four sessions featuring Apache Beam. Apache Beam will also be highlighted at numerous face-to-face meetups and conferences, including the Future of Data San Jose meetup, Strata Data Conference London, Berlin Buzzwords, and DataWorks Summit San Jose.</p> + +<p>Weâd like to invite everyone to try out Apache Beam today and consider joining our vibrant community. We welcome feedback, contribution and participation through our mailing lists, issue tracker, pull requests, and events.</p> +</description> + <pubDate>Wed, 17 May 2017 01:00:01 -0700</pubDate> + <link>https://beam.apache.org/blog/2017/05/17/beam-first-stable-release.html</link> + <guid isPermaLink="true">https://beam.apache.org/blog/2017/05/17/beam-first-stable-release.html</guid> + + + <category>blog</category> + + </item> + + <item> <title>Python SDK released in Apache Beam 0.6.0</title> <description><p>Apache Beamâs latest release, version <a href="/get-started/downloads/">0.6.0</a>, introduces a new SDK â this time, for the Python programming language. The Python SDK joins the Java SDK as the second implementation of the Beam programming model.</p> @@ -1272,40 +1385,5 @@ to us via <a href="/get-started/support/">userâs mailing list& </item> - <item> - <title>How We Added Windowing to the Apache Flink Batch Runner</title> - <description><p>We recently achieved a major milestone by adding support for windowing to the <a href="http://flink.apache.org">Apache Flink</a> Batch runner. In this post we would like to explain what this means for users of Apache Beam and highlight some of the implementation details.</p> - -<!--more--> - -<p>Before we start, though, letâs quickly talk about the execution of Beam programs and how this is relevant to todayâs post. A Beam pipeline can contain bounded and unbounded sources. If the pipeline only contains bounded sources it can be executed in a batch fashion, if it contains some unbounded sources it must be executed in a streaming fashion. When executing a Beam pipeline on Flink, you donât have to choose the execution mode. Internally, the Flink runner either translates the pipeline to a Flink <code class="highlighter-rouge">DataSet</code> program or a <code class="highlighter-rouge">DataStream</code> program, depending on whether unbounded sources are used in the pipeline. In the following, when we say âBatch runnerâ what we are really talking about is the Flink runner being in batch execution mode.</p> - -<h2 id="what-does-this-mean-for-users">What does this mean for users?</h2> - -<p>Support for windowing was the last missing puzzle piece for making the Flink Batch runner compatible with the Beam model. With the latest change to the Batch runner users can now run any pipeline that only contains bounded sources and be certain that the results match those of the original reference-implementation runners that were provided by Google as part of the initial code drop coming from the Google Dataflow SDK.</p> - -<p>The most obvious part of the change is that windows can now be assigned to elements and that the runner respects these windows for the <code class="highlighter-rouge">GroupByKey</code> and <code class="highlighter-rouge">Combine</code> operations. A not-so-obvious change concerns side-inputs. In the Beam model, side inputs respect windows; when a value of the main input is being processed only the side input that corresponds to the correct window is available to the processing function, the <code class="highlighter-rouge">DoFn</code>.</p> - -<p>Getting side-input semantics right is an important milestone in itâs own because it allows to use a big suite of unit tests for verifying the correctness of a runner implementation. These tests exercise every obscure detail of the Beam programming model and verify that the results produced by a runner match what you would expect from a correct implementation. In the suite, side inputs are used to compare the expected result to the actual result. With these tests being executed regularly we can now be more confident that the implementation produces correct results for user-specified pipelines.</p> - -<h2 id="under-the-hood">Under the Hood</h2> -<p>The basis for the changes is the introduction of <code class="highlighter-rouge">WindowedValue</code> in the generated Flink transformations. Before, a Beam <code class="highlighter-rouge">PCollection&lt;T&gt;</code> would be transformed to a <code class="highlighter-rouge">DataSet&lt;T&gt;</code>. Now, we instead create a <code class="highlighter-rouge">DataSet&lt;WindowedValue&lt;T&gt;&gt;</code>. The <code class="highlighter-rouge">WindowedValue&lt;T&gt;</code> stores meta data about the value, such as the timestamp and the windows to which it was assigned.</p> - -<p>With this basic change out of the way we just had to make sure that windows were respected for side inputs and that <code class="highlighter-rouge">Combine</code> and <code class="highlighter-rouge">GroupByKey</code> correctly handled windows. The tricky part there is the handling of merging windows such as session windows. For these we essentially emulate the behavior of a merging <code class="highlighter-rouge">WindowFn</code> in our own code.</p> - -<p>After we got side inputs working we could enable the aforementioned suite of tests to check how well the runner behaves with respect to the Beam model. As can be expected there were quite some discrepancies but we managed to resolve them all. In the process, we also slimmed down the runner implementation. For example, we removed all custom translations for sources and sinks and are now relying only on Beam code for these, thereby greatly reducing the maintenance overhead.</p> - -<h2 id="summary">Summary</h2> -<p>We reached a major milestone in adding windowing support to the Flink Batch runner, thereby making it compatible with the Beam model. Because of the large suite of tests that can now be executed on the runner we are also confident about the correctness of the implementation and about it staying that way in the future.</p> -</description> - <pubDate>Mon, 13 Jun 2016 09:00:00 -0700</pubDate> - <link>https://beam.apache.org/blog/2016/06/13/flink-batch-runner-milestone.html</link> - <guid isPermaLink="true">https://beam.apache.org/blog/2016/06/13/flink-batch-runner-milestone.html</guid> - - - <category>blog</category> - - </item> - </channel> </rss> http://git-wip-us.apache.org/repos/asf/beam-site/blob/0b678294/content/index.html ---------------------------------------------------------------------- diff --git a/content/index.html b/content/index.html index ae4312f..75ab64b 100644 --- a/content/index.html +++ b/content/index.html @@ -163,6 +163,11 @@ </div> <div class="hero__blog__cards"> + <a class="hero__blog__cards__card" href="/blog/2017/05/17/beam-first-stable-release.html"> + <div class="hero__blog__cards__card__title">Apache Beam publishes the first stable release</div> + <div class="hero__blog__cards__card__date">May 17, 2017</div> + </a> + <a class="hero__blog__cards__card" href="/blog/2017/03/16/python-sdk-release.html"> <div class="hero__blog__cards__card__title">Python SDK released in Apache Beam 0.6.0</div> <div class="hero__blog__cards__card__date">Mar 16, 2017</div> @@ -173,11 +178,6 @@ <div class="hero__blog__cards__card__date">Feb 13, 2017</div> </a> - <a class="hero__blog__cards__card" href="/blog/2017/02/01/graduation-media-recap.html"> - <div class="hero__blog__cards__card__title">Media recap of the Apache Beam graduation</div> - <div class="hero__blog__cards__card__date">Feb 1, 2017</div> - </a> - </div> </div> </div>
![https://www.apache.org/foundation/press/kit/feather_small.png"](https://www.apache.org/foundation/press/kit/feather_small.png"){kind=link}