Hi all,

The blog post Powerful and modular IO connectors with Splittable DoFn in
Apache Beam <https://beam.apache.org/blog/2017/08/16/splittable-do-fn.html>
just
went live - take a look!

*One of the most important parts of the Apache Beam ecosystem is its
quickly growing set of connectors that allow Beam pipelines to read and
write data to various data storage systems (“IOs”). Currently, Beam ships
over 20 IO connectors with many more in active development. As user demands
for IO connectors grew, our work on improving the related Beam APIs (in
particular, the Source API) produced an unexpected result: a generalization
of Beam’s most basic primitive, DoFn.*

Thanks to all the reviewers of the PR
<https://github.com/apache/beam-site/pull/292> for edit suggestions!

Reply via email to