Hi all, The blog post Powerful and modular IO connectors with Splittable DoFn in Apache Beam <https://beam.apache.org/blog/2017/08/16/splittable-do-fn.html> just went live - take a look!
*One of the most important parts of the Apache Beam ecosystem is its quickly growing set of connectors that allow Beam pipelines to read and write data to various data storage systems (“IOs”). Currently, Beam ships over 20 IO connectors with many more in active development. As user demands for IO connectors grew, our work on improving the related Beam APIs (in particular, the Source API) produced an unexpected result: a generalization of Beam’s most basic primitive, DoFn.* Thanks to all the reviewers of the PR <https://github.com/apache/beam-site/pull/292> for edit suggestions!