Re: [ANNOUNCEMENT] Common Pipeline Patterns - new section in the documentation + contributions welcome

2019-06-07 Thread Reza Rokni
+1 on the pattern Tim! Please raise a Jira with the label pipeline-patterns, details are here: https://beam.apache.org/documentation/patterns/overview/#contributing-a-pattern On Sat, 8 Jun 2019 at 05:04, Tim Robertson wrote: > This is great. Thanks Pablo and all > > I've seen several folk str

Re: [ANNOUNCEMENT] Common Pipeline Patterns - new section in the documentation + contributions welcome

2019-06-07 Thread Tim Robertson
This is great. Thanks Pablo and all I've seen several folk struggle with writing avro to dynamic locations which I think might be a good addition. If you agree I'll offer a PR unless someone gets there first - I have an example here: https://github.com/gbif/pipelines/blob/master/pipelines/export-

[ANNOUNCEMENT] Common Pipeline Patterns - new section in the documentation + contributions welcome

2019-06-07 Thread Pablo Estrada
Hello everyone, A group of community members has been working on gathering and providing common pipeline patterns for pipelines in Beam. These are examples on how to perform certain operations, and useful ways of using Beam in your pipelines. Some of them relate to processing of files, use of side