Hi all, First cross-post here but figured it makes sense. Scio is a Scala API for Apache Beam and Google Cloud Dataflow that we use heavily at Spotify.
Check out the wiki for more information: https://github.com/spotify/scio/wiki Cheers, Neville ---------- Forwarded message --------- From: 'Neville Li' via Scio Users <[email protected]> Date: Tue, Dec 19, 2017 at 1:12 PM Subject: Scio 0.4.6 released To: <[email protected]> Hi all, We just released Scio 0.4.6. It's based on Beam 2.2.0 now with a lot of improvements and bug fixes. Cheers, Neville https://github.com/spotify/scio/releases/tag/v0.4.6 *"Galago gallarum"* Features - Upgrade Beam to 2.2.0 #797 <https://github.com/spotify/scio/issues/797> #958 <https://github.com/spotify/scio/pull/958> - Support dynamic file IO destinations #919 <https://github.com/spotify/scio/issues/919> #965 <https://github.com/spotify/scio/pull/965> - Support custom Kryo options via PipelineOptions #896 <https://github.com/spotify/scio/issues/896> #955 <https://github.com/spotify/scio/pull/955> - Propagate input to TensorFlow predict output fn - Annotate more examples with Socco - Support compression in TextIO #972 <https://github.com/spotify/scio/pull/972> - Use Compression in TFRecordIO #977 <https://github.com/spotify/scio/pull/977> - Add TSV examples #974 <https://github.com/spotify/scio/pull/974> Bug fixes - Use window as side input cache key #959 <https://github.com/spotify/scio/issues/959> #960 <https://github.com/spotify/scio/pull/960> - Use canonical path in macro type providers #975 <https://github.com/spotify/scio/pull/975> - Fix deduplication in SCollection#subtract #973 <https://github.com/spotify/scio/pull/973> - Fix empty RHS for hashJoin and hashLeftJoin #953 <https://github.com/spotify/scio/pull/953> - Fix ClassNotFound issue with ClosureCleaner - Lift projection in ParquetAvroFile#flatMap - Add Dataflow runner to scio-examples #963 <https://github.com/spotify/scio/pull/963> #968 <https://github.com/spotify/scio/pull/968> - Remove deprecated Pubsub ClientAuthInterceptor #957 <https://github.com/spotify/scio/issues/957> #962 <https://github.com/spotify/scio/pull/962> -- You received this message because you are subscribed to the Google Groups "Scio Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/scio-users/CA%2BJxquN31ziSQiitOKjK_Ak5PJzxMbqFLPTwJZdZhE9MOHxLUQ%40mail.gmail.com <https://groups.google.com/d/msgid/scio-users/CA%2BJxquN31ziSQiitOKjK_Ak5PJzxMbqFLPTwJZdZhE9MOHxLUQ%40mail.gmail.com?utm_medium=email&utm_source=footer> . For more options, visit https://groups.google.com/d/optout.
