Hi all, We just released scio v0.9.2. If you are upgrading from 0.8.x see our Migration Guide <https://spotify.github.io/scio/migrations/v0.9.0-Migration-Guide.html> for detailed instructions.
I’ll take this opportunity to announce that we moved from Gitter to Spotify FOSS Slack, you can find us in the #scio channel! (get an invite here <https://slackin.spotify.com/>) Cheers, Filipe Regadas https://github.com/spotify/scio/releases/tag/v0.9.2 <https://github.com/spotify/scio/releases/tag/v0.9.2> "Alohomora" Improvements Add more info to RateLimiterDoFn javadoc (#3054 <https://github.com/spotify/scio/pull/3054>) Add OnTimeBehaviour window option (#3063 <https://github.com/spotify/scio/pull/3063>) add small SMB sink optimizations (#3079 <https://github.com/spotify/scio/pull/3079>) Add support for PipelineOptions in ContextAndArgs (#3121 <https://github.com/spotify/scio/pull/3121>) Add support for read only ensureTable (#3114 <https://github.com/spotify/scio/pull/3114>) Add support for sharded JDBC reads from tables (#3020 <https://github.com/spotify/scio/pull/3020>) Add support for String/ByteString TF Bucket key types (#3098 <https://github.com/spotify/scio/pull/3098>) Ensures the future returned by addCallback will complete (#3099 <https://github.com/spotify/scio/pull/3099>) Update BigQueryType and AvroType compileTimeOnly msg (#3107 <https://github.com/spotify/scio/pull/3107>) Cleanup scio-repl classloader (#3118 <https://github.com/spotify/scio/pull/3118>) Initialize ScioContext on :reset (#3109 <https://github.com/spotify/scio/pull/3109>) Remove unnecessary cache of client interceptors (#3091 <https://github.com/spotify/scio/pull/3091>) Refactor scio-repl underlying ILoop (#3108 <https://github.com/spotify/scio/pull/3108>) Make SMB source a splittable BoundedSource (#3005 <https://github.com/spotify/scio/pull/3005>) More Coder doc (#3025 <https://github.com/spotify/scio/pull/3025>) Use a sampled subset of files to compute estimated SMB source size (#3037 <https://github.com/spotify/scio/pull/3037>) Use IndexRecord upper bound (#3028 <https://github.com/spotify/scio/pull/3028>) Use MonoidAggregator when available (#3051 <https://github.com/spotify/scio/pull/3051>) Wrap skewedJoin internals in transform (#3104 <https://github.com/spotify/scio/pull/3104>) Update deprecated .toIterator with .iterator (#3053 <https://github.com/spotify/scio/pull/3053>) Update to use testId instead of toString (#3115 <https://github.com/spotify/scio/pull/3115>) Bug Fixes Fix additional exception wrappings for Flink (#3035 <https://github.com/spotify/scio/pull/3035>) Fix classpath issue when running from IntelliJ or Bloop (#3087 <https://github.com/spotify/scio/pull/3087>) Fix containValue serialization (#3128 <https://github.com/spotify/scio/pull/3128>) Fix doc site edit page link (#3062 <https://github.com/spotify/scio/pull/3062>) Fix javafmt from #3054 <https://github.com/spotify/scio/pull/3054> Fix repl-generated classfiles output directory (#3106 <https://github.com/spotify/scio/pull/3106>) Fix scio-repl scala specific repl settings (#3089 <https://github.com/spotify/scio/pull/3089>) fix site homepage formatting fix SMB doc formatting (#3078 <https://github.com/spotify/scio/pull/3078>) Fix tuplecoders script Fix: Add extra schema encoding step if coder already set (#3027 <https://github.com/spotify/scio/pull/3027>) Fix: propagate PipelineOptions in job test (#3026 <https://github.com/spotify/scio/pull/3026>) Fix: support mutable zeroValue in aggregate/combine/fold (#3033 <https://github.com/spotify/scio/pull/3033>) Add missing Dataflow runner to scio-repl (#3081 <https://github.com/spotify/scio/pull/3081>) Dependency Updates Update auto-value, auto-value-annotations to 1.7.3 (#3042 <https://github.com/spotify/scio/pull/3042>) Update Beam to 2.22.0 (#3039 <https://github.com/spotify/scio/pull/3039>) Update caffeine to 2.8.5 (#3112 <https://github.com/spotify/scio/pull/3112>) Update case-app, case-app-annotations, ... to 2.0.3 (#3094 <https://github.com/spotify/scio/pull/3094>) Update elasticsearch-rest-client, ... to 7.8.0 (#3067 <https://github.com/spotify/scio/pull/3067>) Update magnolify-avro, magnolify-bigtable, ... to 0.2.1 (#3127 <https://github.com/spotify/scio/pull/3127>) Update scala to 2.13.3 (#3130 <https://github.com/spotify/scio/pull/3130>) Update scalactic to 3.2.0 (#3072 <https://github.com/spotify/scio/pull/3072>) Update scalatest to 3.2.0 (#3073 <https://github.com/spotify/scio/pull/3073>) Update transport to 6.8.10 (#3047 <https://github.com/spotify/scio/pull/3047>)
