Hi all, We just released Scio 0.9.0. The biggest change was dropping Scala 2.11 and adding 2.13 support. Also included are Guava/magnolia powered Bloom Filter, improved test messages and other improvements.
For those using Featran <https://github.com/spotify/featran> for feature engineering, the matching release is 0.6.0. Cheers, Neville https://github.com/spotify/scio/releases/tag/v0.9.0 *"Furnunculus"* Breaking changes - See v0.9.0 Migration Guide <https://spotify.github.io/scio/migrations/v0.9.0-Migration-Guide.html> for detailed instructions - Remove deprecated elasticsearch2 (#2800 <https://github.com/spotify/scio/pull/2800>) - Remove deprecated cassandra2 (#2801 <https://github.com/spotify/scio/pull/2801>) - Remove deprecated tensorflow saveAsTfExampleFile (#2798 <https://github.com/spotify/scio/pull/2798>) - Remove toEither from ScioUtil (#2799 <https://github.com/spotify/scio/pull/2799>) - Remove ReflectiveRecordIO (#2856 <https://github.com/spotify/scio/pull/2856>) - Remove context close in favor of run (#2858 <https://github.com/spotify/scio/pull/2858>) - Remove deprecated ScioContext Future references (#2859 <https://github.com/spotify/scio/pull/2859>) - Rework implicits/syntax for scio-extra bigquery package (#2844 <https://github.com/spotify/scio/pull/2844>) - Remove implicit Coder requirement for .saveAsSortedBucket (#2839 <https://github.com/spotify/scio/pull/2839>) - Drop scala 2.11 support (#2619 <https://github.com/spotify/scio/pull/2619>) - Re-vamp Bloom filter and sparse-transforms (#2651 <https://github.com/spotify/scio/pull/2651>) - Remove deprecated bigQuery, typedBigQuery and saveAsBigQuery (#2806 <https://github.com/spotify/scio/pull/2806>) Improvements - Add scala 2.13 support (#2619 <https://github.com/spotify/scio/pull/2619>) - Add queryAsSource to BigQueryType (#2804 <https://github.com/spotify/scio/pull/2804>) - Deprecate BigQueryType query in favor of queryRaw (#2857 <https://github.com/spotify/scio/pull/2857>) - Make OptionCoder extends from AtomicCoder (#2882 <https://github.com/spotify/scio/pull/2882>) - Make iterable and traversable coders buffered (#2881 <https://github.com/spotify/scio/pull/2881>) - Better support for alternative runners in tests (#2877 <https://github.com/spotify/scio/pull/2877>) - Use UUID in SMB temp directory (#2849 <https://github.com/spotify/scio/pull/2849>) - Reuse ApproxFilter (#2817 <https://github.com/spotify/scio/pull/2817>) - Support metadata in AvroFileOperations (fix #2832 <https://github.com/spotify/scio/issues/2832>) (#2834 <https://github.com/spotify/scio/pull/2834>) - Add --help command line support for custom PipelineOptions (#2840 <https://github.com/spotify/scio/pull/2840>)(#2843 <https://github.com/spotify/scio/pull/2843>) - Add covary method to lift SCollection to the specified type (#2808 <https://github.com/spotify/scio/pull/2808>) - Customize equality in unit tests and better failure message (#2733 <https://github.com/spotify/scio/pull/2733>) - Add more convinience methods that support default transform names ( #2805 <https://github.com/spotify/scio/pull/2805>) Bug Fixes - Fix create scio-spanner it clients lazy (#2889 <https://github.com/spotify/scio/pull/2889>) - Fix generate tree eagerly before checking for private constructors ( #2846 <https://github.com/spotify/scio/pull/2846>) - Fix missing-bucket case when Sink collection is empty (#2869 <https://github.com/spotify/scio/pull/2869>) - Remove uneeded caffeine dep in scio-bigquery (#2861 <https://github.com/spotify/scio/pull/2861>) - Fix Sharded Sparkey string hashing behaviour for strings longer than one character. (#2826 <https://github.com/spotify/scio/pull/2826>) - Add magnolify BigtableType usage examples to scio-examples #2789 <https://github.com/spotify/scio/issues/2789> (#2816 <https://github.com/spotify/scio/pull/2816>) - Check jobReference.location for query location (#2845 <https://github.com/spotify/scio/pull/2845>) - Fix NPE in BaseAsyncLookupDoFn.Try#hashCode() (#2841 <https://github.com/spotify/scio/pull/2841>) - Fix: cancel job on waitUntilFinish timeout (#2823 <https://github.com/spotify/scio/pull/2823>) - Fix: full camelCase typed args support (#2777 <https://github.com/spotify/scio/pull/2777>) Dependency Updates - Update magnolify to 0.1.7 - Update magnolia to 0.14.5 (#2886 <https://github.com/spotify/scio/pull/2886>) - Update beam-runners-core-construction-java, ... to 2.20.0 (#2887 <https://github.com/spotify/scio/pull/2887>) - Update scala-collection-compat to 2.1.5 (#2885 <https://github.com/spotify/scio/pull/2885>) - Update gcs-connector to hadoop2-2.1.2 (#2842 <https://github.com/spotify/scio/pull/2842>) - Update algebra to 2.0.1 (#2821 <https://github.com/spotify/scio/pull/2821>) - Update es6 transport to 6.8.8 (#2830 <https://github.com/spotify/scio/pull/2830>) - Update es7 elasticsearch-rest-client, ... to 7.6.2 (#2829 <https://github.com/spotify/scio/pull/2829>) - Update cats-kernel to 2.1.1 (#2822 <https://github.com/spotify/scio/pull/2822>) - Update PPrint to 0.5.9 (#2793 <https://github.com/spotify/scio/pull/2793>)
