Hi Neville,
Great !!!! Thanks for the update.
By the way, any plan to leverage the Beam filesystems in Scio now ?
Regards
JB
On 01/04/2018 09:41 PM, Neville Li wrote:
Hi all,
We just release Scio 0.4.7. This release fixed a join performance regression and
introduced several improvements.
https://github.com/spotify/scio/releases/tag/v0.4.7
/"Hydrochoerus hydrochaeris"/
Features
* Add support for TFRecordSpec #990 <https://github.com/spotify/scio/pull/990>
* Add convenience methods to randomSpit #987
<https://github.com/spotify/scio/pull/987>
* Add BigtableDoFn #922 <https://github.com/spotify/scio/issues/922> #931
<https://github.com/spotify/scio/pull/931>
* Add optional arguments validation #979
<https://github.com/spotify/scio/pull/979>
* Performance improvement in Avro and BigQuery macro converters #989
<https://github.com/spotify/scio/issues/989>
* Update new bigquery datetime and timestamp specification #982
<https://github.com/spotify/scio/pull/982>
Bug fixes
* Fix join performance regression introduced in 0.4.4 #976
<https://github.com/spotify/scio/issues/976> #983
<https://github.com/spotify/scio/pull/983>
* Fine tune dynamic sink API and and integration tests #993
<https://github.com/spotify/scio/issues/993> #995
<https://github.com/spotify/scio/pull/995>
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com