HI Chengxuan, We will try to include this change in the next release. As I said, you could also set use_fastavro=true in your pipeline code without having to wait for the change the makes this flag set to true by default.
Thanks, Valentyn *From:*Chengxuan Wang <[email protected]> *Date:*Sat, May 4, 2019, 3:28 AM *To:* <[email protected]> Hi Valentyn, > > Thanks a lot. By following https://github.com/apache/beam/pull/8130 , I > made changes in my apache beam package locally, now my test can pass. This > line > https://github.com/apache/beam/pull/8130/files#diff-04fef9e0550df0b0c4e1cd0264406eb5L608 > is > important. > > Is there a way to accelerate the release of this change? The reason I ask > is couple of my team's customers only use python3. :( So we may lose > customers without this change. > > please let me know. > > Thanks, > Chengxuan > > Valentyn Tymofieiev <[email protected]> 于2019年5月3日周五 下午7:45写道： > >> Correction: we are making fastavro a default option on Python 3 only for >> now. You can follow https://github.com/apache/beam/pull/8130 for updates >> on that. >> >> *From:*Valentyn Tymofieiev <[email protected]> >> *Date:*Fri, May 3, 2019, 10:41 PM >> *To:* <[email protected]> >> >> Hi, >>> >>> Unfortunately, Avro library currently doesn't work well with Python 3. >>> Could you try using fastavro in your pipeline and report back if that >>> helped to resolve your issue? We are also making fastavro a default option, >>> likely starting from 2.13.0. You could use fastavro as follows >>> >>> (sent from Phone, apologies for possible errors): >>> >>> WriteToAvro( >>> ..., >>> use_fastavro=True >>> ) >>> >>> >>> >>> >>> *From:*Chengxuan Wang <[email protected]> >>> *Date:*Fri, May 3, 2019, 8:30 PM >>> *To:* <[email protected]> >>> >>> Hi, >>>> I am trying to create a PTransform to combine avro schemas. But I met >>>> `json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)`, >>>> I think It is related to >>>> https://github.com/apache/avro/blob/master/lang/py3/avro/schema.py#L1058 . >>>> Because avro didn't implement __ne__, it will use __eq__ delegated. >>>> >>>> Then I saw there is `without_default` method in CombineGlobally, so I >>>> add that. Now I get `xception: Attempting to map key 'b' to value >>>> <avro.schema.Field object at 0x7f71b435ec50> in ImmutableDict {} [while >>>> running 'WriteToAvro/_WriteToAvroWithNoSchema/WriteBundles']`. >>>> >>>> Does anyone have this problem before? I am using python3 with >>>> apache-beam 2.12.0(the latest one)? >>>> >>>> It works fine under python2, but can't work under python3. >>>> >>>> Thanks, >>>> Chengxuan >>>> >>>
