Re: Incomplete Beam Schema -> Avro Schema conversion

2022-09-09 Thread Balázs Németh
Is it still better to have an asymmetric conversion that supports more data types than not having these implemented, right? This contribution seems simple enough, but that's definitely not true for the other direction (... and I'm also biased, I only need Beam->Avro). Brian Hulette via dev ezt

Re: Incomplete Beam Schema -> Avro Schema conversion

2022-08-22 Thread Brian Hulette via dev
I don't think there's a reason for this, it's just that these logical types were defined after the Avro <-> Beam schema conversion. I think it would be worthwhile to add support for them, but we'd also need to look at the reverse (avro to beam) direction, which would map back to the catch-all

Incomplete Beam Schema -> Avro Schema conversion

2022-08-17 Thread Balázs Németh
java.lang.RuntimeException: Unhandled logical type beam:logical_type:date:v1 at org.apache.beam.sdk.schemas.utils.AvroUtils.getFieldSchema(AvroUtils.java:943) at org.apache.beam.sdk.schemas.utils.AvroUtils.toAvroField(AvroUtils.java:306) at