Hi Beam community,
I cannot log into Beam jira so I am asking this question here. I am testing
this new feature from Beam 2.28 and see below error:
Exception in thread "main" java.lang.IllegalArgumentException: Unable to infer
coder for output of parseFn. Specify it explicitly using withCoder().
at
org.apache.beam.sdk.io.parquet.ParquetIO$ParseFiles.inferCoder(ParquetIO.java:554)
at
org.apache.beam.sdk.io.parquet.ParquetIO$ParseFiles.expand(ParquetIO.java:521)
at
org.apache.beam.sdk.io.parquet.ParquetIO$ParseFiles.expand(ParquetIO.java:483)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:547)
However ParquetIO builder does not have this withCoder() method. I think this
error message is mimicking AvroIO:
https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/io/AvroIO.java#L1010
Should we add this method to ParquetIO? Thanks!
