Anant Damle created BEAM-11861:
----------------------------------
Summary: ParquetIO throws Coder not found when using
parseGenericRecord or parseFilesGenericRecord
Key: BEAM-11861
URL: https://issues.apache.org/jira/browse/BEAM-11861
Project: Beam
Issue Type: Bug
Components: io-java-parquet
Affects Versions: 2.28.0
Reporter: Anant Damle
Assignee: Anant Damle
ParquetIO is missing output coder when using a user-specified parsing
function with `parseGenericRecord` or `parseFilesGenericRecord` feature for
reading Parquet files with unknown schema.
*Workaround:*
Use `setCoder` directly on the output `PCollection`
for example:
{{SerializableFunction<GenericRecord, Foo> parseFn = ...;}}
{{Coder<Foo> fooCoder = ...;}}
{{PCollection<Foo> records =
}}{{p}}{{.apply(ParquetIO.parseGenericRecords(parseFn).from(...))}}
{{*.setCoder(fooCoder)*;}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)