Anant Damle created BEAM-11861:
----------------------------------

             Summary: ParquetIO throws Coder not found when using 
parseGenericRecord or parseFilesGenericRecord
                 Key: BEAM-11861
                 URL: https://issues.apache.org/jira/browse/BEAM-11861
             Project: Beam
          Issue Type: Bug
          Components: io-java-parquet
    Affects Versions: 2.28.0
            Reporter: Anant Damle
            Assignee: Anant Damle


ParquetIO is missing output coder  when  using a user-specified parsing 
function with `parseGenericRecord` or `parseFilesGenericRecord` feature for 
reading Parquet files with unknown schema.

*Workaround:* 
 Use `setCoder` directly on the output `PCollection`
 for example:

{{SerializableFunction<GenericRecord, Foo> parseFn = ...;}}
 {{Coder<Foo> fooCoder = ...;}}
{{PCollection<Foo> records = 
}}{{p}}{{.apply(ParquetIO.parseGenericRecords(parseFn).from(...))}}
 {{*.setCoder(fooCoder)*;}}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to