knotenpunkt commented on PR #2053: URL: https://github.com/apache/avro/pull/2053#issuecomment-1446539512
This naming-thing was also a problem, if we use that avro-lib in combination with parquet. It is an nice adapter, but that validating of the names entailed that we can't write parquet files with "all" names, also at reading-parquets file in with that library caused in exceptions Take a look here: https://stackoverflow.com/a/39734610/2182302 ```java try (ParquetWriter<GenericData.Record> writer = AvroParquetWriter .<GenericData.Record>builder(fileToWrite) .withSchema(schema) .withConf(new Configuration()) .withCompressionCodec(CompressionCodecName.SNAPPY) .build()) { for (GenericData.Record record : recordsToWrite) { writer.write(record); } } ``` I think a lot of projects use that AvroParquetWriter **Maybe we should deactivate that naming-validation in that `AvroParquetWriter` by default?** -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
