anantdamle opened a new pull request #831:
URL: https://github.com/apache/parquet-mr/pull/831
Make sure you have checked _all_ steps below.
Reading Parquet files in Apache Beam using ParquetIO uses
`AvroParquetReader` causing it to throw `IllegalArgumentException("INT96 not
implemented and is deprecated")`
Customers have large datasets which can't be reprocessed again to convert
into a supported type. An easier approach would be to convert into a byte array
of 12 bytes, that can then be interpreted by the developer in any way they want
to interpret it.
This patch interprets the INT96 parquet type as a byte array of 12-bytes.
the developer/user can then handle it appropriate to interpret into a timestamp
or simple some bytes.
- [x ] My PR adds the following unit tests
`testParquetInt96AsFixed12AvroType`
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
