kevinjqliu opened a new pull request, #3669:
URL: https://github.com/apache/parquet-java/pull/3669

   ## Description
   
   This makes parquet-java more tolerant of Parquet files written by newer 
implementations.
   
   A newer writer may use a logical type that this version of parquet-java does 
not know about yet. The file can still have a perfectly valid physical column 
type, but today the reader fails while trying to interpret the unknown 
logical-type metadata.
   
   The fix is to handle that case in `ParquetMetadataConverter`, where file 
metadata is translated into parquet-java schema annotations. If the logical 
type cannot be understood, the converter now leaves the column as its physical 
type instead of failing. That is the right behavior for forward compatibility: 
readers should preserve the data they can understand, and only apply logical 
annotations when they are known.
   
   This also keeps the existing fallback behavior intact for files that include 
older `converted_type` metadata.
   
   ## Tests
   
   Added tests cover reading an unknown logical type both with and without a 
`converted_type` fallback.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to