shenodaguirguis commented on pull request #2496:
URL: https://github.com/apache/iceberg/pull/2496#issuecomment-1029244367
hi @RussellSpitzer , @rymurr ,
As @wmoustafa shared on this
[thread](https://lists.apache.org/thread/z3r2wjycd9yp5l24tto5ol3dmssoqo9j), we
have deployed support for non-null default values for AVRO and ORC formats at
LinkedIn in production for a while now, which enabled us to rollout Hive tables
to Iceberg (as a step towards converting the tables transparently to Iceberg
format). The relevant changes in LinkedIn's fork are listed below for
reference. I have updated this PR to reflect the its final state. Please take a
look at your earliest convenience.
**LinkedIn/Iceberg PRs related to supporting non-null default values:**
- [Support default value semantic for AVRO
PR#75](https://github.com/linkedin/iceberg/pull/75)
which combines the following three PRs:
[API changes PR#63](https://github.com/linkedin/iceberg/pull/63)
[Schema Mapping changes
PR#69](https://github.com/linkedin/iceberg/pull/69)
[Use default values reading AVRO
PR#72](https://github.com/linkedin/iceberg/pull/72)
- [Support default value read for ORC format in spark
PR#76](https://github.com/linkedin/iceberg/pull/76)
- [(optional) Move to Avro 1.10.2
PR#82](https://github.com/linkedin/iceberg/pull/82)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
