Akash3121 opened a new pull request, #937:
URL: https://github.com/apache/incubator-xtable/pull/937
## What is the purpose of the pull request
This pull request addresses #901 by documenting the current schema evolution
and partition handling limitations for Parquet source directories.
XTable derives a Parquet source table's schema from a single file footer
selected using the filesystem modification time. It does not merge schemas
across all files. The documentation now explains how mixed file schemas and
changes to modification times can affect synchronization.
It also documents that Hive-style partition columns stored only in directory
paths are unsupported because XTable cannot synthesize the missing schema field
or infer its type.
## Brief change log
- Added a Parquet section to the Features and Limitations documentation.
- Documented that schema evolution across files in a Parquet source
directory is unsupported.
- Documented that XTable selects a file schema using filesystem
modification time rather than merging all file schemas.
- Documented the possible synchronization behavior when Parquet files have
different schemas.
- Documented that Hive-style partition columns existing only in directory
paths cannot be synthesized or typed by XTable.
## Verify this pull request
This pull request is a documentation-only change without test coverage.
- Verified the documentation by running the Docusaurus production build
locally with `npm run build`.
- Confirmed the website build completed successfully.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
