vinishjail97 commented on issue #678:
URL:
https://github.com/apache/incubator-xtable/issues/678#issuecomment-2868565386
# Release Notes for release-0.3.0-incubating-rc3
Apache XTable™ (Incubating) is a cross-table converter for table formats
that facilitates omni-directional interoperability across data processing
systems and query engines. Currently, Apache XTable™ supports widely adopted
open-source table formats such as Apache Hudi, Apache Iceberg, and Delta Lake.
## ✨ What's Changed
### 🔄 Core Functionality Enhancements
- **Catalog Sync**:
- Introduced `CatalogSyncClient` and `CatalogSync` interfaces.
- Implemented **Glue** and **HMS catalog sync** for **Iceberg**,
**Delta**, and **Hudi**.
- Additional information can be found in
[docs](https://xtable.apache.org/docs/how-to-catalog-sync).
- **Table Format Sync Improvements**:
- Added support for **continuous sync** using `RunSync`.
- Support **restore/rollback** sync during conversion across all three
formats.
- Added support for **bucket partition transform** (Iceberg → Delta).
- Synced **schema field comments** and **record counts** in Delta source.
- Improved **decimal field scale** handling in iceberg and fixed bug in
**column stats**.
- Supporting **timestamp_ntz** type in conversion logic.
- **Breaking changes**
- We have refactored `SyncStatusCode` and `ErrorDetails` into dedicated
classes, refactor code by fixing the import path if you are using these
classes.
### 🧪 Testing & Quality
- Fixed flaky tests and normalized base paths for test stability.
- Addressed minor issues found via **static analysis tooling**.
- Dockerfile syntax fix and test class name corrections.
### 📘 Documentation & Community
- Added **downloads page** for `0.2.0-incubating` release.
- Introduced **RFC template** and new **change proposals**.
- Updated **community sync** and **blog** pages.
### 🧰 Infrastructure & Maintenance
- Upgraded **parquet-avro** to 1.15.1 to fix critical vulnerabilities found
recently.
- Upgraded **Hadoop** and **AWS SDK** dependencies.
- Refactored `RunSync` for better modularity and reusability.
## Detailed Change Log
* Iceberg and Delta target: sync schema field comments by @emilie-wang in
https://github.com/apache/incubator-xtable/pull/575
* [551] Add downloads page for 0.2.0-incubating release by @vinishjail97 in
https://github.com/apache/incubator-xtable/pull/576
* [551] Try enabling keep_files as false in GH action for downloads by
@vinishjail97 in https://github.com/apache/incubator-xtable/pull/577
* [DOCS] Remove info on snowflake public preview for Iceberg by
@sagarlakshmipathy in https://github.com/apache/incubator-xtable/pull/580
* Add 2 New Community Blogs to the Apache XTable Blogs section by
@dipankarmazumdar in https://github.com/apache/incubator-xtable/pull/585
* Site content is not deployed due to missing .asf.yaml file by @zabetak in
https://github.com/apache/incubator-xtable/pull/587
* Execute correct delete operation in delta tests by @ashvina in
https://github.com/apache/incubator-xtable/pull/589
* Fix commit log parsing of Delta tables with delete vector by @ashvina in
https://github.com/apache/incubator-xtable/pull/596
* Normalize basePath in targetTables in ConversionController by
@vinishjail97 in https://github.com/apache/incubator-xtable/pull/602
* [590] Add RFC template for XTable by @vinishjail97 in
https://github.com/apache/incubator-xtable/pull/604
* [590] Add interfaces for CatalogSyncClient and CatalogSync by
@vinishjail97 in https://github.com/apache/incubator-xtable/pull/603
* [590] Add RFC template for XTable by @vinishjail97 in
https://github.com/apache/incubator-xtable/pull/610
* [590] Hadoop and AWS sdk version upgrade by @kroushan-nit in
https://github.com/apache/incubator-xtable/pull/614
* [619] Maintenance: Update dependencies, fix test class names by
@the-other-tim-brown in https://github.com/apache/incubator-xtable/pull/620
* [608] Ensure column stats for decimal fields have proper scale set by
@the-other-tim-brown in https://github.com/apache/incubator-xtable/pull/617
* [615] Add Iceberg stats when reading snapshot by @the-other-tim-brown in
https://github.com/apache/incubator-xtable/pull/616
* Add community sync page for XTable by @vinishjail97 in
https://github.com/apache/incubator-xtable/pull/625
* Update GMeet link and add today's recording by @vinishjail97 in
https://github.com/apache/incubator-xtable/pull/628
* [590] Add RFC for XCatalogSync - Synchronize tables across catalogs by
@vinishjail97 in https://github.com/apache/incubator-xtable/pull/605
* [590] Add RunCatalogSync utility for synchronizing tables across catalogs
by @vinishjail97 in https://github.com/apache/incubator-xtable/pull/591
* Delta source: add record count for DataFile by @emilie-wang in
https://github.com/apache/incubator-xtable/pull/623
* [site] Update blogs by @bhasudha in
https://github.com/apache/incubator-xtable/pull/635
* [590] Add Iceberg Glue Catalog Sync implementation by @kroushan-nit in
https://github.com/apache/incubator-xtable/pull/632
* [590] Add Iceberg HMS Catalog Sync implementation by @kroushan-nit in
https://github.com/apache/incubator-xtable/pull/633
* [590] Add Delta Glue Catalog Sync implementation by @kroushan-nit in
https://github.com/apache/incubator-xtable/pull/637
* [590] Add Delta HMS Catalog Sync implementation by @kroushan-nit in
https://github.com/apache/incubator-xtable/pull/638
* [590] Add Hudi HMS Catalog Sync implementation by @vamsikarnika in
https://github.com/apache/incubator-xtable/pull/639
* Update xtable-api sources by @emmanuel-ferdman in
https://github.com/apache/incubator-xtable/pull/651
* [Enhancement] Support restore/rollback sync during conversion (1/2) by
@danielhumanmod in https://github.com/apache/incubator-xtable/pull/569
* [590] Add Hudi HMS Catalog Sync Implementation by @vamsikarnika in
https://github.com/apache/incubator-xtable/pull/648
* [590] Add Hudi Glue Catalog Sync Implementation by @vamsikarnika in
https://github.com/apache/incubator-xtable/pull/649
* Add change proposal for conversion of deletion vectors by @ashvina in
https://github.com/apache/incubator-xtable/pull/634
* Add base representation for storage files by @ashvina in
https://github.com/apache/incubator-xtable/pull/653
* Fix flaky test, ignore order of elements in list validation by @ashvina in
https://github.com/apache/incubator-xtable/pull/662
* [594] Support continuous conversion with the RunSync tool by
@the-other-tim-brown in https://github.com/apache/incubator-xtable/pull/593
* [MINOR] fixes recommended from static analysis tooling by
@the-other-tim-brown in https://github.com/apache/incubator-xtable/pull/664
* Modified incremental safe check which does not depend on snapshots list
order by @brishi19791 in https://github.com/apache/incubator-xtable/pull/665
* [668] Support bucket partition transform for Iceberg Sources and Delta
Targets by @the-other-tim-brown in
https://github.com/apache/incubator-xtable/pull/670
* Handle timestamp_ntz in delta and iceberg by @vinishjail97 in
https://github.com/apache/incubator-xtable/pull/647
* [MINOR] Fix docker file syntax issue by @the-other-tim-brown in
https://github.com/apache/incubator-xtable/pull/674
* [528] Refactor RunSync Class for Improved Modularity and Reusability by
@vaibhavk1992 in https://github.com/apache/incubator-xtable/pull/675
* Add how-to docs for catalog sync by @vinishjail97 in
https://github.com/apache/incubator-xtable/pull/673
* [MINOR] Add mailing list for discussions, update issues list in asf.yaml
by @the-other-tim-brown in https://github.com/apache/incubator-xtable/pull/676
* [MINOR] Fix mailing list in asf.yaml by @the-other-tim-brown in
https://github.com/apache/incubator-xtable/pull/677
* [678] Add contribution guidelines to reflect stale PR's guidelines by
@vinishjail97 in https://github.com/apache/incubator-xtable/pull/684
* [678] Avoid skipping xtable-aws and xtable-hive-metastore in mvn deploy by
@vinishjail97 in https://github.com/apache/incubator-xtable/pull/679
* [678] Introduce maturity-level in xtable-api and Refactor SyncStatusCode
into separate class by @vinishjail97 in
https://github.com/apache/incubator-xtable/pull/685
* Bump org.apache.parquet:parquet-avro from 1.12.3 to 1.15.1 by @dependabot
in https://github.com/apache/incubator-xtable/pull/686
* Enable squash and merge in .asf.yaml for xtable by @vinishjail97 in
https://github.com/apache/incubator-xtable/pull/688
* [678] Add LICENSE for xtable-aws module by @vinishjail97 in
https://github.com/apache/incubator-xtable/pull/690
* [678] Add LICENSE for xtable-hive-metastore module by @vinishjail97 in
https://github.com/apache/incubator-xtable/pull/691
* Docs: Update Footer Copyright Year by @omkenge in
https://github.com/apache/incubator-xtable/pull/654
* [692] Include 2025 in NOTICE file by @vinishjail97 in
https://github.com/apache/incubator-xtable/pull/695
* [692] Exclude jol-core in xtable bundled dependencies by @vinishjail97 in
https://github.com/apache/incubator-xtable/pull/696
* Remove parameters from Glue partition columns by @kroushan-nit in
https://github.com/apache/incubator-xtable/pull/697
* [692] Ensure LICENSE content is different for bundled jars by
@vinishjail97 in https://github.com/apache/incubator-xtable/pull/699
* [DOCS]: Add 3 New Community Blogs by @dipankarmazumdar in
https://github.com/apache/incubator-xtable/pull/706
* Add open api REST spec for XTable Service by @rahil-c in
https://github.com/apache/incubator-xtable/pull/705
* [BLOG]: Add the new Catalog sync blog by @dipankarmazumdar in
https://github.com/apache/incubator-xtable/pull/708
* [700] Update license files for bundled jars by @vinishjail97 in
https://github.com/apache/incubator-xtable/pull/707
* Add latest metadata path field in InternalTable by @rahil-c in
https://github.com/apache/incubator-xtable/pull/710
* [700] Update NOTICE file for bundled jars by @vinishjail97 in
https://github.com/apache/incubator-xtable/pull/709
* Add implementation for XTable REST Service by @rahil-c in
https://github.com/apache/incubator-xtable/pull/704
## New Contributors
* @kroushan-nit made their first contribution in
https://github.com/apache/incubator-xtable/pull/614
* @bhasudha made their first contribution in
https://github.com/apache/incubator-xtable/pull/635
* @brishi19791 made their first contribution in
https://github.com/apache/incubator-xtable/pull/665
* @vaibhavk1992 made their first contribution in
https://github.com/apache/incubator-xtable/pull/675
* @omkenge made their first contribution in
https://github.com/apache/incubator-xtable/pull/654
* @rahil-c made their first contribution in
https://github.com/apache/incubator-xtable/pull/705
**Full Changelog**:
https://github.com/apache/incubator-xtable/compare/0.2.0-incubating...0.3.0-incubating-rc3
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@xtable.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
