This is an automated email from the ASF dual-hosted git repository.
vinishjail97 pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-xtable.git
The following commit(s) were added to refs/heads/main by this push:
new ffae569b [MINOR] Update engine versions in the docs to match the build
(#904)
ffae569b is described below
commit ffae569b2778d8acaad21c78135eeebf5b04fae8
Author: Sylwester Lachiewicz <[email protected]>
AuthorDate: Mon Aug 31 22:49:56 2026 +0200
[MINOR] Update engine versions in the docs to match the build (#904)
The spark-shell examples pinned Spark 3.2-era Hudi, Delta and Iceberg
artifacts; the build is on Spark 3.4.2.
---
website/docs/features-and-limitations.md | 2 +-
website/docs/hms.md | 4 ++--
website/docs/how-to.md | 6 +++---
3 files changed, 6 insertions(+), 6 deletions(-)
diff --git a/website/docs/features-and-limitations.md
b/website/docs/features-and-limitations.md
index 1d79f2dc..d3542600 100644
--- a/website/docs/features-and-limitations.md
+++ b/website/docs/features-and-limitations.md
@@ -33,7 +33,7 @@ HMS and AWS Glue are the two catalogs supported right now,
support for other cat
- Only Copy-on-Write or Read-Optimized views of tables are currently
supported. This means that only the underlying parquet files are synced but log
files from Hudi and [delete
vectors](https://docs.delta.io/latest/delta-deletion-vectors.html#:~:text=Deletion%20vectors%20indicate%20changes%20to,is%20run%20on%20the%20table.)
from Delta and Iceberg are not captured by the sync.
### Hudi
-- Hudi 0.14.0 is required when reading a Hudi target table. Users will also
need to enable
+- Hudi 0.14.0 or later is required when reading a Hudi target table. Users
will also need to enable
- the metadata table (`hoodie.metadata.enable=true`) and
- hive style partitioning
(`hoodie.datasource.write.hive_style_partitioning=true`) wherever applicable
when reading the data.
- Be sure to enable `parquet.avro.write-old-list-structure=false` for proper
compatibility with lists when syncing from Hudi to Iceberg.
diff --git a/website/docs/hms.md b/website/docs/hms.md
index 06198286..bc86c846 100644
--- a/website/docs/hms.md
+++ b/website/docs/hms.md
@@ -148,7 +148,7 @@ SELECT * FROM <database_name>.<table_name>;
<TabItem value="delta">
```shell md title="shell"
-spark-sql --packages io.delta:delta-core_2.12:2.0.0 \
+spark-sql --packages io.delta:delta-core_2.12:2.4.0 \
--conf "spark.sql.extensions=io.delta.sql.DeltaSparkSessionExtension" \
--conf
"spark.sql.catalog.spark_catalog=org.apache.spark.sql.delta.catalog.DeltaCatalog"
\
--conf "spark.sql.catalogImplementation=hive"
@@ -182,7 +182,7 @@ SELECT * FROM delta_db.<table_name>;
<TabItem value="iceberg">
```shell md title="shell"
-spark-sql --packages org.apache.iceberg:iceberg-spark-runtime-3.2_2.12:1.2.1 \
+spark-sql --packages org.apache.iceberg:iceberg-spark-runtime-3.4_2.12:1.9.2 \
--conf
"spark.sql.extensions=org.apache.iceberg.spark.extensions.IcebergSparkSessionExtensions"
\
--conf
"spark.sql.catalog.spark_catalog=org.apache.iceberg.spark.SparkSessionCatalog" \
--conf "spark.sql.catalog.spark_catalog.type=hive" \
diff --git a/website/docs/how-to.md b/website/docs/how-to.md
index b765e12d..3e724b7f 100644
--- a/website/docs/how-to.md
+++ b/website/docs/how-to.md
@@ -55,7 +55,7 @@ values={[
```shell md title="shell"
pyspark \
- --packages org.apache.hudi:hudi-spark3.2-bundle_2.12:0.14.0 \
+ --packages org.apache.hudi:hudi-spark3.4-bundle_2.12:1.2.0 \
--conf "spark.serializer=org.apache.spark.serializer.KryoSerializer" \
--conf
"spark.sql.catalog.spark_catalog=org.apache.spark.sql.hudi.catalog.HoodieCatalog"
\
--conf
"spark.sql.extensions=org.apache.spark.sql.hudi.HoodieSparkSessionExtension"
@@ -65,7 +65,7 @@ pyspark \
```shell md title="shell"
pyspark \
- --packages io.delta:delta-core_2.12:2.1.0 \
+ --packages io.delta:delta-core_2.12:2.4.0 \
--conf "spark.sql.extensions=io.delta.sql.DeltaSparkSessionExtension" \
--conf
"spark.sql.catalog.spark_catalog=org.apache.spark.sql.delta.catalog.DeltaCatalog"
```
@@ -74,7 +74,7 @@ pyspark \
```shell md title="shell"
pyspark \
- --packages org.apache.iceberg:iceberg-spark-runtime-3.2_2.12:1.4.1 \
+ --packages org.apache.iceberg:iceberg-spark-runtime-3.4_2.12:1.9.2 \
--conf
"spark.sql.extensions=org.apache.iceberg.spark.extensions.IcebergSparkSessionExtensions"
\
--conf
"spark.sql.catalog.spark_catalog=org.apache.iceberg.spark.SparkSessionCatalog"
```
