This is an automated email from the ASF dual-hosted git repository.
yma pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-gluten.git
The following commit(s) were added to refs/heads/main by this push:
new d3bd3d775 [VL] Add gluten iceberg jar to bundle package (#6008)
d3bd3d775 is described below
commit d3bd3d775e1d0b66aac92bf511df80fcfa3b2dec
Author: Xuedong Luan <[email protected]>
AuthorDate: Tue Jun 11 14:20:45 2024 +0800
[VL] Add gluten iceberg jar to bundle package (#6008)
* Add iceberg to package
* update doc
* fix comment
---
docs/get-started/Velox.md | 3 +--
gluten-iceberg/pom.xml | 4 ----
package/pom.xml | 10 ++++++++++
3 files changed, 11 insertions(+), 6 deletions(-)
diff --git a/docs/get-started/Velox.md b/docs/get-started/Velox.md
index a24c99fda..964744bd5 100644
--- a/docs/get-started/Velox.md
+++ b/docs/get-started/Velox.md
@@ -303,8 +303,7 @@ First of all, compile gluten-iceberg module by a `iceberg`
profile, as follows:
mvn clean package -Pbackends-velox -Pspark-3.3 -Piceberg -DskipTests
```
-Then, put the additional `gluten-iceberg-XX-SNAPSHOT.jar` to the class path
(usually it's `$SPARK_HOME/jars`).
-The gluten-iceberg jar is in `gluten-iceberg/target` directory.
+Once built successfully, iceberg features will be included in
gluten-velox-bundle-X jar. Then you can query iceberg table by gluten/velox
without scan's fallback.
After the two steps, you can query iceberg table by gluten/velox without
scan's fallback.
diff --git a/gluten-iceberg/pom.xml b/gluten-iceberg/pom.xml
index 727077f26..69630b8cf 100644
--- a/gluten-iceberg/pom.xml
+++ b/gluten-iceberg/pom.xml
@@ -63,10 +63,6 @@
<type>test-jar</type>
<scope>test</scope>
</dependency>
- <dependency>
- <groupId>org.apache.spark</groupId>
- <artifactId>spark-core_${scala.binary.version}</artifactId>
- </dependency>
<dependency>
<groupId>org.apache.spark</groupId>
<artifactId>spark-core_${scala.binary.version}</artifactId>
diff --git a/package/pom.xml b/package/pom.xml
index db4056a7e..ab87e1480 100644
--- a/package/pom.xml
+++ b/package/pom.xml
@@ -83,6 +83,16 @@
</dependency>
</dependencies>
</profile>
+ <profile>
+ <id>iceberg</id>
+ <dependencies>
+ <dependency>
+ <groupId>org.apache.gluten</groupId>
+ <artifactId>gluten-iceberg</artifactId>
+ <version>${project.version}</version>
+ </dependency>
+ </dependencies>
+ </profile>
</profiles>
<build>
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
