Csaba Ringhofer has uploaded a new patch set (#2). ( http://gerrit.cloudera.org:8080/25043 )
Change subject: IMPALA-15506: Add utility to test Spark with impala minicluster ...................................................................... IMPALA-15506: Add utility to test Spark with impala minicluster Add convenience scripts to test Spark (4.1.3 by default) with the Impala minicluster. Based on similar scripts for Trino: - create docker image with build-spark-docker-image.sh - start/stop/run sql with run-spark.sh/kill-spark.sh/spark-sql.sh No tests added at this point, to goal is only to help with testing Spark<->Impala interop. The main motivation was GEOMETRY testing, so newest (1.12.0) Iceberg is used in Spark instead of Impala's 1.11.0. Versions used can be overriden with env vars when creating the docker image. Change-Id: I7c87024e898f49e5c4afb737463f728210d018c6 --- A testdata/bin/SPARK-README.md A testdata/bin/build-spark-docker-image.sh A testdata/bin/kill-spark.sh A testdata/bin/run-spark.sh A testdata/bin/spark-sql.sh 5 files changed, 246 insertions(+), 0 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/43/25043/2 -- To view, visit http://gerrit.cloudera.org:8080/25043 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: I7c87024e898f49e5c4afb737463f728210d018c6 Gerrit-Change-Number: 25043 Gerrit-PatchSet: 2 Gerrit-Owner: Csaba Ringhofer <[email protected]>
