slfan1989 commented on code in PR #2408:
URL: https://github.com/apache/auron/pull/2408#discussion_r3649557598
##########
auron-build.sh:
##########
@@ -72,16 +72,33 @@ print_help() {
echo "Examples:"
echo " $0 --pre --sparkver ${SUPPORTED_SPARK_VERSIONS[*]: -1}" \
"--scalaver ${SUPPORTED_SCALA_VERSIONS[*]: -1} -DskipBuildNative"
- echo " $0 --docker true --image ${SUPPORTED_OS_IMAGES[*]:0:1}" \
+ echo " # Spark 3.5 with all supported third-party integrations"
+ echo " $0 --docker true --image rockylinux8" \
"--clean true --skiptests true --release" \
- "--sparkver ${SUPPORTED_SPARK_VERSIONS[*]: -1}" \
+ "--sparkver 3.5 --scalaver 2.12" \
"--flinkver ${SUPPORTED_FLINK_VERSIONS[*]: -1}" \
- "--scalaver ${SUPPORTED_SCALA_VERSIONS[*]: -1}" \
"--celeborn ${SUPPORTED_CELEBORN_VERSIONS[*]: -1}" \
"--uniffle ${SUPPORTED_UNIFFLE_VERSIONS[*]: -1}" \
"--paimon ${SUPPORTED_PAIMON_VERSIONS[*]: -1}" \
"--iceberg ${SUPPORTED_ICEBERG_VERSIONS[*]: -1}" \
"--hudi ${SUPPORTED_HUDI_VERSIONS[*]: -1}"
Review Comment:
Fixed. The Spark 3.5 example now uses explicitly pinned integration versions
that match the compatibility matrix, including Iceberg 1.10.1 and Hudi 0.15. I
also pinned the other integration versions to prevent the example from changing
when the supported-version arrays are reordered or extended.
##########
auron-build.sh:
##########
@@ -72,16 +72,33 @@ print_help() {
echo "Examples:"
echo " $0 --pre --sparkver ${SUPPORTED_SPARK_VERSIONS[*]: -1}" \
"--scalaver ${SUPPORTED_SCALA_VERSIONS[*]: -1} -DskipBuildNative"
- echo " $0 --docker true --image ${SUPPORTED_OS_IMAGES[*]:0:1}" \
+ echo " # Spark 3.5 with all supported third-party integrations"
+ echo " $0 --docker true --image rockylinux8" \
"--clean true --skiptests true --release" \
- "--sparkver ${SUPPORTED_SPARK_VERSIONS[*]: -1}" \
+ "--sparkver 3.5 --scalaver 2.12" \
"--flinkver ${SUPPORTED_FLINK_VERSIONS[*]: -1}" \
- "--scalaver ${SUPPORTED_SCALA_VERSIONS[*]: -1}" \
"--celeborn ${SUPPORTED_CELEBORN_VERSIONS[*]: -1}" \
"--uniffle ${SUPPORTED_UNIFFLE_VERSIONS[*]: -1}" \
"--paimon ${SUPPORTED_PAIMON_VERSIONS[*]: -1}" \
"--iceberg ${SUPPORTED_ICEBERG_VERSIONS[*]: -1}" \
"--hudi ${SUPPORTED_HUDI_VERSIONS[*]: -1}"
+ echo " # Spark 4.0 (Hudi is not supported)"
+ echo " $0 --docker true --image rockylinux8" \
+ "--clean true --skiptests true --release" \
+ "--sparkver 4.0 --scalaver 2.13" \
+ "--flinkver ${SUPPORTED_FLINK_VERSIONS[*]: -1}" \
+ "--celeborn ${SUPPORTED_CELEBORN_VERSIONS[*]: -1}" \
+ "--uniffle ${SUPPORTED_UNIFFLE_VERSIONS[*]: -1}" \
+ "--paimon ${SUPPORTED_PAIMON_VERSIONS[*]: -1}" \
+ "--iceberg ${SUPPORTED_ICEBERG_VERSIONS[*]: -1}"
Review Comment:
Fixed. The Spark 4.0 example now explicitly uses Iceberg 1.10.1, consistent
with the compatibility matrix. The other integration versions in the example
have also been pinned to keep the help output stable.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
