jackye1995 opened a new pull request #3237: URL: https://github.com/apache/iceberg/pull/3237
This is a draft prototype for the approach 3 discussed in the mailing list to support multiple Spark versions. The code is organized to the following format: ``` ├── spark │ ├── 2_4 │ │ ├── core │ │ │ ├── benchmark │ │ │ └── src │ │ └── runtime │ └── 3_0 │ ├── core │ │ ├── benchmark │ │ └── src │ ├── extensions │ │ └── src │ └── runtime │ └── src ├── spark-common │ └── src │ ├── jmh │ │ └── java │ ├── main │ │ └── java │ └── test │ └── java ``` I introduce 3 system properties: - SparkBuildVersion: the actual Spark version to build against - SparkSrcVersion: the Spark source code version, which corresponds to the directory to use - ScalaVersion: scala version to use Then we can build Spark against different versions: ```bash # 3.1.1 ./gradlew clean && ./gradlew build # 3.0.3 ./gradlew clean && ./gradlew build -DsparkBuild=3.0.3 # 2.4.4 ./gradlew clean && ./gradlew build -DsparkBuild=2.4.4 -DsparkSrc=2_4 ``` @aokolnychyi @RussellSpitzer @flyrain @szehon-ho @rdblue @openinx @stevenzwu -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
