lasdf1234 opened a new pull request, #13134: URL: https://github.com/apache/gravitino/pull/13134
### What changes were proposed in this pull request? - Fail built-in Iceberg jobs after `SparkSession` creation when `IcebergSparkSessionExtensions` / `SparkCatalog` are missing. - Report JSON parse errors with the real CLI flag names (`--updater-options`, `--spark-conf`, `--options`). - Omit empty / unresolved optional template arguments in `JobManager` so dangling flags are not passed to the process. - Document that operators must supply a matching `iceberg-spark-runtime` on the Spark classpath. ### Why are the changes needed? Without Iceberg Spark runtime, Spark only warns and jobs continue as if Iceberg were available. Empty optional placeholders also produce confusing dangling flags, and parse errors pointed at a non-existent `--json-options` flag. Fix: #13133 ### Does this PR introduce _any_ user-facing change? - Built-in Iceberg jobs now exit non-zero when Iceberg Spark runtime classes are missing. - Docs clarify the `iceberg-spark-runtime` prerequisite (`spark.jars` / Spark env). - Empty optional jobConf placeholders no longer appear as dangling CLI flags. ### How was this patch tested? - `./gradlew :maintenance:jobs:test --tests org.apache.gravitino.maintenance.jobs.iceberg.TestIcebergJobUtils --tests org.apache.gravitino.maintenance.jobs.iceberg.TestIcebergUpdateStatsJob --tests org.apache.gravitino.maintenance.jobs.iceberg.TestIcebergRewriteDataFilesJob --tests org.apache.gravitino.maintenance.jobs.iceberg.TestIcebergExpireSnapshotsJob` - `./gradlew :core:test --tests org.apache.gravitino.job.TestJobTemplate` Made with [Cursor](https://cursor.com) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
