This is an automated email from the ASF dual-hosted git repository.
pan3793 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 7b88cea47529 [MINOR][BUILD] Mark spark-deps manifest as auto-generated
7b88cea47529 is described below
commit 7b88cea475298dc7d13ef6a5bdf3d3f6cbed6a04
Author: Cheng Pan <[email protected]>
AuthorDate: Mon Aug 10 11:49:56 2026 +0800
[MINOR][BUILD] Mark spark-deps manifest as auto-generated
### What changes were proposed in this pull request?
`dev/test-dependencies.sh` now writes a header at the top of each manifest
it generates (`dev/deps/spark-deps-*`):
```
#
# Generated by `dev/test-dependencies.sh --replace-manifest`.
# Do not edit manually.
#
```
The same header is prepended to the committed
`dev/deps/spark-deps-hadoop-3-hive-2.3` so the manifest matches generator
output and the self-check (`dev/test-dependencies.sh` without
`--replace-manifest`) stays green.
Only POSIX-portable utilities are used in the new code path (`printf
'%s\n'`, `cat`, `rm`); the existing `awk` already uses only POSIX-standard
functions, so the script remains compatible across macOS (BSD awk) and Linux
(gawk).
### Why are the changes needed?
The manifest is machine-generated and regenerated by
`dev/test-dependencies.sh --replace-manifest`; hand edits get overwritten on
the next regeneration. A header stating this prevents accidental manual edits
to a checked-in generated file.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
- `bash -n dev/test-dependencies.sh`
- Verified byte-for-byte that the header the script emits matches the
header prepended to the committed manifest, so the manifest self-check still
passes.
### Was this patch authored or co-authored using generative AI tooling?
Generated-by: GLM 5.2
Closes #57851 from pan3793/mark-spark-deps-as-generated.
Authored-by: Cheng Pan <[email protected]>
Signed-off-by: Cheng Pan <[email protected]>
---
dev/deps/spark-deps-hadoop-3-hive-2.3 | 4 ++++
dev/test-dependencies.sh | 11 ++++++++++-
2 files changed, 14 insertions(+), 1 deletion(-)
diff --git a/dev/deps/spark-deps-hadoop-3-hive-2.3
b/dev/deps/spark-deps-hadoop-3-hive-2.3
index be8bf40106e8..ec3c3fb70df4 100644
--- a/dev/deps/spark-deps-hadoop-3-hive-2.3
+++ b/dev/deps/spark-deps-hadoop-3-hive-2.3
@@ -1,3 +1,7 @@
+#
+# Generated by `dev/test-dependencies.sh --replace-manifest`.
+# Do not edit manually.
+#
HdrHistogram/2.1.12//HdrHistogram-2.1.12.jar
HikariCP/2.5.1//HikariCP-2.5.1.jar
JLargeArrays/1.5//JLargeArrays-1.5.jar
diff --git a/dev/test-dependencies.sh b/dev/test-dependencies.sh
index ad93304e7373..21997b4ac625 100755
--- a/dev/test-dependencies.sh
+++ b/dev/test-dependencies.sh
@@ -115,7 +115,16 @@ for HADOOP_HIVE_PROFILE in "${HADOOP_HIVE_PROFILES[@]}"; do
classifier_end_index=index(jar_name, ".jar") - 1;
classifier=substr(jar_name, classifier_start_index, classifier_end_index
- classifier_start_index + 1);
print artifact_id"/"version"/"classifier"/"jar_name
- }' | sort | grep -v spark > dev/pr-deps/spark-deps-$HADOOP_HIVE_PROFILE
+ }' | sort | grep -v spark > dev/pr-deps/spark-deps-$HADOOP_HIVE_PROFILE.tmp
+ {
+ printf '%s\n' \
+ '#' \
+ '# Generated by `dev/test-dependencies.sh --replace-manifest`.' \
+ '# Do not edit manually.' \
+ '#'
+ cat dev/pr-deps/spark-deps-$HADOOP_HIVE_PROFILE.tmp
+ } > dev/pr-deps/spark-deps-$HADOOP_HIVE_PROFILE
+ rm dev/pr-deps/spark-deps-$HADOOP_HIVE_PROFILE.tmp
done
if [[ $@ == **replace-manifest** ]]; then
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
