This is an automated email from the ASF dual-hosted git repository.
dongjoon-hyun pushed a commit to branch branch-4.1
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-4.1 by this push:
new 0834efbfa66a [SPARK-60122][PYTHON] Remove non-existent `avro` Maven
profile from Avro doctest skip messages
0834efbfa66a is described below
commit 0834efbfa66a3382e0c3f1f97a25825e174da8ed
Author: Dongjoon Hyun <[email protected]>
AuthorDate: Sun Oct 11 17:47:03 2026 +0100
[SPARK-60122][PYTHON] Remove non-existent `avro` Maven profile from Avro
doctest skip messages
### What changes were proposed in this pull request?
This PR aims to remove a non-existent Maven profile, `-Pavro`, from the
skip messages of the Avro doctests in the following files.
- `python/pyspark/sql/avro/functions.py`
- `python/pyspark/sql/connect/avro/functions.py`
### Why are the changes needed?
There is no `avro` profile in any `pom.xml`, and there never has been.
`connector/avro` has been a default module of the root `pom.xml` since
SPARK-24768, so `build/sbt package` and `build/mvn package` already build
`spark-avro`. The current message suggests a profile that Maven ignores, with a
warning like the following.
```
[WARNING] The requested profile "avro" could not be activated because it
does not exist.
```
The message seems to have come from the Kinesis test message when
SPARK-26856 added it. The Kinesis message uses `-Pkinesis-asl` because the
Kinesis module is built only with that profile. After this PR, the Avro
messages are the same as the existing Protobuf messages, which already suggest
`build/sbt package` and `build/mvn package` without any profile.
- `python/pyspark/sql/protobuf/functions.py`
- `python/pyspark/sql/connect/protobuf/functions.py`
### Does this PR introduce _any_ user-facing change?
No. This only changes a test skip message.
### How was this patch tested?
Manual review. `git grep -- '-Pavro'` returns no results after this change.
### Was this patch authored or co-authored using generative AI tooling?
Generated-by: Claude Opus 5.5
Closes #59337 from dongjoon-hyun/SPARK-60122.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
(cherry picked from commit 4def9666e4f857ff4aa7531e06e118e0a938662f)
Signed-off-by: Dongjoon Hyun <[email protected]>
---
python/pyspark/sql/avro/functions.py | 4 ++--
python/pyspark/sql/connect/avro/functions.py | 4 ++--
2 files changed, 4 insertions(+), 4 deletions(-)
diff --git a/python/pyspark/sql/avro/functions.py
b/python/pyspark/sql/avro/functions.py
index e1b70c5fd359..f11d437f29be 100644
--- a/python/pyspark/sql/avro/functions.py
+++ b/python/pyspark/sql/avro/functions.py
@@ -192,8 +192,8 @@ def _test() -> None:
print(
"Skipping all Avro Python tests as the optional Avro project was "
"not compiled into a JAR. To run these tests, "
- "you need to build Spark with 'build/sbt -Pavro package' or "
- "'build/mvn -Pavro package' before running this test."
+ "you need to build Spark with 'build/sbt package' or "
+ "'build/mvn package' before running this test."
)
sys.exit(0)
else:
diff --git a/python/pyspark/sql/connect/avro/functions.py
b/python/pyspark/sql/connect/avro/functions.py
index 55067c33dd49..e7005bf78b0d 100644
--- a/python/pyspark/sql/connect/avro/functions.py
+++ b/python/pyspark/sql/connect/avro/functions.py
@@ -101,8 +101,8 @@ def _test() -> None:
print(
"Skipping all Avro Python tests as the optional Avro project was "
"not compiled into a JAR. To run these tests, "
- "you need to build Spark with 'build/sbt -Pavro package' or "
- "'build/mvn -Pavro package' before running this test."
+ "you need to build Spark with 'build/sbt package' or "
+ "'build/mvn package' before running this test."
)
sys.exit(0)
else:
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
