This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 9b6393d8c030 [SPARK-55284][PYTHON][TEST] Move mypy-data related
configs to the script
9b6393d8c030 is described below
commit 9b6393d8c030b88d8a9b93bcbf7422d4b5e83378
Author: Tian Gao <[email protected]>
AuthorDate: Mon Feb 2 06:52:09 2026 +0900
[SPARK-55284][PYTHON][TEST] Move mypy-data related configs to the script
### What changes were proposed in this pull request?
Move the script-specific global settings for pytest to the script.
### Why are the changes needed?
pytest was only used for this script so we had this config globally.
However pytest could be used in most of our tests now and it has a significant
advantage on usage. We need to clear this global config for users to try it out.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
`./dev/lint-python --mypy-data` still works as before.
### Was this patch authored or co-authored using generative AI tooling?
No
Closes #54067 from gaogaotiantian/move-pytest-data.
Authored-by: Tian Gao <[email protected]>
Signed-off-by: Hyukjin Kwon <[email protected]>
---
dev/lint-python | 6 +++++-
pyproject.toml | 9 ---------
2 files changed, 5 insertions(+), 10 deletions(-)
diff --git a/dev/lint-python b/dev/lint-python
index 30b498cbe45f..72425a327c2c 100755
--- a/dev/lint-python
+++ b/dev/lint-python
@@ -164,10 +164,14 @@ function mypy_data_test {
fi
PYTEST_REPORT=$( (MYPYPATH=python $PYTEST_BUILD \
+ -o "python_files=test_*.yml" \
--rootdir python \
--mypy-only-local-stub \
--mypy-ini-file python/mypy.ini \
- python/pyspark ) 2>&1)
+ python/pyspark/tests/typing \
+ python/pyspark/sql/tests/typing \
+ python/pyspark/ml/tests/typing \
+ ) 2>&1)
PYTEST_STATUS=$?
diff --git a/pyproject.toml b/pyproject.toml
index 11a042305dd7..d37bfe9ed37f 100644
--- a/pyproject.toml
+++ b/pyproject.toml
@@ -15,15 +15,6 @@
# limitations under the License.
#
-[tool.pytest.ini_options]
-# Pytest it used only to run mypy data tests
-python_files = "test_*.yml"
-testpaths = [
- "pyspark/tests/typing",
- "pyspark/sql/tests/typing",
- "pyspark/ml/typing",
-]
-
[tool.ruff]
exclude = [
"*/target/*",
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
