This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new b4bf9ec065bf [SPARK-46269][PS] Enable more NumPy compatibility
function tests
b4bf9ec065bf is described below
commit b4bf9ec065bf3538e3780a833b6c5dec7b602cf2
Author: Haejoon Lee <[email protected]>
AuthorDate: Tue Dec 5 08:33:38 2023 -0800
[SPARK-46269][PS] Enable more NumPy compatibility function tests
### What changes were proposed in this pull request?
This PR proposes to enable NumPy compatibility function tests for `arccos`,
`exp`, `expm1` and `floor_divide`.
### Why are the changes needed?
To improve the test coverage for NumPy compatibility function.
### Does this PR introduce _any_ user-facing change?
No, this improves the test coverage.
### How was this patch tested?
The existing CI should pass. For flaky tests, manually ran 50 times on
local envs.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #44186 from itholic/enable_numpy_tests.
Authored-by: Haejoon Lee <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
---
python/pyspark/pandas/tests/test_numpy_compat.py | 6 +-----
1 file changed, 1 insertion(+), 5 deletions(-)
diff --git a/python/pyspark/pandas/tests/test_numpy_compat.py
b/python/pyspark/pandas/tests/test_numpy_compat.py
index 986083d0d3af..931e5475c36f 100644
--- a/python/pyspark/pandas/tests/test_numpy_compat.py
+++ b/python/pyspark/pandas/tests/test_numpy_compat.py
@@ -26,21 +26,17 @@ from pyspark.testing.sqlutils import SQLTestUtils
class NumPyCompatTestsMixin:
blacklist = [
- # Koalas does not currently support
+ # Pandas-on-Spark does not currently support
"conj",
"conjugate",
"isnat",
"matmul",
"frexp",
# Values are close enough but tests failed.
- "arccos",
- "exp",
- "expm1",
"log", # flaky
"log10", # flaky
"log1p", # flaky
"modf",
- "floor_divide", # flaky
]
@property
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
