Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/22206#discussion_r212795238
--- Diff: python/pyspark/sql/tests.py ---
@@ -6394,6 +6394,17 @@ def test_invalid_args(self):
df.withColumn('mean_v', mean_udf(df['v']).over(ow))
+class DataSourceV2Tests(ReusedSQLTestCase):
+ def test_pyspark_udf_SPARK_25213(self):
+ from pyspark.sql.functions import udf
+
+ df =
self.spark.read.format("org.apache.spark.sql.sources.v2.SimpleDataSourceV2").load()
--- End diff --
I think this test will fail if test classes are not compiled. Can we check
if test classes are compiled and then skip if not existent?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
