Hyukjin Kwon created SPARK-48733:
------------------------------------
Summary: Do not set SET command in Python UDTF test
Key: SPARK-48733
URL: https://issues.apache.org/jira/browse/SPARK-48733
Project: Spark
Issue Type: Improvement
Components: PySpark, Tests
Affects Versions: 4.0.0
Reporter: Hyukjin Kwon
{code}
# We do not use `self.sql_conf` here to test the SQL SET command
# instead of using PySpark's `spark.conf.set`.
old_value =
self.spark.conf.get("spark.sql.execution.pythonUDTF.arrow.enabled")
self.spark.sql("SET spark.sql.execution.pythonUDTF.arrow.enabled=False")
self.assertEqual(udtf(TestUDTF, returnType="x: int").evalType,
PythonEvalType.SQL_TABLE_UDF)
self.spark.sql("SET spark.sql.execution.pythonUDTF.arrow.enabled=True")
self.assertEqual(
udtf(TestUDTF, returnType="x: int").evalType,
PythonEvalType.SQL_ARROW_TABLE_UDF
)
self.spark.conf.set("spark.sql.execution.pythonUDTF.arrow.enabled",
old_value)
{code}
we don;t need to test SET command there
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
