[
https://issues.apache.org/jira/browse/SPARK-48733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-48733:
---------------------------------
Summary: Do not test SET command in Python UDTF test (was: Do not set SET
command in Python UDTF test)
> Do not test SET command in Python UDTF test
> -------------------------------------------
>
> Key: SPARK-48733
> URL: https://issues.apache.org/jira/browse/SPARK-48733
> Project: Spark
> Issue Type: Improvement
> Components: PySpark, Tests
> Affects Versions: 4.0.0
> Reporter: Hyukjin Kwon
> Priority: Trivial
>
> {code}
> # We do not use `self.sql_conf` here to test the SQL SET command
> # instead of using PySpark's `spark.conf.set`.
> old_value =
> self.spark.conf.get("spark.sql.execution.pythonUDTF.arrow.enabled")
> self.spark.sql("SET
> spark.sql.execution.pythonUDTF.arrow.enabled=False")
> self.assertEqual(udtf(TestUDTF, returnType="x: int").evalType,
> PythonEvalType.SQL_TABLE_UDF)
> self.spark.sql("SET
> spark.sql.execution.pythonUDTF.arrow.enabled=True")
> self.assertEqual(
> udtf(TestUDTF, returnType="x: int").evalType,
> PythonEvalType.SQL_ARROW_TABLE_UDF
> )
> self.spark.conf.set("spark.sql.execution.pythonUDTF.arrow.enabled",
> old_value)
> {code}
> we don;t need to test SET command there
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
