Maciej Szymkiewicz created SPARK-33055:
------------------------------------------
Summary: Add support for CalendarIntervalType in PySpark schema
Key: SPARK-33055
URL: https://issues.apache.org/jira/browse/SPARK-33055
Project: Spark
Issue Type: Sub-task
Components: PySpark, SQL
Affects Versions: 3.1.0
Reporter: Maciej Szymkiewicz
Queries resulting in interval types shouldn't fail in PySpark, i.e. the
following
{code:python}
from pyspark.sql.functions import current_timestamp
spark.range(1).select(current_timestamp() - current_timestamp())
{code}
should result in
{code:python}
DataFrame[(current_timestamp() - current_timestamp()): interval]
{code}
instead of {{ValueError}}.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
