Maciej Szymkiewicz created SPARK-33056: ------------------------------------------
Summary: Add mapping between external Python types and CalendarIntervalType Key: SPARK-33056 URL: https://issues.apache.org/jira/browse/SPARK-33056 Project: Spark Issue Type: Sub-task Components: PySpark, SQL Affects Versions: 3.1.0 Reporter: Maciej Szymkiewicz We might consider adding support for at least collecting the results of queries containing interval types {code:python} spark.range(1).select(current_timestamp() - current_timestamp()).first() {code} and possibly a conversion in the opposite direction. An obvious candidate would be {{datetime.timedelta}} which is mapped to {{net.razorvine.pickle.objects.TimeDelta}}, but semantics of these and {{CalendarInteval}} differs. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org