[
https://issues.apache.org/jira/browse/SPARK-57565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk updated SPARK-57565:
-----------------------------
Description:
h2. What
Add dedicated PySpark tests for the TIME data type to match timestamp/date
coverage.
h2. Current state
TIME appears only in scattered cases: test_types.py, test_creation.py
(test_create_dataframe_from_datetime_time), the all-types matrix in
arrow/test_arrow.py, and
connect/test_connect_column.py. There is no dedicated TIME functions /
round-trip suite.
h2. Scope
* DataFrame/SQL tests for TIME functions (current_time, make_time,
to_time/try_to_time,
hour/minute/second, time_trunc, time_diff), mirroring the Scala
TimeFunctionsSuite.
* createDataFrame / collect round-trip of Python datetime.time values across
precisions.
* Dedicated Arrow conversion round-trip (toArrow / Arrow-enabled
createDataFrame) for TIME.
* pandas API on Spark coverage where applicable.
h2. Acceptance criteria
* New PySpark tests cover TIME functions and datetime.time round-trips and run
green.
> Add PySpark test coverage for the TIME data type
> ------------------------------------------------
>
> Key: SPARK-57565
> URL: https://issues.apache.org/jira/browse/SPARK-57565
> Project: Spark
> Issue Type: Sub-task
> Components: PySpark
> Affects Versions: 4.3.0
> Reporter: Max Gekk
> Priority: Major
>
> h2. What
> Add dedicated PySpark tests for the TIME data type to match timestamp/date
> coverage.
> h2. Current state
> TIME appears only in scattered cases: test_types.py, test_creation.py
> (test_create_dataframe_from_datetime_time), the all-types matrix in
> arrow/test_arrow.py, and
> connect/test_connect_column.py. There is no dedicated TIME functions /
> round-trip suite.
> h2. Scope
> * DataFrame/SQL tests for TIME functions (current_time, make_time,
> to_time/try_to_time,
> hour/minute/second, time_trunc, time_diff), mirroring the Scala
> TimeFunctionsSuite.
> * createDataFrame / collect round-trip of Python datetime.time values across
> precisions.
> * Dedicated Arrow conversion round-trip (toArrow / Arrow-enabled
> createDataFrame) for TIME.
> * pandas API on Spark coverage where applicable.
> h2. Acceptance criteria
> * New PySpark tests cover TIME functions and datetime.time round-trips and
> run green.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
