[
https://issues.apache.org/jira/browse/SPARK-58139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nikolina Vraneš updated SPARK-58139:
------------------------------------
Description:
Add BIN BY execution test coverage for day-time interval edge cases that share
the time_bucket bin-boundary arithmetic:
- DST fall-back: a 1-day LTZ bin across the 2024-11-03 fall-back (the 25-hour
day gets a larger ratio share than an adjacent 24-hour day), and a compound
2-day width across the same transition.
- Sub-day bin in a non-UTC session, exercising the UTC-arithmetic path
(distinct from the civil-time path the multi-day tests use).
- ALIGN TO an origin later than the range, exercising the negative step-back in
the bin-boundary arithmetic.
Test-only. Sub-task of SPARK-57133.
was:
BinBySuite covers a DST spring-forward (23-hour day) LTZ case but not the
fall-back (25-hour day) case. They are asymmetric: spring-forward shortens a
day and fall-back lengthens it, and bin_distribute_ratio divides overlap by
real elapsed microseconds, so a bin over the 25-hour day must get a larger
share than an adjacent 24-hour day.
Add test coverage for a 1-day LTZ bin across the 2024-11-03 fall-back in
America/Los_Angeles, and a compound multi-day width across a DST transition.
Test-only.
Sub-task of SPARK-57133.
Summary: Improve BIN BY test coverage for DST and bin alignment (was:
Add BIN BY DST fall-back test coverage)
> Improve BIN BY test coverage for DST and bin alignment
> ------------------------------------------------------
>
> Key: SPARK-58139
> URL: https://issues.apache.org/jira/browse/SPARK-58139
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Affects Versions: 5.0.0
> Reporter: Nikolina Vraneš
> Priority: Major
>
> Add BIN BY execution test coverage for day-time interval edge cases that
> share the time_bucket bin-boundary arithmetic:
> - DST fall-back: a 1-day LTZ bin across the 2024-11-03 fall-back (the 25-hour
> day gets a larger ratio share than an adjacent 24-hour day), and a compound
> 2-day width across the same transition.
> - Sub-day bin in a non-UTC session, exercising the UTC-arithmetic path
> (distinct from the civil-time path the multi-day tests use).
> - ALIGN TO an origin later than the range, exercising the negative step-back
> in the bin-boundary arithmetic.
> Test-only. Sub-task of SPARK-57133.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
