MaxGekk commented on PR #39239:
URL: https://github.com/apache/spark/pull/39239#issuecomment-1470569694
> So the problem here would be implementation detail.
@HyukjinKwon I think this is not impl details but a fundamental problem of
`datetime`, especially in the corner case of
MaxGekk commented on PR #39239:
URL: https://github.com/apache/spark/pull/39239#issuecomment-1465148669
@HyukjinKwon @cloud-fan A problem of PySpark's timestamp_ltz is it is a
local timestamp, and not a physical timestamp that timestamp_ltz is supposed to
be. Let's see even Java 7
MaxGekk commented on PR #39239:
URL: https://github.com/apache/spark/pull/39239#issuecomment-1366021084
@HyukjinKwon @itholic All 4 failed tests are related to Pandas, and it seems
Pandas code suffers from the issue too but I cannot find where the conversion
happens. Could you point me out
