bogao007 commented on PR #48927:
URL: https://github.com/apache/spark/pull/48927#issuecomment-2496165347
> @HeartSaVioR - verified on master and I see the same assert locally as
well. So don't think its related to this change
>
> ```
> File
"/Users/anish.shrigondekar/spark/spark/python/pyspark/sql/utils.py", line 154,
in call
> self.func(DataFrame(jdf, wrapped_session_jdf), batch_id)
> File
"/Users/anish.shrigondekar/spark/spark/python/pyspark/sql/tests/pandas/test_pandas_transform_with_state.py",
line 549, in check_results
> assert set(batch_df.sort("id").collect()) == {Row(id="a",
timestamp="20")}
> AssertionError
> SQLSTATE: 39000
> ```
>
> @jingz-db @bogao007 - is this a known issue ? do we have a PR to fix this
already ?
I made a change previously to fix this issue
https://github.com/apache/spark/pull/48805/files. Maybe 2s is not enough,
@jingz-db could you help take a look?
@anishshri-db There might be an issue running locally since the test is
using UTC time, I need to use option
`spark.conf.set("spark.sql.session.timeZone", "UTC")` to make it work in local.
That's not an issue in CI though.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
