pingedbrain commented on PR #60192:
URL: https://github.com/apache/spark/pull/60192#issuecomment-6701236304
Built it locally and this looks good. The new test fails without the fix,
and a real query shows the corrected error:
```python
def func(key, batches, state):
for _ in batches:
pass
state.setTimeoutTimestamp(1000)
yield pd.DataFrame({"id": [0]})
(spark.readStream.format("rate").load()
.groupBy("value")
.applyInPandasWithState(
func, "id long", "c long", "append",
GroupStateTimeout.ProcessingTimeTimeout)
.writeStream.format("noop").outputMode("append").start())
```
Before, it asks for the timeout that's already enabled:
```
[CANNOT_WITHOUT] Cannot set timeout duration without enabling processing
time timeout in applyInPandasWithState.
```
After:
```
[CANNOT_WITHOUT] Cannot set timeout timestamp without enabling event time
timeout in applyInPandasWithState.
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
