fightBoxing opened a new pull request, #1404:
URL: https://github.com/apache/flink-agents/pull/1404

   ## Summary
   - Ports fightBoxing/flink-agents#1 onto current `main`. Upstream moved chat 
retry backoff into `ChatModelInvoker` and the Python `retry_after` helper, so 
the fork branch cannot merge as-is.
   - Async chat retry backoff no longer sleeps on the operator mailbox thread. 
Java schedules the delay and yields the JDK 21 continuation; Python yields once 
per mailbox poll until the deadline.
   - Sync chat still waits on the caller. An interrupted wait restores the 
interrupt flag and stops retrying.
   
   ## Test plan
   - [x] `mvn -pl plan,runtime -am 
-Dtest=ChatModelInvokerTest,ContinuationSuspendTest test` (11 invoker tests, 
yield test ran with 0 skipped, about 2.3s)
   - [x] `pytest` `test_chat_async_retry_wait_suspends_without_blocking` and 
`test_chat_retries_with_exponential_backoff` (2 passed)
   
   
   Made with [Cursor](https://cursor.com)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to