Lakshmi Manasa Gaduputi created SAMZA-2712:
----------------------------------------------
Summary: AzureBlob SystemProducer: flushtimeout is not respected
if main thread is uploading to azure and azure upload is stuck
Key: SAMZA-2712
URL: https://issues.apache.org/jira/browse/SAMZA-2712
Project: Samza
Issue Type: Bug
Reporter: Lakshmi Manasa Gaduputi
Assignee: Lakshmi Manasa Gaduputi
AzureBlob SystemProducer is designed such that it has a fixed number of
helper/upload threads and Main thread picks up the uploading when all the
upload threads are busy uploading (CallerExcutesPolicy).
However, if the main thread itself is stuck uploading to azure (very likely due
to azure connection issues) then flush timeout is not respected as the main
thread is stuck.
Solution: use reactor's Schedulers.boundedElastic along with subscribeOn to
ensure timeout is respected for uploads and main thread responds to flush/close
calls without being stuck
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
