When spilling to disk is enabled, an upstream operator will be blocked
from emitting more tuples to a corresponding output port when the size
of a buffer (in bytes) exceeds a limit (see documentation on how to
configure the limit). This is a back pressure mechanism that Pramod
refers to. There
When back pressure is enabled (default) the upstream operators are blocked
till space is freed up by downstream operators consuming data.
Since bufferserver also provides fault recovery functionality it cannot
immediately clear out the data when it is consumed by the downstream
operators and needs
HI,
I'm reading Apex documentation regarding buffer servers. I'm wondering what
will happen if buffers between operators became overflowed (lets assume non
partitioned operator)?
I read somewhere that data is split to disk. But what's next? What if disk
space will be exhausted?
Regards,
Mateusz Za
