Abacn commented on issue #21591:
URL: https://github.com/apache/beam/issues/21591#issuecomment-1152551114
> Just to clarify: because you say "until the stage is finished" I think of
batch processing, since stages do not finish in streaming. If it is batch, then
this is expected behavior. In streaming, it is expected that a reshuffle would
immediately emit elements as each bundle is committed.
In my case it is streaming. I've written a pretty simple test:
```
_LOGGER = logging.getLogger(__name__)
def print_time(x):
import datetime
_LOGGER.warning(datetime.datetime.fromtimestamp(x))
result = (p
| PeriodicImpulse(start_timestamp=time.time(), fire_interval=1.0)
| beam.Reshuffle() # HERE
| beam.Map(print_time))
```
No output (warning log) seen in direct runner, portable runner and flink
runner running locally; also tested on dataflow runner and the output can be
seen.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
