quinnj commented on issue #353:
URL: https://github.com/apache/arrow-julia/issues/353#issuecomment-1301188594
Yeah, we could probably add support for this. Maybe with a `lazy::Bool=true`
keyword argument; `lazy=false` would eagerly iterate messages and store the
positions so they could be randomly accessed while `lazy=true` gives the
current behavior where each iteration only consumes one message.
Curious though, because a non-hard workflow you can already do is:
```julia
for record_batch in Arrow.Stream(...)
Distributed.@spawn begin
# do stuff with record_batch
end
end
```
what are the alternative workflows where that doesn't work for you?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
