adriangb commented on PR #19716:
URL: https://github.com/apache/datafusion/pull/19716#issuecomment-3745222161
> * apply casted stream on top of scan stream so we still can manage batch
to batch mapping(potentially it could affect filter pushdown)
I'm a bit confused, isn't it pretty much the same thing? What we do in the
Parquet opener is `stream.map(|maybe_batch| { let batch = maybe_batch?;
projector.project(batch) })` which essentially builds a "casted" stream.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
