davlee1972 commented on issue #36593: URL: https://github.com/apache/arrow/issues/36593#issuecomment-1753963333
Shouldn't dataset() just take the same parameters as to_table()? The difference is that to_table() produces a materialized view while dataset() creates a logical view.. This would include columns whether they are a subset or computed/renamed from the original dataset.. I also not sure why there is a dataset.scanner class.. It looks logical, but you can't perform a join with it against another dataset. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
