jizezhang commented on issue #17297: URL: https://github.com/apache/datafusion/issues/17297#issuecomment-3508793220
Hi @milenkovicm , I am interested in this task and would like to understand the proposal better. Is the idea that - `DataFrame::cache` will create a new logical plan with a `TableScan` node as the root and current logical plan of the dataframe (via `self.plan`) as its child? - To capture the lineage, `TableScan` would be constructed with a custom `InMemoryTableSource` that overrides the `get_logical_plan` method from the trait `TableSource`? - Would `DataFrame::cache` returns `ctx.execute_logical_plan(new_plan)`? Thanks a lot! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
