ozankabak commented on code in PR #6049:
URL: https://github.com/apache/arrow-datafusion/pull/6049#discussion_r1179165585
##########
datafusion/core/src/physical_plan/memory.rs:
##########
@@ -223,15 +245,365 @@ impl RecordBatchStream for MemoryStream {
}
}
+/// Execution plan for writing record batches to an in-memory table.
+pub struct MemoryWriteExec {
Review Comment:
> But I thought the consensus was to have a generic ExecutionPlan for
writing data, rather than one that was specific to MemTable
Are you sure about this? My understanding was going through the
`ExecutionPlan` route for each writer, not a single plan for everything. There
is a separate `Exec` on the read side for every `TableProvider`, why would we
not follow the same pattern?
Anyways, I asked @metesynnada to experiment with the single plan idea, but
he wasn't able to make progress on it -- he will comment here with his findings.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
