alamb commented on issue #1384: URL: https://github.com/apache/arrow-datafusion/issues/1384#issuecomment-985646772
> Yes, I think there is value in exporting those resusable code through public interfaces so we can maintain and optimize them together. Curious what @rdettai @alamb @Dandandan @jorgecarleitao @Jimexist @andygrove think about this. Yes I agree there is value to an API like 'just scan this list of parquet files' . In our IOx project we have a similar situation (we have a list of parquet files we want to scan that we determine using our own in memory metadata / catalog structures). In my opinion the more of such code can be shared in DataFusion the better (so we don't all end up implementing the same thing) cc @tustvold -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
