kylebarron commented on code in PR #1241:
URL:
https://github.com/apache/datafusion-python/pull/1241#discussion_r2355723443
##########
python/datafusion/dataframe.py:
##########
@@ -370,6 +375,39 @@ def schema(self) -> pa.Schema:
Describing schema of the DataFrame
"""
return self.df.schema()
+
+ def to_batches(self) -> list[pa.RecordBatch]:
+ """Convert DataFrame to list of RecordBatches."""
+ return self.collect() # delegate to existing method
Review Comment:
Perhaps we should get @timsaucer 's thoughts in
https://github.com/apache/datafusion-python/issues/1227: is having a required
dependency on pyarrow a problem? What should we do about it? Do we want to
depend on arro3-core instead? Or have functions that rely on pyarrow but error
if pyarrow isn't installed?
@ion-elgreco feel free to write down your thoughts there too
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
