Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19459#discussion_r149887860
--- Diff: python/pyspark/serializers.py ---
@@ -214,6 +214,14 @@ def __repr__(self):
def _create_batch(series):
+ """
+ Create an Arrow record batch from the given pandas.Series or list of
Series, with optional type.
+
+ :param series: A single pandas.Series, list of Series, or list of
(series, arrow_type)
+ :param copy: Option to make a copy of the series before performing any
type casts
--- End diff --
We can remove this description.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
