Github user BryanCutler commented on the issue:
https://github.com/apache/spark/pull/15821
Hey @holdenk, I just had this in to do my own testing and hadn't thought
about keeping the option, but if we do keep it then yeah you're right, it
would be better to default to the original way.
On Nov 22, 2016 12:02 PM, "Holden Karau" <[email protected]> wrote:
> *@holdenk* commented on this pull request.
> ------------------------------
>
> In python/pyspark/sql/dataframe.py
> <https://github.com/apache/spark/pull/15821#pullrequestreview-9746576>:
>
> > @@ -1508,7 +1518,7 @@ def toDF(self, *cols):
> return DataFrame(jdf, self.sql_ctx)
>
> @since(1.3)
> - def toPandas(self):
> + def toPandas(self, useArrow=True):
>
> Would it maybe make more sense to default this to false or have more
> thorough checking that the dataframe being written with arrow is
supported?
> At least initially the set of supported dataframes might be rather small.
>
> â
> You are receiving this because you authored the thread.
> Reply to this email directly, view it on GitHub
> <https://github.com/apache/spark/pull/15821#pullrequestreview-9746576>,
> or mute the thread
>
<https://github.com/notifications/unsubscribe-auth/AEUwdd_Y8jogGipNikWJG3JAPy8DoLV8ks5rA0pygaJpZM4KtGBc>
> .
>
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
