GitHub user davies opened a pull request:
https://github.com/apache/spark/pull/4476
[SPARK-5678] Convert DataFrame to pandas.DataFrame and Series
```
pyspark.sql.DataFrame.to_pandas = to_pandas(self) unbound
pyspark.sql.DataFrame method
Collect all the rows and return a `pandas.DataFrame`.
>>> df.to_pandas() # doctest: +SKIP
age name
0 2 Alice
1 5 Bob
pyspark.sql.Column.to_pandas = to_pandas(self) unbound pyspark.sql.Column
method
Return a pandas.Series from the column
>>> df.age.to_pandas() # doctest: +SKIP
0 2
1 5
dtype: int64
```
Not tests by jenkins (they depends on pandas)
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/davies/spark to_pandas
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/4476.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #4476
----
commit 6276fb69887067f1861a543b25da86f8aa0e2b61
Author: Davies Liu <[email protected]>
Date: 2015-02-09T18:21:33Z
Convert DataFrame to pandas.DataFrame and Series
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
