GitHub user HyukjinKwon opened a pull request:
https://github.com/apache/spark/pull/19596
[SPARK-22369][PYTHON][DOCS] Exposes catalog API documentation in PySpark
## What changes were proposed in this pull request?
This PR proposes to add a link from `spark.catalog(..)` to `Catalog` and
expose Catalog APIs in PySpark as below:
<img width="740" alt="2017-10-29 12 25 46"
src="https://user-images.githubusercontent.com/6477701/32135863-f8e9b040-bc40-11e7-92ad-09c8043a1295.png">
<img width="1131" alt="2017-10-29 12 26 33"
src="https://user-images.githubusercontent.com/6477701/32135849-bb257b86-bc40-11e7-9eda-4d58fc1301c2.png">
Note that this is not shown in the list on the top -
https://spark.apache.org/docs/latest/api/python/pyspark.sql.html#module-pyspark.sql
<img width="674" alt="2017-10-29 12 30 58"
src="https://user-images.githubusercontent.com/6477701/32135854-d50fab16-bc40-11e7-9181-812c56fd22f5.png">
This is basically similar with `DataFrameReader` and `DataFrameWriter`.
## How was this patch tested?
Manually built the doc.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/HyukjinKwon/spark SPARK-22369
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/19596.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #19596
----
commit 82fe78bd6f16fabcc82e0020e0d1b77bc3b5a18f
Author: hyukjinkwon <[email protected]>
Date: 2017-10-28T15:31:14Z
Expose catalog API documentation in PySpark
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]