[
https://issues.apache.org/jira/browse/SPARK-34606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17294423#comment-17294423
]
Ondrej Kokes commented on SPARK-34606:
--------------------------------------
I tried building HTML docs for PySpark 2.4.7 and the current master and here's
the one-way diff (set(2.4.7) - set(master)).
missing docs
* build/html/pyspark.html
* build/html/pyspark.ml.html
* build/html/pyspark.mllib.html
* build/html/pyspark.sql.html
* build/html/pyspark.streaming.html
other pages not present (module code):
* build/html/_modules/pyspark/profiler.html
* build/html/_modules/pyspark/serializers.html
* build/html/_modules/pyspark/sql/catalog.html
* build/html/_modules/pyspark/sql/context.html
* build/html/_modules/pyspark/sql/udf.html
* build/html/_modules/pyspark/status.html
* build/html/_modules/pyspark/streaming/flume.html
* build/html/_modules/pyspark/streaming/kafka.html
* build/html/_modules/pyspark/streaming/listener.html
> New PySpark documentation has different URLs
> --------------------------------------------
>
> Key: SPARK-34606
> URL: https://issues.apache.org/jira/browse/SPARK-34606
> Project: Spark
> Issue Type: Bug
> Components: Documentation, PySpark
> Affects Versions: 3.1.1
> Reporter: Ondrej Kokes
> Priority: Minor
>
> The new documentation site moved some subsites to different URLs, notably the
> PySpark API reference ([see
> here|https://spark.apache.org/docs/latest/api/python/pyspark.sql.html]).
> (Note the new `/reference/` bit in the new URL.)
> It's the first hit when you google "pyspark sql functions", you'll also get
> there if you search for individual functions or modules (e.g. "pyspark
> streaming").
> I looked through various JIRA tickets and pull requests, but couldn't find a
> mention of this. Even the pull request introducing the new documentation site
> mentions the only visible change to users is the design, not its location.
> Possible resolution:
> * let the links be refreshed by search engines and live with dead links in
> various places (stack overflow, emails, bookmarks, ...)
> * identify the missing pages and provide a 301 redirects for these (could be
> found in logs, google analytics, or maybe we can list all assets generated
> before/now and diff them)
> * change sphinx configuration to result in identical links as before
> Links to potentially relevant tickets and PRs:
> * https://issues.apache.org/jira/browse/SPARK-31851
> * https://github.com/apache/spark/pull/29188
> * https://issues.apache.org/jira/browse/SPARK-32188
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
