This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch branch-4.1
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-4.1 by this push:
new 95ea4ce11842 [MINOR][DOCS][CONNECT] Replace pyspark with
pyspark-client in the Connect overview
95ea4ce11842 is described below
commit 95ea4ce11842718c99be4754e05312b6c0586df9
Author: Gera Shegalov <[email protected]>
AuthorDate: Fri Nov 7 08:11:20 2025 +0900
[MINOR][DOCS][CONNECT] Replace pyspark with pyspark-client in the Connect
overview
### What changes were proposed in this pull request?
Spark Connect Overview doc should reference the non-JVM pyspark-client pip
package instead of `pyspark[connect]` which includes a complete SPARK_HOME
with JVM jars
### Why are the changes needed?
Spark Connect Overview is a top search result and should encourage using a
package with the minimum footprint.
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
Previewed the doc on Github
### Was this patch authored or co-authored using generative AI tooling?
No
Closes #52901 from gerashegalov/patch-1.
Authored-by: Gera Shegalov <[email protected]>
Signed-off-by: Hyukjin Kwon <[email protected]>
(cherry picked from commit 2f04e783b7e30c2071c80f1f3ed5ff9e319505de)
Signed-off-by: Hyukjin Kwon <[email protected]>
---
docs/spark-connect-overview.md | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/docs/spark-connect-overview.md b/docs/spark-connect-overview.md
index f01ebf1b54f7..3c15153e0305 100644
--- a/docs/spark-connect-overview.md
+++ b/docs/spark-connect-overview.md
@@ -284,11 +284,11 @@ The connection may also be programmatically created using
_SparkSession#builder_
<div data-lang="python" markdown="1">
-First, install PySpark with `pip install
pyspark[connect]=={{site.SPARK_VERSION_SHORT}}` or if building a packaged
PySpark application/library,
+First, install PySpark with `pip install
pyspark-client=={{site.SPARK_VERSION_SHORT}}` or if building a packaged PySpark
application/library,
add it your setup.py file as:
{% highlight python %}
install_requires=[
-'pyspark[connect]=={{site.SPARK_VERSION_SHORT}}'
+'pyspark-client=={{site.SPARK_VERSION_SHORT}}'
]
{% endhighlight %}
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
