This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 1c9cde59ba65 [SPARK-49402][PYTHON][FOLLOW-UP] Manually load ~/.profile
in Spark Connect notebook
1c9cde59ba65 is described below
commit 1c9cde59ba65dc4444cbb85471965e21d1e1e253
Author: Hyukjin Kwon <[email protected]>
AuthorDate: Wed Aug 28 12:25:24 2024 +0900
[SPARK-49402][PYTHON][FOLLOW-UP] Manually load ~/.profile in Spark Connect
notebook
### What changes were proposed in this pull request?
This is a followup of https://github.com/apache/spark/pull/47883 that adds
manual `source ~/.profile`.
### Why are the changes needed?
Ever since we switched to `Dockerfile`, none of `./profile`, `/.bashrc`,
`./bash_profile`, etc seems working. There are a couple of related issues in
Jupyter but I cannot figure it out.
This is the only cell it needs the environment variable so decided to
simply work around.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Manually tested.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #47902 from HyukjinKwon/SPARK-49402-followup.
Authored-by: Hyukjin Kwon <[email protected]>
Signed-off-by: Hyukjin Kwon <[email protected]>
---
python/docs/source/getting_started/quickstart_connect.ipynb | 4 +++-
1 file changed, 3 insertions(+), 1 deletion(-)
diff --git a/python/docs/source/getting_started/quickstart_connect.ipynb
b/python/docs/source/getting_started/quickstart_connect.ipynb
index 74b77238c67f..019e6c175a44 100644
--- a/python/docs/source/getting_started/quickstart_connect.ipynb
+++ b/python/docs/source/getting_started/quickstart_connect.ipynb
@@ -28,7 +28,9 @@
"metadata": {},
"outputs": [],
"source": [
- "!$HOME/sbin/start-connect-server.sh"
+ "%%bash\n",
+ "source ~/.profile # Make sure environment variables are loaded.\n",
+ "$HOME/sbin/start-connect-server.sh"
]
},
{
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
