This is an automated email from the ASF dual-hosted git repository.
kabhwan pushed a commit to branch branch-3.5
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.5 by this push:
new 9b4778fc1dc7 [SPARK-46906][INFRA][3.5] Bump python libraries (pandas,
pyarrow) in Docker image for release script
9b4778fc1dc7 is described below
commit 9b4778fc1dc7047635c9ec19c187d4e75d182590
Author: Jungtaek Lim <[email protected]>
AuthorDate: Thu Feb 15 14:49:09 2024 +0900
[SPARK-46906][INFRA][3.5] Bump python libraries (pandas, pyarrow) in Docker
image for release script
### What changes were proposed in this pull request?
This PR proposes to bump python libraries (pandas to 2.0.3, pyarrow to
4.0.0) in Docker image for release script.
### Why are the changes needed?
Without this change, release script (do-release-docker.sh) fails on docs
phase. Changing this fixes the release process against branch-3.5.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Confirmed with dry-run of release script against branch-3.5.
`dev/create-release/do-release-docker.sh -d ~/spark-release -n -s docs`
```
Generating HTML files for SQL API documentation.
INFO - Cleaning site directory
INFO - Building documentation to directory:
/opt/spark-rm/output/spark/sql/site
INFO - Documentation built in 0.85 seconds
/opt/spark-rm/output/spark/sql
Moving back into docs dir.
Making directory api/sql
cp -r ../sql/site/. api/sql
Source: /opt/spark-rm/output/spark/docs
Destination: /opt/spark-rm/output/spark/docs/_site
Incremental build: disabled. Enable with --incremental
Generating...
done in 7.469 seconds.
Auto-regeneration: disabled. Use --watch to enable.
```
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #45111 from HeartSaVioR/SPARK-46906-3.5.
Authored-by: Jungtaek Lim <[email protected]>
Signed-off-by: Jungtaek Lim <[email protected]>
---
dev/create-release/spark-rm/Dockerfile | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/dev/create-release/spark-rm/Dockerfile
b/dev/create-release/spark-rm/Dockerfile
index cd57226f5e01..789915d018de 100644
--- a/dev/create-release/spark-rm/Dockerfile
+++ b/dev/create-release/spark-rm/Dockerfile
@@ -42,7 +42,7 @@ ARG APT_INSTALL="apt-get install --no-install-recommends -y"
# We should use the latest Sphinx version once this is fixed.
# TODO(SPARK-35375): Jinja2 3.0.0+ causes error when building with Sphinx.
# See also https://issues.apache.org/jira/browse/SPARK-35375.
-ARG PIP_PKGS="sphinx==3.0.4 mkdocs==1.1.2 numpy==1.20.3
pydata_sphinx_theme==0.8.0 ipython==7.19.0 nbsphinx==0.8.0 numpydoc==1.1.0
jinja2==2.11.3 twine==3.4.1 sphinx-plotly-directive==0.1.3
sphinx-copybutton==0.5.2 pandas==1.5.3 pyarrow==3.0.0 plotly==5.4.0
markupsafe==2.0.1 docutils<0.17 grpcio==1.56.0 protobuf==4.21.6
grpcio-status==1.56.0 googleapis-common-protos==1.56.4"
+ARG PIP_PKGS="sphinx==3.0.4 mkdocs==1.1.2 numpy==1.20.3
pydata_sphinx_theme==0.8.0 ipython==7.19.0 nbsphinx==0.8.0 numpydoc==1.1.0
jinja2==2.11.3 twine==3.4.1 sphinx-plotly-directive==0.1.3
sphinx-copybutton==0.5.2 pandas==2.0.3 pyarrow==4.0.0 plotly==5.4.0
markupsafe==2.0.1 docutils<0.17 grpcio==1.56.0 protobuf==4.21.6
grpcio-status==1.56.0 googleapis-common-protos==1.56.4"
ARG GEM_PKGS="bundler:2.3.8"
# Install extra needed repos and refresh.
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
