This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.4 by this push: new 4f9d6d077ff [SPARK-44557][INFRA] Clean up untracked/ignored files before running pip packaging test in GitHub Actions 4f9d6d077ff is described below commit 4f9d6d077ff1d3f359774d21d32833cb80a193b7 Author: Hyukjin Kwon <gurwls...@apache.org> AuthorDate: Thu Jul 27 14:08:09 2023 +0900 [SPARK-44557][INFRA] Clean up untracked/ignored files before running pip packaging test in GitHub Actions ### What changes were proposed in this pull request? This PR proposes to remove untracked/ignored files before running pip packaging test in GitHub Actions. ### Why are the changes needed? In order to fix the flakiness in the test such as: ``` ... creating dist Creating tar archive error: [Errno 28] No space left on device Cleaning up temporary directory - /tmp/tmp.CvSzgB7Kyy ``` See also https://github.com/apache/spark/actions/runs/5665869112/job/15351515539. ### Does this PR introduce _any_ user-facing change? No, test-only. ### How was this patch tested? GitHub Actions build in this PR. Closes #42159 from HyukjinKwon/debug-ci-failure. Lead-authored-by: Hyukjin Kwon <gurwls...@apache.org> Co-authored-by: Hyukjin Kwon <gurwls...@gmail.com> Signed-off-by: Hyukjin Kwon <gurwls...@apache.org> (cherry picked from commit 77aab6edb7c2b7be54cb19d40c0eeeb2c699f0f7) Signed-off-by: Hyukjin Kwon <gurwls...@apache.org> --- dev/run-pip-tests | 7 +++++++ 1 file changed, 7 insertions(+) diff --git a/dev/run-pip-tests b/dev/run-pip-tests index 5da231495a2..773611d9d92 100755 --- a/dev/run-pip-tests +++ b/dev/run-pip-tests @@ -25,6 +25,13 @@ shopt -s nullglob FWDIR="$(cd "$(dirname "$0")"/..; pwd)" cd "$FWDIR" +# Clean ignored/untracked files that do not need +# for pip packaging test. Machines in GitHub Action do not have +# enough space, see also SPARK-44557. +if [[ ! -z "${GITHUB_ACTIONS}" ]]; then + git clean -d -f -x -e assembly +fi + echo "Constructing virtual env for testing" VIRTUALENV_BASE=$(mktemp -d) --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org