This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-3.2
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.2 by this push:
new f807df1 [SPARK-36270][BUILD][FOLLOWUP] Reduce metaspace size for
pyspark
f807df1 is described below
commit f807df1924ba4faed92463688be8ca2f4f0bb948
Author: Liang-Chi Hsieh <[email protected]>
AuthorDate: Fri Jul 23 14:20:00 2021 -0700
[SPARK-36270][BUILD][FOLLOWUP] Reduce metaspace size for pyspark
### What changes were proposed in this pull request?
Notice that pyspark GA module `pyspark-pandas-slow` sometimes still has
return code 137. Try to reduce its metaspace size further.
### Why are the changes needed?
Fix return code 137 for pyspark GA module.
### Does this PR introduce _any_ user-facing change?
No, dev only.
### How was this patch tested?
GA
Closes #33496 from viirya/test-ga-followup.
Authored-by: Liang-Chi Hsieh <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
(cherry picked from commit c2de111ec53a3e42812ce5a7b5268ca73faa39c1)
Signed-off-by: Dongjoon Hyun <[email protected]>
---
.github/workflows/build_and_test.yml | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/.github/workflows/build_and_test.yml
b/.github/workflows/build_and_test.yml
index 9dafd5e..7a15172 100644
--- a/.github/workflows/build_and_test.yml
+++ b/.github/workflows/build_and_test.yml
@@ -169,7 +169,7 @@ jobs:
GITHUB_PREV_SHA: ${{ github.event.before }}
SPARK_LOCAL_IP: localhost
SKIP_UNIDOC: true
- METASPACE_SIZE: 512m
+ METASPACE_SIZE: 128m
steps:
- name: Checkout Spark repository
uses: actions/checkout@v2
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
