This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 0d938de112df [SPARK-47112][INFRA] Write logs into a file in SparkR
Windows build
0d938de112df is described below
commit 0d938de112dfe142f40d4c6f86cfa1e6e32210ec
Author: Hyukjin Kwon <[email protected]>
AuthorDate: Wed Feb 21 16:39:37 2024 +0900
[SPARK-47112][INFRA] Write logs into a file in SparkR Windows build
### What changes were proposed in this pull request?
We used to write Log4J logs into `target/unit-tests.log` instead of
console. This seems to be broken in SparkR Windows job. This PR fixes it.
### Why are the changes needed?
https://github.com/apache/spark/actions/runs/7977185456/job/21779508822#step:10:89
This write too many logs, and difficult to see the real test cases.
### Does this PR introduce _any_ user-facing change?
No, dev-only.
### How was this patch tested?
In my fork
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #45192 from HyukjinKwon/reduce-logs.
Authored-by: Hyukjin Kwon <[email protected]>
Signed-off-by: Hyukjin Kwon <[email protected]>
---
.github/workflows/build_sparkr_window.yml | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/.github/workflows/build_sparkr_window.yml
b/.github/workflows/build_sparkr_window.yml
index 07f4ebe91ad2..fbaca36f9f87 100644
--- a/.github/workflows/build_sparkr_window.yml
+++ b/.github/workflows/build_sparkr_window.yml
@@ -71,7 +71,7 @@ jobs:
run: |
set HADOOP_HOME=%USERPROFILE%\hadoop-3.3.5
set PATH=%HADOOP_HOME%\bin;%PATH%
- .\bin\spark-submit2.cmd --driver-java-options
"-Dlog4j.configuration=file:///%CD:\=/%/R/log4j2.properties" --conf
spark.hadoop.fs.defaultFS="file:///" R\pkg\tests\run-all.R
+ .\bin\spark-submit2.cmd --driver-java-options
"-Dlog4j.configurationFile=file:///%CD:\=/%/R/log4j2.properties" --conf
spark.hadoop.fs.defaultFS="file:///" R\pkg\tests\run-all.R
shell: cmd
env:
NOT_CRAN: true
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
