This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.2 by this push: new 0a2a568e739 [SPARK-40172][ML][TESTS] Temporarily disable flaky test cases in ImageFileFormatSuite 0a2a568e739 is described below commit 0a2a568e73993acddbac3fb7cefcc05acbcc4620 Author: Gengliang Wang <gengli...@apache.org> AuthorDate: Mon Aug 22 16:16:03 2022 +0900 [SPARK-40172][ML][TESTS] Temporarily disable flaky test cases in ImageFileFormatSuite ### What changes were proposed in this pull request? 3 test cases in ImageFileFormatSuite become flaky in the GitHub action tests: https://github.com/apache/spark/runs/7941765326?check_suite_focus=true https://github.com/gengliangwang/spark/runs/7928658069 Before they are fixed(https://issues.apache.org/jira/browse/SPARK-40171), I suggest disabling them in OSS. ### Why are the changes needed? Disable flaky tests before they are fixed. The test cases keep failing from time to time, while they always pass on local env. ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? Existing CI Closes #37605 from gengliangwang/disableFlakyTest. Authored-by: Gengliang Wang <gengli...@apache.org> Signed-off-by: Hyukjin Kwon <gurwls...@apache.org> (cherry picked from commit 50f2f506327b7d51af9fb0ae1316135905d2f87d) Signed-off-by: Dongjoon Hyun <dongj...@apache.org> (cherry picked from commit 6572c66d01e3db00858f0b4743670a1243d3c44f) Signed-off-by: Dongjoon Hyun <dongj...@apache.org> --- .../org/apache/spark/ml/source/image/ImageFileFormatSuite.scala | 9 ++++++--- 1 file changed, 6 insertions(+), 3 deletions(-) diff --git a/mllib/src/test/scala/org/apache/spark/ml/source/image/ImageFileFormatSuite.scala b/mllib/src/test/scala/org/apache/spark/ml/source/image/ImageFileFormatSuite.scala index 0ec2747be65..edb0ea27192 100644 --- a/mllib/src/test/scala/org/apache/spark/ml/source/image/ImageFileFormatSuite.scala +++ b/mllib/src/test/scala/org/apache/spark/ml/source/image/ImageFileFormatSuite.scala @@ -50,7 +50,8 @@ class ImageFileFormatSuite extends SparkFunSuite with MLlibTestSparkContext { assert(df.schema("image").dataType == columnSchema, "data do not fit ImageSchema") } - test("image datasource count test") { + // TODO(SPARK-40171): Re-enable the following flaky test case after being fixed. + ignore("image datasource count test") { val df1 = spark.read.format("image").load(imagePath) assert(df1.count === 9) @@ -88,7 +89,8 @@ class ImageFileFormatSuite extends SparkFunSuite with MLlibTestSparkContext { assert(result === invalidImageRow(resultOrigin)) } - test("image datasource partition test") { + // TODO(SPARK-40171): Re-enable the following flaky test case after being fixed. + ignore("image datasource partition test") { val result = spark.read.format("image") .option("dropInvalid", true).load(imagePath) .select(substring_index(col("image.origin"), "/", -1).as("origin"), col("cls"), col("date")) @@ -106,8 +108,9 @@ class ImageFileFormatSuite extends SparkFunSuite with MLlibTestSparkContext { )) } + // TODO(SPARK-40171): Re-enable the following flaky test case after being fixed. // Images with the different number of channels - test("readImages pixel values test") { + ignore("readImages pixel values test") { val images = spark.read.format("image").option("dropInvalid", true) .load(imagePath + "/cls=multichannel/").collect() --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org