pan3793 commented on code in PR #36496:
URL: https://github.com/apache/spark/pull/36496#discussion_r874040979
##########
sql/core/src/test/scala/org/apache/spark/sql/execution/columnar/InMemoryColumnarQuerySuite.scala:
##########
@@ -563,4 +563,33 @@ class InMemoryColumnarQuerySuite extends QueryTest with
SharedSparkSession {
}
}
}
+
+ test("SPARK-39104: InMemoryRelation#isCachedColumnBuffersLoaded should be
thread-safe") {
Review Comment:
I updated the UT and reproduced the issue on local, but I would say it's not
easy to reproduce
```
[info] InMemoryColumnarQuerySuite:
01:58:25.558 WARN org.apache.spark.util.Utils: Your hostname,
Chengs-Mac-mini.local resolves to a loopback address: 127.0.0.1; using
10.221.96.10 instead (on interface en1)
01:58:25.562 WARN org.apache.spark.util.Utils: Set SPARK_LOCAL_IP if you
need to bind to another address
01:58:25.808 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
Exception: org.scalatest.exceptions.TestFailedException thrown from the
UncaughtExceptionHandler in thread "Thread-10"
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
