wypoon commented on code in PR #4588:
URL: https://github.com/apache/iceberg/pull/4588#discussion_r878936151
##########
spark/v3.2/spark/src/test/java/org/apache/iceberg/spark/source/TestSparkReaderDeletes.java:
##########
@@ -94,11 +141,15 @@ public static void startMetastoreAndSpark() {
spark = SparkSession.builder()
.master("local[2]")
+ .config("spark.appStateStore.asyncTracking.enable", false)
Review Comment:
The default is true, which means that when the `SQLAppStatusListener`
receives a `SparkListenerSQLExecutionEnd` event, it asks its
`ElementTrackingStore` to asynchronously aggregate the metrics. This async call
sometimes results in the metric we need not being available. To make the tests
more predictable, ensure that a synchronous call to aggregate metrics is used.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
