Github user heary-cao commented on the issue:
https://github.com/apache/spark/pull/20516
@srowen,
if you don't set the spark.testing for true, the default value for
spark.port.maxRetries is not 100, but 16,
so in verifyServicePort function,
actualPort should be <= (expectedPort + 100) is not true.
because
def portMaxRetries(conf: SparkConf): Int = {
val maxRetries = conf.getOption("spark.port.maxRetries").map(_.toInt)
if (conf.contains("spark.testing")) {
// Set a higher number of retries for tests...
maxRetries.getOrElse(100)
} else {
maxRetries.getOrElse(16)
}
}
thanks.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
