Patrick Wendell created SPARK-4688: -------------------------------------- Summary: Consolidate timeout defaults in Spark Key: SPARK-4688 URL: https://issues.apache.org/jira/browse/SPARK-4688 Project: Spark Issue Type: Improvement Components: Spark Core Reporter: Patrick Wendell Priority: Critical
We have several different timeouts, but in most cases users just want to set something that is large enough that they can avoid GC pauses. We should have a single conf "spark.network.timeout" that is used as the default timeout for all network interactions. This can replace the following timeouts: spark.core.connection.ack.wait.timeout spark.akka.timeout spark.storage.blockManagerSlaveTimeoutMs (undocumented) spark.shuffle.io.connectionTimeout (undocumented) Of course, for compatibility we should respect the old ones when they are set. This idea was proposed originally by [~rxin] and I'm paraphrasing his suggestion here. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org