Cheng Lian created SPARK-2591: --------------------------------- Summary: Add config property to disable incremental collection used in Thrift server Key: SPARK-2591 URL: https://issues.apache.org/jira/browse/SPARK-2591 Project: Spark Issue Type: Bug Components: SQL Reporter: Cheng Lian Priority: Minor
{{SparkSQLOperationManager}} uses {{RDD.toLocalIterator}} to collect the result set one partition at a time. This is useful to avoid OOM when the result is large, but introduces extra job scheduling costs as each partition is collected with a separate job. Users may want to disable this when the result set is expected to be small. -- This message was sent by Atlassian JIRA (v6.2#6252)