Cheng Lian created SPARK-2591:
---------------------------------

             Summary: Add config property to disable incremental collection 
used in Thrift server
                 Key: SPARK-2591
                 URL: https://issues.apache.org/jira/browse/SPARK-2591
             Project: Spark
          Issue Type: Bug
          Components: SQL
            Reporter: Cheng Lian
            Priority: Minor


{{SparkSQLOperationManager}} uses {{RDD.toLocalIterator}} to collect the result 
set one partition at a time. This is useful to avoid OOM when the result is 
large, but introduces extra job scheduling costs as each partition is collected 
with a separate job. Users may want to disable this when the result set is 
expected to be small.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to