GitHub user shaolinliu opened a pull request:
https://github.com/apache/spark/pull/17561
[SPARK-20248][ SQL]Spark SQL add limit parameter to enhance the reliability.
## What changes were proposed in this pull request?
Add a parameter "spark.sql.thriftServer.retainedResults" with default value
200, when user run a query without a limit, this will implicitly add a limit to
this query. When user run a query with a limit,we do nothing. If this parameter
is set to 0,we do nothing too.
## How was this patch tested?
manual tests
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/shaolinliu/spark liu
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/17561.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #17561
----
commit b47cf92fee79a57fbec37bbf9c7d35753f5c7d75
Author: liu shaolin <[email protected]>
Date: 2017-04-07T05:25:21Z
modified:
sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
modified:
sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkExecuteStatementOperation.scala
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
