[
https://issues.apache.org/jira/browse/SPARK-13768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256142#comment-15256142
]
Teng Qiu commented on SPARK-13768:
----------------------------------
perhaps it is a beeline issue, we used the beeline from official hive 1.2
package, --hiveconf and --hivevar worked with spark 1.5.x, since spark 1.6, the
thriftserver implementation changed, therefore we got the issue described in
SPARK-13983, the official beeline do not work either...
> Set hive conf failed use --hiveconf when beeline connect to thriftserver
> ------------------------------------------------------------------------
>
> Key: SPARK-13768
> URL: https://issues.apache.org/jira/browse/SPARK-13768
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 1.5.1
> Reporter: Weizhong
> Priority: Minor
>
> 1. Start thriftserver
> 2. ./bin/beeline -u '...' --hiveconf hive.exec.max.dynamic.partitions=10000
> 3. set hive.exec.max.dynamic.partitions; -- return is default value 1000,
> not 10000
> May be we can pass conf to context when open session
> {code:java}
> override def openSession(...): SessionHandle = {
> ...
> if (sessionConf != null) {
> import scala.collection.JavaConversions._
> for ((k, v) <- sessionConf) {
> if (k.startsWith("set:hiveconf:")) {
> val setK = k.split("set:hiveconf:")(1)
> ctx.setConf(setK, v)
> }
> }
> }
> ctx.setConf("spark.sql.hive.version", HiveContext.hiveExecutionVersion)
> ...
> }
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
