r.setConf(key, value)
runSqlHive(s"SET $key=$value")
}
From: madhu phatak
Date: 2015-04-23 02:17
To: Michael Armbrust
CC: Ophir Cohen; Hao Ren; user
Subject: Re: HiveContext setConf seems not stable
Hi,
calling getConf don't solve the issue. Even many hive specific queries are
broken. Se
Hi,
calling getConf don't solve the issue. Even many hive specific queries are
broken. Seems like no hive configurations are getting passed properly.
Regards,
Madhukara Phatak
http://datamantra.io/
On Wed, Apr 22, 2015 at 2:19 AM, Michael Armbrust
wrote:
> As a workaround, can you call getCo
As a workaround, can you call getConf first before any setConf?
On Tue, Apr 21, 2015 at 1:58 AM, Ophir Cohen wrote:
> I think I encounter the same problem, I'm trying to turn on the
> compression of Hive.
> I have the following lines:
> def initHiveContext(sc: SparkContext): HiveContext = {
>
I think I encounter the same problem, I'm trying to turn on the compression
of Hive.
I have the following lines:
def initHiveContext(sc: SparkContext): HiveContext = {
val hc: HiveContext = new HiveContext(sc)
hc.setConf("hive.exec.compress.output", "true")
hc.setConf("mapreduce.output.
Hi,
Jira created: https://issues.apache.org/jira/browse/SPARK-6675
Thank you.
On Wed, Apr 1, 2015 at 7:50 PM, Michael Armbrust
wrote:
> Can you open a JIRA please?
>
> On Wed, Apr 1, 2015 at 9:38 AM, Hao Ren wrote:
>
>> Hi,
>>
>> I find HiveContext.setConf does not work correctly. Here are s
Can you open a JIRA please?
On Wed, Apr 1, 2015 at 9:38 AM, Hao Ren wrote:
> Hi,
>
> I find HiveContext.setConf does not work correctly. Here are some code
> snippets showing the problem:
>
> snippet 1:
>
> -
Hi,
I find HiveContext.setConf does not work correctly. Here are some code
snippets showing the problem:
snippet 1:
import org.apache.spark.sql.hive.HiveContext
import org.apache.spark
