Re: hive on spark job not start enough executors

All the parameters except spark.executor.instances are specified in spark-default.conf located in hive's conf folder. So I think it's a yes. I also checked on spark's web page when a hive on spark job is running, the parameters shown on the web page are exactly what I specified in the config

Re: hive on spark job not start enough executors

when you start hive on spark do you set any parameters for the submitted job (or read them from init file)? set spark.master=yarn; set spark.deploy.mode=client; set spark.executor.memory=3g; set spark.driver.memory=3g; set spark.executor.instances=2; set spark.ui.port=; Dr Mich Talebzadeh

Re: Quota for rogue ad-hoc queries

Hi, I am trying to add this feature in hive ( HIVE-11735 ). But hit a road block while setting the quota during session folder creation as the quota can be only set by super user in HDFS. Any thoughts how to avoid this issue? Thanks, Ravi On

Re: load data Failed with exception java.lang.IndexOutOfBoundsException

You are hitting this issue https://issues.apache.org/jira/browse/HIVE-13185 which is fixed in latest hive release (2.1.0) Thanks Prasanth > On Sep 9, 2016, at 2:21 AM, Gopal Vijayaraghavan wrote: > > >> It will be ok if the file has more than two characters,that is a

Re: load data Failed with exception java.lang.IndexOutOfBoundsException

> It will be ok if the file has more than two characters,that is a little > interesting. I can not understand the result of function checkInputFormat is  > OrcInputFormat,maybe that is just right. My guess is that it is trying to read the 3 letter string "ORC" from that file and failing.

Re: Re: load data Failed with exception java.lang.IndexOutOfBoundsException

drop table ods.loadtest; create external table ods.loadtest ( c1 string ) stored as textfile location '/tmp/loadtest'; hive> show create table ods.loadtest; OK CREATE EXTERNAL TABLE `ods.loadtest`( `c1` string) ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe' STORED AS