Re: hacking the hive ql parser?

2015-12-29 Thread Yang
thanks! On Tue, Dec 29, 2015 at 12:14 PM, Edward Capriolo wrote: > hive --service lineage 'hql' exists i believe. > > On Tue, Dec 29, 2015 at 3:05 PM, Yang wrote: > >> I'm trying to create a utility to parse out the data lineage (i.e. DAG >> dependency graph) among all my hive scripts. >> >> t

Re: How to set hive.aux.jars.path in hive1.1.0?

2015-12-29 Thread Amey Barve
Hi Heng, Following steps worked for me: 1. sudo mkdir $HIVE_HOME/auxlib on machine running hive server 2 2. Copy all your jars in this folder 3. restart hive server 2 4. Now you can run hive queries through beeline Regards, Amey On Wed, Dec 30, 2015 at 4:41 AM, Heng Chen wrote: > Yeah, this is

About hive on spark

2015-12-29 Thread Todd
Hi, I would explore whether hive on spark is stable enough to adopt it in our production environment. As a starting point, is there some documentation for me to get started? Thanks.

Test Error building hive

2015-12-29 Thread Colm McHugh
Hi, I am compiling hive from source per the getting started guide ( https://cwiki.apache.org/confluence/display/Hive/GettingStarted#GettingStarted-CompileHiveonmaster) and keep hitting a failure in testing the Hive Query Language module. The output is reproduced below. I am building on mac os x (y

Re: How to set hive.aux.jars.path in hive1.1.0?

2015-12-29 Thread Heng Chen
Yeah, this is my code. Properties prop = new Properties(); prop.put(USER, user); prop.put(PASSWORD, password); prop.put("hiveconf:hive.aux.jars.path", auxJarPath); ConnectionFactory connectionFactory = new DriverManagerConnectionFactory(url, prop); Hopes it will be helpful. 2015-12-29 19:49 GM

Immutable data in Hive

2015-12-29 Thread Ashok Kumar
Hi, Can someone please clarify what  "immutable data" in Hive means? I have been told that data in Hive is/should be immutable but in that case why we need transactional tables in Hive that allow updates to data. thanks and greetings

Re: hacking the hive ql parser?

2015-12-29 Thread Edward Capriolo
hive --service lineage 'hql' exists i believe. On Tue, Dec 29, 2015 at 3:05 PM, Yang wrote: > I'm trying to create a utility to parse out the data lineage (i.e. DAG > dependency graph) among all my hive scripts. > > to do this I need to parse out the input and output tables from a query. > does

hacking the hive ql parser?

2015-12-29 Thread Yang
I'm trying to create a utility to parse out the data lineage (i.e. DAG dependency graph) among all my hive scripts. to do this I need to parse out the input and output tables from a query. does this ability existing already? if not, I'm going to hack the parser. I am not very familiar with the par

Re: How to set hive.aux.jars.path in hive1.1.0?

2015-12-29 Thread Lee S
@Heng, I didn't try to set the variable directly in beeline shell. Actually, I programmed with hive jdbc to create table with self defined serde. And I need to put the serde jar in the hive.aux.jars.path,in case I can find it directly, not through beeline. On Tue, Dec 29, 2015 at 5:38 PM, Hen

Running the same query on 1 billion rows fact table in Hive on Spark compared to Sybase IQ columnar database

2015-12-29 Thread Mich Talebzadeh
Hi, I have a fact table in Hive imported from Sybase IQ via SQOOP with 1 billion rows as follows: show create table sales; +--- +--+ |createtab_stmt | +

Re: How to set hive.aux.jars.path in hive1.1.0?

2015-12-29 Thread Heng Chen
Have you try to set hive_aux_jars_path explicitly in beeline shell? I found this problem too when i use hive-jdbc in my project, and i set hive_aux_jars_path explicitly in my code. Hopes it will be helpful. 2015-12-29 15:58 GMT+08:00 Peyman Mohajerian : > Maybe you need to also add: > > HIVE_A

Re: How to set hive.aux.jars.path in hive1.1.0?

2015-12-29 Thread Lee S
@Peyman I've done as this webpage.But export the variable only makes effects in hive console, didnt work on hiveserver. On Tue, Dec 29, 2015 at 3:58 PM, Peyman Mohajerian wrote: > Maybe you need to also add: > > HIVE_AUX_JARS_PATH = /path/to/JAR > > e.g.: > http://www.cloudera.com/content/www/e