Re: Combining hive tables as one query

2018-05-15 Thread Sowjanya Kakarala
t; 1.4 2.4 3.4 >> >> >> >> You could of course then resave it in .csv format. But if the entire >> process needs to be automated within Hive, then my Hive query skills are >> not quite that advanced yet (I’ve only been using Hive for about a month). >&

Re: Combining hive tables as one query

2018-05-15 Thread balajee venkatesh
ld of course then resave it in .csv format. But if the entire > process needs to be automated within Hive, then my Hive query skills are > not quite that advanced yet (I’ve only been using Hive for about a month). > > > > Paul > > > > > > *From:* Sowjanya Kakarala &

Re: Combining hive tables as one query

2018-05-15 Thread Uli Bethke
Maybe use ROW_NUMBER() OVER () AS row_num for each table to create a sequence number and then (full outer) join all tables on row_num Probably best done outside SQL though On 15/05/2018 18:32, Sowjanya Kakarala wrote: I am trying to fetch data from hive for 8tables at a time and save it in a

RE: Combining hive tables as one query

2018-05-15 Thread Grim, Paul
Kakarala <sowja...@agrible.com> Sent: Tuesday, May 15, 2018 1:33 PM To: user@hive.apache.org Subject: Re: Combining hive tables as one query I am trying to fetch data from hive for 8tables at a time and save it in a csv, so that our pipeline would read that csv which had 8tables data like

Re: Combining hive tables as one query

2018-05-15 Thread balajee venkatesh
Ok. There are 8 tables. Do you see any conditional match based on some keys? May be a well designed 'Left/Right' join provisioning would help you tackling your use case. You can also look at merge or union options. Once you are able to correlate those tables and design a query which would give you

Re: Combining hive tables as one query

2018-05-15 Thread Sowjanya Kakarala
I am trying to fetch data from hive for 8tables at a time and save it in a csv, so that our pipeline would read that csv which had 8tables data like: tb1 tb2 tb3 tb4 tb5 tb6 tb7 tb8 0.1 1.1 2.1 -1.1 -0.1 0.1 0.2 3.2 1.2 0.4 4.1 -2.1 -0.5 0.2 0.3 6.2 and so on If I fetch one table at a time

RE: Combining hive tables as one query

2018-05-15 Thread Grim, Paul
May 15, 2018 12:34 PM To: user@hive.apache.org Subject: Re: Combining hive tables as one query ok. but in my usecase join's/union's wont help. Here is an example of my usecase from postgres, which I have to do it in similar way for hive. with recursive a as (select col from tb1), b as (select col fr

Re: Combining hive tables as one query

2018-05-15 Thread Alan Gates
You are correct that Hive does not support "with recursive". A few more details of what you are trying to do would be helpful, since it's not clear why you need the iteration provided by "with recursive". If you really need the iteration I don't think Hive can do what you want. Alan. On Tue,

Re: Combining hive tables as one query

2018-05-15 Thread Sowjanya Kakarala
ok. but in my usecase join's/union's wont help. Here is an example of my usecase from postgres, which I have to do it in similar way for hive. with recursive a as (select col from tb1), b as (select col from tb2), c as (select col from tb3) select a,b,c from a,b,c; which output's me in a

Re: Combining hive tables as one query

2018-05-15 Thread Alan Gates
In general this is done using joins, as in all SQL engines. A google search on "intro to SQL joins" will suggest a number of resources, for example https://www.essentialsql.com/get-ready-to-learn-sql-12-introduction-to-database-joins/ Alan. On Tue, May 15, 2018 at 7:37 AM, Sowjanya Kakarala