Re: Subqueries two tables to one in Hive

Thank you for replying. You are right, I just have to set these guys in: set hive.strict.checks.cartesian.product=false; set hive.mapred.mode=nonstrict; *From: *Furcy Pin *Date: *Tuesday, August 7, 2018 at 2:25 AM *To: *Sowjanya Kakarala *Subject: *[EXT] Re: Subqueries two tables to one

Subqueries two tables to one in Hive

Hi Everyone, I am trying to insert data from 2tables to one table as separate columns. Example: Table1 as A: Id Data time_stamp 1 0.1 2018-01-01 2 0.2 2018-01-01 3 0.3 2018-01-02 Table2 as B Id Data time_stamp 1 1.1 2018-01-01 2 2.2 2018-01-01 3 1.3 2018-01-02 Now I

Re: Performance in hive fetch

018 at 10:07 AM, Shawn Weeks wrote: > How long is it taking to run the actual query if you create a temp table > or something with the result? How many rows are returned? Need to narrow > down if it’s the fetch taken a while or the actual query. > > > > Thanks > > Shawn

Performance in hive fetch

Hi Guys, I am trying to fetch the data from hive through python code based on dates and id. For fetch of 20days till current day for 7tables together it is taking 30seconds. for fetching for an year worth data for 7tables together it is taking 3minutes26seconds. My tables are stored as orc and

Re:

u still have available space. This also > happens when YARN and/or M/R logs are filling up the disks where the > DataNode is running. > > On Wed, Jun 13, 2018 at 8:56 AM Sowjanya Kakarala > wrote: > >> Hi Sajid, >> >> As this is development environment, we have limit

Re:

our rack topology ? > > On Tue, Jun 12, 2018 at 9:26 PM Sowjanya Kakarala > wrote: > >> Hi Guys, >> >> >> I have 4datanodes and one master node EMR cluster with 120GB data storage >> left. I have been running sqoop jobs which loads data to hive table. After

[no subject]

Hi Guys, I have 4datanodes and one master node EMR cluster with 120GB data storage left. I have been running sqoop jobs which loads data to hive table. After some jobs ran successfully I suddenly see these errors all over the name node logs and datanodes logs. I have tried changing so many

passing configuration through connection string

Hi all, I am trying to fetch the data from hive using python code, which works for normal tables. But, for bucketed tables with transactions set true, it is throwing error ` This command is not allowed on an ACID table dbname.tblname with a non-ACID transaction manager. ` I have set the folowing

Re: Combining hive tables as one query

t; 1.4 2.4 3.4 >> >> >> >> You could of course then resave it in .csv format. But if the entire >> process needs to be automated within Hive, then my Hive query skills are >> not quite that advanced yet (I’ve only been using Hive for about a month). >&

Re: Combining hive tables as one query

t you are trying to do would be helpful, since it's not clear > why you need the iteration provided by "with recursive". If you really > need the iteration I don't think Hive can do what you want. > > Alan. > > On Tue, May 15, 2018 at 9:34 AM, Sowjanya Kakarala <sowj

Re: Combining hive tables as one query

one using joins, as in all SQL engines. A google > search on "intro to SQL joins" will suggest a number of resources, for > example https://www.essentialsql.com/get-ready-to- > learn-sql-12-introduction-to-database-joins/ > > Alan. > > On Tue, May 15, 2018 at 7:37 AM,

Combining hive tables as one query

Hi all, Is there a way in hive that different tables data, can be read as in a single query? example: (something like) select a,b from (select col1 from tbl1)a , (select col1 from tb2)b); output as : a b 0.1 0.2 Any help is appreciated. Thanks Sowjanya

Re: insert overwrite to hive orc table in aws

c LIMIT 10; ? Did it return something? > > > > On Fri, 27 Apr 2018, 21:30 Sowjanya Kakarala, <sowja...@agrible.com> > wrote: > >> >> >> >> >>> Hi Guys, >>> >>> I am new to aws, I am not sure how the hive works and store the

ACID transactions table data not getting inserted

Hi all, I am using S3 location to store data in ORC table and I am not seeing any data from it any help here? Even I used default location which is HDFS it results the same in ORC 'no data'. hive> *create* *table* test_S3_*text*(cell_id int, run_date string, init_hour double, pet array, rainfall

Re: insert overwrite to hive orc table in aws

> Hi Guys, > > I am new to aws, I am not sure how the hive works and store the data in > aws. > > I have created a text table and orc table. where text table have data and > when I do insert overwrite from text table the qury runs fine and when I do > a count on orc table its zero. > > I have no

insert overwrite to hive orc table in aws

Hi Guys, I am new to aws, I am not sure how the hive works and store the data in aws. I have created a text table and orc table. where text table have data and when I do insert overwrite from text table the qury runs fine and when I do a count on orc table its zero. I have no clue where the

Migrating data from Postgres to Hive using Sqoop

Hi Guys, I am trying to migrate one of the tables from Postgres database to Hive. Schema of Postgres: db=> \d table Table "public.table" Column |Type| Collation | Nullable | Default -++---+--+- cell_id |