Re: Adding a virtual column for a custom input format

2020-05-06 Thread saquib khan
unsubscribe On Wed, May 6, 2020 at 10:53 AM Christine Mathiesen wrote: > Hello! > > I'm hoping someone can help me shed some light on how Hive deals with > virtual columns. We are trying to implement some time travel features in a > custom input format we're building and are considering the

Re: Controlling Number of small files while inserting into Hive table

2017-06-25 Thread saquib khan
Please remove me from the user list. On Sun, Jun 25, 2017 at 5:10 PM Db-Blog wrote: > Hi Arpan, > Include the partition column in the distribute by clause of DML, it will > generate only one file per day. Hope this will resolve the issue. > > "insert into 'target_table'

Re: Tez jobs on YARN failing sporadically..

2016-06-28 Thread saquib khan
Unsubscribe On Tuesday, June 28, 2016, Gautam wrote: > Hello, > > We have Tez being used for one of our main ETL workflows and have been > using it for couple months now. We recently started seeing the following > error for a query that regularly runs and hasn't been

Indexing in Hive

2014-04-18 Thread saquib khan
Hi, For large tables, its takes a lot of time to load the indexes in the index table. Is there any way we can reduce the index load time? CREATE TABLE SE_TX_SUMMARY (COUNTY string, BLOCKGROUPID string, GROUPING_ID int) PARTITIONED BY (EXPOSED_TIME int) row format delimited fields terminated by

Indexes in hive

2014-04-07 Thread saquib khan
Dear Friends, I have created the indexes but I am not able to use them. Does hive have an index optimizer? For a simple query in Oracle/Postgres, when we do EXPLAIN it gives the Query Plan with indexes but with Hive it does not show me the indexes. How can we make sure that the indexes are being

Unable to run Join queries

2014-04-04 Thread saquib khan
Dear Folks, Whenever I run join queries, it does not display the output, thought it give me output for queries on single table. Thanks and Regards, Saky

Re: Unable to run Join queries

2014-04-04 Thread saquib khan
... java.lang.RuntimeException: failed to evaluate: unbound=Class.new(); Continuing ... java.lang.InstantiationException: org.antlr.runtime.CommonToken Continuing ... java.lang.RuntimeException: failed to evaluate: unbound=Class.new(); Continuing ... On Fri, Apr 4, 2014 at 4:03 PM, saquib khan skhan...@gmail.com

Re: Unable to run Join queries

2014-04-04 Thread saquib khan
Phostle decimusphos...@gmail.comwrote: It might help if you post details on the queries themselves. On Fri, Apr 4, 2014 at 1:14 PM, saquib khan skhan...@gmail.com wrote: I get java exceptions while running the queries: java.lang.InstantiationException: org.antlr.runtime.CommonToken

Re: Unable to run Join queries

2014-04-04 Thread saquib khan
Query : SELECT exposed_time, ROUND(COUNT(ses_tx_20130805.pid)/10) COUNT FROM tx_demography_info join ses_tx_20130805 on (tx_demography_info.pid=ses_tx_20130805.pid) where countyid='50015' GROUP BY exposed_time ORDER BY exposed_time; On Fri, Apr 4, 2014 at 4:14 PM, saquib khan skhan

Re: Unable to run Join queries

2014-04-04 Thread saquib khan
(COUNT(ses_tx_20130805.pid)/10) ***COUNT*** FROM tx_demography_info JOIN ses_tx_20130805 ON (tx_demography_info.pid=ses_tx_20130805.pid) WHERE countyid='50015' GROUP BY exposed_time ORDER BY exposed_time; On Fri, Apr 4, 2014 at 1:25 PM, saquib khan skhan...@gmail.com wrote: Thanks