Re: Anyone successfully deployed Hive on TEZ engine?

2016-05-30 Thread Damien Carol
HIVE 1.2.1 and Tez 0.5.2 or 0.7.0 works pretty well beginning to use HIVE 2.0.0 and 0.8.x but not stable :/ 2016-05-29 22:26 GMT+02:00 Mich Talebzadeh : > > Please bear in mind that I am talking about your own build not anything > comes as part of Vendor's package. >

Re: last stats time on table columns

2016-06-16 Thread Damien Carol
ANALYZE TABLE COMPUTE STATISTICS => change stats for the table and should should it ANALYZE TABLE COMPUTE STATISTICS for COLUMNS => change stats for columns and should change it for columns but NOT for the table That's it. 2016-06-16 21:10 GMT+02:00 Ashok Kumar : >

Re: De-identification_in Hive

2016-03-18 Thread Damien Carol
For the record, see this ticket: https://issues.apache.org/jira/browse/HIVE-13125 2016-03-17 17:02 GMT+01:00 Ajay Chander : > Thanks for your time Mich! I will try this one out. > > > On Thursday, March 17, 2016, Mich Talebzadeh > wrote: > >>

Pb with HBase

2016-03-14 Thread Damien Carol
I have this error sometimes : {noformat} Error: Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Reducer 3, vertexId=vertex_1457964631631_0013_1_03, diagnostics=[Task failed,

Re: Hive system catalog

2016-05-19 Thread Damien Carol
1) If your metastore use a RDBMS for the backend, you can query it by program. 2) If you want a more "command line" approach try the hcatalog cli tool 3) If you want to stay on hive, you could use beeline (HIVE as few meta data commands like SHOW DATABASES) Hope it helps, Damien 2016-05-19

Re: Does HIVE JDBC return same sequence of records?

2016-07-04 Thread Damien Carol
There are no garantee. Use a SORT BY and LIMIT BY if you want some sort of fixed result set. 2016-07-04 12:28 GMT+02:00 Igor Kuzmenko : > If I perform query "*SELECT * FROM table t WHERE t.partition = value" *with > Hive JDBC several times is there garantee, that when I will

Re: Hive LLAP daemon failing with Tez

2017-02-17 Thread Damien Carol
For record, We had the same issue in my company. We use Ambari and HDP. Ambari in HDP 2.5.3 doesn't provide well some configuration keys. My advice for HDP users: checks the xml configuration files which Ambari generate. Regards, Damien 2017-02-16 22:32 GMT+01:00 Mistry, Jigar

Re: on duplicate update equivalent?

2016-09-24 Thread Damien Carol
Another solution is to use HIVE over HBase. When you insert in this table, HIVE do an upsert. 2016-09-23 21:00 GMT+02:00 Mich Talebzadeh : > The fundamental question is: do you need these recurring updates to > dimension tables throttling your Hive tables. > >

Re: incosistent result from orc select count(*)

2016-09-18 Thread Damien Carol
Could you please get hte result of this query: *EXPLAIN EXTENDED select count(*) from table where id= <...>* 2016-09-17 4:15 GMT+02:00 Sanjeev Verma : > Hi > > on hive-1.2.1 orc backed table I am running query select * from table > where id=some it is returning me

Re: ELB Log processing

2016-09-20 Thread Damien Carol
see the udf *parse_url_tuple* SELECT b.* FROM src LATERAL VIEW parse_url_tuple(fullurl, 'HOST', 'PATH', 'QUERY', 'QUERY:id') b as host, path, query, query_id LIMIT 1; https://cwiki.apache.org/confluence/display/Hive/LanguageManual+UDF#LanguageManualUDF-parse_url_tuple 2016-09-20 11:22 GMT+02:00

Re: ELB Log processing

2016-09-20 Thread Damien Carol
, > regexp_extract(url, '.*aid=([a-zA-Z0-9]+).*', 1) as aid, > regexp_extract(url, '.*tid=([a-zA-Z0-9]+).*', 1) as tid, > regexp_extract(url, '.*eid=([a-zA-Z0-9]+).*', 1) as eid, > regexp_extract(url, '.*did=([a-zA-Z0-9]+).*', 1) as did, protocol, > useragent, ssl_cipher, ssl_protocol from

Re: Connect metadata

2016-10-25 Thread Damien Carol
You could use CTAS in presto 2016-10-25 9:09 GMT+02:00 Rajendra Bhat : > Hi Team, > > I have configured only meta store and started the meta store service, > hwich i ma used on presto. > > I need create table on metastore.. how can i able create that.. as i am > not started

Re: [ANNOUNCE] New committer for Apache Hive: Laszlo Vegh

2023-02-08 Thread Damien Carol
Congratulations, Laszlo! Regards, Damien Le mer. 8 févr. 2023 à 11:11, Stamatis Zampetakis a écrit : > Congratulations Laszlo! > > ACID and compactions are a complex beast and the slightest problem there > can have a huge impact in the system. > Many thanks for all your work in this area that