Re: Need write access to hive wiki

2014-10-02 Thread Ehsan ul Haq
I think I already have the account. https://cwiki.apache.org/confluence/users/viewuserprofile.action?username=m.ehsan.haq but still no permission On Thu, Oct 2, 2014 at 1:32 AM, Lefty Leverenz leftylever...@gmail.com wrote: First you'll need a Confluence account: how to get permission to edit

java.lang.RuntimeException: Unknown type BIGINT

2014-10-02 Thread Adam Kawa
Hi! When using Hive 0.14 (trunk from April 2014), I can't run queries on tables with BIGINT partition column. I get: *FAILED: RuntimeException Unknown type BIGINT.* It runs runs nicely in Hive 0.12. It also runs nicely, if my table has a bigint column (un-capitalized, not BIGINT). The problem

How put the third party jar first in classpath of Hive UDF

2014-10-02 Thread java8964
Hi, Currently our production is using Hive 0.9.0. There is already a complex Hive query running on hadoop daily to generate millions records output. What I want to do is to transfer this result to Cassandra. I tried to do it in UDF, as then I can send the data at reducer level, to maximum the

Re: percentile_approx slowness

2014-10-02 Thread Kevin Weiler
Hi all, I wanted to note that I figured out a better solution to my problem. I was selecting each percentile I wanted to compute (0.1, 0.5, 0.9 etc) as an individual percentile calculation which was blowing up my query. It turns out that if you do it like this: SELECT PERCENTILE(col,

Hive User Group Meeting, Oct. 15th, New York

2014-10-02 Thread Xuefu Zhang
Dear Hive users/developers, The next Hive user group meeting is around the corner. It will be held on Oct. 15th, from 6:30pm to 9:00pm at 1500 Broadway, 6th floor, New York, NY 10036. This will be a great opportunity for vast users and developers to find out what's happening in the community or

Re: percentile_approx slowness

2014-10-02 Thread Prasanth Jayachandran
You can look for explode(), posexplode() UDF’s in hive. https://cwiki.apache.org/confluence/display/Hive/LanguageManual+UDF#LanguageManualUDF-explode Thanks Prasanth Jayachandran On Oct 2, 2014, at 7:15 AM, Kevin Weiler kevin.wei...@imc-chicago.com wrote: Hi all, I wanted to note that I

RES: Join error with ORC Hive tables

2014-10-02 Thread Thiago Henrique dos Santos Bento
Erro: 2014-10-02 15:59:08,654 FATAL [IPC Server handler 7 on 46438] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: attempt_1411750973876_0130_m_23_1000 - exited : java.io.IOException: java.lang.reflect.InvocationTargetException at

transform with distribute by bug?

2014-10-02 Thread Wil -
Hi, I was having an issue with a query that involves a transform with a distribute by. The query works in the Hive 0.11 but not in Hive 0.13 (both on EMR). shell echo -e a\tb\tc /tmp/a.txt create table tbl ( a string, b string, c string ) row format delimited fields terminated by

Re: RES: Join error with ORC Hive tables

2014-10-02 Thread Prasanth Jayachandran
Caused by: java.io.IOException: Malformed ORC file hdfs://arnaldo01:8020/apps/hive/warehouse/mds.db/ds_customer_qg/part-m-1. Invalid postscript. From the exception it looks like the file it is trying to read from table stored as ORC but the above file is not an ORC file. How is the ORC