Re: Create custom UDF

2015-03-05 Thread Buntu Dev
Thanks for the info! On Thu, Mar 5, 2015 at 12:17 PM, Alexander Pivovarov apivova...@gmail.com wrote: Several useful common udf methods we added to GenericUDF recently https://issues.apache.org/jira/browse/HIVE-9744 you can look at the following UDFs as an example:

Re: Create custom UDF

2015-03-05 Thread Alexander Pivovarov
Several useful common udf methods we added to GenericUDF recently https://issues.apache.org/jira/browse/HIVE-9744 you can look at the following UDFs as an example: https://github.com/apache/hive/blob/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFLevenshtein.java

Re: Bucket map join - reducers role

2015-03-05 Thread Vikram Dixit
Hi Murali, I think you missed Xuefu's response. Can you post your query and explain output so that we can understand what is happening? Regards Vikram. From: murali parimi muralikrishna.par...@icloud.commailto:muralikrishna.par...@icloud.com Reply-To:

Re: Row exception in Hive while using join

2015-03-05 Thread Vikram Dixit
Hi Krish, Which version of hive are you using? Can you also provide the logs for this run? Regards Vikram. From: krish kri22go...@gmail.commailto:kri22go...@gmail.com Reply-To: user@hive.apache.orgmailto:user@hive.apache.org user@hive.apache.orgmailto:user@hive.apache.org Date: Thursday, March

Error using ADD JAR with signed jars

2015-03-05 Thread Rahul Sharma
Hi, I am trying to use a signed jar (BouncyCastle) in one of my UDFs. Since signed jars shouldn't be extracted I am using two ADD JAR statements to add both the UDF jar as well as BouncyCastle provider jar to the classpath. However, hive/hadoop automatically extracts the signed jar

Re: Bucket map join - reducers role

2015-03-05 Thread murali parimi
Hi could someone look into this issue! Please let me know if more details are required. Sent from my iPhone On Mar 5, 2015, at 8:53 AM, murali parimi muralikrishna.par...@icloud.com wrote: Hello team, I have two tables A and B. A has 360Million rows with one column K. B has around two

Hive Transactions fail

2015-03-05 Thread David Simoes
Ive had some troubles enabling transactions in Hive 1.0.0 and Ive made a post in http://stackoverflow.com/questions/28867368/hive-transactions-are-crashing Could anyone check it out and give me some pointers on why things are crashing? Tyvm, Dave

Re: Hive Transactions fail

2015-03-05 Thread Srinivas Thunga
Hi, After seeing your mail, i came to know that you are trying to update and delete operations on Hive 1.0. For doing the same, After extracting Hive version, you have to create Hive meta store

Re: FW: Hive error while starting up services using Ambari

2015-03-05 Thread Srinivas Thunga
Hi, Have you created the Hive Metastore? http://www.cloudera.com/content/cloudera/en/documentation/cdh5/v5-1-x/CDH5-Installation-Guide/cdh5ig_hive_metastore_configure.html and then try to start the server *Thanks Regards,* *Srinivas T* On Thu, Mar 5, 2015 at 2:57 PM, Pratik Gadiya

FW: Hive error while starting up services using Ambari

2015-03-05 Thread Pratik Gadiya
Hi, I am trying to deploy a hadoop cluster using Ambari Blueprint. All the services are up and running except one i.e. Hive Server 2. I tried to look into the logs(/var/log/hive/hiveserver2.log) and looks like Hive is trying to access the MySQL service using username:hive. However, I think it

Fwd: Row exception in Hive while using join

2015-03-05 Thread krish
I got the following exception while executing join on Hive Query and reducer hang after 68% completion. java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row (tag=1) {key:{joinkey0:12},value:{_col2:rs317647905},alias:1} at

Re: Bucket map join - reducers role

2015-03-05 Thread murali parimi
Hello team, I have two tables A and B. A has 360Million rows with one column K. B has around two billion rows with multiple columns including K. Both tables are clustered and sorted by K and Bucketed into same number of buckets. When I perform a join, I assumed there won't be any

Re: Row exception in Hive while using join

2015-03-05 Thread Divakar Reddy
Can you try this script? create table table_llv_N_C as select a.chromosome_number, a.position, b.id from (select * from table_line_n_passed where chromosome_number is not null) a join table_line_c_passed b on a.chromosome_number=b.chromosome_number; On Thu, Mar 5, 2015 at 1:41 PM, Vikram Dixit

Re: Create custom UDF

2015-03-05 Thread Buntu Dev
Is there a pivot/transform function available? I need to pivot the rows to columns without the knowledge of the values. Source table: date | page | count 20150301 | p1 | 10 20150301 | p2 | 20 ... Result table that I would like without the knowledge of the distinct values for