Get arguments' names in Hive's UDF

2013-07-21 Thread Felix .
Hi all, Is there any api to retrieve the parameter's column name in GenericUDF? For example: Select UDFTEST(columnA,columnB) from test; I want to get the column names("columnA" and "columnB") in UDFTEST's initialize function via ObjectInspector but I did not find any viable solution.

Possible to specify reducers for each stage?

2013-07-02 Thread Felix .
Hi all, Is it possible to specify reducer number for each stage ? how? thanks!

Re: Performance difference between tuning reducer num and partition table

2013-06-30 Thread Felix .
t; overhead could matter. Another clue is the size of the files the first run > produced, i.e., do you have 30 small (much less than a block size) files? > > On Sat, Jun 29, 2013 at 12:27 AM, Felix.徐 wrote: > >> Hi Stephen, >> >> My query is actually more complex , hiv

Re: Performance difference between tuning reducer num and partition table

2013-06-28 Thread Felix .
t; your cluster for these two scenarios? I'd be curious if there are the > same. > > > > > On Fri, Jun 28, 2013 at 8:40 AM, Felix.徐 wrote: > >> Hi all, >> >> Here is the scenario, suppose I have 2 tables A and B, I would like to >> perform a simp

Performance difference between tuning reducer num and partition table

2013-06-28 Thread Felix .
Hi all, Here is the scenario, suppose I have 2 tables A and B, I would like to perform a simple join on them, We can do it like this: INSERT OVERWRITE TABLE C SELECT FROM A JOIN B on A.id=B.id In order to speed up this query since table A and B have lots of data, another approach is : Say

Re: Overwrite by selected data from table itself?

2013-05-29 Thread Felix .
I've done in this way many times , there must be some errors in your script , you may paste your script here. 2013/5/30 Stephen Sprague > i think it's a clever idea. Can you reproduce this behavior via a simple > example and show it here? I ran a test on hive 0.80 and it worked as you > wou

How to change the separator of INSERT OVERWRITE LOCAL DIRECTORY

2013-05-29 Thread Felix .
Hi all, I am wondering how to change the fields separator of INSERT OVERWRITE LOCAL DIRECTORY , does anyone have experience doing this ? thanks!

Re: How to change the separator of input reocrd in TRANSFORM of Hive

2013-05-23 Thread Felix .
Oh sorry , I find the solution on wiki: https://cwiki.apache.org/Hive/languagemanual-transform.html by specifying the inrowformat and outrowformat . 2013/5/24 Felix.徐 > Hi all, > > I am trying to use Transform in Hive, but I do not find a way to change > the separator between fie

How to change the separator of input reocrd in TRANSFORM of Hive

2013-05-23 Thread Felix .
Hi all, I am trying to use Transform in Hive, but I do not find a way to change the separator between fields of input records in Transform. I create a table A by specify ROW FORMAT DELIMITED FIELDS TERMINATED BY '\0' However, while using SELECT TRANSFORM(id,name) USING 'python script.py' AS (id,

Bugs exist in SEMI JOIN?

2012-11-21 Thread Felix .
Hi, I am using the version 0.9.0 and my tables are the same with TPC-H benchmark: Here is a simple query(works correctly): *Q1* INSERT OVERWRITE TABLE customer_orders_statistics SELECT C_CUSTKEY FROM CUSTOMER LEFT SEMI JOIN( SELECT O_CUSTKEY FROM ORDERS WHERE unix_timestamp(O_ORDERDATE, '

What is the rule of job name generation in Hive?

2012-03-22 Thread Felix .
Hi,all..I find that the job names of Hive are like this " INSERT OVERWRITE TABLE u...userID,neighborid(Stage-4) " What is the rule of generating such a name?

Re: How to get job names and stages of a query?

2012-03-20 Thread Felix .
nks, > Manish > Sent from my BlackBerry, pls excuse typo > ------ > *From: * Felix.徐 > *Date: *Tue, 20 Mar 2012 12:58:53 +0800 > *To: * > *ReplyTo: * user@hive.apache.org > *Subject: *How to get job names and stages of a query? > > Hi,all > I

How to track query status in hive via thrift or anything else?

2012-03-14 Thread Felix .
Hi,all .. I didn't find any helpful api in ThriftHive that can track the execution status of hive(or job progress).I want to get execution progress of queries from hive?How to do that?Thanks!

Re: Is it possible to get the progress of a query through thrift server?

2012-03-12 Thread Felix .
Can you provide some references? Thanks very much! 在 2012年3月12日 下午11:28,Edward Capriolo 写道: > Yes. You have access to the job counters through thrift, as well as a > method to test if query is done. > > Edward > > On Mon, Mar 12, 2012 at 11:12 AM, Felix.徐 wrote: > > Hi

Is it possible to get the progress of a query through thrift server?

2012-03-12 Thread Felix .
Hi all, I want to build a website to monitor the execution of queries sent to hive , is there any way to realize it?

Re: Showing wrong count after importing table in Hive

2012-02-08 Thread Felix .
Hi, I meet the same problem once, then I change the amount of imported columns it works fine. Sometimes blank rows would be generated by sqoop..I do not actually know what the problem really is.. 2012/2/9 Bhavesh Shah > > > > >Hello All, > > I have imported near about 10 tables in Hive from