hive2.1.0 one partition has two locations

2016-12-21 Thread 徐 鹏
Hi all: HQL: Alter table OperatingStat_R_View Add IF NOT EXISTS partition(YEAR=2016,MONTH=12,DAY=04) LOCATION '/data/ApplicationDep/TCRecSys_ApplyData/OperatingStat/Report/View/2016/12/04'; INSERT OVERWRITE TABLE TCRecSys_ApplyData.OperatingStat_R_View PARTITION (YEAR=2016,MONTH=12,DAY=04)

Re: Can Beeline handle HTTP redirect?

2016-12-21 Thread Takashi Sakairi
Hi, I want to know whether Beeline can handle HTTP redirect or not. I was wondering if some of Beeline experts can answer my question? Cheers, Takashi From: Takashi Sakairi/Japan/IBM@IBMJP To: user@hive.apache.org Date: 2016/12/12 18:18 Subject:Can Beeline handle HTTP

Re: Maintaining big and complex Hive queries

2016-12-21 Thread Edward Capriolo
I have been contemplating attaching meta data for the query lineage to each table such that I can know where the data came from and have a 1 click regenerate button. On Wed, Dec 21, 2016 at 3:02 PM, Stephen Sprague wrote: > my 2 cents. :) > > as soon as you say "complex

Re: Maintaining big and complex Hive queries

2016-12-21 Thread Stephen Sprague
my 2 cents. :) as soon as you say "complex query" i would submit you've lost the upperhand and you're behind the eight-ball right off the bat. And you know this too otherwise you wouldn't have posted here. ha! i use cascading CTAS statements so that i can examine the intermediate tables.

Re: Maintaining big and complex Hive queries

2016-12-21 Thread Saumitra Shahapure
Hi Elliot, Thanks for letting me know. HPL-SQL sounded particularly interesting. But in the documentation I could not see any way to pass output generated by one Hive query to the next one. The tool looks good as a homogeneous PL-SQL platform for multiple big-data systems

Re: Hive statistics

2016-12-21 Thread Chao Sun
Hi Rob, (I'm not a Hive stats expert so please take my words with a grain of salt) Do you mean distinct keys in aggregations? From what I can see Hive uses column stats (which include the # of distinct values for each column) from each source table involved in a query, and populate the stats for

Re: Hive statistics

2016-12-21 Thread Haas, Nichole
Hi Rob, I am not a developer, but I can tell you that to generate such statistics, we had an intern work in spark all last summer. So, I don’t think it is built into hive. Hope this helps you, ~Nikki From: Robert Grandl Reply-To: "user@hive.apache.org"

Re: Hive statistics

2016-12-21 Thread Robert Grandl
Hi guys, I am wondering. Is there any other mailing list for hive related questions? I feel there is not much activity on the user/dev hive mailing lists or at least not much support in answering my questions. Thanks,Robert On Tuesday, December 20, 2016 11:01 PM, Robert Grandl