Re: hive window function can only calculate the main table?

2017-10-09 Thread Gopal Vijayaraghavan
> ) t_result where formable = ’t1' … > This sql using 29+ hours in 11 computers cluster within 600G memory. > In my opinion, the time wasting in the `order by sampledate` and `calculate > the table B’s record`. Is there a setting to avoid `table B`’s record not to > get ‘avg_wfoy_b2’ column,

hive window function can only calculate the main table?

2017-10-09 Thread newbegin2020
Hi all, I am using hive(1.2.0) on spark(1.6.0). These days I met a problem that is window function waste too much time: I have table `A` has 3 columns 5 million lines and table `B` has 10 columns and 3 billion lines 嵐, my hql like: ``` select *, … ( select id, sampledate, max(b1) over wf7 as