[jira] [Updated] (HIVE-20592) hive on spark - got a weird output when count(*) from this script
[ https://issues.apache.org/jira/browse/HIVE-20592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gu Yuchen updated HIVE-20592: - Description: use hiveContext to exec a script below: with nt as (select label, score from (select * from (select label, score, row_number() over (order by score desc) as position from t1)t_1 join (select count(*) as countall from t1)t_2 )ta where position <= countall * 0.4) select count(*) as c_positive from nt where label = 1 and i got this result. !jira.png! it is weird when call the 'count()' func on rdd and dataframe, as the pic says: different output here can someone help me out? thanks a lot PS: the parquet file i used is the 'test.gz.parquet' in Attachments. was: use hiveContext to exec a script below: with nt as (select label, score from (select * from (select label, score, row_number() over (order by score desc) as position from t1)t_1 join (select count(*) as countall from t1)t_2 )ta where position <= countall * 0.4) select count(*) as c_positive from nt where label = 1 and i got this result. !jira.png! it is weird when call the 'count()' func on rdd and dataframe, as the pic says: different output here can someone help me out? thanks a lot > hive on spark - got a weird output when count(*) from this script > -- > > Key: HIVE-20592 > URL: https://issues.apache.org/jira/browse/HIVE-20592 > Project: Hive > Issue Type: Bug > Environment: spark 1.6.1 > hive 1.2.2 > hadoop 2.7.1 >Reporter: Gu Yuchen >Priority: Major > Attachments: jira.png, test.gz.parquet > > > > use hiveContext to exec a script below: > with nt as (select label, score from (select * from (select label, score, > row_number() over (order by score desc) as position from t1)t_1 join (select > count(*) as countall from t1)t_2 )ta where position <= countall * 0.4) select > count(*) as c_positive from nt where label = 1 > and i got this result. > !jira.png! > it is weird when call the 'count()' func on rdd and dataframe, > as the pic says: different output here > can someone help me out? thanks a lot > > PS: the parquet file i used is the 'test.gz.parquet' in Attachments. > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-20592) hive on spark - got a weird output when count(*) from this script
[ https://issues.apache.org/jira/browse/HIVE-20592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gu Yuchen updated HIVE-20592: - Description: use hiveContext to exec a script below: with nt as (select label, score from (select * from (select label, score, row_number() over (order by score desc) as position from t1)t_1 join (select count(*) as countall from t1)t_2 )ta where position <= countall * 0.4) select count(*) as c_positive from nt where label = 1 and i got this result. !jira.png! it is weird when call the 'count()' func on rdd and dataframe, as the pic says: different output here can someone help me out? thanks a lot was: use hiveContext to exec a script blew: with nt as (select label, score from (select * from (select label, score, row_number() over (order by score desc) as position from t1)t_1 join (select count(*) as countall from t1)t_2 )ta where position <= countall * 0.4) select count(*) as c_positive from nt where label = 1 and i got this result. !jira.png! it is weird when call the 'count()' func on rdd and dataframe, as the pic says: different output here can someone help me out? thanks a lot > hive on spark - got a weird output when count(*) from this script > -- > > Key: HIVE-20592 > URL: https://issues.apache.org/jira/browse/HIVE-20592 > Project: Hive > Issue Type: Bug > Environment: spark 1.6.1 > hive 1.2.2 > hadoop 2.7.1 >Reporter: Gu Yuchen >Priority: Major > Attachments: jira.png, test.gz.parquet > > > > use hiveContext to exec a script below: > with nt as (select label, score from (select * from (select label, score, > row_number() over (order by score desc) as position from t1)t_1 join (select > count(*) as countall from t1)t_2 )ta where position <= countall * 0.4) select > count(*) as c_positive from nt where label = 1 > and i got this result. > !jira.png! > it is weird when call the 'count()' func on rdd and dataframe, > as the pic says: different output here > can someone help me out? thanks a lot > > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-20592) hive on spark - got a weird output when count(*) from this script
[ https://issues.apache.org/jira/browse/HIVE-20592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gu Yuchen updated HIVE-20592: - Attachment: test.gz.parquet > hive on spark - got a weird output when count(*) from this script > -- > > Key: HIVE-20592 > URL: https://issues.apache.org/jira/browse/HIVE-20592 > Project: Hive > Issue Type: Bug > Environment: spark 1.6.1 > hive 1.2.2 > hadoop 2.7.1 >Reporter: Gu Yuchen >Priority: Major > Attachments: jira.png, test.gz.parquet > > > > use hiveContext to exec a script below: > with nt as (select label, score from (select * from (select label, score, > row_number() over (order by score desc) as position from t1)t_1 join (select > count(*) as countall from t1)t_2 )ta where position <= countall * 0.4) select > count(*) as c_positive from nt where label = 1 > and i got this result. > !jira.png! > it is weird when call the 'count()' func on rdd and dataframe, > as the pic says: different output here > can someone help me out? thanks a lot > > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
