[jira] [Commented] (HIVE-7624) Reduce operator initialization failed when running multiple MR query on spark

2014-08-18 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14100358#comment-14100358 ] Hive QA commented on HIVE-7624: --- {color:red}Overall{color}: -1 at least one tests failed

[jira] [Commented] (HIVE-7624) Reduce operator initialization failed when running multiple MR query on spark

2014-08-18 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14100769#comment-14100769 ] Brock Noland commented on HIVE-7624: Hi Rui, Hive generally follows one commit = one

[jira] [Commented] (HIVE-7624) Reduce operator initialization failed when running multiple MR query on spark

2014-08-18 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101680#comment-14101680 ] Rui Li commented on HIVE-7624: -- [~brocknoland] Got it, thanks! Reduce operator

[jira] [Commented] (HIVE-7624) Reduce operator initialization failed when running multiple MR query on spark

2014-08-12 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14093796#comment-14093796 ] Rui Li commented on HIVE-7624: -- Thanks for the review : -) Reduce operator initialization

[jira] [Commented] (HIVE-7624) Reduce operator initialization failed when running multiple MR query on spark

2014-08-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14092606#comment-14092606 ] Hive QA commented on HIVE-7624: --- {color:red}Overall{color}: -1 no tests executed Here are

[jira] [Commented] (HIVE-7624) Reduce operator initialization failed when running multiple MR query on spark

2014-08-11 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14092900#comment-14092900 ] Brock Noland commented on HIVE-7624: Nice work!! bq. The patch does not appear to

[jira] [Commented] (HIVE-7624) Reduce operator initialization failed when running multiple MR query on spark

2014-08-11 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14093614#comment-14093614 ] Szehon Ho commented on HIVE-7624: - +1 for latest version Reduce operator initialization

[jira] [Commented] (HIVE-7624) Reduce operator initialization failed when running multiple MR query on spark

2014-08-11 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14093618#comment-14093618 ] Rui Li commented on HIVE-7624: -- Hi [~brocknoland], [~szehon] I'll rebase the patch. Reduce

[jira] [Commented] (HIVE-7624) Reduce operator initialization failed when running multiple MR query on spark

2014-08-11 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14093638#comment-14093638 ] Szehon Ho commented on HIVE-7624: - Oh I thought the last version on RB was already rebased.

[jira] [Commented] (HIVE-7624) Reduce operator initialization failed when running multiple MR query on spark

2014-08-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14093770#comment-14093770 ] Hive QA commented on HIVE-7624: --- {color:red}Overall{color}: -1 at least one tests failed

[jira] [Commented] (HIVE-7624) Reduce operator initialization failed when running multiple MR query on spark

2014-08-11 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14093774#comment-14093774 ] Szehon Ho commented on HIVE-7624: - udaf_context_ngrams is a strange failure, never seen it

[jira] [Commented] (HIVE-7624) Reduce operator initialization failed when running multiple MR query on spark

2014-08-08 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090452#comment-14090452 ] Rui Li commented on HIVE-7624: -- Finally I found this is because we don't set output collector

[jira] [Commented] (HIVE-7624) Reduce operator initialization failed when running multiple MR query on spark

2014-08-08 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090509#comment-14090509 ] Rui Li commented on HIVE-7624: -- Some change may bypass HIVE-7597. Remove it. Reduce operator

[jira] [Commented] (HIVE-7624) Reduce operator initialization failed when running multiple MR query on spark

2014-08-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090525#comment-14090525 ] Hive QA commented on HIVE-7624: --- {color:red}Overall{color}: -1 at least one tests failed

[jira] [Commented] (HIVE-7624) Reduce operator initialization failed when running multiple MR query on spark

2014-08-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090689#comment-14090689 ] Hive QA commented on HIVE-7624: --- {color:red}Overall{color}: -1 at least one tests failed

[jira] [Commented] (HIVE-7624) Reduce operator initialization failed when running multiple MR query on spark

2014-08-08 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14091198#comment-14091198 ] Szehon Ho commented on HIVE-7624: - Hi Li Rui, I think the patch looks reasonable. Just had

[jira] [Commented] (HIVE-7624) Reduce operator initialization failed when running multiple MR query on spark

2014-08-07 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14088993#comment-14088993 ] Chao commented on HIVE-7624: Hi [~ruili], I spent sometime looking at this bug today. What I

[jira] [Commented] (HIVE-7624) Reduce operator initialization failed when running multiple MR query on spark

2014-08-07 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089001#comment-14089001 ] Rui Li commented on HIVE-7624: -- Thanks very much [~csun]. After some debugging, I found this

[jira] [Commented] (HIVE-7624) Reduce operator initialization failed when running multiple MR query on spark

2014-08-07 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089181#comment-14089181 ] Rui Li commented on HIVE-7624: -- This patch solves the reducesinkkey0 problem. Map work and

[jira] [Commented] (HIVE-7624) Reduce operator initialization failed when running multiple MR query on spark

2014-08-07 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089455#comment-14089455 ] Chao commented on HIVE-7624: Great! Thanks [~ruili]. I'll try this patch. Reduce operator

[jira] [Commented] (HIVE-7624) Reduce operator initialization failed when running multiple MR query on spark

2014-08-07 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089459#comment-14089459 ] Brock Noland commented on HIVE-7624: During debugging I have used the code below

[jira] [Commented] (HIVE-7624) Reduce operator initialization failed when running multiple MR query on spark

2014-08-07 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089555#comment-14089555 ] Chao commented on HIVE-7624: Hi [~ruili], I think this patch overlaps a little bit with

[jira] [Commented] (HIVE-7624) Reduce operator initialization failed when running multiple MR query on spark

2014-08-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089922#comment-14089922 ] Xuefu Zhang commented on HIVE-7624: --- {quote} However, no result is returned. I checked

[jira] [Commented] (HIVE-7624) Reduce operator initialization failed when running multiple MR query on spark

2014-08-07 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090010#comment-14090010 ] Chao commented on HIVE-7624: sorry should be order by in my last comment. Reduce operator

[jira] [Commented] (HIVE-7624) Reduce operator initialization failed when running multiple MR query on spark

2014-08-07 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090009#comment-14090009 ] Chao commented on HIVE-7624: With this patch and HIVE-7492 plus HIVE-7652, group by + reduce by

[jira] [Commented] (HIVE-7624) Reduce operator initialization failed when running multiple MR query on spark

2014-08-07 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090152#comment-14090152 ] Rui Li commented on HIVE-7624: -- [~xuefuz] currently the second R does end with a ReduceSink.

[jira] [Commented] (HIVE-7624) Reduce operator initialization failed when running multiple MR query on spark

2014-08-07 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090261#comment-14090261 ] Rui Li commented on HIVE-7624: -- Hi [~csun] I updated the patch based on latest code. But the

Re: [jira] [Commented] (HIVE-7624) Reduce operator initialization failed when running multiple MR query on spark

2014-08-06 Thread Xuefu Zhang
Another thing to watch is HiveConf's thread safety. I see it uses many static variables, but not sure if this the cause. On Tue, Aug 5, 2014 at 10:39 PM, Chao (JIRA) j...@apache.org wrote: [

[jira] [Commented] (HIVE-7624) Reduce operator initialization failed when running multiple MR query on spark

2014-08-05 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14087264#comment-14087264 ] Brock Noland commented on HIVE-7624: [~lirui] In our sync-up you mentioned overwriting

[jira] [Commented] (HIVE-7624) Reduce operator initialization failed when running multiple MR query on spark

2014-08-05 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14087272#comment-14087272 ] Rui Li commented on HIVE-7624: -- Thanks [~brocknoland] let me try this. Reduce operator

[jira] [Commented] (HIVE-7624) Reduce operator initialization failed when running multiple MR query on spark

2014-08-05 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14087281#comment-14087281 ] Chao commented on HIVE-7624: Hi [~brocknoland] and [~lirui], I tried cloning new jobConf today,