[jira] [Commented] (HIVE-8536) Enable SkewJoinResolver for spark [Spark Branch]

2014-12-07 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14237359#comment-14237359 ] Rui Li commented on HIVE-8536: -- Hi [~xuefuz], my uncertainty is mainly about the # map join

[jira] [Commented] (HIVE-8536) Enable SkewJoinResolver for spark [Spark Branch]

2014-12-07 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14237423#comment-14237423 ] Hive QA commented on HIVE-8536: --- {color:red}Overall{color}: -1 at least one tests failed

[jira] [Commented] (HIVE-8536) Enable SkewJoinResolver for spark [Spark Branch]

2014-12-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14237465#comment-14237465 ] Xuefu Zhang commented on HIVE-8536: --- +1 Enable SkewJoinResolver for spark [Spark

[jira] [Commented] (HIVE-8536) Enable SkewJoinResolver for spark [Spark Branch]

2014-12-05 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14236364#comment-14236364 ] Xuefu Zhang commented on HIVE-8536: --- Hi [~lirui], in your original research doc, you

[jira] [Commented] (HIVE-8536) Enable SkewJoinResolver for spark [Spark Branch]

2014-12-04 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14235146#comment-14235146 ] Xuefu Zhang commented on HIVE-8536: --- Hi [~lirui], I think we can disable

[jira] [Commented] (HIVE-8536) Enable SkewJoinResolver for spark [Spark Branch]

2014-12-03 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14233870#comment-14233870 ] Rui Li commented on HIVE-8536: -- The failures and diff in query plan is expected. We can

[jira] [Commented] (HIVE-8536) Enable SkewJoinResolver for spark [Spark Branch]

2014-12-02 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14232500#comment-14232500 ] Szehon Ho commented on HIVE-8536: - Great. +1 pending tests Enable SkewJoinResolver for

[jira] [Commented] (HIVE-8536) Enable SkewJoinResolver for spark [Spark Branch]

2014-12-02 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14232643#comment-14232643 ] Hive QA commented on HIVE-8536: --- {color:red}Overall{color}: -1 at least one tests failed

[jira] [Commented] (HIVE-8536) Enable SkewJoinResolver for spark [Spark Branch]

2014-11-25 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14224179#comment-14224179 ] Szehon Ho commented on HIVE-8536: - I honestly dont know too much about

[jira] [Commented] (HIVE-8536) Enable SkewJoinResolver for spark [Spark Branch]

2014-11-25 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14224182#comment-14224182 ] Rui Li commented on HIVE-8536: -- OK I'll take a look. Enable SkewJoinResolver for spark

[jira] [Commented] (HIVE-8536) Enable SkewJoinResolver for spark [Spark Branch]

2014-11-25 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14224299#comment-14224299 ] Rui Li commented on HIVE-8536: -- It seems the dependency task is created in

[jira] [Commented] (HIVE-8536) Enable SkewJoinResolver for spark [Spark Branch]

2014-11-25 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14224712#comment-14224712 ] Chao commented on HIVE-8536: [~lirui] Yes, I remember dependency task is for multi-insert, so

[jira] [Commented] (HIVE-8536) Enable SkewJoinResolver for spark [Spark Branch]

2014-11-25 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14225565#comment-14225565 ] Rui Li commented on HIVE-8536: -- Hi [~csun] thanks for your input. I'm removing the dependency

[jira] [Commented] (HIVE-8536) Enable SkewJoinResolver for spark [Spark Branch]

2014-11-25 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14225643#comment-14225643 ] Chao commented on HIVE-8536: [~lirui] I couldn't think up a query that has skewjoin AND

[jira] [Commented] (HIVE-8536) Enable SkewJoinResolver for spark [Spark Branch]

2014-11-25 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14225677#comment-14225677 ] Rui Li commented on HIVE-8536: -- Thanks [~csun], I can verify this later. For now, let's stick

[jira] [Commented] (HIVE-8536) Enable SkewJoinResolver for spark [Spark Branch]

2014-11-24 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14222964#comment-14222964 ] Rui Li commented on HIVE-8536: -- With the latest patch, the previous example query plan is:

[jira] [Commented] (HIVE-8536) Enable SkewJoinResolver for spark [Spark Branch]

2014-11-24 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14223025#comment-14223025 ] Hive QA commented on HIVE-8536: --- {color:red}Overall{color}: -1 at least one tests failed

[jira] [Commented] (HIVE-8536) Enable SkewJoinResolver for spark [Spark Branch]

2014-11-24 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14224122#comment-14224122 ] Rui Li commented on HIVE-8536: -- Hi [~szehon], {{skewjoin_noskew}} failed to run because our

[jira] [Commented] (HIVE-8536) Enable SkewJoinResolver for spark [Spark Branch]

2014-11-21 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14220838#comment-14220838 ] Rui Li commented on HIVE-8536: -- {noformat} Listening for transport dt_socket at address: 5005

[jira] [Commented] (HIVE-8536) Enable SkewJoinResolver for spark [Spark Branch]

2014-11-21 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14220915#comment-14220915 ] Hive QA commented on HIVE-8536: --- {color:red}Overall{color}: -1 at least one tests failed

[jira] [Commented] (HIVE-8536) Enable SkewJoinResolver for spark [Spark Branch]

2014-11-21 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14221655#comment-14221655 ] Szehon Ho commented on HIVE-8536: - Great work Rui! Left comments on the review-board.

[jira] [Commented] (HIVE-8536) Enable SkewJoinResolver for spark [Spark Branch]

2014-11-21 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14221696#comment-14221696 ] Rui Li commented on HIVE-8536: -- [~szehon] - thanks for the review! Stage 3 is not split

[jira] [Commented] (HIVE-8536) Enable SkewJoinResolver for spark [Spark Branch]

2014-11-21 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14221716#comment-14221716 ] Szehon Ho commented on HIVE-8536: - Got it. [~csun] may correct me if wrong, but I

[jira] [Commented] (HIVE-8536) Enable SkewJoinResolver for spark [Spark Branch]

2014-11-21 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14221721#comment-14221721 ] Chao commented on HIVE-8536: Hi [~lirui], SparkMapJoinResolver will expect Map 4 to depend on

[jira] [Commented] (HIVE-8536) Enable SkewJoinResolver for spark [Spark Branch]

2014-11-21 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14221726#comment-14221726 ] Rui Li commented on HIVE-8536: -- Got it. Thanks [~csun] for the explanation. Enable