[jira] [Commented] (HIVE-17114) HoS: Possible skew in shuffling when data is not really skewed

2017-07-21 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096570#comment-16096570 ] Chao Sun commented on HIVE-17114: - Looks good. +1. > HoS: Possible skew in shuffling when data is not

[jira] [Commented] (HIVE-17114) HoS: Possible skew in shuffling when data is not really skewed

2017-07-20 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095761#comment-16095761 ] Rui Li commented on HIVE-17114: --- Latest failures not related. > HoS: Possible skew in shuffling when data

[jira] [Commented] (HIVE-17114) HoS: Possible skew in shuffling when data is not really skewed

2017-07-20 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094640#comment-16094640 ] Hive QA commented on HIVE-17114: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17114) HoS: Possible skew in shuffling when data is not really skewed

2017-07-20 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094588#comment-16094588 ] Rui Li commented on HIVE-17114: --- {{constprog_semijoin}} needs sorting query results. Other failures are not

[jira] [Commented] (HIVE-17114) HoS: Possible skew in shuffling when data is not really skewed

2017-07-20 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094516#comment-16094516 ] Hive QA commented on HIVE-17114: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17114) HoS: Possible skew in shuffling when data is not really skewed

2017-07-20 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094384#comment-16094384 ] liyunzhang_intel commented on HIVE-17114: - [~lirui]: {quote} It happens when the data has the

[jira] [Commented] (HIVE-17114) HoS: Possible skew in shuffling when data is not really skewed

2017-07-20 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094381#comment-16094381 ] Rui Li commented on HIVE-17114: --- [~gopalv], thanks for your input. Since HIVE-7074 is superseded by

[jira] [Commented] (HIVE-17114) HoS: Possible skew in shuffling when data is not really skewed

2017-07-20 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094329#comment-16094329 ] liyunzhang_intel commented on HIVE-17114: - [~lirui]: thanks for your explanation, but i also want

[jira] [Commented] (HIVE-17114) HoS: Possible skew in shuffling when data is not really skewed

2017-07-19 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093563#comment-16093563 ] Gopal V commented on HIVE-17114: Yes, the bucketed table fix was taken out of that patch and parked in

[jira] [Commented] (HIVE-17114) HoS: Possible skew in shuffling when data is not really skewed

2017-07-19 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16092860#comment-16092860 ] Rui Li commented on HIVE-17114: --- Hi [~kellyzly], 1. It's spark code. You can look at {{HashPartitioner}}

[jira] [Commented] (HIVE-17114) HoS: Possible skew in shuffling when data is not really skewed

2017-07-19 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16092780#comment-16092780 ] liyunzhang_intel commented on HIVE-17114: - [~lirui]: several questions: 1.{quote} Spark decides

[jira] [Commented] (HIVE-17114) HoS: Possible skew in shuffling when data is not really skewed

2017-07-19 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16092647#comment-16092647 ] Rui Li commented on HIVE-17114: --- Hi [~kellyzly], I have an example in the description. Basically, Spark

[jira] [Commented] (HIVE-17114) HoS: Possible skew in shuffling when data is not really skewed

2017-07-18 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16092577#comment-16092577 ] Hive QA commented on HIVE-17114: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17114) HoS: Possible skew in shuffling when data is not really skewed

2017-07-18 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16092529#comment-16092529 ] liyunzhang_intel commented on HIVE-17114: - [~lirui]: can you provide detail example to explain the

[jira] [Commented] (HIVE-17114) HoS: Possible skew in shuffling when data is not really skewed

2017-07-17 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091054#comment-16091054 ] Rui Li commented on HIVE-17114: --- Hi [~gopalv], thanks for pointing me to the ReducerTraits. I'll see what I

[jira] [Commented] (HIVE-17114) HoS: Possible skew in shuffling when data is not really skewed

2017-07-17 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091039#comment-16091039 ] Gopal V commented on HIVE-17114: [~lirui]: Changing the ObjectInspectorUtils.hashCode() implementation