[jira] [Commented] (HIVE-17270) Qtest results show wrong number of executors

2017-08-10 Thread Peter Vary (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121768#comment-16121768 ] Peter Vary commented on HIVE-17270: --- Thanks [~lirui] for the pointers. Based on that i was able to

[jira] [Commented] (HIVE-17270) Qtest results show wrong number of executors

2017-08-09 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121020#comment-16121020 ] Rui Li commented on HIVE-17270: --- Hi [~pvary], I don't understand why 1 NM means we can only have 1 executor.

[jira] [Commented] (HIVE-17270) Qtest results show wrong number of executors

2017-08-09 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120310#comment-16120310 ] Xuefu Zhang commented on HIVE-17270: Thanks for the investigation, [~pvary]. Auto determining the

[jira] [Commented] (HIVE-17270) Qtest results show wrong number of executors

2017-08-09 Thread Peter Vary (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120039#comment-16120039 ] Peter Vary commented on HIVE-17270: --- Ok, I think I understand now what is happening. When running

[jira] [Commented] (HIVE-17270) Qtest results show wrong number of executors

2017-08-08 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119244#comment-16119244 ] Rui Li commented on HIVE-17270: --- When automatically deciding numReducers, it should be no less than

[jira] [Commented] (HIVE-17270) Qtest results show wrong number of executors

2017-08-08 Thread Peter Vary (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118850#comment-16118850 ] Peter Vary commented on HIVE-17270: --- {code:title=SparkSessionImpl} @Override public ObjectPair

[jira] [Commented] (HIVE-17270) Qtest results show wrong number of executors

2017-08-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118797#comment-16118797 ] Xuefu Zhang commented on HIVE-17270: 1. The number of executors could be a matter of MiniSparkOnYarn

[jira] [Commented] (HIVE-17270) Qtest results show wrong number of executors

2017-08-08 Thread Peter Vary (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118723#comment-16118723 ] Peter Vary commented on HIVE-17270: --- ??I'm not sure why the MiniSparkOnYarn cluster shows only 1

[jira] [Commented] (HIVE-17270) Qtest results show wrong number of executors

2017-08-08 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118672#comment-16118672 ] Sahil Takiar commented on HIVE-17270: - I'm not sure why the MiniSparkOnYarn cluster shows only 1

[jira] [Commented] (HIVE-17270) Qtest results show wrong number of executors

2017-08-08 Thread Peter Vary (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118561#comment-16118561 ] Peter Vary commented on HIVE-17270: --- Also the number of reducers shown in the golden files are 2, and