[
https://issues.apache.org/jira/browse/AMBARI-19827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15858740#comment-15858740
]
Swapan Shridhar commented on AMBARI-19827:
------------------------------------------
Following issue was reported after the above commit :
{code}
=============================================================================
Error occured in stack advisor.
Error details: invalid literal for float(): SET_ON_FIRST_INVOCATION
08 Feb 2017 02:24:19,299 INFO [pool-18-thread-1] StackAdvisorRunner:71 -
advisor script stderr: Traceback (most recent call last):
File "/var/lib/ambari-server/resources/scripts/stack_advisor.py", line 166,
in <module>
main(sys.argv)
File "/var/lib/ambari-server/resources/scripts/stack_advisor.py", line 116,
in main
result = stackAdvisor.recommendConfigurations(services, hosts)
File "/var/lib/ambari-server/resources/scripts/../stacks/stack_advisor.py",
line 775, in recommendConfigurations
calculation(configurations, clusterSummary, services, hosts)
File
"/var/lib/ambari-server/resources/scripts/./../stacks/HDP/2.5/services/stack_advisor.py",
line 687, in recommendHIVEConfigurations
super(HDP25StackAdvisor, self).recommendHIVEConfigurations(configurations,
clusterData, services, hosts)
File
"/var/lib/ambari-server/resources/scripts/./../stacks/HDP/2.3/services/stack_advisor.py",
line 222, in recommendHIVEConfigurations
super(HDP23StackAdvisor, self).recommendHIVEConfigurations(configurations,
clusterData, services, hosts)
File
"/var/lib/ambari-server/resources/scripts/./../stacks/HDP/2.2/services/stack_advisor.py",
line 375, in recommendHIVEConfigurations
self.recommendYARNConfigurations(configurations, clusterData, services,
hosts)
File
"/var/lib/ambari-server/resources/scripts/./../stacks/HDP/2.5/services/stack_advisor.py",
line 734, in recommendYARNConfigurations
self.updateLlapConfigs(configurations, services, hosts, LLAP_QUEUE_NAME)
File
"/var/lib/ambari-server/resources/scripts/./../stacks/HDP/2.5/services/stack_advisor.py",
line 910, in updateLlapConfigs
mem_per_thread_for_llap = self.calculate_mem_per_thread_for_llap(services,
yarn_nm_mem_in_mb_normalized, cpu_per_nm_host)
File
"/var/lib/ambari-server/resources/scripts/./../stacks/HDP/2.5/services/stack_advisor.py",
line 1320, in calculate_mem_per_thread_for_llap
hive_tez_container_size = self.get_hive_tez_container_size(services)
File
"/var/lib/ambari-server/resources/scripts/./../stacks/HDP/2.5/services/stack_advisor.py",
line 1347, in get_hive_tez_container_size
hive_container_size = float(hsi_site['hive.tez.container.size'])
ValueError: invalid literal for float(): SET_ON_FIRST_INVOCATION
=============================================================================
{code}
Thus, reverted.
trunk:
{code}
commit c219d357700a781777062442d7112088da1fe388
Author: Swapan Shridhar <[email protected]>
Date: Wed Feb 8 13:38:09 2017 -0800
Revert "AMBARI-19827. HiveServer2 Interactive won't start in clusters with
less memory."
This reverts commit 63b68260817214285267923ed08ee9970affad30.
{code}
branch-2.5:
{code}
commit cb9cd6df5611a739d59e496721243aa8c9198883
Author: Swapan Shridhar <[email protected]>
Date: Wed Feb 8 13:39:25 2017 -0800
Revert "AMBARI-19827. HiveServer2 Interactive won't start in clusters with
less memory."
This reverts commit 868b2a88455957f36cc498b94956e816d9868674.
{code}
> HiveServer2 Interactive won't start in clusters with less memory
> ----------------------------------------------------------------
>
> Key: AMBARI-19827
> URL: https://issues.apache.org/jira/browse/AMBARI-19827
> Project: Ambari
> Issue Type: Bug
> Components: ambari-server
> Affects Versions: 2.5.0
> Reporter: Swapan Shridhar
> Assignee: Swapan Shridhar
> Fix For: trunk, 2.5.0
>
> Attachments: AMBARI-19827.01.patch, AMBARI-19827.patch
>
>
> HS2 Interactive in a 3 node local cluster with 3.5G memory in each node. The
> task fails due to this exception:
> {code:java}
> WARN conf.HiveConf: HiveConf of name hive.llap.daemon.allow.permanent.fns
> does not exist
> WARN conf.HiveConf: HiveConf hive.llap.daemon.vcpus.per.instance expects INT
> type value
> Failed: null
> java.lang.IllegalArgumentException
> at
> java.util.concurrent.ThreadPoolExecutor.<init>(ThreadPoolExecutor.java:1307)
> at
> java.util.concurrent.ThreadPoolExecutor.<init>(ThreadPoolExecutor.java:1230)
> at java.util.concurrent.Executors.newFixedThreadPool(Executors.java:151)
> at
> org.apache.hadoop.hive.llap.cli.LlapServiceDriver.run(LlapServiceDriver.java:197)
> at
> org.apache.hadoop.hive.llap.cli.LlapServiceDriver.main(LlapServiceDriver.java:112)
> INFO cli.LlapServiceDriver: LLAP service driver finished
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
