[
https://issues.apache.org/jira/browse/AMBARI-26305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Basapuram Kumar updated AMBARI-26305:
-------------------------------------
Attachment: image-2025-02-04-19-33-17-226.png
> Hive Metastore Initialization Fails Due to error in initialization of VM
> ------------------------------------------------------------------------
>
> Key: AMBARI-26305
> URL: https://issues.apache.org/jira/browse/AMBARI-26305
> Project: Ambari
> Issue Type: Improvement
> Components: ambari-sever
> Affects Versions: 2.7.8
> Reporter: Basapuram Kumar
> Priority: Major
> Attachments: image-2025-02-04-19-28-39-283.png,
> image-2025-02-04-19-29-15-338.png, image-2025-02-04-19-33-17-226.png
>
>
> Hive Metastore initialization failed with the below error.
> error
>
> {noformat}
> resource_management.core.exceptions.ExecutionFailed: Execution of 'export
> HIVE_CONF_DIR=/usr/odp/current/hive-metastore/conf/ ;
> /usr/odp/current/hive-server2/bin/schematool -initSchema -dbType mysql
> -userName hive -passWord [PROTECTED] -verbose' returned 1. Error occurred
> during initialization of VM Initial heap size set to a larger value than the
> maximum heap size stdout:{noformat}
>
>
> Complete stack-trace
>
> {noformat}
> the following exception:Traceback (most recent call last):
> File
> "/var/lib/ambari-agent/cache/stacks/ODP/3.3/services/HIVE/package/scripts/hive_metastore.py",
> line 201, in
> HiveMetastore().execute()
> File
> "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py",
> line 351, in execute
> method(env)
> File
> "/var/lib/ambari-agent/cache/stacks/ODP/3.3/services/HIVE/package/scripts/hive_metastore.py",
> line 61, in start
> create_metastore_schema() # execute without config lock
> ^^^^^^^^^^^^^^^^^^^^^^^^^
> File
> "/var/lib/ambari-agent/cache/stacks/ODP/3.3/services/HIVE/package/scripts/hive.py",
> line 448, in create_metastore_schema
> Execute(create_schema_cmd,
> File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line
> 164, in __init__
> self.env.run()
> File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py",
> line 163, in run
> self.run_action(resource, action)
> File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py",
> line 127, in run_action
> provider_action()
> File
> "/usr/lib/ambari-agent/lib/resource_management/core/providers/system.py",
> line 253, in action_run
> shell.checked_call(self.resource.command,
> logoutput=self.resource.logoutput,
> File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line
> 73, in inner
> result = function(command, **kwargs)
> ^^^^^^^^^^^^^^^^^^^^^^^^^^^
> File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line
> 100, in checked_call
> return _call_wrapper(command, logoutput=logoutput, throw_on_failure=True,
> stdout=stdout, stderr=stderr,
>
> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
> File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line
> 151, in _call_wrapper
> result = _call(command, **kwargs_copy)
> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
> File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line
> 315, in _call
> raise ExecutionFailed(err_msg, code, out, err)
> resource_management.core.exceptions.ExecutionFailed: Execution of 'export
> HIVE_CONF_DIR=/usr/odp/current/hive-metastore/conf/ ;
> /usr/odp/current/hive-server2/bin/schematool -initSchema -dbType mysql
> -userName hive -passWord [PROTECTED] -verbose' returned 1. Error occurred
> during initialization of VM
> Initial heap size set to a larger value than the maximum heap size
> stdout:{noformat}
>
>
> When checked on other hadoop services, it started with both min and max heap
> sizes( Xms and Xmx).
> For example:
> +*For Namenode*+
>
> {noformat}
> /usr/lib/jvm/java-11-openjdk/bin/java
> ..
> ..
> -Xms2048m -Xmx2048m
> ..
> ..
> org.apache.hadoop.hdfs.server.namenode.NameNode{noformat}
> For ResourceManager
>
> {{}}
> {noformat}
> /usr/lib/jvm/java-11-openjdk/bin/java
> ..
> ..
> -Xmx1024m -Xms1024m
> ..
> ..
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager{noformat}
> {{}}
> For NodeManager
> {noformat}
> /usr/lib/jvm/java-11-openjdk/bin/java -Dproc_nodemanager
> ..
> ..
> -Xmx1024m -Xms1024m
> ..
> ..
> org.apache.hadoop.yarn.server.nodemanager.NodeManager{noformat}
> {{}}
> For habse Region Server
>
> {{}}
> {noformat}
> /usr/lib/jvm/java-11-openjdk/bin/java
> ..
> ..
> -Xms3276m -Xmx3276m
> ..
> ..
> org.apache.hadoop.hbase.regionserver.HRegionServer start{noformat}
> {{}}
> So suggesting to set the similar way for hive services as well.
>
> Currently is setting only Xmx value as mentioned
> [here|https://github.com/apache/ambari/blob/ebf95d0d4b4634f8e2b4592857b291d5dd81c6ce/ambari-server/src/main/resources/stacks/BIGTOP/3.2.0/services/HIVE/configuration/hive-env.xml#L391C1-L392C1]
>
> {noformat}
> export HADOOP_CLIENT_OPTS="$HADOOP_CLIENT_OPTS
> -Xmx${HADOOP_HEAPSIZE}m"{noformat}
> Altering to
> {noformat}
> export HADOOP_CLIENT_OPTS="$HADOOP_CLIENT_OPTS -Xms${HADOOP_HEAPSIZE}m
> -Xmx${HADOOP_HEAPSIZE}m"{noformat}
>
> With the above suggested changes, the service start and running fine.
>
> !image-2025-02-04-19-28-39-283.png!
>
> The heap values are set from ambari as shown ambari.
> !image-2025-02-04-19-29-15-338.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
