[jira] [Commented] (AMBARI-21206) Remove Zookeeper as a required service from YARN
[ https://issues.apache.org/jira/browse/AMBARI-21206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16070537#comment-16070537 ] Sumana Sathish commented on AMBARI-21206: - sure .. please commit your patch. I will get back to you if I see the error again > Remove Zookeeper as a required service from YARN > > > Key: AMBARI-21206 > URL: https://issues.apache.org/jira/browse/AMBARI-21206 > Project: Ambari > Issue Type: Improvement > Components: ambari-server >Affects Versions: trunk >Reporter: Tim Thorpe >Assignee: Tim Thorpe > Fix For: trunk > > Attachments: AMBARI-21206.patch > > > YARN has an implicit dependency on ZOOKEEPER. It currently didn't declare an > explicit dependency because HDFS had one. > Enabling the following settings in YARN requires ZOOKEEPER: > * yarn.resourcemanager.recovery.enabled > * yarn.nodemanager.recovery.enabled > * yarn.resourcemanager.ha.enabled > * hadoop.registry.rm.enabled > In addition, these properties are related to ZOOKEEPER and should be empty if > ZOOKEEPER is not installed: > * yarn.resourcemanager.zk-address > * hadoop.registry.zk.quorum -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (AMBARI-21206) Remove Zookeeper as a required service from YARN
[
https://issues.apache.org/jira/browse/AMBARI-21206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069076#comment-16069076
]
Sumana Sathish commented on AMBARI-21206:
-
Hi [~Tim Thorpe]
I was able to start ambari-server properly. But I couldnot find HDP3.0 to
select under 'select hdp version' section.
In ambari-server.log, we saw the following error
{code}
26 Jun 2017 21:36:34,523 ERROR [main] ModuleFileUnmarshaller:141 - Cannot parse
/var/lib/ambari-server/resources/common-services/YARN/3.0.0.3.0/metainfo.xml
26 Jun 2017 21:36:34,524 ERROR [main] ModuleFileUnmarshaller:143 - The prefix
"xsi" for attribute "xsi:type" associated with an element type "condition" is
not bound.
org.xml.sax.SAXParseException; systemId:
file:/var/lib/ambari-server/resources/common-services/YARN/3.0.0.3.0/metainfo.xml;
lineNumber: 84; columnNumber: 54; The prefix "xsi" for attribute "xsi:type"
associated with an element type "condition" is not bound.
at
com.sun.org.apache.xerces.internal.util.ErrorHandlerWrapper.createSAXParseException(ErrorHandlerWrapper.java:203)
at
com.sun.org.apache.xerces.internal.util.ErrorHandlerWrapper.fatalError(ErrorHandlerWrapper.java:177)
at
com.sun.org.apache.xerces.internal.impl.XMLErrorReporter.reportError(XMLErrorReporter.java:400)
at
com.sun.org.apache.xerces.internal.impl.XMLErrorReporter.reportError(XMLErrorReporter.java:327)
at
com.sun.org.apache.xerces.internal.impl.XMLErrorReporter.reportError(XMLErrorReporter.java:284)
at
com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.scanStartElement(XMLNSDocumentScannerImpl.java:308)
at
com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:2784)
at
com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:602)
at
com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:112)
at
com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:505)
at
com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:841)
at
com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:770)
at
com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:141)
at
com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1213)
at
com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:643)
at
com.sun.xml.bind.v2.runtime.unmarshaller.UnmarshallerImpl.unmarshal0(UnmarshallerImpl.java:216)
at
com.sun.xml.bind.v2.runtime.unmarshaller.UnmarshallerImpl.unmarshal(UnmarshallerImpl.java:189)
at
javax.xml.bind.helpers.AbstractUnmarshallerImpl.unmarshal(AbstractUnmarshallerImpl.java:157)
at
javax.xml.bind.helpers.AbstractUnmarshallerImpl.unmarshal(AbstractUnmarshallerImpl.java:162)
at
javax.xml.bind.helpers.AbstractUnmarshallerImpl.unmarshal(AbstractUnmarshallerImpl.java:171)
at
javax.xml.bind.helpers.AbstractUnmarshallerImpl.unmarshal(AbstractUnmarshallerImpl.java:189)
at
org.apache.ambari.server.stack.ModuleFileUnmarshaller.unmarshal(ModuleFileUnmarshaller.java:136)
at
org.apache.ambari.server.stack.ModuleFileUnmarshaller.unmarshal(ModuleFileUnmarshaller.java:81)
at
org.apache.ambari.server.stack.ServiceDirectory.parseMetaInfoFile(ServiceDirectory.java:397)
at
org.apache.ambari.server.stack.ServiceDirectory.parsePath(ServiceDirectory.java:258)
at
org.apache.ambari.server.stack.ServiceDirectory.(ServiceDirectory.java:144)
at
org.apache.ambari.server.stack.CommonServiceDirectory.(CommonServiceDirectory.java:37)
at
org.apache.ambari.server.stack.StackManager.parseCommonServicesDirectory(StackManager.java:575)
at
org.apache.ambari.server.stack.StackManager.parseDirectories(StackManager.java:193)
at
org.apache.ambari.server.stack.StackManager.(StackManager.java:165)
at
org.apache.ambari.server.stack.StackManager$$FastClassByGuice$$33e4ffe0.newInstance()
at
com.google.inject.internal.cglib.reflect.$FastConstructor.newInstance(FastConstructor.java:40)
at
com.google.inject.internal.DefaultConstructionProxyFactory$1.newInstance(DefaultConstructionProxyFactory.java:60)
at
com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:85)
at
com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:254)
at
com.google.inject.internal.InjectorImpl$4$1.call(InjectorImpl.java:978)
at
com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1031)
[jira] [Commented] (AMBARI-21206) Remove Zookeeper as a required service from YARN
[
https://issues.apache.org/jira/browse/AMBARI-21206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063882#comment-16063882
]
Sumana Sathish commented on AMBARI-21206:
-
Hi [~Tim Thorpe],
Can you please revert the change since its breaking ambari-server start where
in ambari wont list HDP3.0 as selectVersion
{code:title=ambari-server.log}
26 Jun 2017 21:36:34,523 ERROR [main] ModuleFileUnmarshaller:141 - Cannot parse
/var/lib/ambari-server/resources/common-services/YARN/3.0.0.3.0/metainfo.xml
26 Jun 2017 21:36:34,524 ERROR [main] ModuleFileUnmarshaller:143 - The prefix
"xsi" for attribute "xsi:type" associated with an element type "condition" is
not bound.
org.xml.sax.SAXParseException; systemId:
file:/var/lib/ambari-server/resources/common-services/YARN/3.0.0.3.0/metainfo.xml;
lineNumber: 84; columnNumber: 54; The prefix "xsi" for attribute "xsi:type"
associated with an element type "condition" is not bound.
at
com.sun.org.apache.xerces.internal.util.ErrorHandlerWrapper.createSAXParseException(ErrorHandlerWrapper.java:203)
at
com.sun.org.apache.xerces.internal.util.ErrorHandlerWrapper.fatalError(ErrorHandlerWrapper.java:177)
at
com.sun.org.apache.xerces.internal.impl.XMLErrorReporter.reportError(XMLErrorReporter.java:400)
at
com.sun.org.apache.xerces.internal.impl.XMLErrorReporter.reportError(XMLErrorReporter.java:327)
at
com.sun.org.apache.xerces.internal.impl.XMLErrorReporter.reportError(XMLErrorReporter.java:284)
at
com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.scanStartElement(XMLNSDocumentScannerImpl.java:308)
at
com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:2784)
at
com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:602)
at
com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:112)
at
com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:505)
at
com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:841)
at
com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:770)
at
com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:141)
at
com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1213)
at
com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:643)
at
com.sun.xml.bind.v2.runtime.unmarshaller.UnmarshallerImpl.unmarshal0(UnmarshallerImpl.java:216)
at
com.sun.xml.bind.v2.runtime.unmarshaller.UnmarshallerImpl.unmarshal(UnmarshallerImpl.java:189)
at
javax.xml.bind.helpers.AbstractUnmarshallerImpl.unmarshal(AbstractUnmarshallerImpl.java:157)
at
javax.xml.bind.helpers.AbstractUnmarshallerImpl.unmarshal(AbstractUnmarshallerImpl.java:162)
at
javax.xml.bind.helpers.AbstractUnmarshallerImpl.unmarshal(AbstractUnmarshallerImpl.java:171)
at
javax.xml.bind.helpers.AbstractUnmarshallerImpl.unmarshal(AbstractUnmarshallerImpl.java:189)
at
org.apache.ambari.server.stack.ModuleFileUnmarshaller.unmarshal(ModuleFileUnmarshaller.java:136)
at
org.apache.ambari.server.stack.ModuleFileUnmarshaller.unmarshal(ModuleFileUnmarshaller.java:81)
at
org.apache.ambari.server.stack.ServiceDirectory.parseMetaInfoFile(ServiceDirectory.java:397)
at
org.apache.ambari.server.stack.ServiceDirectory.parsePath(ServiceDirectory.java:258)
at
org.apache.ambari.server.stack.ServiceDirectory.(ServiceDirectory.java:144)
at
org.apache.ambari.server.stack.CommonServiceDirectory.(CommonServiceDirectory.java:37)
at
org.apache.ambari.server.stack.StackManager.parseCommonServicesDirectory(StackManager.java:575)
at
org.apache.ambari.server.stack.StackManager.parseDirectories(StackManager.java:193)
at
org.apache.ambari.server.stack.StackManager.(StackManager.java:165)
at
org.apache.ambari.server.stack.StackManager$$FastClassByGuice$$33e4ffe0.newInstance()
at
com.google.inject.internal.cglib.reflect.$FastConstructor.newInstance(FastConstructor.java:40)
at
com.google.inject.internal.DefaultConstructionProxyFactory$1.newInstance(DefaultConstructionProxyFactory.java:60)
at
com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:85)
at
com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:254)
at
com.google.inject.internal.InjectorImpl$4$1.call(InjectorImpl.java:978)
at
com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1031)
at
[jira] [Reopened] (AMBARI-21287) Cannot install Datanode/AppTimeLine server from ambari 3.0
[
https://issues.apache.org/jira/browse/AMBARI-21287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sumana Sathish reopened AMBARI-21287:
-
> Cannot install Datanode/AppTimeLine server from ambari 3.0
> --
>
> Key: AMBARI-21287
> URL: https://issues.apache.org/jira/browse/AMBARI-21287
> Project: Ambari
> Issue Type: Bug
> Components: ambari-server
>Affects Versions: 3.0.0
>Reporter: Sumana Sathish
>Assignee: Dmitry Lysnichenko
>Priority: Blocker
> Fix For: 3.0.0
>
> Attachments: AMBARI-21287.patch
>
>
> Fails to install datanode and apptimeline server with the following error
> {code}
> Traceback (most recent call last):
> File
> "/var/lib/ambari-agent/cache/common-services/HDFS/3.0.0.3.0/package/scripts/datanode.py",
> line 120, in
> DataNode().execute()
> File
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
> line 330, in execute
> method(env)
> File
> "/var/lib/ambari-agent/cache/common-services/HDFS/3.0.0.3.0/package/scripts/datanode.py",
> line 49, in install
> self.install_packages(env)
> File
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
> line 740, in install_packages
> retry_count=agent_stack_retry_count)
> File "/usr/lib/python2.6/site-packages/resource_management/core/base.py",
> line 155, in __init__
> self.env.run()
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/environment.py",
> line 160, in run
> self.run_action(resource, action)
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/environment.py",
> line 124, in run_action
> provider_action()
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py",
> line 54, in action_install
> self.install_package(package_name, self.resource.use_repos,
> self.resource.skip_repos)
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/yumrpm.py",
> line 43, in install_package
> if is_upgrade or use_repos or not self._check_existence(name):
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/yumrpm.py",
> line 93, in _check_existence
> return self.yum_check_package_available(name)
> File
> "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py",
> line 150, in yum_check_package_available
> name_regex = re.escape(name).replace("\\?", ".").replace("\\*", ".*") + '$'
> File "/usr/lib64/python2.7/re.py", line 206, in escape
> s = list(pattern)
> TypeError: 'NoneType' object is not iterable
> {code}
> Ambari version
> {code}
> ambari-server --version
> 3.0.0.0-855
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Created] (AMBARI-21173) Not able to start Yarn services after restoring the configs to initial value
Sumana Sathish created AMBARI-21173:
---
Summary: Not able to start Yarn services after restoring the
configs to initial value
Key: AMBARI-21173
URL: https://issues.apache.org/jira/browse/AMBARI-21173
Project: Ambari
Issue Type: Bug
Affects Versions: 3.0.0
Reporter: Sumana Sathish
Priority: Blocker
Fix For: 3.0.0
Change Yarn-site.xml to some custom configs and restart Yarn
Restore it back to the origin config; Restart fails
{Code}
Traceback (most recent call last):
File
"/var/lib/ambari-agent/cache/common-services/YARN/3.0.0.3.0/package/scripts/nodemanager.py",
line 106, in
Nodemanager().execute()
File
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
line 330, in execute
method(env)
File
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
line 835, in restart
self.stop(env, upgrade_type=upgrade_type)
File
"/var/lib/ambari-agent/cache/common-services/YARN/3.0.0.3.0/package/scripts/nodemanager.py",
line 45, in stop
import params
File
"/var/lib/ambari-agent/cache/common-services/YARN/3.0.0.3.0/package/scripts/params.py",
line 29, in
from params_linux import *
File
"/var/lib/ambari-agent/cache/common-services/YARN/3.0.0.3.0/package/scripts/params_linux.py",
line 39, in
import status_params
File
"/var/lib/ambari-agent/cache/common-services/YARN/3.0.0.3.0/package/scripts/status_params.py",
line 46, in
yarn_pid_dir = format("{yarn_pid_dir_prefix}/{yarn_user}")
File
"/usr/lib/python2.6/site-packages/resource_management/libraries/functions/format.py",
line 95, in format
return ConfigurationFormatter().format(format_string, args, **result)
File
"/usr/lib/python2.6/site-packages/resource_management/libraries/functions/format.py",
line 59, in format
result_protected = self.vformat(format_string, args, all_params)
File "/usr/lib64/python2.7/string.py", line 549, in vformat
result = self._vformat(format_string, args, kwargs, used_args, 2)
File "/usr/lib64/python2.7/string.py", line 582, in _vformat
result.append(self.format_field(obj, format_spec))
File "/usr/lib64/python2.7/string.py", line 599, in format_field
return format(value, format_spec)
File
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/config_dictionary.py",
line 73, in __getattr__
raise Fail("Configuration parameter '" + self.name + "' was not found in
configurations dictionary!")
resource_management.core.exceptions.Fail: Configuration parameter 'yarn-env'
was not found in configurations dictionary!
{Code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (AMBARI-21116) Setting yarn.node-labels.fs-store.root-dir to a "path" changes the permission of the "root path"
Sumana Sathish created AMBARI-21116:
---
Summary: Setting yarn.node-labels.fs-store.root-dir to a "path"
changes the permission of the "root path"
Key: AMBARI-21116
URL: https://issues.apache.org/jira/browse/AMBARI-21116
Project: Ambari
Issue Type: Bug
Reporter: Sumana Sathish
Priority: Critical
1. Set the following configs to run nodeLabels test via Ambari Rest Call
{code}
yarnProperties = {'yarn.acl.enable': 'true',
'yarn.node-labels.enabled' : "True",
'yarn.node-labels.fs-store.root-dir':
NODE_LABEL_STORE_DIR,
'yarn.admin.acl': yarn_user + ',' + qa_user}
{code}
where NODE_LABEL_STORE_DIR = "/tmp/node-labels"
2Restart ResourceManager and NodeManagers via ambari
3. After running these commands, /tmp directory's permission changes to
[drwx-- - yarn hadoop] from [drwxrwxrwx - hdfs hadoop] causing
other tests to fail since it cannot access /tmp
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
