Re: Operating System matching redhat7 could not be found
I use centos7.4: $ cat /etc/redhat-release CentOS Linux release 7.4.1708 (Core) From: "David Quiroga" To: "user" Sent: Saturday, May 19, 2018 4:08:37 AM Subject: Re: Operating System matching redhat7 could not be found What is the output of cat /etc/*release on the hosts. I know the code has to map values to the 'redhat7' On Fri, May 18, 2018 at 7:08 AM, < xiang@sky-data.cn > wrote: I define a stack called SKY, and my repo.xml is as below: http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.0.3 SKY-3.0 SKY true http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos7 SKY-UTILS-1.1.0.21 SKY-UTILS false I use centos7 to test, i really do not know how to fix it. Could someone help me? Thanks From: "David Quiroga" < quirogadf4w...@gmail.com > To: "user" < user@ambari.apache.org > Sent: Friday, May 18, 2018 1:29:13 AM Subject: Re: Operating System matching redhat7 could not be found "At least one set of repositories for OS should be provided" I would take a look in Ambari under Admin > Stacks and Versions > Versions Tab For the current version "Show Details", click Edit button this should list the OS and repositories. Are those valid from the host you are now running on? On Thu, May 17, 2018 at 7:38 AM, < xiang@sky-data.cn > wrote: BQ_BEGIN True error maybe as below: 17 May 2018 20:33:46,103 ERROR [ambari-client-thread-78] AbstractResourceProvider:343 - Caught AmbariException when modifying a resource org.apache.ambari.server.AmbariException: At least one set of repositories for OS should be provided at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider.validateRepositoryVersion(RepositoryVersionResourceProvider.java:490) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider.validateRepositoryVersion(RepositoryVersionResourceProvider.java:439) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$2.invoke(RepositoryVersionResourceProvider.java:356) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$2.invoke(RepositoryVersionResourceProvider.java:316) at org.apache.ambari.server.controller.internal.AbstractResourceProvider.invokeWithRetry(AbstractResourceProvider.java:455) at org.apache.ambari.server.controller.internal.AbstractResourceProvider.modifyResources(AbstractResourceProvider.java:336) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider.updateResourcesAuthorized(RepositoryVersionResourceProvider.java:316) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$$EnhancerByGuice$$46398843.CGLIB$updateResourcesAuthorized$2() at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$$EnhancerByGuice$$46398843$$FastClassByGuice$$bbfdd590.invoke() at com.google.inject.internal.cglib.proxy.$MethodProxy.invokeSuper(MethodProxy.java:228) at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72) at org.apache.ambari.server.orm.AmbariJpaLocalTxnInterceptor.invoke(AmbariJpaLocalTxnInterceptor.java:128) at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72) at com.google.inject.internal.InterceptorStackCallback.intercept(InterceptorStackCallback.java:52) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$$EnhancerByGuice$$46398843.updateResourcesAuthorized() at org.apache.ambari.server.controller.internal.AbstractAuthorizedResourceProvider.updateResources(AbstractAuthorizedResourceProvider.java:301) at org.apache.ambari.server.controller.internal.ClusterControllerImpl.updateResources(ClusterControllerImpl.java:319) at org.apache.ambari.server.api.services.persistence.PersistenceManagerImpl.update(PersistenceManagerImpl.java:125) at org.apache.ambari.server.api.handlers.UpdateHandler.persist(UpdateHandler.java:45) From: "xiang dai" < xiang@sky-data.cn > To: "user" < user@ambari.apache.org > Sent: Thursday, May 17, 2018 4:29:14 PM Subject: Re: Operating System matching redhat7 could not be found Add some clue: 17 May 2018 16:17:33,861 ERROR [ambari-client-thread-233] Request:147 - Unable to compile query predicate: Unexpected token encountered in query string. Last Token Type=PROPERTY_OPERAND, Cur rent Token[type=LOGICAL_OPERATOR, value='&'] org.apache.ambari.server.api.predicate.InvalidQueryException: Unexpected token encountered in query string. Last Token Type=PROPERTY_OPERAND, Current Token[type=LOGICAL_OPERATOR, value='&'] at org.apache.ambari.server.api.predicate.QueryParser$TokenHandler.handleToken(QueryParser.java:351) From: "xiang dai" < xiang@sky-data.cn > To: "user" < user@ambari.apache.org > Sent: Thursday, May 17, 2018 10:27:23 AM Subject: Operati
Re: Operating System matching redhat7 could not be found
What is the output of cat /etc/*release on the hosts. I know the code has to map values to the 'redhat7' On Fri, May 18, 2018 at 7:08 AM, wrote: > I define a stack called SKY, and my repo.xml is as below: > > > > > http://public-repo-1.hortonworks.com/HDP/centos7/2. > x/updates/2.6.0.3 > SKY-3.0 > SKY > true > > > http://public-repo-1.hortonworks.com/HDP-UTILS-1.1. > 0.21/repos/centos7 > SKY-UTILS-1.1.0.21 > SKY-UTILS > false > > > > > I use centos7 to test, i really do not know how to fix it. > > Could someone help me? > > Thanks > > -- > *From: *"David Quiroga" > *To: *"user" > *Sent: *Friday, May 18, 2018 1:29:13 AM > > *Subject: *Re: Operating System matching redhat7 could not be found > > *"At least one set of repositories for OS should be provided"* > > I would take a look in Ambari under Admin > Stacks and Versions > Versions > Tab > For the current version "Show Details", click Edit button this should list > the OS and repositories. > > Are those valid from the host you are now running on? > > On Thu, May 17, 2018 at 7:38 AM, wrote: > >> True error maybe as below: >> >> 17 May 2018 20:33:46,103 ERROR [ambari-client-thread-78] >> AbstractResourceProvider:343 - Caught AmbariException when modifying a >> resource >> org.apache.ambari.server.AmbariException: At least one set of >> repositories for OS should be provided >> at org.apache.ambari.server.controller.internal. >> RepositoryVersionResourceProvider.validateRepositoryVersion( >> RepositoryVersionResourceProvider.java:490) >> at org.apache.ambari.server.controller.internal. >> RepositoryVersionResourceProvider.validateRepositoryVersion( >> RepositoryVersionResourceProvider.java:439) >> at org.apache.ambari.server.controller.internal. >> RepositoryVersionResourceProvider$2.invoke(RepositoryVersionResourceProvi >> der.java:356) >> at org.apache.ambari.server.controller.internal. >> RepositoryVersionResourceProvider$2.invoke(RepositoryVersionResourceProvi >> der.java:316) >> at org.apache.ambari.server.controller.internal. >> AbstractResourceProvider.invokeWithRetry(AbstractResourceProvider.java: >> 455) >> at org.apache.ambari.server.controller.internal. >> AbstractResourceProvider.modifyResources(AbstractResourceProvider.java: >> 336) >> at org.apache.ambari.server.controller.internal. >> RepositoryVersionResourceProvider.updateResourcesAuthorized( >> RepositoryVersionResourceProvider.java:316) >> at org.apache.ambari.server.controller.internal. >> RepositoryVersionResourceProvider$$EnhancerByGuice$$46398843.CGLIB$ >> updateResourcesAuthorized$2() >> at org.apache.ambari.server.controller.internal. >> RepositoryVersionResourceProvider$$EnhancerByGuice$$ >> 46398843$$FastClassByGuice$$bbfdd590.invoke() >> at com.google.inject.internal.cglib.proxy.$MethodProxy. >> invokeSuper(MethodProxy.java:228) >> at com.google.inject.internal.InterceptorStackCallback$ >> InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72) >> at org.apache.ambari.server.orm.AmbariJpaLocalTxnInterceptor. >> invoke(AmbariJpaLocalTxnInterceptor.java:128) >> at com.google.inject.internal.InterceptorStackCallback$ >> InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72) >> at com.google.inject.internal.InterceptorStackCallback.intercept( >> InterceptorStackCallback.java:52) >> at org.apache.ambari.server.controller.internal. >> RepositoryVersionResourceProvider$$EnhancerByGuice$$46398843. >> updateResourcesAuthorized() >> at org.apache.ambari.server.controller.internal. >> AbstractAuthorizedResourceProvider.updateResources( >> AbstractAuthorizedResourceProvider.java:301) >> at org.apache.ambari.server.controller.internal. >> ClusterControllerImpl.updateResources(ClusterControllerImpl.java:319) >> at org.apache.ambari.server.api.services.persistence. >> PersistenceManagerImpl.update(PersistenceManagerImpl.java:125) >> at org.apache.ambari.server.api.handlers.UpdateHandler. >> persist(UpdateHandler.java:45) >> >> -- >> *From: *"xiang dai" >> *To: *"user" >> *Sent: *Thursday, May 17, 2018 4:29:14 PM >> *Subject: *Re: Operating System matching redhat7 could not be found >> >> Add some clue: >> >> 17 May 2018 16:17:33,861 ERROR [ambari-client-thread-233] Request:147 - >> Unable to compile query predicate: Unexpected token encountered in query >> string. Last Token Type=PROPERTY_OPERAND, Cur >> rent Token[type=LOGICAL_OPERATOR, value='&'] >> org.apache.ambari.server.api.predicate.InvalidQueryException: Unexpected >> token encountered in query string. Last Token Type=PROPERTY_OPERAND, >> Current Token[type=LOGICAL_OPERATOR, value='&'] >> at org.apache.ambari.server.api.predicate.QueryParser$ >> TokenHandler.handleToken(QueryParser.java:351) >> >> ---
Extending an existing cluster via API calls
I'm looking to extend an existing cluster via API calls. The cluster was
configured to have hostgroups 2 (Ambari server with all necessary
infrastructure) and hostgroup 1 (Zookeeper etc).
According to the documentation, it looks like I should be able to post the
following JSON to /api/v1/clusters/idp/hosts/
{"blueprint": "cluster1", "host_group": "host_group_1"}
I would expect Ambari to pick up the services as defined in the blueprint for
host_group_1, and start installing them automatically (as, again, described in
the blueprint).
This isn't what happens. Restarting ambari-agent on the node immediately after
calling the above API yields the log below:
18 May 2018 14:14:44,473 INFO [ambari-client-thread-73] TopologyManager:485 -
TopologyManager.scaleHosts: Entering
18 May 2018 14:14:44,474 INFO [ambari-client-thread-73]
ClusterTopologyImpl:158 - ClusterTopologyImpl.addHostTopology: added host =
node5 to host group = host_group_1
18 May 2018 14:14:44,480 INFO [ambari-client-thread-73] HostRequest:205 -
Skipping Start task creation since provision action = INSTALL_ONLY
18 May 2018 14:14:44,483 INFO [ambari-client-thread-73] HostRequest:244 -
Skipping create of START task for ZOOKEEPER_SERVER on PENDING HOST ASSIGNMENT :
HOSTGROUP=host_group_1.
18 May 2018 14:14:44,486 INFO [ambari-client-thread-73] HostRequest:244 -
Skipping create of START task for ZOOKEEPER_CLIENT on PENDING HOST ASSIGNMENT :
HOSTGROUP=host_group_1.
18 May 2018 14:14:44,486 INFO [ambari-client-thread-73] HostRequest:99 -
HostRequest: Created request for host: node5
18 May 2018 14:14:44,486 INFO [ambari-client-thread-73] LogicalRequest:437 -
LogicalRequest.createHostRequests: all host requests size 1 , outstanding
requests size = 0
18 May 2018 14:14:44,491 INFO [ambari-client-thread-73] TopologyManager:923 -
TopologyManager.createLogicalRequest: created LogicalRequest with ID = 51 and
completed persistence of this request.
18 May 2018 14:14:44,495 INFO [ambari-client-thread-73] TopologyManager:845 -
TopologyManager.processRequest: Entering
18 May 2018 14:14:44,496 INFO [ambari-client-thread-73] TopologyManager:863 -
TopologyManager.processRequest: host name = node5 is mapped to LogicalRequest
ID = 51 and will be removed from the reserved hosts.
18 May 2018 14:14:44,496 INFO [ambari-client-thread-73] TopologyManager:876 -
TopologyManager.processRequest: offering host name = node5 to LogicalRequest ID
= 51
18 May 2018 14:14:44,496 INFO [ambari-client-thread-73] LogicalRequest:101 -
LogicalRequest.offer: attempting to match a request to a request for a reserved
host to hostname = node5
18 May 2018 14:14:44,497 INFO [ambari-client-thread-73] LogicalRequest:110 -
LogicalRequest.offer: request mapping ACCEPTED for host = node5
18 May 2018 14:14:44,497 INFO [ambari-client-thread-73] LogicalRequest:113 -
LogicalRequest.offer returning response, reservedHost list size = 0
18 May 2018 14:14:44,497 INFO [ambari-client-thread-73] TopologyManager:886 -
TopologyManager.processRequest: host name = node5 was ACCEPTED by
LogicalRequest ID = 51 , host has been removed from available hosts.
18 May 2018 14:14:44,498 INFO [ambari-client-thread-73]
ClusterTopologyImpl:158 - ClusterTopologyImpl.addHostTopology: added host =
node5 to host group = host_group_1
18 May 2018 14:14:44,502 INFO [ambari-client-thread-73] TopologyManager:963 -
TopologyManager.processAcceptedHostOffer: queue tasks for host = node5 which
responded ACCEPTED
18 May 2018 14:14:44,502 INFO [ambari-client-thread-73] TopologyManager:988 -
TopologyManager.processAcceptedHostOffer: queueing tasks for host = node5
18 May 2018 14:14:44,503 INFO [ambari-client-thread-73] TopologyManager:977 -
Creating TopologyTaskExecutorService for clusterId: 2
18 May 2018 14:14:44,503 INFO [ambari-client-thread-73] TopologyManager:904 -
TopologyManager.processRequest: not all required hosts have been matched, so
adding LogicalRequest ID = 51 to outstanding requests
18 May 2018 14:14:44,504 INFO [ambari-client-thread-73]
AbstractProviderModule:864 - Resetting property provider maps to reflect
changes in cluster state
18 May 2018 14:14:46,873 INFO [ambari-client-thread-74]
MetricsCollectorHAManager:54 - Adding collector host : node1 to cluster :
cluster
18 May 2018 14:15:05,924 WARN [qtp-ambari-agent-253] SecurityFilter:103 -
Request https://node1:8440/ca doesn't match any pattern.
18 May 2018 14:15:05,925 WARN [qtp-ambari-agent-253] SecurityFilter:62 - This
request is not allowed on this port: https://node1:8440/ca
18 May 2018 14:15:08,122 INFO [qtp-ambari-agent-255] HeartBeatHandler:385 -
agentOsType = redhat7
18 May 2018 14:15:08,128 INFO [qtp-ambari-agent-255] HostImpl:334 - Received
host registration,
host=[hostname=node5,fqdn=node5,domain=,architecture=x86_64,processorcount=8,physicalprocessorcount=8,osname=redhat,osversion=7.5,osfamily=redhat,memory=32764508,uptime_hours=360,mounts=(available=8617972,mountpoint=/,used=1849356,percen
Re: Operating System matching redhat7 could not be found
I define a stack called SKY, and my repo.xml is as below: http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.0.3 SKY-3.0 SKY true http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos7 SKY-UTILS-1.1.0.21 SKY-UTILS false I use centos7 to test, i really do not know how to fix it. Could someone help me? Thanks From: "David Quiroga" To: "user" Sent: Friday, May 18, 2018 1:29:13 AM Subject: Re: Operating System matching redhat7 could not be found "At least one set of repositories for OS should be provided" I would take a look in Ambari under Admin > Stacks and Versions > Versions Tab For the current version "Show Details", click Edit button this should list the OS and repositories. Are those valid from the host you are now running on? On Thu, May 17, 2018 at 7:38 AM, < xiang@sky-data.cn > wrote: True error maybe as below: 17 May 2018 20:33:46,103 ERROR [ambari-client-thread-78] AbstractResourceProvider:343 - Caught AmbariException when modifying a resource org.apache.ambari.server.AmbariException: At least one set of repositories for OS should be provided at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider.validateRepositoryVersion(RepositoryVersionResourceProvider.java:490) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider.validateRepositoryVersion(RepositoryVersionResourceProvider.java:439) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$2.invoke(RepositoryVersionResourceProvider.java:356) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$2.invoke(RepositoryVersionResourceProvider.java:316) at org.apache.ambari.server.controller.internal.AbstractResourceProvider.invokeWithRetry(AbstractResourceProvider.java:455) at org.apache.ambari.server.controller.internal.AbstractResourceProvider.modifyResources(AbstractResourceProvider.java:336) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider.updateResourcesAuthorized(RepositoryVersionResourceProvider.java:316) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$$EnhancerByGuice$$46398843.CGLIB$updateResourcesAuthorized$2() at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$$EnhancerByGuice$$46398843$$FastClassByGuice$$bbfdd590.invoke() at com.google.inject.internal.cglib.proxy.$MethodProxy.invokeSuper(MethodProxy.java:228) at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72) at org.apache.ambari.server.orm.AmbariJpaLocalTxnInterceptor.invoke(AmbariJpaLocalTxnInterceptor.java:128) at com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72) at com.google.inject.internal.InterceptorStackCallback.intercept(InterceptorStackCallback.java:52) at org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$$EnhancerByGuice$$46398843.updateResourcesAuthorized() at org.apache.ambari.server.controller.internal.AbstractAuthorizedResourceProvider.updateResources(AbstractAuthorizedResourceProvider.java:301) at org.apache.ambari.server.controller.internal.ClusterControllerImpl.updateResources(ClusterControllerImpl.java:319) at org.apache.ambari.server.api.services.persistence.PersistenceManagerImpl.update(PersistenceManagerImpl.java:125) at org.apache.ambari.server.api.handlers.UpdateHandler.persist(UpdateHandler.java:45) From: "xiang dai" < xiang@sky-data.cn > To: "user" < user@ambari.apache.org > Sent: Thursday, May 17, 2018 4:29:14 PM Subject: Re: Operating System matching redhat7 could not be found Add some clue: 17 May 2018 16:17:33,861 ERROR [ambari-client-thread-233] Request:147 - Unable to compile query predicate: Unexpected token encountered in query string. Last Token Type=PROPERTY_OPERAND, Cur rent Token[type=LOGICAL_OPERATOR, value='&'] org.apache.ambari.server.api.predicate.InvalidQueryException: Unexpected token encountered in query string. Last Token Type=PROPERTY_OPERAND, Current Token[type=LOGICAL_OPERATOR, value='&'] at org.apache.ambari.server.api.predicate.QueryParser$TokenHandler.handleToken(QueryParser.java:351) From: "xiang dai" < xiang@sky-data.cn > To: "user" < user@ambari.apache.org > Sent: Thursday, May 17, 2018 10:27:23 AM Subject: Operating System matching redhat7 could not be found Hi! I met a confused issue: when i use vagrant to test, all work. when i change to my hosts, below waring show: org.apache.ambari.server.controller.spi.SystemException: Operating System matching redhat7 could not be found And UI hang. The question is that both VM and hosts are Centos7, why behave differently? Thanks -- 戴翔 南京天数信息科技有限公司 电话: +86 1 3382776490 公司官网: www.sky-data.cn 免费使用天数润科智能计算平台 SkyDiscovery
