Re: when agent sync service scripts

2018-05-20 Thread xiang . dai 
In my case, i define a stack and install a service. 

For start/stop, i need to do some test, so i edit service script under stack. 

Then restart server, not sync. 

Then restart agent, still not. 

Does it need time to sync or it is real-time? 


From: "David Quiroga"  
To: "user"  
Sent: Monday, May 21, 2018 1:20:31 AM 
Subject: Re: when agent sync service scripts 

The agent code cache should update when the agents check-in to the server. 
Believe check-in occurs after the server is restarted and/or after an agent is 
restarted. 

Is the python? code in the standard location 
ambari-server/resources/common-services/YOUR_SERVICE/VERSION/package/scripts/ 
Or what type of code update are you attempting. 


On Sat, May 19, 2018 at 1:37 AM, < xiang@sky-data.cn > wrote: 



I install a custom stack in VM, then i want to update some codes for a 
installed service. 

But when i restart server, the codes in agent does not update. 

Then i restart agent, still failed. 

So when agent sync service scripts? 

Thanks

Re: Operating System matching redhat7 could not be found

2018-05-19 Thread xiang . dai 
.hortonworks.com/HDP-UTILS-1.1.0.21/repos/ubuntu12, 
repoName=SKY-UTILS, distribution=null, components=null, mirrorsList=null, 
unique=false, ambariManagedRepositories=true, applicableServices= ]]} 



From: "xiang dai" <xiang@sky-data.cn> 
To: "user" <user@ambari.apache.org> 
Sent: Saturday, May 19, 2018 9:30:32 AM 
Subject: Re: Operating System matching redhat7 could not be found 

I use centos7.4: 

$ cat /etc/redhat-release 
CentOS Linux release 7.4.1708 (Core) 


From: "David Quiroga" <quirogadf4w...@gmail.com> 
To: "user" <user@ambari.apache.org> 
Sent: Saturday, May 19, 2018 4:08:37 AM 
Subject: Re: Operating System matching redhat7 could not be found 

What is the output of cat /etc/*release on the hosts. 
I know the code has to map values to the 'redhat7' 

On Fri, May 18, 2018 at 7:08 AM, < xiang@sky-data.cn > wrote: 



I define a stack called SKY, and my repo.xml is as below: 

 
 
 
 http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.0.3 
 
SKY-3.0 
SKY 
true 
 
 
 http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos7 
 
SKY-UTILS-1.1.0.21 
SKY-UTILS 
false 
 
 
 

I use centos7 to test, i really do not know how to fix it. 

Could someone help me? 

Thanks 


From: "David Quiroga" < quirogadf4w...@gmail.com > 
To: "user" < user@ambari.apache.org > 
Sent: Friday, May 18, 2018 1:29:13 AM 

Subject: Re: Operating System matching redhat7 could not be found 

"At least one set of repositories for OS should be provided" 

I would take a look in Ambari under Admin > Stacks and Versions > Versions Tab 
For the current version "Show Details", click Edit button this should list the 
OS and repositories. 

Are those valid from the host you are now running on? 

On Thu, May 17, 2018 at 7:38 AM, < xiang@sky-data.cn > wrote: 

BQ_BEGIN

True error maybe as below: 

17 May 2018 20:33:46,103 ERROR [ambari-client-thread-78] 
AbstractResourceProvider:343 - Caught AmbariException when modifying a resource 
org.apache.ambari.server.AmbariException: At least one set of repositories for 
OS should be provided 
at 
org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider.validateRepositoryVersion(RepositoryVersionResourceProvider.java:490)
 
at 
org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider.validateRepositoryVersion(RepositoryVersionResourceProvider.java:439)
 
at 
org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$2.invoke(RepositoryVersionResourceProvider.java:356)
 
at 
org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$2.invoke(RepositoryVersionResourceProvider.java:316)
 
at 
org.apache.ambari.server.controller.internal.AbstractResourceProvider.invokeWithRetry(AbstractResourceProvider.java:455)
 
at 
org.apache.ambari.server.controller.internal.AbstractResourceProvider.modifyResources(AbstractResourceProvider.java:336)
 
at 
org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider.updateResourcesAuthorized(RepositoryVersionResourceProvider.java:316)
 
at 
org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$$EnhancerByGuice$$46398843.CGLIB$updateResourcesAuthorized$2()
 
at 
org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$$EnhancerByGuice$$46398843$$FastClassByGuice$$bbfdd590.invoke()
 
at 
com.google.inject.internal.cglib.proxy.$MethodProxy.invokeSuper(MethodProxy.java:228)
 
at 
com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
 
at 
org.apache.ambari.server.orm.AmbariJpaLocalTxnInterceptor.invoke(AmbariJpaLocalTxnInterceptor.java:128)
 
at 
com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
 
at 
com.google.inject.internal.InterceptorStackCallback.intercept(InterceptorStackCallback.java:52)
 
at 
org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$$EnhancerByGuice$$46398843.updateResourcesAuthorized()
 
at 
org.apache.ambari.server.controller.internal.AbstractAuthorizedResourceProvider.updateResources(AbstractAuthorizedResourceProvider.java:301)
 
at 
org.apache.ambari.server.controller.internal.ClusterControllerImpl.updateResources(ClusterControllerImpl.java:319)
 
at 
org.apache.ambari.server.api.services.persistence.PersistenceManagerImpl.update(PersistenceManagerImpl.java:125)
 
at 
org.apache.ambari.server.api.handlers.UpdateHandler.persist(UpdateHandler.java:45)
 


From: "xiang dai" < xiang@sky-data.cn > 
To: "user" < user@ambari.apache.org > 
Sent: Thursday, May 17, 2018 4:29:14 PM 
Subject: Re: Operating System matching redhat7 could not be found 

Add some clue: 

17 May 2018 16:17:33,861 ERROR [ambari-client-thread-233] Request:1

when agent sync service scripts

2018-05-19 Thread xiang . dai 
I install a custom stack in VM, then i want to update some codes for a 
installed service. 

But when i restart server, the codes in agent does not update. 

Then i restart agent, still failed. 

So when agent sync service scripts? 

Thanks

Re: Operating System matching redhat7 could not be found

2018-05-18 Thread xiang . dai 
I use centos7.4: 

$ cat /etc/redhat-release 
CentOS Linux release 7.4.1708 (Core) 


From: "David Quiroga" <quirogadf4w...@gmail.com> 
To: "user" <user@ambari.apache.org> 
Sent: Saturday, May 19, 2018 4:08:37 AM 
Subject: Re: Operating System matching redhat7 could not be found 

What is the output of cat /etc/*release on the hosts. 
I know the code has to map values to the 'redhat7' 

On Fri, May 18, 2018 at 7:08 AM, < xiang@sky-data.cn > wrote: 



I define a stack called SKY, and my repo.xml is as below: 

 
 
 
 http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.0.3 
 
SKY-3.0 
SKY 
true 
 
 
 http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos7 
 
SKY-UTILS-1.1.0.21 
SKY-UTILS 
false 
 
 
 

I use centos7 to test, i really do not know how to fix it. 

Could someone help me? 

Thanks 


From: "David Quiroga" < quirogadf4w...@gmail.com > 
To: "user" < user@ambari.apache.org > 
Sent: Friday, May 18, 2018 1:29:13 AM 

Subject: Re: Operating System matching redhat7 could not be found 

"At least one set of repositories for OS should be provided" 

I would take a look in Ambari under Admin > Stacks and Versions > Versions Tab 
For the current version "Show Details", click Edit button this should list the 
OS and repositories. 

Are those valid from the host you are now running on? 

On Thu, May 17, 2018 at 7:38 AM, < xiang@sky-data.cn > wrote: 

BQ_BEGIN

True error maybe as below: 

17 May 2018 20:33:46,103 ERROR [ambari-client-thread-78] 
AbstractResourceProvider:343 - Caught AmbariException when modifying a resource 
org.apache.ambari.server.AmbariException: At least one set of repositories for 
OS should be provided 
at 
org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider.validateRepositoryVersion(RepositoryVersionResourceProvider.java:490)
 
at 
org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider.validateRepositoryVersion(RepositoryVersionResourceProvider.java:439)
 
at 
org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$2.invoke(RepositoryVersionResourceProvider.java:356)
 
at 
org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$2.invoke(RepositoryVersionResourceProvider.java:316)
 
at 
org.apache.ambari.server.controller.internal.AbstractResourceProvider.invokeWithRetry(AbstractResourceProvider.java:455)
 
at 
org.apache.ambari.server.controller.internal.AbstractResourceProvider.modifyResources(AbstractResourceProvider.java:336)
 
at 
org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider.updateResourcesAuthorized(RepositoryVersionResourceProvider.java:316)
 
at 
org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$$EnhancerByGuice$$46398843.CGLIB$updateResourcesAuthorized$2()
 
at 
org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$$EnhancerByGuice$$46398843$$FastClassByGuice$$bbfdd590.invoke()
 
at 
com.google.inject.internal.cglib.proxy.$MethodProxy.invokeSuper(MethodProxy.java:228)
 
at 
com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
 
at 
org.apache.ambari.server.orm.AmbariJpaLocalTxnInterceptor.invoke(AmbariJpaLocalTxnInterceptor.java:128)
 
at 
com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
 
at 
com.google.inject.internal.InterceptorStackCallback.intercept(InterceptorStackCallback.java:52)
 
at 
org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$$EnhancerByGuice$$46398843.updateResourcesAuthorized()
 
at 
org.apache.ambari.server.controller.internal.AbstractAuthorizedResourceProvider.updateResources(AbstractAuthorizedResourceProvider.java:301)
 
at 
org.apache.ambari.server.controller.internal.ClusterControllerImpl.updateResources(ClusterControllerImpl.java:319)
 
at 
org.apache.ambari.server.api.services.persistence.PersistenceManagerImpl.update(PersistenceManagerImpl.java:125)
 
at 
org.apache.ambari.server.api.handlers.UpdateHandler.persist(UpdateHandler.java:45)
 


From: "xiang dai" < xiang@sky-data.cn > 
To: "user" < user@ambari.apache.org > 
Sent: Thursday, May 17, 2018 4:29:14 PM 
Subject: Re: Operating System matching redhat7 could not be found 

Add some clue: 

17 May 2018 16:17:33,861 ERROR [ambari-client-thread-233] Request:147 - Unable 
to compile query predicate: Unexpected token encountered in query string. Last 
Token Type=PROPERTY_OPERAND, Cur 
rent Token[type=LOGICAL_OPERATOR, value='&'] 
org.apache.ambari.server.api.predicate.InvalidQueryException: Unexpected token 
encountered in query string. Last Token Type=PROPERTY_OPERAND, Current 
Token[type=LOGICAL_OPERATOR, value='&'] 
at 
org.apache.ambari.server.api.predicate.QueryPars

Re: Operating System matching redhat7 could not be found

2018-05-18 Thread xiang . dai 
I define a stack called SKY, and my repo.xml is as below: 

 
 
 
http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.0.3
 
SKY-3.0 
SKY 
true 
 
 
http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos7
 
SKY-UTILS-1.1.0.21 
SKY-UTILS 
false 
 
 
 

I use centos7 to test, i really do not know how to fix it. 

Could someone help me? 

Thanks 


From: "David Quiroga" <quirogadf4w...@gmail.com> 
To: "user" <user@ambari.apache.org> 
Sent: Friday, May 18, 2018 1:29:13 AM 
Subject: Re: Operating System matching redhat7 could not be found 

"At least one set of repositories for OS should be provided" 

I would take a look in Ambari under Admin > Stacks and Versions > Versions Tab 
For the current version "Show Details", click Edit button this should list the 
OS and repositories. 

Are those valid from the host you are now running on? 

On Thu, May 17, 2018 at 7:38 AM, < xiang@sky-data.cn > wrote: 



True error maybe as below: 

17 May 2018 20:33:46,103 ERROR [ambari-client-thread-78] 
AbstractResourceProvider:343 - Caught AmbariException when modifying a resource 
org.apache.ambari.server.AmbariException: At least one set of repositories for 
OS should be provided 
at 
org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider.validateRepositoryVersion(RepositoryVersionResourceProvider.java:490)
 
at 
org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider.validateRepositoryVersion(RepositoryVersionResourceProvider.java:439)
 
at 
org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$2.invoke(RepositoryVersionResourceProvider.java:356)
 
at 
org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$2.invoke(RepositoryVersionResourceProvider.java:316)
 
at 
org.apache.ambari.server.controller.internal.AbstractResourceProvider.invokeWithRetry(AbstractResourceProvider.java:455)
 
at 
org.apache.ambari.server.controller.internal.AbstractResourceProvider.modifyResources(AbstractResourceProvider.java:336)
 
at 
org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider.updateResourcesAuthorized(RepositoryVersionResourceProvider.java:316)
 
at 
org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$$EnhancerByGuice$$46398843.CGLIB$updateResourcesAuthorized$2()
 
at 
org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$$EnhancerByGuice$$46398843$$FastClassByGuice$$bbfdd590.invoke()
 
at 
com.google.inject.internal.cglib.proxy.$MethodProxy.invokeSuper(MethodProxy.java:228)
 
at 
com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
 
at 
org.apache.ambari.server.orm.AmbariJpaLocalTxnInterceptor.invoke(AmbariJpaLocalTxnInterceptor.java:128)
 
at 
com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
 
at 
com.google.inject.internal.InterceptorStackCallback.intercept(InterceptorStackCallback.java:52)
 
at 
org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$$EnhancerByGuice$$46398843.updateResourcesAuthorized()
 
at 
org.apache.ambari.server.controller.internal.AbstractAuthorizedResourceProvider.updateResources(AbstractAuthorizedResourceProvider.java:301)
 
at 
org.apache.ambari.server.controller.internal.ClusterControllerImpl.updateResources(ClusterControllerImpl.java:319)
 
at 
org.apache.ambari.server.api.services.persistence.PersistenceManagerImpl.update(PersistenceManagerImpl.java:125)
 
at 
org.apache.ambari.server.api.handlers.UpdateHandler.persist(UpdateHandler.java:45)
 


From: "xiang dai" < xiang@sky-data.cn > 
To: "user" < user@ambari.apache.org > 
Sent: Thursday, May 17, 2018 4:29:14 PM 
Subject: Re: Operating System matching redhat7 could not be found 

Add some clue: 

17 May 2018 16:17:33,861 ERROR [ambari-client-thread-233] Request:147 - Unable 
to compile query predicate: Unexpected token encountered in query string. Last 
Token Type=PROPERTY_OPERAND, Cur 
rent Token[type=LOGICAL_OPERATOR, value='&'] 
org.apache.ambari.server.api.predicate.InvalidQueryException: Unexpected token 
encountered in query string. Last Token Type=PROPERTY_OPERAND, Current 
Token[type=LOGICAL_OPERATOR, value='&'] 
at 
org.apache.ambari.server.api.predicate.QueryParser$TokenHandler.handleToken(QueryParser.java:351)
 


From: "xiang dai" < xiang@sky-data.cn > 
To: "user" < user@ambari.apache.org > 
Sent: Thursday, May 17, 2018 10:27:23 AM 
Subject: Operating System matching redhat7 could not be found 

Hi! 

I met a confused issue: 
when i use vagrant to test, all work. 
when i change to my hosts, below waring show: 
org.apache.ambari.server.controller.spi.SystemException: Operating System 
matching redhat7 could not be found 

And UI hang.

Re: Operating System matching redhat7 could not be found

2018-05-17 Thread xiang . dai 
True error maybe as below: 

17 May 2018 20:33:46,103 ERROR [ambari-client-thread-78] 
AbstractResourceProvider:343 - Caught AmbariException when modifying a resource 
org.apache.ambari.server.AmbariException: At least one set of repositories for 
OS should be provided 
at 
org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider.validateRepositoryVersion(RepositoryVersionResourceProvider.java:490)
 
at 
org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider.validateRepositoryVersion(RepositoryVersionResourceProvider.java:439)
 
at 
org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$2.invoke(RepositoryVersionResourceProvider.java:356)
 
at 
org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$2.invoke(RepositoryVersionResourceProvider.java:316)
 
at 
org.apache.ambari.server.controller.internal.AbstractResourceProvider.invokeWithRetry(AbstractResourceProvider.java:455)
 
at 
org.apache.ambari.server.controller.internal.AbstractResourceProvider.modifyResources(AbstractResourceProvider.java:336)
 
at 
org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider.updateResourcesAuthorized(RepositoryVersionResourceProvider.java:316)
 
at 
org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$$EnhancerByGuice$$46398843.CGLIB$updateResourcesAuthorized$2()
 
at 
org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$$EnhancerByGuice$$46398843$$FastClassByGuice$$bbfdd590.invoke()
 
at 
com.google.inject.internal.cglib.proxy.$MethodProxy.invokeSuper(MethodProxy.java:228)
 
at 
com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
 
at 
org.apache.ambari.server.orm.AmbariJpaLocalTxnInterceptor.invoke(AmbariJpaLocalTxnInterceptor.java:128)
 
at 
com.google.inject.internal.InterceptorStackCallback$InterceptedMethodInvocation.proceed(InterceptorStackCallback.java:72)
 
at 
com.google.inject.internal.InterceptorStackCallback.intercept(InterceptorStackCallback.java:52)
 
at 
org.apache.ambari.server.controller.internal.RepositoryVersionResourceProvider$$EnhancerByGuice$$46398843.updateResourcesAuthorized()
 
at 
org.apache.ambari.server.controller.internal.AbstractAuthorizedResourceProvider.updateResources(AbstractAuthorizedResourceProvider.java:301)
 
at 
org.apache.ambari.server.controller.internal.ClusterControllerImpl.updateResources(ClusterControllerImpl.java:319)
 
at 
org.apache.ambari.server.api.services.persistence.PersistenceManagerImpl.update(PersistenceManagerImpl.java:125)
 
at 
org.apache.ambari.server.api.handlers.UpdateHandler.persist(UpdateHandler.java:45)
 


From: "xiang dai" <xiang@sky-data.cn> 
To: "user" <user@ambari.apache.org> 
Sent: Thursday, May 17, 2018 4:29:14 PM 
Subject: Re: Operating System matching redhat7 could not be found 

Add some clue: 

17 May 2018 16:17:33,861 ERROR [ambari-client-thread-233] Request:147 - Unable 
to compile query predicate: Unexpected token encountered in query string. Last 
Token Type=PROPERTY_OPERAND, Cur 
rent Token[type=LOGICAL_OPERATOR, value='&'] 
org.apache.ambari.server.api.predicate.InvalidQueryException: Unexpected token 
encountered in query string. Last Token Type=PROPERTY_OPERAND, Current 
Token[type=LOGICAL_OPERATOR, value='&'] 
at 
org.apache.ambari.server.api.predicate.QueryParser$TokenHandler.handleToken(QueryParser.java:351)
 


From: "xiang dai" <xiang@sky-data.cn> 
To: "user" <user@ambari.apache.org> 
Sent: Thursday, May 17, 2018 10:27:23 AM 
Subject: Operating System matching redhat7 could not be found 

Hi! 

I met a confused issue: 
when i use vagrant to test, all work. 
when i change to my hosts, below waring show: 
org.apache.ambari.server.controller.spi.SystemException: Operating System 
matching redhat7 could not be found 

And UI hang. 

The question is that both VM and hosts are Centos7, why behave differently? 

Thanks 


-- 
戴翔 
南京天数信息科技有限公司 
电话: +86 1 3382776490 
公司官网: www.sky-data.cn 
免费使用天数润科智能计算平台 SkyDiscovery

Re: Operating System matching redhat7 could not be found

2018-05-17 Thread xiang . dai 
Add some clue: 

17 May 2018 16:17:33,861 ERROR [ambari-client-thread-233] Request:147 - Unable 
to compile query predicate: Unexpected token encountered in query string. Last 
Token Type=PROPERTY_OPERAND, Cur 
rent Token[type=LOGICAL_OPERATOR, value='&'] 
org.apache.ambari.server.api.predicate.InvalidQueryException: Unexpected token 
encountered in query string. Last Token Type=PROPERTY_OPERAND, Current 
Token[type=LOGICAL_OPERATOR, value='&'] 
at 
org.apache.ambari.server.api.predicate.QueryParser$TokenHandler.handleToken(QueryParser.java:351)
 


From: "xiang dai" <xiang@sky-data.cn> 
To: "user" <user@ambari.apache.org> 
Sent: Thursday, May 17, 2018 10:27:23 AM 
Subject: Operating System matching redhat7 could not be found 

Hi! 

I met a confused issue: 
when i use vagrant to test, all work. 
when i change to my hosts, below waring show: 
org.apache.ambari.server.controller.spi.SystemException: Operating System 
matching redhat7 could not be found 

And UI hang. 

The question is that both VM and hosts are Centos7, why behave differently? 

Thanks

Operating System matching redhat7 could not be found

2018-05-16 Thread xiang . dai 
Hi! 

I met a confused issue: 
when i use vagrant to test, all work. 
when i change to my hosts, below waring show: 
org.apache.ambari.server.controller.spi.SystemException: Operating System 
matching redhat7 could not be found 

And UI hang. 

The question is that both VM and hosts are Centos7, why behave differently? 

Thanks

Re: metrics can not work as expected

2018-05-06 Thread xiang . dai 
I just download them and make my own repo including them. 
Then, i install them with ambari UI. 




From: "Siddharth Wagle"  
To: "user"  
Sent: Saturday, May 5, 2018 11:07:12 PM 
Subject: Re: metrics can not work as expected 



​Collector is not able to reach Zookeeper. Are you not installing AMS using 
Ambari? 





- Sid 




From: xiang@sky-data.cn  
Sent: Saturday, May 5, 2018 1:27 AM 
To: user 
Subject: metrics can not work as expected 
Hi! 

I tested installation on my vbox, it works well, then i move it to a server 
which run many services. 

When install, it failed at check service status. 

I checked ambari-metrics-collector.log and found below error: 

2018-05-05 08:16:03,536 INFO org.apache.phoenix.metrics.Metrics: Initializing 
metrics system: phoenix 
2018-05-05 08:16:03,559 WARN org.apache.hadoop.metrics2.impl.MetricsConfig: 
Cannot locate configuration: tried 
hadoop-metrics2-phoenix.properties,hadoop-metrics2.properties 
 

2018-05-05 08:18:50,342 INFO org.apache.zookeeper.ClientCnxn: Socket connection 
established to dx-1.novalocal/192.168.80.34:2188, initiating session 
2018-05-05 08:18:50,343 INFO org.apache.zookeeper.ClientCnxn: Unable to read 
additional data from server sessionid 0x0, likely server has closed socket, 
closing socket connection and attempting reconnect 
2018-05-05 08:18:50,811 INFO org.apache.zookeeper.ClientCnxn: Opening socket 
connection to server dx-2.novalocal/192.168.80.27:2188. Will not attempt to 
authenticate using SASL (unknown error) 
2018-05-05 08:18:50,812 INFO org.apache.zookeeper.ClientCnxn: Socket connection 
established to dx-2.novalocal/192.168.80.27:2188, initiating session 
2018-05-05 08:18:50,813 INFO org.apache.zookeeper.ClientCnxn: Unable to read 
additional data from server sessionid 0x0, likely server has closed socket, 
closing socket connection and attempting reconnect 
 

2018-05-05 08:18:50,947 INFO org.apache.helix.manager.zk.ZkClient: Closing 
zkclient: State:CONNECTING sessionid:0x0 local:null remoteserver:null 
lastZxid:0 xid:1 sent:35 recv:0 queuedpkts:0 pendingresp:0 queuedevents:0 
2018-05-05 08:18:50,947 INFO org.I0Itec.zkclient.ZkEventThread: Terminate 
ZkClient event thread. 
2018-05-05 08:18:51,352 INFO org.apache.zookeeper.ZooKeeper: Session: 0x0 
closed 
2018-05-05 08:18:51,352 INFO org.apache.helix.manager.zk.ZkClient: Closed 
zkclient 
2018-05-05 08:18:51,352 ERROR 
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore:
 org.I0Itec.zkclient.exception.ZkTimeoutException: Unable to connect to 
zookeeper server within timeout: 3 
2018-05-05 08:18:51,354 INFO org.apache.hadoop.service.AbstractService: Service 
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore
 failed in state INITED; cause: 
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.MetricsSystemInitializationException:
 Unable to initialize HA controller 
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.MetricsSystemInitializationException:
 Unable to initialize HA controller 
at 
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore.initializeSubsystem(HBaseTimelineMetricStore.java:118)
 
at 
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore.serviceInit(HBaseTimelineMetricStore.java:96)
 
. 

The 2188 port is my setting about zookeeper, and from web UI, its status is OK. 
Also i check zookeeper process, it runs as usual. 

By the way, metrics needs listen 6188 port, but i use `netstat` to check, 
related processes do not start. 

I do not know how to fix it, could someone help me? 

Thanks

Re: metrics do not show

2018-05-06 Thread xiang . dai 
There is no conf: 
[root@dx-a ~]# less /etc/ambari-metrics/conf/metrics_grafana.ini 
/etc/ambari-metrics/conf/metrics_grafana.ini: No such file or directory 
[root@dx-a ~]# yum list | grep grafana 
ambari-metrics-grafana.x86_64 2.6.1.0-143 @dx-ambari 

I download pkgs and make my own repo including it. 


From: "Siddharth Wagle"  
To: "user"  
Sent: Saturday, May 5, 2018 11:05:18 PM 
Subject: Re: metrics do not show 



That is the Phoenix metrics system initialization of AMS itself and is 
non-consequential for the dashboard or Grafana metrics. 





Check your /etc/ambari-metrics/conf/metrics_grafana.ini is pointing to the 
collector. 





- Sid 




From: xiang@sky-data.cn  
Sent: Friday, May 4, 2018 11:25 PM 
To: user 
Subject: Re: metrics do not show 
I found below wwaring: 
2018-05-05 06:19:30,393 WARN org.apache.hadoop.metrics2.impl.MetricsConfig: 
Cannot locate configuration: tried 
hadoop-metrics2-phoenix.properties,hadoop-metrics2.properties 


From: "Aravindan Vijayan"  
To: "user"  
Sent: Friday, May 4, 2018 9:02:46 PM 
Subject: Re: metrics do not show 



Hi Xiang, 



If you have Grafana installed, can you check if the System-Servers and 
System-Home dashboard show data? 




-- 


Thanks and Regards, 


Aravindan Vijayan 




From: "xiang@sky-data.cn"  
Reply-To: "user@ambari.apache.org"  
Date: Friday, May 4, 2018 at 12:51 AM 
To: user  
Subject: metrics do not show 





But i find that metrics in AMBARI-METRICS and metrics in hosts can not show. 



-- 
戴翔 
南京天数信息科技有限公司 
电话: +86 1 3382776490 
公司官网: www.sky-data.cn 
免费使用天数润科智能计算平台 SkyDiscovery

Re: metrics do not show

2018-05-06 Thread xiang . dai 
There is no conf: 
[root@dx-a ~]# less /etc/ambari-metrics/conf/metrics_grafana.ini 
/etc/ambari-metrics/conf/metrics_grafana.ini: No such file or directory 
[root@dx-a ~]# yum list | grep grafana 
ambari-metrics-grafana.x86_64 2.6.1.0-143 @dx-ambari 

I download pkgs and make my own repo including it. 


From: "Siddharth Wagle"  
To: "user"  
Sent: Saturday, May 5, 2018 11:05:18 PM 
Subject: Re: metrics do not show 



That is the Phoenix metrics system initialization of AMS itself and is 
non-consequential for the dashboard or Grafana metrics. 





Check your /etc/ambari-metrics/conf/metrics_grafana.ini is pointing to the 
collector. 





- Sid 




From: xiang@sky-data.cn  
Sent: Friday, May 4, 2018 11:25 PM 
To: user 
Subject: Re: metrics do not show 
I found below wwaring: 
2018-05-05 06:19:30,393 WARN org.apache.hadoop.metrics2.impl.MetricsConfig: 
Cannot locate configuration: tried 
hadoop-metrics2-phoenix.properties,hadoop-metrics2.properties 


From: "Aravindan Vijayan"  
To: "user"  
Sent: Friday, May 4, 2018 9:02:46 PM 
Subject: Re: metrics do not show 



Hi Xiang, 



If you have Grafana installed, can you check if the System-Servers and 
System-Home dashboard show data? 




-- 


Thanks and Regards, 


Aravindan Vijayan 




From: "xiang@sky-data.cn"  
Reply-To: "user@ambari.apache.org"  
Date: Friday, May 4, 2018 at 12:51 AM 
To: user  
Subject: metrics do not show 





But i find that metrics in AMBARI-METRICS and metrics in hosts can not show. 



-- 
戴翔 
南京天数信息科技有限公司 
电话: +86 1 3382776490 
公司官网: www.sky-data.cn 
免费使用天数润科智能计算平台 SkyDiscovery

metrics can not work as expected

2018-05-05 Thread xiang . dai 
Hi! 

I tested installation on my vbox, it works well, then i move it to a server 
which run many services. 

When install, it failed at check service status. 

I checked ambari-metrics-collector.log and found below error: 

2018-05-05 08:16:03,536 INFO org.apache.phoenix.metrics.Metrics: Initializing 
metrics system: phoenix 
2018-05-05 08:16:03,559 WARN org.apache.hadoop.metrics2.impl.MetricsConfig: 
Cannot locate configuration: tried 
hadoop-metrics2-phoenix.properties,hadoop-metrics2.properties 
 

2018-05-05 08:18:50,342 INFO org.apache.zookeeper.ClientCnxn: Socket connection 
established to dx-1.novalocal/192.168.80.34:2188, initiating session 
2018-05-05 08:18:50,343 INFO org.apache.zookeeper.ClientCnxn: Unable to read 
additional data from server sessionid 0x0, likely server has closed socket, 
closing socket connection and attempting reconnect 
2018-05-05 08:18:50,811 INFO org.apache.zookeeper.ClientCnxn: Opening socket 
connection to server dx-2.novalocal/192.168.80.27:2188. Will not attempt to 
authenticate using SASL (unknown error) 
2018-05-05 08:18:50,812 INFO org.apache.zookeeper.ClientCnxn: Socket connection 
established to dx-2.novalocal/192.168.80.27:2188, initiating session 
2018-05-05 08:18:50,813 INFO org.apache.zookeeper.ClientCnxn: Unable to read 
additional data from server sessionid 0x0, likely server has closed socket, 
closing socket connection and attempting reconnect 
 

2018-05-05 08:18:50,947 INFO org.apache.helix.manager.zk.ZkClient: Closing 
zkclient: State:CONNECTING sessionid:0x0 local:null remoteserver:null 
lastZxid:0 xid:1 sent:35 recv:0 queuedpkts:0 pendingresp:0 queuedevents:0 
2018-05-05 08:18:50,947 INFO org.I0Itec.zkclient.ZkEventThread: Terminate 
ZkClient event thread. 
2018-05-05 08:18:51,352 INFO org.apache.zookeeper.ZooKeeper: Session: 0x0 
closed 
2018-05-05 08:18:51,352 INFO org.apache.helix.manager.zk.ZkClient: Closed 
zkclient 
2018-05-05 08:18:51,352 ERROR 
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore:
 org.I0Itec.zkclient.exception.ZkTimeoutException: Unable to connect to 
zookeeper server within timeout: 3 
2018-05-05 08:18:51,354 INFO org.apache.hadoop.service.AbstractService: Service 
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore
 failed in state INITED; cause: 
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.MetricsSystemInitializationException:
 Unable to initialize HA controller 
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.MetricsSystemInitializationException:
 Unable to initialize HA controller 
at 
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore.initializeSubsystem(HBaseTimelineMetricStore.java:118)
 
at 
org.apache.hadoop.yarn.server.applicationhistoryservice.metrics.timeline.HBaseTimelineMetricStore.serviceInit(HBaseTimelineMetricStore.java:96)
 
. 

The 2188 port is my setting about zookeeper, and from web UI, its status is OK. 
Also i check zookeeper process, it runs as usual. 

By the way, metrics needs listen 6188 port, but i use `netstat` to check, 
related processes do not start. 

I do not know how to fix it, could someone help me? 

Thanks

Re: metrics do not show

2018-05-05 Thread xiang . dai 
I found below wwaring: 
2018-05-05 06:19:30,393 WARN org.apache.hadoop.metrics2.impl.MetricsConfig: 
Cannot locate configuration: tried 
hadoop-metrics2-phoenix.properties,hadoop-metrics2.properties 


From: "Aravindan Vijayan"  
To: "user"  
Sent: Friday, May 4, 2018 9:02:46 PM 
Subject: Re: metrics do not show 



Hi Xiang, 



If you have Grafana installed, can you check if the System-Servers and 
System-Home dashboard show data? 




-- 


Thanks and Regards, 


Aravindan Vijayan 




From: "xiang@sky-data.cn"  
Reply-To: "user@ambari.apache.org"  
Date: Friday, May 4, 2018 at 12:51 AM 
To: user  
Subject: metrics do not show 





But i find that metrics in AMBARI-METRICS and metrics in hosts can not show.

metrics do not show

2018-05-04 Thread xiang . dai 
Hi! 

I build 2.6.1 ambari server and agent following docs. 

Then I succeed in installing zookeeper and ambari-metrics, and metrics in 
dashborad looks very good. 

But i find that metrics in AMBARI-METRICS and metrics in hosts can not show. 

I check the log but do not find error. 

Did i miss something import? 

Could someone help me? 

Thanks

How to use installed zookeeper to install Ambari Metrics

2018-03-01 Thread xiang . dai 
Hi! 

I have a cluster which has installed zookeeper, and i want to use Ambari to 
manage it. 

Also, Ambari Metrics is so cool that i want to add it to my cluster. 

Is it possible? If so, how to make it?

how to support multi languages

2018-02-08 Thread xiang . dai 
Hi! 

I am kind of new to Ambari, and it is a wonderful tool to deploy hadoop env. 

I have a question that how can i use other language to show in web. 

Is there a easy way to do it? 

Thanks

How to write service scripts in shell

2018-01-03 Thread xiang . dai 


Hi! 





I am new about ambari and want to add customized services. 

I am used to writing scripts in shell. 


I read docs at ambari and seems that ambari support use shell to write service 
scripts. But i do not find any examples. All service scripts in ambari repo are 
in python. 

Could someone know how to use shell to write service scripts for ambari? Or 
somewhere can get examples? 




Thanks 


Dai