Hi, Team
The auto scaling only work for onetime, after that stoped work, ( restarted
APP / Reboot the instance in openstack still not work.)
The debug log attached here:
[2015-03-17 18:50:04,205] DEBUG
{org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
- Avg load avg event: [cluster] lb.lb.domain [network-partition]
openstack-region1 [value] 1.0
[2015-03-17 18:50:04,205] DEBUG
{org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
- Avg load avg event: [cluster] php.php301.domain [network-partition]
openstack-region1 [value] 999.0
[2015-03-17 18:50:04,206] DEBUG
{org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
- Member avg of load avg event: [member]
lb.lb.domain58ac9d95-9ab8-459a-80c2-fd0ec44a0d2e [value] 1.0
[2015-03-17 18:50:04,206] DEBUG
{org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
- Member avg of load avg event: [member]
php.php301.domaind0e67359-39c5-4aba-b6eb-6dfa602f90d3 [value] 999.0
[2015-03-17 18:50:04,207] DEBUG
{org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
- Avg Memory Consumption event: [cluster] lb.lb.domain [network-partition]
openstack-region1 [value] 24.856016
[2015-03-17 18:50:04,208] DEBUG
{org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
- Avg Memory Consumption event: [cluster] php.php301.domain
[network-partition] openstack-region1 [value] 49.108723
[2015-03-17 18:50:04,209] DEBUG
{org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
- Member avg Memory Consumption event: [member]
lb.lb.domain58ac9d95-9ab8-459a-80c2-fd0ec44a0d2e [value] 24.856016
[2015-03-17 18:50:04,209] DEBUG
{org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
- Member avg Memory Consumption event: [member]
php.php301.domaind0e67359-39c5-4aba-b6eb-6dfa602f90d3 [value] 49.108723
[2015-03-17 18:50:04,243] DEBUG
{org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
- Member grad of load avg event: [member]
lb.lb.domain58ac9d95-9ab8-459a-80c2-fd0ec44a0d2e [value] 22.158789
[2015-03-17 18:50:04,250] DEBUG
{org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
- Grad of load avg event: [cluster] lb.lb.domain [network-partition]
openstack-region1 [value] 22.158789
[2015-03-17 18:50:04,252] DEBUG
{org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
- Member grad of Memory Consumption event: [member]
lb.lb.domain58ac9d95-9ab8-459a-80c2-fd0ec44a0d2e [value] 0.5358955
[2015-03-17 18:50:04,253] DEBUG
{org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
- Grad of Memory Consumption event: [cluster] lb.lb.domain
[network-partition] openstack-region1 [value] 0.5358955
[2015-03-17 18:50:04,337] DEBUG
{org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
- Average Rif event: [cluster] php.php301.domain [network-partition]
openstack-region1 [value] 0.0
[2015-03-17 18:50:04,338] DEBUG
{org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
- Average Rif event: [cluster] lb.lb.domain [network-partition]
openstack-region1 [value] 0.0
[2015-03-17 18:50:04,346] DEBUG
{org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
- Gradient of Rif event: [cluster] php.php301.domain [network-partition]
openstack-region1 [value] 0.0
[2015-03-17 18:50:04,499] DEBUG
{org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
- Second Derivation of Memory Consumption event: [cluster] lb.lb.domain
[network-partition] openstack-region1 [value] 0.0054160617
[2015-03-17 18:50:04,499] DEBUG
{org.apache.stratos.autoscaler.NetworkPartitionContext} - Memory
consumption stats are reset, ready to do scale check [network partition]
openstack-region1
[2015-03-17 18:50:04,502] DEBUG
{org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
- Second Derivation of load avg event: [cluster] lb.lb.domain
[network-partition] openstack-region1 [value] 9.625086E-4
[2015-03-17 18:50:04,502] DEBUG
{org.apache.stratos.autoscaler.NetworkPartitionContext} - Load average
stats are reset, ready to do scale check [network partition]
openstack-region1
[2015-03-17 18:50:04,503] DEBUG
{org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
- Member Second Derivation of load avg event: [member]
lb.lb.domain58ac9d95-9ab8-459a-80c2-fd0ec44a0d2e [value] 9.625086E-4
[2015-03-17 18:50:04,530] DEBUG
{org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
- Second derivative of Rif event: [cluster] php.php301.domain
[network-partition] openstack-region1 [value] 0.0
[2015-03-17 18:50:04,531] DEBUG
{org.apache.stratos.autoscaler.NetworkPartitionContext} - Requests in
flights stats are reset, ready to do scale check [network partition]
openstack-region1
[2015-03-17 18:50:15,069] DEBUG
{org.apache.stratos.autoscaler.monitor.ClusterMonitor} - Cluster monitor
is running.. ClusterMonitor [clusterId=php.php301.domain, serviceId=php301,
deploymentPolicy=Deployment Policy [id]economyDeployment [partitions]
[org.apache.stratos.cloud.controller.stub.deployment.partition.Partition@692b2214],
autoscalePolicy=ASPolicy [id=economyPolicyload, displayName=null,
description=null], lbReferenceType=null]
[2015-03-17 18:50:15,069] DEBUG
{org.apache.stratos.autoscaler.monitor.ClusterMonitor} - Running minimum
check for partition zone-1
[2015-03-17 18:50:15,070] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - Running minimum rule:
[network-partition] openstack-region1 [partition] zone-1
[2015-03-17 18:50:15,070] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - [min-check]
[network-partition] openstack-region1 [partition] zone-1 Non terminated
member count: 1
[2015-03-17 18:50:15,070] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - [min-check]
[network-partition] openstack-region1 [partition] zone-1 Minimum member
count: 1
[2015-03-17 18:50:15,070] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - Running obsolete instances
rule: [partition] zone-1 [network-partition] openstack-region1
[2015-03-17 18:50:15,070] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - [obsolete-check]
[network-partition] openstack-region1 [partition] zone-1 Obsolete member
count: 0
[2015-03-17 18:50:15,071] DEBUG
{org.apache.stratos.autoscaler.rule.AutoscalerRuleEvaluator} - Minimum
check executed for : org.apache.stratos.autoscaler.PartitionContext@1c585de8
[2015-03-17 18:50:15,071] DEBUG
{org.apache.stratos.autoscaler.monitor.ClusterMonitor} - Running scale
check for network partition openstack-region1
[2015-03-17 18:50:15,071] DEBUG
{org.apache.stratos.autoscaler.rule.RuleTasksDelegator} - Partition
algorithm is
[2015-03-17 18:50:15,071] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - Running scale up rule:
[network-partition] openstack-region1 [cluster] php.php301.domain
[2015-03-17 18:50:15,071] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - [scaling]
[network-partition] openstack-region1 [cluster] php.php301.domain Algorithm
name: one-after-another
[2015-03-17 18:50:15,072] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - [scaling]
[network-partition] openstack-region1 [cluster] php.php301.domain
Algorithm: org.apache.stratos.autoscaler.algorithm.OneAfterAnother@51e30103
[2015-03-17 18:50:15,072] DEBUG
{org.apache.stratos.autoscaler.rule.RuleTasksDelegator} - Predicting the
value, [average]: 0.0 , [gradient]: 0.0 , [second derivative]: 0.0 , [time
intervals]: 1
[2015-03-17 18:50:15,072] DEBUG
{org.apache.stratos.autoscaler.rule.RuleTasksDelegator} - Predicting the
value, [average]: 49.108723 , [gradient]: 0.0 , [second derivative]: 0.0 ,
[time intervals]: 1
[2015-03-17 18:50:15,073] DEBUG
{org.apache.stratos.autoscaler.rule.RuleTasksDelegator} - Predicting the
value, [average]: 999.0 , [gradient]: 0.0 , [second derivative]: 0.0 ,
[time intervals]: 1
[2015-03-17 18:50:15,073] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] [cluster]
php.php301.domain RIF predicted value: 0.0
[2015-03-17 18:50:15,073] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] [cluster]
php.php301.domain RIF average limit: 0.0
[2015-03-17 18:50:15,073] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] [cluster]
php.php301.domain MC predicted value: 49.10872268676758
[2015-03-17 18:50:15,073] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] [cluster]
php.php301.domain MC average limit: 0.0
[2015-03-17 18:50:15,073] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] [cluster]
php.php301.domain LA predicted value: 999.0
[2015-03-17 18:50:15,074] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] [cluster]
php.php301.domain LA Average limit: 30.0
[2015-03-17 18:50:15,074] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] [cluster]
php.php301.domain Scale-up action: false
[2015-03-17 18:50:15,074] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] [cluster]
php.php301.domain Scale-down action: false
[2015-03-17 18:50:15,074] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] No decision made
to either scale up or scale down ...
[2015-03-17 18:50:15,074] DEBUG
{org.apache.stratos.autoscaler.rule.AutoscalerRuleEvaluator} - Scale check
executed for : NetworkPartitionContext
[id=openstack-region1partitionAlgorithm=one-after-another,
minInstanceCount=1, maxInstanceCount=1]
[2015-03-17 18:50:23,780] DEBUG
{org.apache.stratos.autoscaler.monitor.ClusterMonitor} - Cluster monitor
is running.. ClusterMonitor [clusterId=lb.lb.domain, serviceId=lb,
deploymentPolicy=Deployment Policy [id]economyDeployment [partitions]
[org.apache.stratos.cloud.controller.stub.deployment.partition.Partition@692b2214],
autoscalePolicy=ASPolicy [id=economyPolicy, displayName=null,
description=null], lbReferenceType=null]
[2015-03-17 18:50:23,784] DEBUG
{org.apache.stratos.autoscaler.monitor.ClusterMonitor} - Running minimum
check for partition zone-1
[2015-03-17 18:50:23,784] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - Running minimum rule:
[network-partition] openstack-region1 [partition] zone-1
[2015-03-17 18:50:23,785] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - [min-check]
[network-partition] openstack-region1 [partition] zone-1 Non terminated
member count: 1
[2015-03-17 18:50:23,785] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - [min-check]
[network-partition] openstack-region1 [partition] zone-1 Minimum member
count: 1
[2015-03-17 18:50:23,785] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - Running obsolete instances
rule: [partition] zone-1 [network-partition] openstack-region1
[2015-03-17 18:50:23,785] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - [obsolete-check]
[network-partition] openstack-region1 [partition] zone-1 Obsolete member
count: 0
[2015-03-17 18:50:23,785] DEBUG
{org.apache.stratos.autoscaler.rule.AutoscalerRuleEvaluator} - Minimum
check executed for : org.apache.stratos.autoscaler.PartitionContext@211daacc
[2015-03-17 18:50:23,786] DEBUG
{org.apache.stratos.autoscaler.monitor.ClusterMonitor} - Running scale
check for network partition openstack-region1
[2015-03-17 18:50:23,786] DEBUG
{org.apache.stratos.autoscaler.rule.RuleTasksDelegator} - Partition
algorithm is
[2015-03-17 18:50:23,786] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - Running scale up rule:
[network-partition] openstack-region1 [cluster] lb.lb.domain
[2015-03-17 18:50:23,786] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - [scaling]
[network-partition] openstack-region1 [cluster] lb.lb.domain Algorithm
name: one-after-another
[2015-03-17 18:50:23,787] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - [scaling]
[network-partition] openstack-region1 [cluster] lb.lb.domain Algorithm:
org.apache.stratos.autoscaler.algorithm.OneAfterAnother@132e0471
[2015-03-17 18:50:23,787] DEBUG
{org.apache.stratos.autoscaler.rule.RuleTasksDelegator} - Predicting the
value, [average]: 0.0 , [gradient]: 0.0 , [second derivative]: 0.0 , [time
intervals]: 1
[2015-03-17 18:50:23,787] DEBUG
{org.apache.stratos.autoscaler.rule.RuleTasksDelegator} - Predicting the
value, [average]: 24.856016 , [gradient]: 0.5358955 , [second derivative]:
0.0054160617 , [time intervals]: 1
[2015-03-17 18:50:23,788] DEBUG
{org.apache.stratos.autoscaler.rule.RuleTasksDelegator} - Predicting the
value, [average]: 1.0 , [gradient]: 22.158789 , [second derivative]:
9.625086E-4 , [time intervals]: 1
[2015-03-17 18:50:23,788] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] [cluster]
lb.lb.domain RIF predicted value: 0.0
[2015-03-17 18:50:23,788] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] [cluster]
lb.lb.domain RIF average limit: 40.0
[2015-03-17 18:50:23,788] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] [cluster]
lb.lb.domain MC predicted value: 25.394620491191745
[2015-03-17 18:50:23,789] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] [cluster]
lb.lb.domain MC average limit: 100.0
[2015-03-17 18:50:23,789] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] [cluster]
lb.lb.domain LA predicted value: 23.159269935335033
[2015-03-17 18:50:23,789] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] [cluster]
lb.lb.domain LA Average limit: 100.0
[2015-03-17 18:50:23,789] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] [cluster]
lb.lb.domain Scale-up action: false
[2015-03-17 18:50:23,789] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] [cluster]
lb.lb.domain Scale-down action: false
[2015-03-17 18:50:23,790] DEBUG
{org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] No decision made
to either scale up or scale down ...
[2015-03-17 18:50:23,790] DEBUG
{org.apache.stratos.autoscaler.rule.AutoscalerRuleEvaluator} - Scale check
executed for : NetworkPartitionContext
[id=openstack-region1partitionAlgorithm=one-after-another,
minInstanceCount=1, maxInstanceCount=1]
Please help,
Thanks
-D