I found the issue is the Scale-up action update too slow. If any idea to configure this Scale-up action more quick?
Thanks -D On Tue, Mar 17, 2015 at 11:51 AM, david hbase <[email protected]> wrote: > Hi, Team > > The auto scaling only work for onetime, after that stoped work, ( > restarted APP / Reboot the instance in openstack still not work.) > > The debug log attached here: > > [2015-03-17 18:50:04,205] DEBUG > {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver} > - Avg load avg event: [cluster] lb.lb.domain [network-partition] > openstack-region1 [value] 1.0 > [2015-03-17 18:50:04,205] DEBUG > {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver} > - Avg load avg event: [cluster] php.php301.domain [network-partition] > openstack-region1 [value] 999.0 > [2015-03-17 18:50:04,206] DEBUG > {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver} > - Member avg of load avg event: [member] > lb.lb.domain58ac9d95-9ab8-459a-80c2-fd0ec44a0d2e [value] 1.0 > [2015-03-17 18:50:04,206] DEBUG > {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver} > - Member avg of load avg event: [member] > php.php301.domaind0e67359-39c5-4aba-b6eb-6dfa602f90d3 [value] 999.0 > [2015-03-17 18:50:04,207] DEBUG > {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver} > - Avg Memory Consumption event: [cluster] lb.lb.domain [network-partition] > openstack-region1 [value] 24.856016 > [2015-03-17 18:50:04,208] DEBUG > {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver} > - Avg Memory Consumption event: [cluster] php.php301.domain > [network-partition] openstack-region1 [value] 49.108723 > [2015-03-17 18:50:04,209] DEBUG > {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver} > - Member avg Memory Consumption event: [member] > lb.lb.domain58ac9d95-9ab8-459a-80c2-fd0ec44a0d2e [value] 24.856016 > [2015-03-17 18:50:04,209] DEBUG > {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver} > - Member avg Memory Consumption event: [member] > php.php301.domaind0e67359-39c5-4aba-b6eb-6dfa602f90d3 [value] 49.108723 > [2015-03-17 18:50:04,243] DEBUG > {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver} > - Member grad of load avg event: [member] > lb.lb.domain58ac9d95-9ab8-459a-80c2-fd0ec44a0d2e [value] 22.158789 > [2015-03-17 18:50:04,250] DEBUG > {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver} > - Grad of load avg event: [cluster] lb.lb.domain [network-partition] > openstack-region1 [value] 22.158789 > [2015-03-17 18:50:04,252] DEBUG > {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver} > - Member grad of Memory Consumption event: [member] > lb.lb.domain58ac9d95-9ab8-459a-80c2-fd0ec44a0d2e [value] 0.5358955 > [2015-03-17 18:50:04,253] DEBUG > {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver} > - Grad of Memory Consumption event: [cluster] lb.lb.domain > [network-partition] openstack-region1 [value] 0.5358955 > [2015-03-17 18:50:04,337] DEBUG > {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver} > - Average Rif event: [cluster] php.php301.domain [network-partition] > openstack-region1 [value] 0.0 > [2015-03-17 18:50:04,338] DEBUG > {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver} > - Average Rif event: [cluster] lb.lb.domain [network-partition] > openstack-region1 [value] 0.0 > [2015-03-17 18:50:04,346] DEBUG > {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver} > - Gradient of Rif event: [cluster] php.php301.domain [network-partition] > openstack-region1 [value] 0.0 > [2015-03-17 18:50:04,499] DEBUG > {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver} > - Second Derivation of Memory Consumption event: [cluster] lb.lb.domain > [network-partition] openstack-region1 [value] 0.0054160617 > [2015-03-17 18:50:04,499] DEBUG > {org.apache.stratos.autoscaler.NetworkPartitionContext} - Memory > consumption stats are reset, ready to do scale check [network partition] > openstack-region1 > [2015-03-17 18:50:04,502] DEBUG > {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver} > - Second Derivation of load avg event: [cluster] lb.lb.domain > [network-partition] openstack-region1 [value] 9.625086E-4 > [2015-03-17 18:50:04,502] DEBUG > {org.apache.stratos.autoscaler.NetworkPartitionContext} - Load average > stats are reset, ready to do scale check [network partition] > openstack-region1 > [2015-03-17 18:50:04,503] DEBUG > {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver} > - Member Second Derivation of load avg event: [member] > lb.lb.domain58ac9d95-9ab8-459a-80c2-fd0ec44a0d2e [value] 9.625086E-4 > [2015-03-17 18:50:04,530] DEBUG > {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver} > - Second derivative of Rif event: [cluster] php.php301.domain > [network-partition] openstack-region1 [value] 0.0 > [2015-03-17 18:50:04,531] DEBUG > {org.apache.stratos.autoscaler.NetworkPartitionContext} - Requests in > flights stats are reset, ready to do scale check [network partition] > openstack-region1 > [2015-03-17 18:50:15,069] DEBUG > {org.apache.stratos.autoscaler.monitor.ClusterMonitor} - Cluster monitor > is running.. ClusterMonitor [clusterId=php.php301.domain, serviceId=php301, > deploymentPolicy=Deployment Policy [id]economyDeployment [partitions] > [org.apache.stratos.cloud.controller.stub.deployment.partition.Partition@692b2214], > autoscalePolicy=ASPolicy [id=economyPolicyload, displayName=null, > description=null], lbReferenceType=null] > [2015-03-17 18:50:15,069] DEBUG > {org.apache.stratos.autoscaler.monitor.ClusterMonitor} - Running minimum > check for partition zone-1 > [2015-03-17 18:50:15,070] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - Running minimum rule: > [network-partition] openstack-region1 [partition] zone-1 > [2015-03-17 18:50:15,070] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - [min-check] > [network-partition] openstack-region1 [partition] zone-1 Non terminated > member count: 1 > [2015-03-17 18:50:15,070] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - [min-check] > [network-partition] openstack-region1 [partition] zone-1 Minimum member > count: 1 > [2015-03-17 18:50:15,070] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - Running obsolete instances > rule: [partition] zone-1 [network-partition] openstack-region1 > [2015-03-17 18:50:15,070] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - [obsolete-check] > [network-partition] openstack-region1 [partition] zone-1 Obsolete member > count: 0 > [2015-03-17 18:50:15,071] DEBUG > {org.apache.stratos.autoscaler.rule.AutoscalerRuleEvaluator} - Minimum > check executed for : org.apache.stratos.autoscaler.PartitionContext@1c585de8 > > [2015-03-17 18:50:15,071] DEBUG > {org.apache.stratos.autoscaler.monitor.ClusterMonitor} - Running scale > check for network partition openstack-region1 > [2015-03-17 18:50:15,071] DEBUG > {org.apache.stratos.autoscaler.rule.RuleTasksDelegator} - Partition > algorithm is > [2015-03-17 18:50:15,071] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - Running scale up rule: > [network-partition] openstack-region1 [cluster] php.php301.domain > [2015-03-17 18:50:15,071] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] > [network-partition] openstack-region1 [cluster] php.php301.domain Algorithm > name: one-after-another > [2015-03-17 18:50:15,072] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] > [network-partition] openstack-region1 [cluster] php.php301.domain > Algorithm: org.apache.stratos.autoscaler.algorithm.OneAfterAnother@51e30103 > [2015-03-17 18:50:15,072] DEBUG > {org.apache.stratos.autoscaler.rule.RuleTasksDelegator} - Predicting the > value, [average]: 0.0 , [gradient]: 0.0 , [second derivative]: 0.0 , [time > intervals]: 1 > [2015-03-17 18:50:15,072] DEBUG > {org.apache.stratos.autoscaler.rule.RuleTasksDelegator} - Predicting the > value, [average]: 49.108723 , [gradient]: 0.0 , [second derivative]: 0.0 , > [time intervals]: 1 > [2015-03-17 18:50:15,073] DEBUG > {org.apache.stratos.autoscaler.rule.RuleTasksDelegator} - Predicting the > value, [average]: 999.0 , [gradient]: 0.0 , [second derivative]: 0.0 , > [time intervals]: 1 > [2015-03-17 18:50:15,073] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] [cluster] > php.php301.domain RIF predicted value: 0.0 > [2015-03-17 18:50:15,073] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] [cluster] > php.php301.domain RIF average limit: 0.0 > [2015-03-17 18:50:15,073] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] [cluster] > php.php301.domain MC predicted value: 49.10872268676758 > [2015-03-17 18:50:15,073] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] [cluster] > php.php301.domain MC average limit: 0.0 > [2015-03-17 18:50:15,073] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] [cluster] > php.php301.domain LA predicted value: 999.0 > [2015-03-17 18:50:15,074] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] [cluster] > php.php301.domain LA Average limit: 30.0 > [2015-03-17 18:50:15,074] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] [cluster] > php.php301.domain Scale-up action: false > [2015-03-17 18:50:15,074] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] [cluster] > php.php301.domain Scale-down action: false > [2015-03-17 18:50:15,074] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] No decision made > to either scale up or scale down ... > [2015-03-17 18:50:15,074] DEBUG > {org.apache.stratos.autoscaler.rule.AutoscalerRuleEvaluator} - Scale check > executed for : NetworkPartitionContext > [id=openstack-region1partitionAlgorithm=one-after-another, > minInstanceCount=1, maxInstanceCount=1] > [2015-03-17 18:50:23,780] DEBUG > {org.apache.stratos.autoscaler.monitor.ClusterMonitor} - Cluster monitor > is running.. ClusterMonitor [clusterId=lb.lb.domain, serviceId=lb, > deploymentPolicy=Deployment Policy [id]economyDeployment [partitions] > [org.apache.stratos.cloud.controller.stub.deployment.partition.Partition@692b2214], > autoscalePolicy=ASPolicy [id=economyPolicy, displayName=null, > description=null], lbReferenceType=null] > [2015-03-17 18:50:23,784] DEBUG > {org.apache.stratos.autoscaler.monitor.ClusterMonitor} - Running minimum > check for partition zone-1 > [2015-03-17 18:50:23,784] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - Running minimum rule: > [network-partition] openstack-region1 [partition] zone-1 > [2015-03-17 18:50:23,785] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - [min-check] > [network-partition] openstack-region1 [partition] zone-1 Non terminated > member count: 1 > [2015-03-17 18:50:23,785] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - [min-check] > [network-partition] openstack-region1 [partition] zone-1 Minimum member > count: 1 > [2015-03-17 18:50:23,785] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - Running obsolete instances > rule: [partition] zone-1 [network-partition] openstack-region1 > [2015-03-17 18:50:23,785] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - [obsolete-check] > [network-partition] openstack-region1 [partition] zone-1 Obsolete member > count: 0 > [2015-03-17 18:50:23,785] DEBUG > {org.apache.stratos.autoscaler.rule.AutoscalerRuleEvaluator} - Minimum > check executed for : org.apache.stratos.autoscaler.PartitionContext@211daacc > > [2015-03-17 18:50:23,786] DEBUG > {org.apache.stratos.autoscaler.monitor.ClusterMonitor} - Running scale > check for network partition openstack-region1 > [2015-03-17 18:50:23,786] DEBUG > {org.apache.stratos.autoscaler.rule.RuleTasksDelegator} - Partition > algorithm is > [2015-03-17 18:50:23,786] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - Running scale up rule: > [network-partition] openstack-region1 [cluster] lb.lb.domain > [2015-03-17 18:50:23,786] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] > [network-partition] openstack-region1 [cluster] lb.lb.domain Algorithm > name: one-after-another > [2015-03-17 18:50:23,787] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] > [network-partition] openstack-region1 [cluster] lb.lb.domain Algorithm: > org.apache.stratos.autoscaler.algorithm.OneAfterAnother@132e0471 > [2015-03-17 18:50:23,787] DEBUG > {org.apache.stratos.autoscaler.rule.RuleTasksDelegator} - Predicting the > value, [average]: 0.0 , [gradient]: 0.0 , [second derivative]: 0.0 , [time > intervals]: 1 > [2015-03-17 18:50:23,787] DEBUG > {org.apache.stratos.autoscaler.rule.RuleTasksDelegator} - Predicting the > value, [average]: 24.856016 , [gradient]: 0.5358955 , [second derivative]: > 0.0054160617 , [time intervals]: 1 > [2015-03-17 18:50:23,788] DEBUG > {org.apache.stratos.autoscaler.rule.RuleTasksDelegator} - Predicting the > value, [average]: 1.0 , [gradient]: 22.158789 , [second derivative]: > 9.625086E-4 , [time intervals]: 1 > [2015-03-17 18:50:23,788] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] [cluster] > lb.lb.domain RIF predicted value: 0.0 > [2015-03-17 18:50:23,788] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] [cluster] > lb.lb.domain RIF average limit: 40.0 > [2015-03-17 18:50:23,788] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] [cluster] > lb.lb.domain MC predicted value: 25.394620491191745 > [2015-03-17 18:50:23,789] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] [cluster] > lb.lb.domain MC average limit: 100.0 > [2015-03-17 18:50:23,789] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] [cluster] > lb.lb.domain LA predicted value: 23.159269935335033 > [2015-03-17 18:50:23,789] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] [cluster] > lb.lb.domain LA Average limit: 100.0 > [2015-03-17 18:50:23,789] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] [cluster] > lb.lb.domain Scale-up action: false > [2015-03-17 18:50:23,789] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] [cluster] > lb.lb.domain Scale-down action: false > [2015-03-17 18:50:23,790] DEBUG > {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling] No decision made > to either scale up or scale down ... > [2015-03-17 18:50:23,790] DEBUG > {org.apache.stratos.autoscaler.rule.AutoscalerRuleEvaluator} - Scale check > executed for : NetworkPartitionContext > [id=openstack-region1partitionAlgorithm=one-after-another, > minInstanceCount=1, maxInstanceCount=1] > > > Please help, > Thanks > -D >
