Re: [Dev] [PPaaS] Integrating DAS with Stratos for Metering Service and Monitoring Health Statistics

2015-07-11 Thread Udara Liyanage
Hi Iranga,

In Stratos cartridge agents inside the instances or containers sends their
health statistics to CEP. Then CEP aggregates and
publish aggregated results to the message broker which is then used by
Stratos Auto Scaler for scaling decisions. This is what
exist in Stratos now. I guess this diagram shows those details are
published to DAS as well for health monitoring.
In a real deployment Stratos components (CC, AS and SM) and CEP and DAS are
deployed in deployed in destroyed fashion. Thus using external CEP
is better rather than in DAS. In addition we need CEP even if someone
disable metering and health monitoring


On Fri, Jul 10, 2015 at 8:17 PM, Pubudu Gunatilaka pubu...@wso2.com wrote:

 Hi Iranga,

 Actually Stratos uses separate CEP to analyse health statistics that are
 published from cartridges and services. Those analysed data are sent to the
 Autoscaler to take autoscaling decisions. You can find more information in
 [1].

 In this DAS integration with Stratos, for the requirement of monitoring
 health statistics we need those summerized data from CEP. Therefore we need
 to publish those data from CEP to DAS. Other thing is DAS is an extension
 point in Stratos. Depend on the user requirement, he can use DAS for
 monitoring real time statistics.

 [1] -
 https://cwiki.apache.org/confluence/display/STRATOS/4.1.0+Complex+Event+Processor

 Thank you!

 On Fri, Jul 10, 2015 at 2:12 PM, Iranga Muthuthanthri ira...@wso2.com
 wrote:



 On Fri, Jul 10, 2015 at 2:08 PM, Thanuja Uruththirakodeeswaran 
 thanu...@wso2.com wrote:

 Hi Devs,

 Stratos is integrated with DAS for Metering service and Monitoring
 Health Statistics. In order to implement this requirement, following idea
 is used:


 ​​

- Here for the Metering service, Instance details (cluster level
instance count with time and member level instance details with 
 autoscaling
decision) are published from Stratos to DAS, persisted in HBase, analyzed
using Spark and saved in MySQL and then shown in DAS dashboard.
- For the Monitoring service, Health Statistics aggregated by CEP is
sent to DAS and then shown in dashboard as shown above.

 Would it not be possible to do this within DAS it self, since
 CEP(realtime) features are available in DAS itself?

 Currently, I'm in the stage of getting part of instance details and
 showing it in dashboard.

 Thanks.

 --
 Thanuja Uruththirakodeeswaran
 Software Engineer
 WSO2 Inc.;http://wso2.com
 lean.enterprise.middleware

 mobile: +94 774363167

 ___
 Dev mailing list
 Dev@wso2.org
 http://wso2.org/cgi-bin/mailman/listinfo/dev




 --
 Thanks  Regards

 Iranga Muthuthanthri
 (M) -0777-255773
 Team Product Management


 ___
 Dev mailing list
 Dev@wso2.org
 http://wso2.org/cgi-bin/mailman/listinfo/dev




 --

 *Pubudu Gunatilaka*
 Software Engineer
 WSO2, Inc.: http://wso2.com
 lean.enterprise.middleware
 mobile:  +94 77 4078049

 ___
 Dev mailing list
 Dev@wso2.org
 http://wso2.org/cgi-bin/mailman/listinfo/dev




-- 

Udara Liyanage
Software Engineer
WSO2, Inc.: http://wso2.com
lean. enterprise. middleware

web: http://udaraliyanage.wordpress.com
phone: +94 71 443 6897
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev


[Dev] [PPaaS] Integrating DAS with Stratos for Metering Service and Monitoring Health Statistics

2015-07-10 Thread Thanuja Uruththirakodeeswaran
Hi Devs,

Stratos is integrated with DAS for Metering service and Monitoring Health
Statistics. In order to implement this requirement, following idea is used:


​​

   - Here for the Metering service, Instance details (cluster level
   instance count with time and member level instance details with autoscaling
   decision) are published from Stratos to DAS, persisted in HBase, analyzed
   using Spark and saved in MySQL and then shown in DAS dashboard.
   - For the Monitoring service, Health Statistics aggregated by CEP is
   sent to DAS and then shown in dashboard as shown above.

Currently, I'm in the stage of getting part of instance details and showing
it in dashboard.

Thanks.

-- 
Thanuja Uruththirakodeeswaran
Software Engineer
WSO2 Inc.;http://wso2.com
lean.enterprise.middleware

mobile: +94 774363167
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev


Re: [Dev] [PPaaS] Integrating DAS with Stratos for Metering Service and Monitoring Health Statistics

2015-07-10 Thread Iranga Muthuthanthri
On Fri, Jul 10, 2015 at 2:08 PM, Thanuja Uruththirakodeeswaran 
thanu...@wso2.com wrote:

 Hi Devs,

 Stratos is integrated with DAS for Metering service and Monitoring Health
 Statistics. In order to implement this requirement, following idea is used:


 ​​

- Here for the Metering service, Instance details (cluster level
instance count with time and member level instance details with autoscaling
decision) are published from Stratos to DAS, persisted in HBase, analyzed
using Spark and saved in MySQL and then shown in DAS dashboard.
- For the Monitoring service, Health Statistics aggregated by CEP is
sent to DAS and then shown in dashboard as shown above.

 Would it not be possible to do this within DAS it self, since
CEP(realtime) features are available in DAS itself?

 Currently, I'm in the stage of getting part of instance details and
 showing it in dashboard.

 Thanks.

 --
 Thanuja Uruththirakodeeswaran
 Software Engineer
 WSO2 Inc.;http://wso2.com
 lean.enterprise.middleware

 mobile: +94 774363167

 ___
 Dev mailing list
 Dev@wso2.org
 http://wso2.org/cgi-bin/mailman/listinfo/dev




-- 
Thanks  Regards

Iranga Muthuthanthri
(M) -0777-255773
Team Product Management
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev


Re: [Dev] [PPaaS] Integrating DAS with Stratos for Metering Service and Monitoring Health Statistics

2015-07-10 Thread Pubudu Gunatilaka
Hi Iranga,

Actually Stratos uses separate CEP to analyse health statistics that are
published from cartridges and services. Those analysed data are sent to the
Autoscaler to take autoscaling decisions. You can find more information in
[1].

In this DAS integration with Stratos, for the requirement of monitoring
health statistics we need those summerized data from CEP. Therefore we need
to publish those data from CEP to DAS. Other thing is DAS is an extension
point in Stratos. Depend on the user requirement, he can use DAS for
monitoring real time statistics.

[1] -
https://cwiki.apache.org/confluence/display/STRATOS/4.1.0+Complex+Event+Processor

Thank you!

On Fri, Jul 10, 2015 at 2:12 PM, Iranga Muthuthanthri ira...@wso2.com
wrote:



 On Fri, Jul 10, 2015 at 2:08 PM, Thanuja Uruththirakodeeswaran 
 thanu...@wso2.com wrote:

 Hi Devs,

 Stratos is integrated with DAS for Metering service and Monitoring Health
 Statistics. In order to implement this requirement, following idea is used:


 ​​

- Here for the Metering service, Instance details (cluster level
instance count with time and member level instance details with 
 autoscaling
decision) are published from Stratos to DAS, persisted in HBase, analyzed
using Spark and saved in MySQL and then shown in DAS dashboard.
- For the Monitoring service, Health Statistics aggregated by CEP is
sent to DAS and then shown in dashboard as shown above.

 Would it not be possible to do this within DAS it self, since
 CEP(realtime) features are available in DAS itself?

 Currently, I'm in the stage of getting part of instance details and
 showing it in dashboard.

 Thanks.

 --
 Thanuja Uruththirakodeeswaran
 Software Engineer
 WSO2 Inc.;http://wso2.com
 lean.enterprise.middleware

 mobile: +94 774363167

 ___
 Dev mailing list
 Dev@wso2.org
 http://wso2.org/cgi-bin/mailman/listinfo/dev




 --
 Thanks  Regards

 Iranga Muthuthanthri
 (M) -0777-255773
 Team Product Management


 ___
 Dev mailing list
 Dev@wso2.org
 http://wso2.org/cgi-bin/mailman/listinfo/dev




-- 

*Pubudu Gunatilaka*
Software Engineer
WSO2, Inc.: http://wso2.com
lean.enterprise.middleware
mobile:  +94 77 4078049
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev