Hi Imesh, I will be free for the whole next week. We can have the google hangout any day.Please give me a time slot to have the hangout.
Thank You! Best Regards, Ashan On Sun, Aug 2, 2015 at 5:59 PM, Imesh Gunaratne <im...@apache.org> wrote: > Hi Ashan, > > Great work! May be we could arrange a public Google Hangout when you are > available to present the current status of the project. > > Thanks > > On Thu, Jul 30, 2015 at 11:00 PM, Ashan Dhananjaya <dhananjay...@gmail.com > > wrote: > >> Hi All, >> >> I have implemented formatters and did some changes in the cep event flow >> to change the RDBMS 3 tables in to one table as we discussed last week. And >> committed it. And id did few changes to the UI according to the feedback i >> had last week. I finished writing the REST API documentation and sent it to >> everyone. >> >> I have started to write a blog for the marketing aspect for stratos how >> Health Stat UI works and a documentation for the health statistics UI. >> >> [1]= >> https://github.com/apache/stratos/commit/1490310cae3ba085fbb77d84346dd66fd2b12132 >> >> Thank You! >> Best Regards, >> Ashan >> >> On Fri, Jul 24, 2015 at 11:17 PM, Imesh Gunaratne <im...@apache.org> >> wrote: >> >>> Great work Ashan! >>> >>> Actually you don't need to replace MySQL database with H2 rather both >>> options might be needed. The reason for having H2 is to allow users to see >>> the statistics when running on Single-JVM mode with embedded H2 database. >>> >>> On Thu, Jul 23, 2015 at 12:35 AM, Ashan Dhananjaya < >>> dhananjay...@gmail.com> wrote: >>> >>>> Hi All, >>>> >>>> I have implemented the UI for the Health Statistics UI. The git hub >>>> commits can be find from here [1]. >>>> >>>> And im moving forward to replace the MySql database from the embedded >>>> H2 RDBMS as we discussed offline on 22nd of July. >>>> >>>> Thank You! >>>> Best Regards, >>>> Ashan >>>> >>>> >>>> [1]= >>>> https://github.com/ashandk/stratos/commit/310ea343d80d009778f572da12a4098c7d2177ec >>>> >>>> >>>> On Thu, Jul 16, 2015 at 7:29 PM, Ashan Dhananjaya < >>>> dhananjay...@gmail.com> wrote: >>>> >>>>> Hi Imesh, >>>>> >>>>> Noted. I will create a documentation for the REST API. >>>>> >>>>> Thank You! >>>>> Best Regards, >>>>> Ashan >>>>> >>>>> On Thu, Jul 16, 2015 at 10:51 AM, Imesh Gunaratne <im...@apache.org> >>>>> wrote: >>>>> >>>>>> >>>>>> On Tue, Jul 14, 2015 at 9:44 PM, Reka Thirunavukkarasu <r...@wso2.com >>>>>> > wrote: >>>>>>> >>>>>>> >>>>>>>> 1.getAverageClusterMemoryByClusterId >>>>>>>> >>>>>>> >>>>>>> /cluster/averageMemory/{Id}/{Interval}} >>>>>>> >>>>>>> >>>>>>>> 2.getAverageClusterLoadByClusterId >>>>>>>> >>>>>>> >>>>>>> /cluster/averageLoad/{Id}/{Interval}} >>>>>>> >>>>>>> >>>>>>>> 3.getAverageMemberMemoryByMemberId >>>>>>>> >>>>>>> >>>>>>> /member/averageMemory/{Id}/{Interval}} >>>>>>> >>>>>>> 4.getAverageMemberLoadByMemberId >>>>>>>> >>>>>>> >>>>>>> /member/averageLoad/{Id}/{Interval}} >>>>>>> >>>>>>> >>>>>>>> 5.getAverageClusterFlightRequestCountByClusterId >>>>>>>> >>>>>>> >>>>>>> /cluster/flightRequestCount/{Id}/{Interval}} >>>>>>> >>>>>> >>>>>> +1 A great thought! @Ashan: It would be better if you can document >>>>>> the API methods (may be in a Google doc). >>>>>> >>>>>> Thanks >>>>>> >>>>>> On Tue, Jul 14, 2015 at 9:44 PM, Reka Thirunavukkarasu <r...@wso2.com >>>>>> > wrote: >>>>>> >>>>>>> Hi Ashan, >>>>>>> >>>>>>> Wouldn't it be better to stick with the REST API paths currently >>>>>>> used by stratos? You can inherit and add more stuffs as you want. Please >>>>>>> see below for some sample paths: >>>>>>> >>>>>>> On Tue, Jul 14, 2015 at 1:55 AM, Ashan Dhananjaya < >>>>>>> dhananjay...@gmail.com> wrote: >>>>>>> >>>>>>>> Hi All, >>>>>>>> >>>>>>>> I have implemented the REST api methods for the health statistics >>>>>>>> UI in the stratos existing REST API. >>>>>>>> >>>>>>>> 1.getAverageClusterMemoryByClusterId >>>>>>>> >>>>>>> >>>>>>> /cluster/averageMemory/{Id}/{Interval}} >>>>>>> >>>>>>> >>>>>>>> 2.getAverageClusterLoadByClusterId >>>>>>>> >>>>>>> >>>>>>> /cluster/averageLoad/{Id}/{Interval}} >>>>>>> >>>>>>> >>>>>>>> 3.getAverageMemberMemoryByMemberId >>>>>>>> >>>>>>> >>>>>>> /member/averageMemory/{Id}/{Interval}} >>>>>>> >>>>>>> 4.getAverageMemberLoadByMemberId >>>>>>>> >>>>>>> >>>>>>> /member/averageLoad/{Id}/{Interval}} >>>>>>> >>>>>>> >>>>>>>> 5.getAverageClusterFlightRequestCountByClusterId >>>>>>>> >>>>>>> >>>>>>> /cluster/flightRequestCount/{Id}/{Interval}} >>>>>>> >>>>>>> Thanks, >>>>>>> Reka >>>>>>> >>>>>>>> >>>>>>>> Please find the Github commit here[1]. >>>>>>>> >>>>>>>> [1]= >>>>>>>> https://github.com/apache/stratos/commit/5ab9159744f136e649174f7293adabe5c77fb4bd >>>>>>>> >>>>>>>> >>>>>>>> Thank You! >>>>>>>> Best Regards, >>>>>>>> Ashan >>>>>>>> >>>>>>>> On Thu, Jul 9, 2015 at 8:30 PM, Ashan Dhananjaya < >>>>>>>> dhananjay...@gmail.com> wrote: >>>>>>>> >>>>>>>>> Noted Lahiru. >>>>>>>>> >>>>>>>>> On Thu, Jul 9, 2015 at 7:48 PM, Lahiru Sandaruwan < >>>>>>>>> lahi...@wso2.com> wrote: >>>>>>>>> >>>>>>>>>> Hi Ashan, >>>>>>>>>> >>>>>>>>>> Good stuff. It is fine to set the time stamp from CEP for now. >>>>>>>>>> But ultimately we need the timestamp to be sent from Python cartridge >>>>>>>>>> agent. Let's fix that part we proceed. >>>>>>>>>> >>>>>>>>>> Thanks. >>>>>>>>>> >>>>>>>>>> On Thu, Jul 9, 2015 at 7:38 PM, Ashan Dhananjaya < >>>>>>>>>> dhananjay...@gmail.com> wrote: >>>>>>>>>> >>>>>>>>>>> Hi All, >>>>>>>>>>> >>>>>>>>>>> I was able to get the TimeaStamp to the RDBMS without any >>>>>>>>>>> conflict AFAIK. I am testing the flow more. Please find the commits >>>>>>>>>>> [1], >>>>>>>>>>> [2] for the Formatters. >>>>>>>>>>> >>>>>>>>>>> [1]= >>>>>>>>>>> https://github.com/ashandk/stratos/commit/efa25eb255cadbf2843e5f0d0e13b34c09535f91 >>>>>>>>>>> [2]= >>>>>>>>>>> https://github.com/ashandk/stratos/commit/9c0fce9081c299c34031d602c94ea712602c7a6c >>>>>>>>>>> >>>>>>>>>>> Thank You! >>>>>>>>>>> Best Regards, >>>>>>>>>>> Ashan >>>>>>>>>>> >>>>>>>>>>> On Thu, Jul 9, 2015 at 2:41 PM, Lahiru Sandaruwan < >>>>>>>>>>> lahi...@wso2.com> wrote: >>>>>>>>>>> >>>>>>>>>>>> Great work Ashan. >>>>>>>>>>>> >>>>>>>>>>>> On Thu, Jul 9, 2015 at 2:39 PM, Ashan Dhananjaya < >>>>>>>>>>>> dhananjay...@gmail.com> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> Hi All, >>>>>>>>>>>>> >>>>>>>>>>>>> I was able to take the timestamp from the cartridge agent >>>>>>>>>>>>> (WSO2CEPHealthStatisticsPublisher and >>>>>>>>>>>>> WSO2CEPInFlightRequestPublisher) to >>>>>>>>>>>>> CEP PayLoad definition.Git Hub commits can be found here[1], [2]. >>>>>>>>>>>>> Currently >>>>>>>>>>>>> working on sending the timestamp to the RDBMS without conflicting >>>>>>>>>>>>> execution >>>>>>>>>>>>> plans. >>>>>>>>>>>>> >>>>>>>>>>>>> I have included the read-me [2] file to the cep extensions how >>>>>>>>>>>>> to configure should happen for the Health Stat publishing to the >>>>>>>>>>>>> RDBMS. >>>>>>>>>>>>> >>>>>>>>>>>>> [1]= >>>>>>>>>>>>> https://github.com/apache/stratos/commit/4c65e705be822fd420b4e48ebafef789c8686b76 >>>>>>>>>>>>> [2]= >>>>>>>>>>>>> https://github.com/apache/stratos/commit/e09334cd98f245a4633c992f02db2878ac24d3d0 >>>>>>>>>>>>> [3]= >>>>>>>>>>>>> https://github.com/apache/stratos/commit/5ca895ef030f6aaeba56183d982aa5ae95db9337 >>>>>>>>>>>>> >>>>>>>>>>>>> Thank You! >>>>>>>>>>>>> Best Regards, >>>>>>>>>>>>> Ashan >>>>>>>>>>>>> >>>>>>>>>>>>> On Tue, Jul 7, 2015 at 1:13 PM, Lasantha Fernando < >>>>>>>>>>>>> lasantha....@gmail.com> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>>> Hi Ashan, >>>>>>>>>>>>>> >>>>>>>>>>>>>> Currently, you would not be able to get the timestamp out of >>>>>>>>>>>>>> the event >>>>>>>>>>>>>> unless you use a databridge agent callback. In that case, you >>>>>>>>>>>>>> can use >>>>>>>>>>>>>> Java code to simply get by calling event.getTimestamp(). >>>>>>>>>>>>>> >>>>>>>>>>>>>> However, if you want to use the timestamp as an attribute >>>>>>>>>>>>>> while doing >>>>>>>>>>>>>> processing within CEP, you would have to pass the timestamp >>>>>>>>>>>>>> as an >>>>>>>>>>>>>> attribute of the stream. i.e. add it as an attribute of >>>>>>>>>>>>>> either meta, >>>>>>>>>>>>>> correlation or payload data. Then you can use that timestamp >>>>>>>>>>>>>> and >>>>>>>>>>>>>> format the output event as necessary. >>>>>>>>>>>>>> >>>>>>>>>>>>>> Thanks, >>>>>>>>>>>>>> Lasantha >>>>>>>>>>>>>> >>>>>>>>>>>>>> On Tue, Jul 7, 2015 at 1:04 PM, Ashan Dhananjaya < >>>>>>>>>>>>>> dhananjay...@gmail.com> wrote: >>>>>>>>>>>>>> > Hi All, >>>>>>>>>>>>>> > >>>>>>>>>>>>>> > I applied the above patch and get the timestamp in the >>>>>>>>>>>>>> Input Adapter. The >>>>>>>>>>>>>> > formatter i used was >>>>>>>>>>>>>> "member_average_memory_consumption_stats:1.0.0". I >>>>>>>>>>>>>> > tried several time to get the timeStamp attribute but >>>>>>>>>>>>>> failed. Is there any >>>>>>>>>>>>>> > way to get a data which is outside in the payload? The >>>>>>>>>>>>>> Input stream is as >>>>>>>>>>>>>> > below, >>>>>>>>>>>>>> > >>>>>>>>>>>>>> > 10:40:27,757 [-] [DataBridge-Core-pool-2-thread-1] INFO >>>>>>>>>>>>>> TenantId=-1234 : >>>>>>>>>>>>>> > Input Event Adaptor : DefaultWSO2EventInputAdaptor, received >>>>>>>>>>>>>> > >>>>>>>>>>>>>> > Event{ >>>>>>>>>>>>>> > streamId='cartridge_agent_health_stats:1.0.0', >>>>>>>>>>>>>> > timeStamp=1436245827731, >>>>>>>>>>>>>> > metaData=null, >>>>>>>>>>>>>> > correlationData=null, >>>>>>>>>>>>>> > payloadData=[single-cartridge-app.my-php.php.domain, >>>>>>>>>>>>>> > single-cartridge-app-1, network-partition-1, >>>>>>>>>>>>>> > >>>>>>>>>>>>>> single-cartridge-app.my-php.php.domaina5598e2b-995f-4620-b652-e66341e24c99, >>>>>>>>>>>>>> > partition-1, memory_consumption, 20.0], >>>>>>>>>>>>>> > arbitraryDataMap={}, >>>>>>>>>>>>>> > } >>>>>>>>>>>>>> > >>>>>>>>>>>>>> > Any help will be really appreciated. >>>>>>>>>>>>>> > >>>>>>>>>>>>>> > Thank You! >>>>>>>>>>>>>> > Best Regards, >>>>>>>>>>>>>> > Ashan >>>>>>>>>>>>>> > >>>>>>>>>>>>>> > On Tue, Jul 7, 2015 at 9:32 AM, Chamila De Alwis < >>>>>>>>>>>>>> chami...@wso2.com> wrote: >>>>>>>>>>>>>> >> >>>>>>>>>>>>>> >> Hi Ashan, >>>>>>>>>>>>>> >> >>>>>>>>>>>>>> >> As I've seen from the PCA testing recently, the timestamp >>>>>>>>>>>>>> is added to >>>>>>>>>>>>>> >> every ThriftEvent before publishing. Are you working on >>>>>>>>>>>>>> PCA or the Mock >>>>>>>>>>>>>> >> IaaS? I took a look at the Mock IaaS and the >>>>>>>>>>>>>> WSO2CEPStatisticsPublisher as >>>>>>>>>>>>>> >> well, and found out that the latter indeed doesn't add the >>>>>>>>>>>>>> timestamp to the >>>>>>>>>>>>>> >> ThriftEvents. This means that the JCA also publishes >>>>>>>>>>>>>> Thrift Events with >>>>>>>>>>>>>> >> empty timestamp fields. >>>>>>>>>>>>>> >> >>>>>>>>>>>>>> >> Following is the simple fix for that. I've attached the >>>>>>>>>>>>>> patch herewith. >>>>>>>>>>>>>> >> Could you quickly verify with the patch applied build also? >>>>>>>>>>>>>> >> >>>>>>>>>>>>>> >> chamilad@chamilad-ThinkPad-T530:~/dev/stratos[master *]$ >>>>>>>>>>>>>> git diff >>>>>>>>>>>>>> >> diff --git >>>>>>>>>>>>>> >> >>>>>>>>>>>>>> a/components/org.apache.stratos.common/src/main/java/org/apache/stratos/common/statistics/publisher/wso2/cep/WSO2CEPStatisticsPublisher.java >>>>>>>>>>>>>> >> b/c >>>>>>>>>>>>>> >> index 653288d..f1fe426 100644 >>>>>>>>>>>>>> >> --- >>>>>>>>>>>>>> >> >>>>>>>>>>>>>> a/components/org.apache.stratos.common/src/main/java/org/apache/stratos/common/statistics/publisher/wso2/cep/WSO2CEPStatisticsPublisher.java >>>>>>>>>>>>>> >> +++ >>>>>>>>>>>>>> >> >>>>>>>>>>>>>> b/components/org.apache.stratos.common/src/main/java/org/apache/stratos/common/statistics/publisher/wso2/cep/WSO2CEPStatisticsPublisher.java >>>>>>>>>>>>>> >> @@ -29,6 +29,7 @@ import >>>>>>>>>>>>>> >> >>>>>>>>>>>>>> org.wso2.carbon.databridge.agent.thrift.exception.AgentException; >>>>>>>>>>>>>> >> import org.wso2.carbon.databridge.commons.Event; >>>>>>>>>>>>>> >> import >>>>>>>>>>>>>> org.wso2.carbon.databridge.commons.StreamDefinition; >>>>>>>>>>>>>> >> >>>>>>>>>>>>>> >> +import java.util.Date; >>>>>>>>>>>>>> >> import java.util.HashMap; >>>>>>>>>>>>>> >> >>>>>>>>>>>>>> >> /** >>>>>>>>>>>>>> >> @@ -98,6 +99,7 @@ public class WSO2CEPStatisticsPublisher >>>>>>>>>>>>>> implements >>>>>>>>>>>>>> >> StatisticsPublisher { >>>>>>>>>>>>>> >> >>>>>>>>>>>>>> >> Event event = new Event(); >>>>>>>>>>>>>> >> event.setPayloadData(payload); >>>>>>>>>>>>>> >> + event.setTimeStamp(new Date().getTime()); >>>>>>>>>>>>>> >> event.setArbitraryDataMap(new HashMap<String, >>>>>>>>>>>>>> String>()); >>>>>>>>>>>>>> >> >>>>>>>>>>>>>> >> try { >>>>>>>>>>>>>> >> >>>>>>>>>>>>>> >> >>>>>>>>>>>>>> >> >>>>>>>>>>>>>> >> >>>>>>>>>>>>>> >> >>>>>>>>>>>>>> >> Regards, >>>>>>>>>>>>>> >> Chamila de Alwis >>>>>>>>>>>>>> >> Committer and PMC Member - Apache Stratos >>>>>>>>>>>>>> >> Software Engineer | WSO2 | +94772207163 >>>>>>>>>>>>>> >> Blog: code.chamiladealwis.com >>>>>>>>>>>>>> >> >>>>>>>>>>>>>> >> >>>>>>>>>>>>>> > >>>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> -- >>>>>>>>>>>> -- >>>>>>>>>>>> Lahiru Sandaruwan >>>>>>>>>>>> Committer and PMC member, Apache Stratos, >>>>>>>>>>>> Senior Software Engineer, >>>>>>>>>>>> WSO2 Inc., http://wso2.com >>>>>>>>>>>> lean.enterprise.middleware >>>>>>>>>>>> >>>>>>>>>>>> phone: +94773325954 >>>>>>>>>>>> email: lahi...@wso2.com blog: http://lahiruwrites.blogspot.com/ >>>>>>>>>>>> linked-in: >>>>>>>>>>>> http://lk.linkedin.com/pub/lahiru-sandaruwan/16/153/146 >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> _______________________________________________ >>>>>>>>>>>> Dev mailing list >>>>>>>>>>>> d...@wso2.org >>>>>>>>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> -- >>>>>>>>>> -- >>>>>>>>>> Lahiru Sandaruwan >>>>>>>>>> Committer and PMC member, Apache Stratos, >>>>>>>>>> Senior Software Engineer, >>>>>>>>>> WSO2 Inc., http://wso2.com >>>>>>>>>> lean.enterprise.middleware >>>>>>>>>> >>>>>>>>>> phone: +94773325954 >>>>>>>>>> email: lahi...@wso2.com blog: http://lahiruwrites.blogspot.com/ >>>>>>>>>> linked-in: >>>>>>>>>> http://lk.linkedin.com/pub/lahiru-sandaruwan/16/153/146 >>>>>>>>>> >>>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> Reka Thirunavukkarasu >>>>>>> Senior Software Engineer, >>>>>>> WSO2, Inc.:http://wso2.com, >>>>>>> Mobile: +94776442007 >>>>>>> >>>>>>> >>>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> Imesh Gunaratne >>>>>> >>>>>> Senior Technical Lead, WSO2 >>>>>> Committer & PMC Member, Apache Stratos >>>>>> >>>>> >>>>> >>>> >>> >>> >>> -- >>> Imesh Gunaratne >>> >>> Senior Technical Lead, WSO2 >>> Committer & PMC Member, Apache Stratos >>> >> >> > > > -- > Imesh Gunaratne > > Senior Technical Lead, WSO2 > Committer & PMC Member, Apache Stratos >