Hi Nirmal, We already have couples of MBean[1] that exposed last execution start time for the given script. But definitely a useful feature if we can display this through the UI in a user friendly manner.
[1] - https://github.com/wso2/carbon-analytics/tree/release-1.2.3/components/analytics-processors/org.wso2.carbon.analytics.spark.core/src/main/java/org/wso2/carbon/analytics/spark/core/internal/jmx Regards, Gihan On Tue, Jan 23, 2018 at 10:45 AM, Rukshan Premathunga <[email protected]> wrote: > Sorry, I have a typo. What I meant to tell is "last execution duration" >> (how long it took to run a spark script last time). Averages are important >> to observe any latency introduced, with time. > > +1. Sometimes script take longer time to execute the script due to > hardware limitation. So it is hard to guess what was wrong and unable to > check the time taken to execute. > > Also in spark job monitoring page(http://localhost:4041/jobs/) also we > can extract some related information right? But their it is really hard to > get information based on the script. So your feature is to check time > duration of the script and is there anyway to check time duration of the > specific query using monitoring page or something? > > Thanks and Regards > > On Mon, Jan 22, 2018 at 3:45 PM, Nirmal Fernando <[email protected]> wrote: > >> Sorry, I have a typo. What I meant to tell is "last execution duration" >> (how long it took to run a spark script last time). Averages are important >> to observe any latency introduced, with time. >> >> On Mon, Jan 22, 2018 at 3:37 PM, Damith Wickramasinghe <[email protected]> >> wrote: >> >>> Hi Nirmal, >>> >>> +1 for showing last execution time against each spark script which ran >>> successfully. But why we need the stat of average execution times ? for the >>> administrators need to know is whether the specific spark script has ran >>> successfully . By showing the last execution time , he/she can determine >>> whether it ran as per the specific cron interval. >>> >>> Regards, >>> Damith >>> >>> On Mon, Jan 22, 2018 at 3:25 PM, Nirmal Fernando <[email protected]> >>> wrote: >>> >>>> Hi All, >>>> >>>> Currently, there's no way to see the last execution time against >>>> scheduled spark scripts of DAS. I think it'll be a useful feature for DAS >>>> administrators. Wdyt? >>>> >>>> Further, if we can calculate the average execution times of a spark >>>> script during last hour, past day that'll be useful as well. Since it's an >>>> average calculation, there won't be a big overhead. >>>> >>>> -- >>>> >>>> Thanks & regards, >>>> Nirmal >>>> >>>> Technical Lead, WSO2 Inc. >>>> Mobile: +94715779733 <+94%2071%20577%209733> >>>> Blog: http://nirmalfdo.blogspot.com/ >>>> >>>> >>>> >>> >>> >>> -- >>> Senior Software Engineer >>> WSO2 Inc.; http://wso2.com >>> <http://www.google.com/url?q=http%3A%2F%2Fwso2.com&sa=D&sntz=1&usg=AFQjCNEZvyc0uMD1HhBaEGCBxs6e9fBObg> >>> lean.enterprise.middleware >>> >>> mobile: *+94728671315 <+94%2072%20867%201315>* >>> >>> >> >> >> -- >> >> Thanks & regards, >> Nirmal >> >> Technical Lead, WSO2 Inc. >> Mobile: +94715779733 <+94%2071%20577%209733> >> Blog: http://nirmalfdo.blogspot.com/ >> >> >> >> _______________________________________________ >> Architecture mailing list >> [email protected] >> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture >> >> > > > -- > Rukshan Chathuranga. > Software Engineer. > WSO2, Inc. > +94711822074 <071%20182%202074> > > _______________________________________________ > Architecture mailing list > [email protected] > https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture > > -- W.G. Gihan Anuruddha Associate Technical Lead | WSO2, Inc. M: +94772272595
_______________________________________________ Architecture mailing list [email protected] https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture
