On Wed, Jan 27, 2016 at 12:42 PM, Anjana Fernando <[email protected]> wrote:
> Hi Gimantha, > > On Wed, Jan 27, 2016 at 11:26 AM, Gimantha Bandara <[email protected]> > wrote: > >> @Vithulan/Malith >> >> >> On Tue, Jan 26, 2016 at 7:38 PM, Malith Dhanushka <[email protected]> >> wrote: >> >>> Hi Gimantha, >>> >>> I Think we can add Unique Count, Standard deviation and Percentile >>> under default matrices right? >>> >> >> @Anjana Shall we add these matrices under default aggregate methods or >> shall we provide a extension point and these? >> > > Yes, things we think that would be useful, we have to implement OOTB. And > also, we have to implement the extension as well. > yeah +1, also we should have a document about the extension on how to use it, etc similar to doc about spark UDF [1]. Do we have page on what are the OOTB supported aggregate methods? I wasn't able to find it in the DAS docs pages, in case if we don't have it, then we need to add docs on that too. [1] https://docs.wso2.com/display/DAS300/Creating+Spark+User+Defined+Functions Thanks, Sinthuja. > > Cheers, > Anjana. > > >> >>> And do we already have API support for grouping aggregations like range >>> and histograms? >>> >> >> Yes, we have APIs for ranges and histograms already >> >>> >>> Thanks, >>> Malith >>> >>> On Tue, Jan 26, 2016 at 6:51 PM, Vithulan Vijayanandan < >>> [email protected]> wrote: >>> >>>> Hi Rukshan, >>>> Oh. Thank you for the prompt reply and the links. >>>> >>>> Hi Gimantha, >>>> Yes, can we be able to have, >>>> >>>> - Unique Count - It will get a count in a field about how many >>>> unique values it has. >>>> - Standard deviation >>>> - Percentile >>>> >>>> I will look at Unique count, Standard deviation and Percentile. I think >> Unique count is something DAS already supports. >> >>> >>>> - >>>> >>>> And also some grouping aggregations, >>>> >>>> - Time-stamp based aggregation - Where we should be able to group >>>> the logs based on timestamp (Automatically/Hour/Day/etc) >>>> >>>> Given a specific timestamp range you can group the logs >> >>> >>>> - Date range - Where we should be able to group and analyze the >>>> logs within specific date range. >>>> - Integer range based aggregation - Where we should be able to >>>> group the events based on range of an integer field. >>>> >>>> Also you can group logs using Date range ( I think still if this is >> epoch time it comes under integer ranges. So since you can group by integer >> ranges using DAS, you will be able to group by date also. >> >>> >>>> - An aggregation where we should be able to compare all the log >>>> fields against existing all metric aggregations (count,sum,min,max,avg). >>>> (Eg:log_level vs count) >>>> >>>> This is can be done by defining the field as a "facet" field and using >> aggregate methods provided by DAS. >> >>> >>>> Thanks. >>>> >>>> Regards, >>>> >>>> Vithulan >>>> >>>> On Tue, Jan 26, 2016 at 4:25 PM, Gimantha Bandara <[email protected]> >>>> wrote: >>>> >>>>> Hi Vithulan, >>>>> >>>>> Other than the aggregates Rukshan has mentioned, DAS supports COUNT >>>>> also. Are there any other aggregates required log analyzer >>>>> functionalities? >>>>> >>>>> On Tue, Jan 26, 2016 at 3:31 PM, Rukshan Premathunga <[email protected] >>>>> > wrote: >>>>> >>>>>> Hi Vithulan, >>>>>> >>>>>> if you mean aggregate functions, known functions are >>>>>> >>>>>> - MAX >>>>>> - MIN >>>>>> - AVG >>>>>> - SUM >>>>>> >>>>>> also you can refer these[1][2] docs for more about the API. >>>>>> >>>>>> [1] >>>>>> https://docs.wso2.com/display/DAS300/Retrieving+Aggregated+Values+of+Given+Records+via+REST+API >>>>>> [2] >>>>>> http://blog.rukspot.com/2015/11/aggregate-functions-with-wso2-das-rest.html >>>>>> >>>>>> Thanks and Regards. >>>>>> >>>>>> >>>>>> On Tue, Jan 26, 2016 at 3:21 PM, Vithulan Vijayanandan < >>>>>> [email protected]> wrote: >>>>>> >>>>>>> Hi, >>>>>>> >>>>>>> We need to have data aggregations for LogAnalyzer, log search >>>>>>> requirement. What are the aggregations that are available in DAS REST >>>>>>> API >>>>>>> currently? >>>>>>> >>>>>>> Thanks. >>>>>>> >>>>>>> Regards, >>>>>>> Vithulan. >>>>>>> >>>>>>> -- >>>>>>> *Vithulan MV* >>>>>>> >>>>>>> Intern-Software Engineering >>>>>>> WSO2, Inc : wso2.com >>>>>>> Mobile : +94712540524 >>>>>>> >>>>>>> _______________________________________________ >>>>>>> Dev mailing list >>>>>>> [email protected] >>>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>>>> >>>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> Rukshan Chathuranga. >>>>>> Software Engineer. >>>>>> WSO2, Inc. >>>>>> >>>>>> _______________________________________________ >>>>>> Dev mailing list >>>>>> [email protected] >>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>>> >>>>>> >>>>> >>>>> >>>>> -- >>>>> Gimantha Bandara >>>>> Software Engineer >>>>> WSO2. Inc : http://wso2.com >>>>> Mobile : +94714961919 >>>>> >>>> >>>> >>>> >>>> -- >>>> *Vithulan MV* >>>> >>>> Intern-Software Engineering >>>> WSO2, Inc : wso2.com >>>> Mobile : +94712540524 >>>> >>> >>> >>> >>> -- >>> Malith Dhanushka >>> Senior Software Engineer - Data Technologies >>> *WSO2, Inc. : wso2.com <http://wso2.com/>* >>> *Mobile* : +94 716 506 693 >>> >> >> >> >> -- >> Gimantha Bandara >> Software Engineer >> WSO2. Inc : http://wso2.com >> Mobile : +94714961919 >> > > > > -- > *Anjana Fernando* > Senior Technical Lead > WSO2 Inc. | http://wso2.com > lean . enterprise . middleware > > _______________________________________________ > Dev mailing list > [email protected] > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- *Sinthuja Rajendran* Associate Technical Lead WSO2, Inc.:http://wso2.com Blog: http://sinthu-rajan.blogspot.com/ Mobile: +94774273955
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
