Hi Suho,
What the duration are we looking at ? If its like an hour then we can use
> CEP.
>
Initial plan was to do the calculations daily.
> Can you look at whether we can implement percentile in CEP in a scalable
> manner ?
>
Will look into this and update the thread.
Thanks,
Sachini
> Suho
>
> On Mon, Feb 15, 2016 at 4:39 PM, Sachini Jayasekara <[email protected]>
> wrote:
>
>> Hi all,
>>
>> I am working on following two alert generation scenarios,
>>
>> 1. Abnormal response time/ backend time - If an API response time or the
>> backend time lies outside the Xth percentile.
>>
>> 2. Abnormal request counts - Count the number of requests during last
>> minute and check if it lies outside the Xth percentile.
>>
>> Initially, we thought of having a summarization job to calculate the
>> percentile values daily. However, in DAS, spark doesn't have OOB support to
>> calculate percentile even though hive has that as a built-in aggregate
>> function.
>>
>> With DAS 3.0.1 we can define UDFs (User Defined Functions), but the
>> function 'percentile' is a user-defined aggregation function (UDAF).
>> Hence, we cannot use that approach as well.
>>
>> Is there an alternative way in DAS to define custom aggregation function?
>>
>>
>> Thanks,
>> Sachini
>>
>> --
>>
>>
>>
>> *Thanks & Regards,Sachini JayasekaraSoftware Engineer; **WSO2 Inc. *
>>
>> *lean . enterprise . middleware | http://wso2.com <http://wso2.com> *
>>
>> Mobile : +94712371165
>>
>
>
>
> --
>
> *S. Suhothayan*
> Technical Lead & Team Lead of WSO2 Complex Event Processor
> *WSO2 Inc. *http://wso2.com
> * <http://wso2.com/>*
> lean . enterprise . middleware
>
>
> *cell: (+94) 779 756 757 <%28%2B94%29%20779%20756%20757> | blog:
> http://suhothayan.blogspot.com/ <http://suhothayan.blogspot.com/>twitter:
> http://twitter.com/suhothayan <http://twitter.com/suhothayan> | linked-in:
> http://lk.linkedin.com/in/suhothayan <http://lk.linkedin.com/in/suhothayan>*
>
--
*Thanks & Regards,Sachini JayasekaraSoftware Engineer; **WSO2 Inc. *
*lean . enterprise . middleware | http://wso2.com <http://wso2.com> *
Mobile : +94712371165
_______________________________________________
Dev mailing list
[email protected]
http://wso2.org/cgi-bin/mailman/listinfo/dev
