Dmitry,

you're totally right, it was in the email, but it should have been in the
wikis.
I added some documentation on it here:
https://wikitech.wikimedia.org/wiki/EventLogging#Log_size_limit

Thanks!

On Fri, May 15, 2015 at 10:00 PM, Dmitry Brant <[email protected]> wrote:

> [brain fart] it's in your email. :(  Thanks!
>
> On Fri, May 15, 2015 at 3:59 PM, Dmitry Brant <[email protected]>
> wrote:
>
>> Thanks for reporting this, Marcel!
>> I've created a task for us to correct the behavior of our EL funnels:
>> https://phabricator.wikimedia.org/T99276
>>
>> Is the actual character limit of EL messages specified somewhere?
>>
>>
>> -Dmitry
>>
>>
>> On Fri, May 15, 2015 at 3:41 PM, Marcel Ruiz Forns <[email protected]>
>> wrote:
>>
>>> Hi Mobile,
>>>
>>> Analyzing EventLogging logs we percieved that a significant share of
>>> MobileWikiAppSavedPages, MobileWikiAppArticleSuggestions and
>>> MobileWikiAppShareAFact events are failing validation.
>>>
>>> *1) MobileWikiAppShareAFact: 1.5% not validating*
>>> In this schema, the field "text" stores long fractions of text sometimes.
>>> This exceeds the size limitation of EL, specially when the text contains
>>> special characters, like chinese, greek, etc.
>>>
>>> *2) MobileWikiAppArticleSuggestions: 1% not validating*
>>> In this case, it's the field "readMoreList" that is sometimes very long,
>>> specially when it contains special characters.
>>> This, again, exceeds the log size limit.
>>>
>>> *3) MobileWikiAppSavedPages: 1% not validating*
>>> Some events do not contain the required field "appInstallID".
>>>
>>> In cases 1) and 2) the percentage is not big overall, but it can be that
>>> for a given language, a lot of events are lost.
>>>
>>> EventLogging performance is not compromised by these validation errors,
>>> but we are receiving monitoring alerts, and would like to maintain the
>>> validation rate close to 100%.
>>>
>>> Is it possible for you to somehow reduce the size of the logs of 1) and
>>> 2)?
>>> If so, have in mind that the log size limit is 1k, and that the highest
>>> priority for us would be 2).
>>>
>>> Thank you!
>>>
>>> Marcel
>>>
>>> _______________________________________________
>>> Mobile-l mailing list
>>> [email protected]
>>> https://lists.wikimedia.org/mailman/listinfo/mobile-l
>>>
>>>
>>
>
_______________________________________________
Mobile-l mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/mobile-l

Reply via email to