Ladsgroup closed this task as "Invalid".
Ladsgroup added a comment.

The task is invalid. For example we enabled xkill for hewiki which means now there is no x aspects usages there at all but still the wiki has 20% of its rows injected from Wikidata (daily):

MariaDB [hewiki_p]> select left(rc_timestamp,8), sum(if(rc_source='wb',1,0)) as WB, count(*),sum(if(rc_source='wb',1,0))/count(*) as RATIO from recentchanges where rc_bot = 0 group by left(rc_timestamp,8);
+----------------------+------+----------+--------+
| left(rc_timestamp,8) | WB   | count(*) | RATIO  |
+----------------------+------+----------+--------+
| 20180120             |  855 |     4337 | 0.1971 |
| 20180121             | 1939 |     6996 | 0.2772 |
| 20180122             | 4083 |     9665 | 0.4225 |
| 20180123             | 1961 |     7237 | 0.2710 |
| 20180124             | 1715 |     7555 | 0.2270 |
| 20180125             | 1803 |     7329 | 0.2460 |
| 20180126             | 1601 |     7099 | 0.2255 |
| 20180127             | 1868 |     7145 | 0.2614 |
| 20180128             | 2262 |     8869 | 0.2550 |
| 20180129             | 3680 |     9262 | 0.3973 |
| 20180130             | 1897 |     8780 | 0.2161 |
| 20180131             | 1655 |     9342 | 0.1772 |
| 20180201             | 1612 |     8753 | 0.1842 |
| 20180202             | 1713 |     7270 | 0.2356 |
| 20180203             | 1630 |     7648 | 0.2131 |
| 20180204             | 1623 |     9053 | 0.1793 |
| 20180205             | 1426 |     7397 | 0.1928 |
| 20180206             | 1641 |     8030 | 0.2044 |
| 20180207             |  953 |     7327 | 0.1301 |
| 20180208             | 1556 |     7645 | 0.2035 |
| 20180209             | 1597 |     8049 | 0.1984 |
| 20180210             | 1672 |     8119 | 0.2059 |
| 20180211             | 1598 |     7916 | 0.2019 |
| 20180212             | 1641 |     8596 | 0.1909 |
| 20180213             | 1667 |     8063 | 0.2067 |
| 20180214             | 1540 |     7503 | 0.2053 |
| 20180215             | 1900 |     8673 | 0.2191 |
| 20180216             | 1447 |     7301 | 0.1982 |
| 20180217             | 1731 |     8041 | 0.2153 |
| 20180218             | 1614 |     8586 | 0.1880 |
| 20180219             |  600 |     3483 | 0.1723 |
+----------------------+------+----------+--------+
31 rows in set (13.12 sec)

As I explained above, we don't inject rc records too much and drop it after first batch in order to avoid database explosion when there is bad lua.


TASK DETAIL
https://phabricator.wikimedia.org/T183778

EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: Ladsgroup, matej_suchanek, Aklapper, Lahi, Gq86, GoranSMilovanovic, Jrbranaa, QZanden, LawExplorer, Wong128hk, Wikidata-bugs, aude, Mbch331
_______________________________________________
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

Reply via email to