Ottomata added a comment.
Doing the following for all main-eqiad and main-codfw:
for t in \
mediawiki.page-create\
mediawiki.page-delete\
mediawiki.page-edit \
mediawiki.page-move \
Ottomata added a comment.
mediawiki eventbus topics should now be retained for 31 days in main Kafka clusters. If we add a new mediawiki topic, we need to remember to run this command for it.TASK DETAILhttps://phabricator.wikimedia.org/T187296EMAIL
Ottomata added a comment.
I'll make this 31 days just to bump it up to a month. We have plenty of space for this.TASK DETAILhttps://phabricator.wikimedia.org/T187296EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: OttomataCc: mforns, elukey, Ottomata,
mforns added a comment.
We'll have this on our radar, until things are stable.TASK DETAILhttps://phabricator.wikimedia.org/T187296EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mfornsCc: mforns, elukey, Ottomata, Aklapper, Nuria, Ladsgroup, Pchelolo,
Smalyshev added a comment.
I need it only on jumbo I think, that's where I'll be connecting.TASK DETAILhttps://phabricator.wikimedia.org/T187296EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: elukey, Ottomata, Aklapper, Nuria, Ladsgroup,
Ottomata added a comment.
Is there a reason we want to do this on main instead of jumbo? Stas will be consuming from jumbo, since it has timestamp offset support.TASK DETAILhttps://phabricator.wikimedia.org/T187296EMAIL
Pchelolo added a comment.
Currently on kafka-main machines the disk utiliation is really low, so I think we can easily do it without kafka-jumbo.
dsh --group kafka_eqiad --remoteshell ssh -- 'df -h' | grep '/srv'
/dev/md17.2T 737G 6.1T 11% /srv
/dev/md17.2T 736G 6.1T 11%
Ottomata added a comment.
I think we can do this just for the mediawiki eventbus topics on the jumbo cluster.TASK DETAILhttps://phabricator.wikimedia.org/T187296EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: OttomataCc: Ottomata, Aklapper, Nuria, Ladsgroup,
