[Wikidata-bugs] [Maniphest] T226093: Capacity planning for Commons Structured Data

2023-06-21 Thread ArielGlenn 
ArielGlenn closed this task as "Resolved".
ArielGlenn claimed this task.
ArielGlenn added a comment.


  There's no point in having this open for a once a year check in, so I'll go 
ahead and close it. When capacity planning needs to be done for dbs in the 
regular course of things, this can be discussed.

TASK DETAIL
  https://phabricator.wikimedia.org/T226093

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: ArielGlenn
Cc: LSobanski, Nintendofan885, Ladsgroup, Abit, matthiasmullie, Marostegui, 
Addshore, Ramsey-WMF, jcrespo, Yann, MarkTraceur, ArielGlenn, Aklapper, 
Busfault, Astuthiodit_1, Atieno, karapayneWMDE, Invadibot, GFontenelle_WMF, 
maantietaja, FRomeo_WMF, jannee_e, CBogen, ItamarWMDE, Akuckartz, holger.knust, 
Nandana, JKSTNK, Lahi, Gq86, E1presidente, Cparle, SandraF_WMF, 
GoranSMilovanovic, Lunewa, QZanden, Tramullas, Acer, LawExplorer, Salgo60, 
Silverfish, _jensen, rosalieper, Scott_WUaS, Susannaanas, gnosygnu, Fuzheado, 
Jane023, Wikidata-bugs, Base, aude, Daniel_Mietchen, Ricordisamoa, Wesalius, 
Lydia_Pintscher, Raymond, Steinsplitter, Mbch331, Hokwelum
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T226093: Capacity planning for Commons Structured Data

2023-01-11 Thread LSobanski 
LSobanski removed a project: SRE.
LSobanski added a comment.


  Thanks for all the responses. Based on the above I think that a regular 
(yearly?) check-in should still happen but there are no immediate actions for 
#SRE .

TASK DETAIL
  https://phabricator.wikimedia.org/T226093

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: LSobanski
Cc: LSobanski, Nintendofan885, Ladsgroup, Abit, matthiasmullie, Marostegui, 
Addshore, Ramsey-WMF, jcrespo, Yann, MarkTraceur, ArielGlenn, Aklapper, 
Busfault, Astuthiodit_1, Atieno, karapayneWMDE, Invadibot, GFontenelle_WMF, 
maantietaja, FRomeo_WMF, jannee_e, CBogen, ItamarWMDE, Akuckartz, holger.knust, 
Nandana, JKSTNK, Lahi, Gq86, E1presidente, Cparle, SandraF_WMF, 
GoranSMilovanovic, Lunewa, QZanden, Tramullas, Acer, LawExplorer, Salgo60, 
Silverfish, _jensen, rosalieper, Scott_WUaS, Susannaanas, gnosygnu, Fuzheado, 
Jane023, Wikidata-bugs, Base, aude, Daniel_Mietchen, Ricordisamoa, Wesalius, 
Lydia_Pintscher, Raymond, Steinsplitter, Mbch331, joanna_borun, Devnull, 
Muchiri124, Legado_Shulgin, ReaperDawn, Davinaclare77, Techguru.pc, Hfbn0, 
Zppix, Wong128hk, faidon, Jay8g, fgiunchedi, Hokwelum
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T226093: Capacity planning for Commons Structured Data

2023-01-10 Thread Ladsgroup 
Ladsgroup added a comment.


  Commons is now the biggest section and by far. It used to be so much worse 
that wikidata dwarfed in comparison. The thing is: It has almost exclusively 
nothing to do with the SDoC. The biggest tables were templatelinks, 
categorylinks, externallinks, etc. It has already back to a much smaller size 
and I hope we will get to a reasonable size by end of the calendar year but 
it's not really related to SDoC TBH.

TASK DETAIL
  https://phabricator.wikimedia.org/T226093

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: LSobanski, Nintendofan885, Ladsgroup, Abit, matthiasmullie, Marostegui, 
Addshore, Ramsey-WMF, jcrespo, Yann, MarkTraceur, ArielGlenn, Aklapper, 
Busfault, Astuthiodit_1, Atieno, karapayneWMDE, joanna_borun, Invadibot, 
GFontenelle_WMF, Devnull, maantietaja, FRomeo_WMF, Muchiri124, jannee_e, 
CBogen, ItamarWMDE, Akuckartz, holger.knust, Legado_Shulgin, ReaperDawn, 
Nandana, JKSTNK, Davinaclare77, Techguru.pc, Lahi, Gq86, E1presidente, Cparle, 
SandraF_WMF, GoranSMilovanovic, Lunewa, Hfbn0, QZanden, Tramullas, Acer, 
LawExplorer, Salgo60, Zppix, Silverfish, _jensen, rosalieper, Scott_WUaS, 
Susannaanas, Wong128hk, gnosygnu, Fuzheado, Jane023, Wikidata-bugs, Base, aude, 
Daniel_Mietchen, Ricordisamoa, Wesalius, Lydia_Pintscher, Raymond, faidon, 
Steinsplitter, Mbch331, Jay8g, fgiunchedi, Hokwelum
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T226093: Capacity planning for Commons Structured Data

2023-01-10 Thread Marostegui 
Marostegui added a comment.


  I think even if they grow a lot, with the new set of servers, we still have 
6.6TB free (76% free disk space)...I'd be surprised if we grow that much in 3 
years.

TASK DETAIL
  https://phabricator.wikimedia.org/T226093

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Marostegui
Cc: LSobanski, Nintendofan885, Ladsgroup, Abit, matthiasmullie, Marostegui, 
Addshore, Ramsey-WMF, jcrespo, Yann, MarkTraceur, ArielGlenn, Aklapper, 
Busfault, Astuthiodit_1, Atieno, karapayneWMDE, joanna_borun, Invadibot, 
GFontenelle_WMF, Devnull, maantietaja, FRomeo_WMF, Muchiri124, jannee_e, 
CBogen, ItamarWMDE, Akuckartz, holger.knust, Legado_Shulgin, ReaperDawn, 
Nandana, JKSTNK, Davinaclare77, Techguru.pc, Lahi, Gq86, E1presidente, Cparle, 
SandraF_WMF, GoranSMilovanovic, Lunewa, Hfbn0, QZanden, Tramullas, Acer, 
LawExplorer, Salgo60, Zppix, Silverfish, _jensen, rosalieper, Scott_WUaS, 
Susannaanas, Wong128hk, gnosygnu, Fuzheado, Jane023, Wikidata-bugs, Base, aude, 
Daniel_Mietchen, Ricordisamoa, Wesalius, Lydia_Pintscher, Raymond, faidon, 
Steinsplitter, Mbch331, Jay8g, fgiunchedi, Hokwelum
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T226093: Capacity planning for Commons Structured Data

2023-01-10 Thread ArielGlenn 
ArielGlenn added a comment.


  In T226093#8512308 , 
@LSobanski wrote:
  
  > The task's original intent was to cover planning "over the next 3 years" 
starting in 2019. @ArielGlenn is the task still relevant, can it be closed, do 
we need a new one?
  
  It depends on whether any tables are expected to grow a fair amount in the 
next three years. @Ladsgroup will have a better handle on that now.

TASK DETAIL
  https://phabricator.wikimedia.org/T226093

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: ArielGlenn
Cc: LSobanski, Nintendofan885, Ladsgroup, Abit, matthiasmullie, Marostegui, 
Addshore, Ramsey-WMF, jcrespo, Yann, MarkTraceur, ArielGlenn, Aklapper, 
Busfault, Astuthiodit_1, Atieno, karapayneWMDE, joanna_borun, Invadibot, 
GFontenelle_WMF, Devnull, maantietaja, FRomeo_WMF, Muchiri124, jannee_e, 
CBogen, ItamarWMDE, Akuckartz, holger.knust, Legado_Shulgin, ReaperDawn, 
Nandana, JKSTNK, Davinaclare77, Techguru.pc, Lahi, Gq86, E1presidente, Cparle, 
SandraF_WMF, GoranSMilovanovic, Lunewa, Hfbn0, QZanden, Tramullas, Acer, 
LawExplorer, Salgo60, Zppix, Silverfish, _jensen, rosalieper, Scott_WUaS, 
Susannaanas, Wong128hk, gnosygnu, Fuzheado, Jane023, Wikidata-bugs, Base, aude, 
Daniel_Mietchen, Ricordisamoa, Wesalius, Lydia_Pintscher, Raymond, faidon, 
Steinsplitter, Mbch331, Jay8g, fgiunchedi, Hokwelum
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T226093: Capacity planning for Commons Structured Data

2023-01-10 Thread LSobanski 
LSobanski added a comment.


  The task's original intent was to cover planning "over the next 3 years" 
starting in 2019. @ArielGlenn is the task still relevant, can it be closed, do 
we need a new one?

TASK DETAIL
  https://phabricator.wikimedia.org/T226093

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: LSobanski
Cc: LSobanski, Nintendofan885, Ladsgroup, Abit, matthiasmullie, Marostegui, 
Addshore, Ramsey-WMF, jcrespo, Yann, MarkTraceur, ArielGlenn, Aklapper, 
Busfault, Astuthiodit_1, Atieno, karapayneWMDE, joanna_borun, Invadibot, 
GFontenelle_WMF, Devnull, maantietaja, FRomeo_WMF, Muchiri124, jannee_e, 
CBogen, ItamarWMDE, Akuckartz, holger.knust, Legado_Shulgin, ReaperDawn, 
Nandana, JKSTNK, Davinaclare77, Techguru.pc, Lahi, Gq86, E1presidente, Cparle, 
SandraF_WMF, GoranSMilovanovic, Lunewa, Hfbn0, QZanden, Tramullas, Acer, 
LawExplorer, Salgo60, Zppix, Silverfish, _jensen, rosalieper, Scott_WUaS, 
Susannaanas, Wong128hk, gnosygnu, Fuzheado, Jane023, Wikidata-bugs, Base, aude, 
Daniel_Mietchen, Ricordisamoa, Wesalius, Lydia_Pintscher, Raymond, faidon, 
Steinsplitter, Mbch331, Jay8g, fgiunchedi, Hokwelum
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T226093: Capacity planning for Commons Structured Data

2021-03-13 Thread Ladsgroup 
Ladsgroup added a comment.


  If we can clean up the image table (T275268: Avoid capacity issues from the 
image table holding the text of pdf/djvu files as part of their metadata 
) it'll give us leeway for the 
structured data I assume.

TASK DETAIL
  https://phabricator.wikimedia.org/T226093

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: Nintendofan885, Ladsgroup, Abit, matthiasmullie, Marostegui, Addshore, 
Ramsey-WMF, jcrespo, Yann, MarkTraceur, ArielGlenn, Aklapper, GFontenelle_WMF, 
Ramtin0071, Devnull, maantietaja, FRomeo_WMF, lmata, Muchiri124, jannee_e, 
CBogen, Akuckartz, Legado_Shulgin, Nandana, JKSTNK, Davinaclare77, Qtn1293, 
Techguru.pc, Lahi, Gq86, E1presidente, Cparle, Anooprao, SandraF_WMF, 
GoranSMilovanovic, Lunewa, Th3d3v1ls, Hfbn0, QZanden, Tramullas, Acer, 
LawExplorer, Salgo60, Zppix, Silverfish, _jensen, rosalieper, Scott_WUaS, 
Susannaanas, Wong128hk, gnosygnu, abian, Jane023, Wikidata-bugs, Base, aude, 
Ricordisamoa, Wesalius, Lydia_Pintscher, Raymond, faidon, Steinsplitter, 
Mbch331, Jay8g, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T226093: Capacity planning for Commons Structured Data

2021-03-13 Thread Nintendofan885 
Restricted Application added a project: wdwb-tech-focus.

TASK DETAIL
  https://phabricator.wikimedia.org/T226093

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Nintendofan885
Cc: Nintendofan885, Ladsgroup, Abit, matthiasmullie, Marostegui, Addshore, 
Ramsey-WMF, jcrespo, Yann, MarkTraceur, ArielGlenn, Aklapper, GFontenelle_WMF, 
Ramtin0071, Devnull, maantietaja, FRomeo_WMF, lmata, Muchiri124, jannee_e, 
CBogen, Akuckartz, Legado_Shulgin, Nandana, JKSTNK, Davinaclare77, Qtn1293, 
Techguru.pc, Lahi, Gq86, E1presidente, Cparle, Anooprao, SandraF_WMF, 
GoranSMilovanovic, Lunewa, Th3d3v1ls, Hfbn0, QZanden, Tramullas, Acer, 
LawExplorer, Salgo60, Zppix, Silverfish, _jensen, rosalieper, Scott_WUaS, 
Susannaanas, Wong128hk, gnosygnu, abian, Jane023, Wikidata-bugs, Base, aude, 
Ricordisamoa, Wesalius, Lydia_Pintscher, Raymond, faidon, Steinsplitter, 
Mbch331, Jay8g, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T226093: Capacity planning for Commons Structured Data

2020-09-16 Thread Marostegui 
Marostegui added a comment.


  Following my IRC chat with @ArielGlenn - `revision` and `slots` table on s4 
(commonswiki) are still under reasonable sizes.
  We just decrease the size of the `revision` table as we applied the MCR 
schema changes there.
  As of now, the sizes on disk are:
  
  - `revision`: 76GB
  - `slots`: 20GB

TASK DETAIL
  https://phabricator.wikimedia.org/T226093

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Marostegui
Cc: Ladsgroup, Abit, matthiasmullie, Marostegui, Addshore, Ramsey-WMF, jcrespo, 
Yann, MarkTraceur, ArielGlenn, Aklapper, lmata, jannee_e, CBogen, Akuckartz, 
darthmon_wmde, Legado_Shulgin, Nandana, JKSTNK, Davinaclare77, Qtn1293, 
Techguru.pc, Lahi, PDrouin-WMF, Gq86, E1presidente, Cparle, Anooprao, 
SandraF_WMF, GoranSMilovanovic, Lunewa, Th3d3v1ls, Hfbn0, QZanden, Tramullas, 
Acer, LawExplorer, Salgo60, Zppix, Silverfish, _jensen, rosalieper, Scott_WUaS, 
Susannaanas, Wong128hk, gnosygnu, Jane023, Wikidata-bugs, Base, aude, 
Ricordisamoa, Wesalius, Lydia_Pintscher, Fabrice_Florin, Raymond, faidon, 
Steinsplitter, Mbch331, Rxy, Jay8g, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T226093: Capacity planning for Commons Structured Data

2020-09-16 Thread ArielGlenn 
ArielGlenn added a comment.


  Updated (ouch!) F32352585: commons_slots.png 


TASK DETAIL
  https://phabricator.wikimedia.org/T226093

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: ArielGlenn
Cc: Ladsgroup, Abit, matthiasmullie, Marostegui, Mholloway, Addshore, 
Ramsey-WMF, jcrespo, Yann, MarkTraceur, ArielGlenn, Aklapper, lmata, jannee_e, 
CBogen, Akuckartz, darthmon_wmde, Legado_Shulgin, Nandana, JKSTNK, 
Davinaclare77, Qtn1293, Techguru.pc, Lahi, PDrouin-WMF, Gq86, E1presidente, 
Cparle, Anooprao, SandraF_WMF, GoranSMilovanovic, Lunewa, Th3d3v1ls, Hfbn0, 
QZanden, Tramullas, Acer, LawExplorer, Salgo60, Zppix, Silverfish, _jensen, 
rosalieper, Scott_WUaS, Susannaanas, Wong128hk, gnosygnu, Jane023, 
Wikidata-bugs, Base, aude, Ricordisamoa, Wesalius, Lydia_Pintscher, 
Fabrice_Florin, Raymond, faidon, Steinsplitter, Mbch331, Rxy, Jay8g, fgiunchedi
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs