[Wikidata-bugs] [Maniphest] T264710: Host static sites on kubernetes

[akosiaris]

akosiaris closed this task as "Invalid".
akosiaris added a comment.


  In T264710#6586070 , 
@Addshore wrote:
  
  > Sounds like a fine solution from our side for now.
  > I'll let #serviceops  do 
with this ticket as they wish (keep it or close it) and I'll get on to creating 
some tickets for:
  
  Cool, thanks. I 'll close it as invalid for now, but we can always reopen in 
the future to resume this conversation.

TASK DETAIL
  https://phabricator.wikimedia.org/T264710

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: akosiaris
Cc: JMeybohm, CDanis, Dzahn, Gehel, dcausse, Joe, akosiaris, Tarrow, Aklapper, 
WMDE-leszek, Addshore, wkandek, CBogen, Akuckartz, Nandana, Namenlos314, 
jijiki, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Mahir256, 
QZanden, EBjune, merbst, LawExplorer, Salgo60, _jensen, rosalieper, Scott_WUaS, 
Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T264710: Host static sites on kubernetes

[Addshore]

Addshore added a comment.


  Sounds like a fine solution from our side for now.
  I'll let #serviceops  do 
with this ticket as they wish (keep it or close it) and I'll get on to creating 
some tickets for:
  
  1. Moving wdqs UI to static sites
  2. Deploying the querybuilder ui to static sites

TASK DETAIL
  https://phabricator.wikimedia.org/T264710

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: JMeybohm, CDanis, Dzahn, Gehel, dcausse, Joe, akosiaris, Tarrow, Aklapper, 
WMDE-leszek, Addshore, wkandek, CBogen, Akuckartz, Nandana, Namenlos314, 
jijiki, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Mahir256, 
QZanden, EBjune, merbst, LawExplorer, Salgo60, _jensen, rosalieper, Scott_WUaS, 
Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T264710: Host static sites on kubernetes

[akosiaris]

akosiaris added a comment.


  For what is worth, the idea that Daniel explains above, would solve the issue 
for now without the need to move to kubernetes, satisfying multiple of the 
requirements without requiring significant effort.
  
  The following from the task description are satisfied:
  
  [X] Teams that manage / own the sites should be able to update the content of 
the site
  [X] The hosting location can be pointed to from sub paths of 
query.wikidata.org (and similar flexible locations). For WDQS this could be 
done in the WDQS nginx server config
  [X] Does CDN cache purging need to be considered at all (setting the correct 
`Cache-control` HTTP header in the apache config would solve this).
  
  The following aren't, but were marked by yours truly as SHOULD, not MUST to 
begin with. In the interest of moving forward and providing a solution I think 
it's ok.
  
  [ ] Support for structured logging to stdout to allow debugging issues via 
our ELK stack should be a requirement.
  [ ] Support for exporting metrics via prometheus or statsd should be a 
requirement.

TASK DETAIL
  https://phabricator.wikimedia.org/T264710

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: akosiaris
Cc: JMeybohm, CDanis, Dzahn, Gehel, dcausse, Joe, akosiaris, Tarrow, Aklapper, 
WMDE-leszek, Addshore, wkandek, CBogen, Akuckartz, darthmon_wmde, Nandana, 
Namenlos314, jijiki, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
Mahir256, QZanden, EBjune, merbst, LawExplorer, Salgo60, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T264710: Host static sites on kubernetes

[Dzahn]

Dzahn added a comment.


  While we are generally interested in moving all static sites at some point in 
the future we are not there yet at the current time, primarily because we don't 
have an ingress yet.
  
  Until that has changed we would like to offer a the following fix in the 
meantime:
  
  wikidata-query-service UI / query builder move to the current setup for 
microsites. They are hosted on miscweb* servers alongside other existing 
microsites.
  
  We would add puppet code needed for that and puppet would pull content from 
deployment repos on Gerrit, like we do it with other microsites.
  
  Once setup, some people would then get +2 on the deploy repo and it would 
also solve the requirement that you can deploy content by yourself without 
having to wait for other teams
  while needing a lot less engineering effort.
  
  Regarding CDN cache purging the same would apply that does for varnish/ATS on 
wiki sites. 
(https://wikitech.wikimedia.org/wiki/Apache_Traffic_Server#Forcing_a_cache_miss_(similar_to_ban)
  if really needed though almost never needed for microsites).
  
  It is also possible to configure a specific site as just "passthrough" 
without actual caching.
  
  I would be happy to setup the puppet part for you.  In the future we would 
then revisit this to move all static sites at once.

TASK DETAIL
  https://phabricator.wikimedia.org/T264710

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Dzahn
Cc: JMeybohm, CDanis, Dzahn, Gehel, dcausse, Joe, akosiaris, Tarrow, Aklapper, 
WMDE-leszek, Addshore, wkandek, CBogen, Akuckartz, darthmon_wmde, Nandana, 
Namenlos314, jijiki, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
Mahir256, QZanden, EBjune, merbst, LawExplorer, Salgo60, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T264710: Host static sites on kubernetes

[Addshore]

Addshore updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T264710

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: JMeybohm, CDanis, Dzahn, Gehel, dcausse, Joe, akosiaris, Tarrow, Aklapper, 
WMDE-leszek, Addshore, wkandek, CBogen, Akuckartz, darthmon_wmde, Nandana, 
Namenlos314, jijiki, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, 
Mahir256, QZanden, EBjune, merbst, LawExplorer, Salgo60, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T264710: Host static sites on kubernetes

[Addshore]

Addshore updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T264710

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: CDanis, Dzahn, Gehel, dcausse, Joe, akosiaris, Tarrow, Aklapper, 
WMDE-leszek, Addshore, wkandek, JMeybohm, CBogen, Akuckartz, darthmon_wmde, 
Nandana, Namenlos314, jijiki, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, Mahir256, QZanden, EBjune, merbst, LawExplorer, Salgo60, 
_jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, 
Jdouglas, aude, Tobias1984, Manybubbles, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T264710: Host static sites on kubernetes

[Addshore]

Addshore updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T264710

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: CDanis, Dzahn, Gehel, dcausse, Joe, akosiaris, Tarrow, Aklapper, 
WMDE-leszek, Addshore, wkandek, JMeybohm, CBogen, Akuckartz, darthmon_wmde, 
Nandana, Namenlos314, jijiki, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, Mahir256, QZanden, EBjune, merbst, LawExplorer, Salgo60, 
_jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, 
Jdouglas, aude, Tobias1984, Manybubbles, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T264710: Host static sites on kubernetes

[Addshore]

Addshore updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T264710

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: Gehel, dcausse, Joe, akosiaris, Tarrow, Aklapper, WMDE-leszek, Addshore, 
wkandek, JMeybohm, CBogen, Akuckartz, darthmon_wmde, Nandana, Namenlos314, 
jijiki, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Mahir256, 
QZanden, EBjune, merbst, LawExplorer, Salgo60, _jensen, rosalieper, Scott_WUaS, 
Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, 
Lydia_Pintscher, Mbch331, Dzahn
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T264710: Host static sites on kubernetes

[Addshore]

Addshore updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T264710

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: Gehel, dcausse, Joe, akosiaris, Tarrow, Aklapper, WMDE-leszek, Addshore, 
wkandek, JMeybohm, CBogen, Akuckartz, darthmon_wmde, Nandana, Namenlos314, 
jijiki, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Mahir256, 
QZanden, EBjune, merbst, LawExplorer, Salgo60, _jensen, rosalieper, Scott_WUaS, 
Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, 
Lydia_Pintscher, Mbch331, Dzahn
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T264710: Host static sites on kubernetes

[Addshore]

Addshore added projects: serviceops, Wikidata Query Builder, Wikidata Query UI.
Addshore updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T264710

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: akosiaris, Tarrow, Aklapper, WMDE-leszek, Addshore, wkandek, JMeybohm, 
CBogen, Akuckartz, darthmon_wmde, Nandana, Namenlos314, jijiki, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, Mahir256, QZanden, EBjune, merbst, 
LawExplorer, Salgo60, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Lydia_Pintscher, 
Mbch331, Dzahn
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T264710: Host static sites on kubernetes

[Addshore]

Addshore updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T264710

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: akosiaris, Tarrow, Aklapper, WMDE-leszek, Addshore, Akuckartz, 
darthmon_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, 
_jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T264710: Host static sites on kubernetes

[Addshore]

Addshore updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T264710

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: akosiaris, Tarrow, Aklapper, WMDE-leszek, Addshore, Akuckartz, 
darthmon_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, 
_jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T264710: Host static sites on kubernetes

[akosiaris]

akosiaris added a comment.


  A couple of requirements from my side, regardless of where those sites are 
deployed and the technology used:
  
  - Support for structured logging to stdout to allow debugging issues via our 
ELK stack should be a requirement.
  - Support for exporting metrics via prometheus or statsd should be a 
requirement. This should allow debugging issues, establishing SLIs and SLOs and 
allowing to come up with a level of support and ownership of powered services. 
Failing that, it will be impossible to come up with a level of support and will 
make those static sites a best effort.

TASK DETAIL
  https://phabricator.wikimedia.org/T264710

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: akosiaris
Cc: akosiaris, Tarrow, Aklapper, WMDE-leszek, Addshore, Akuckartz, 
darthmon_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, 
_jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T264710: Host static sites on kubernetes

[Addshore]

Addshore created this task.
Addshore added projects: User-Addshore, Wikidata.
Restricted Application added a subscriber: Aklapper.

TASK DESCRIPTION
  This ticket is a placeholder (so we have a ticket ID) and content will come 
soon (today).
  
  Initial adopters:
  
  - Wikidata query service UI (currently deployed on wdqs hosts)
  - Wikidata query service query builder (currently under development)

TASK DETAIL
  https://phabricator.wikimedia.org/T264710

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: Aklapper, WMDE-leszek, Addshore, Akuckartz, darthmon_wmde, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T264710: Host static sites on kubernetes

[Tarrow]

Tarrow added a comment.


  It might be that one of the benefits of hosting (e.g. **Wikidata query 
service query builder**) on k8s would be the CI build step that could be 
provided by pipelinelib/blubber.
  
  In this case a single generic service (all using the same container images) 
would mean we miss out on this benefit.

TASK DETAIL
  https://phabricator.wikimedia.org/T264710

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Tarrow
Cc: Tarrow, Aklapper, WMDE-leszek, Addshore, Akuckartz, darthmon_wmde, Nandana, 
Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T264710: Host static sites on kubernetes

[Addshore]

Addshore updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T264710

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: Aklapper, WMDE-leszek, Addshore, Akuckartz, darthmon_wmde, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs