[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2021-06-22 Thread jijiki
jijiki updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jijiki Cc: akosiaris, Mstyles, Gehel, Aklapper, Biggs657, Invadibot, Lalamarie69, MPhamWMF, maantietaja,

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2021-06-21 Thread Gehel
Gehel closed subtask T278385: Streaming Updater must make all requests to proxy endpoints as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: akosiaris, Mstyles, Gehel,

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2021-06-14 Thread dcausse
dcausse closed subtask T280166: Investigate using session cluster for Flink as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse Cc: akosiaris, Mstyles, Gehel, Aklapper,

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2021-03-24 Thread Gehel
Gehel closed subtask Restricted Task as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: akosiaris, Mstyles, Gehel, Aklapper, Invadibot, MPhamWMF, maantietaja, Alter-paule,

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2021-03-24 Thread Gehel
Gehel closed subtask T276131: Fix Serialization Bug as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: akosiaris, Mstyles, Gehel, Aklapper, Invadibot, MPhamWMF, maantietaja,

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2021-03-18 Thread Mstyles
Mstyles updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Mstyles Cc: akosiaris, Mstyles, Gehel, Aklapper, MPhamWMF, maantietaja, Alter-paule, Beast1978, CBogen,

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2021-03-18 Thread Mstyles
Mstyles updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Mstyles Cc: akosiaris, Mstyles, Gehel, Aklapper, MPhamWMF, maantietaja, Alter-paule, Beast1978, CBogen,

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2021-03-12 Thread jeena
jeena closed subtask T277125: Allow timeout override for pipeline k8s deployments to ci cluster as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jeena Cc: akosiaris, Mstyles, Gehel,

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2021-03-12 Thread Mstyles
Mstyles added a subtask: Restricted Task. TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Mstyles Cc: akosiaris, Mstyles, Gehel, Aklapper, MPhamWMF, maantietaja, Alter-paule, Beast1978, CBogen,

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2021-03-12 Thread gerritbot
gerritbot added a comment. Change 671204 had a related patch set uploaded (by Mstyles; owner: Mstyles): [operations/deployment-charts@master] create helmfile.d structure https://gerrit.wikimedia.org/r/671204 TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2021-03-11 Thread gerritbot
gerritbot added a comment. Change 650309 **merged** by jenkins-bot: [wikidata/query/flink-rdf-streaming-updater@master] add pipeline test and chart and update to Flink 1.12.1 https://gerrit.wikimedia.org/r/650309 TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2021-02-25 Thread gerritbot
gerritbot added a comment. Change 666713 **merged** by jenkins-bot: [wikidata/query/rdf@master] update flink version to 1.12.1 https://gerrit.wikimedia.org/r/666713 TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2021-02-24 Thread gerritbot
gerritbot added a comment. Change 666713 had a related patch set uploaded (by Mstyles; owner: Mstyles): [wikidata/query/rdf@master] update flink version to 1.12.1 https://gerrit.wikimedia.org/r/666713 TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2021-02-24 Thread Gehel
Gehel closed subtask T269619: Create pipelines for late/spurious/failed events as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: akosiaris, Mstyles, Gehel, Aklapper,

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2021-02-17 Thread Gehel
Gehel closed subtask T267310: Allow job name configuration for Streaming Updater as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: akosiaris, Mstyles, Gehel, Aklapper,

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2021-02-10 Thread Gehel
Gehel closed subtask T273097: Create Flink Base Image as Declined. TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: akosiaris, Mstyles, Gehel, Aklapper, MPhamWMF, Alter-paule, Beast1978,

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2021-02-08 Thread Mstyles
Mstyles closed subtask T266495: Create Debian Package for Flink as Declined. TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Mstyles Cc: akosiaris, Mstyles, Gehel, Aklapper, MPhamWMF,

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2021-02-08 Thread Gehel
Gehel added a subtask: T273735: Migrate Streaming Updater to newer Scala version. TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: akosiaris, Mstyles, Gehel, Aklapper, MPhamWMF,

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2021-02-01 Thread Gehel
Gehel closed subtask T265526: Create Helm Chart as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: akosiaris, Mstyles, Gehel, Aklapper, MPhamWMF, Alter-paule, Beast1978,

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2021-02-01 Thread Gehel
Gehel closed subtask T269876: Add swift plugin to Flink k8s as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: akosiaris, Mstyles, Gehel, Aklapper, MPhamWMF, Alter-paule,

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2021-01-21 Thread gerritbot
gerritbot added a comment. Change 654723 **merged** by jenkins-bot: [operations/deployment-charts@master] update flink logging https://gerrit.wikimedia.org/r/654723 TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2021-01-06 Thread gerritbot
gerritbot added a comment. Change 654723 had a related patch set uploaded (by Mstyles; owner: Mstyles): [operations/deployment-charts@master] update flink logging https://gerrit.wikimedia.org/r/654723 TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2020-12-17 Thread gerritbot
gerritbot added a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: gerritbot Cc: akosiaris, Mstyles, Gehel, Aklapper, MPhamWMF, Alter-paule, Beast1978, CBogen, Un1tY,

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2020-12-17 Thread gerritbot
gerritbot added a comment. Change 650309 had a related patch set uploaded (by Mstyles; owner: Mstyles): [wikidata/query/flink-rdf-streaming-updater@master] add helm test and helm chart https://gerrit.wikimedia.org/r/650309 TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2020-12-16 Thread akosiaris
akosiaris added a comment. After the helm chart is merged and published (both should happen automatically on a +2, I 've +1ed already), the final 2 items for deployment are: [ ] Create k8s tokens, namespaces. That's for SRE ServiceOps, example is at

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2020-12-14 Thread Gehel
Gehel closed subtask T265504: Create Blubberfile in WDQS repo as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Mstyles, Gehel, Aklapper, CBogen, Akuckartz, Nandana,

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2020-12-14 Thread Gehel
Gehel closed subtask T265512: Set up Pipeline Configuration in WDQS repo as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Mstyles, Gehel, Aklapper, CBogen, Akuckartz,

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2020-11-09 Thread Gehel
Gehel added a subtask: T267310: Allow job name configuration for Streaming Updater. TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Mstyles, Gehel, Aklapper, CBogen, Akuckartz, Nandana,

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2020-10-28 Thread Gehel
Gehel triaged this task as "High" priority. TASK DETAIL https://phabricator.wikimedia.org/T264006 WORKBOARD https://phabricator.wikimedia.org/project/board/1227/ EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Mstyles, Gehel, Aklapper,

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2020-10-08 Thread Mstyles
Mstyles added a comment. We're having an in person meeting soon, but I just wanted to outline some things I think will need to happen from a high level. This is based on reading https://wikitech.wikimedia.org/wiki/Deployment_pipeline/Components. 1. Create blubberfiles for both flink and

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2020-10-05 Thread CBogen
CBogen set the point value for this task to "21". TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: CBogen Cc: Gehel, Aklapper, CBogen, Akuckartz, darthmon_wmde, Nandana, Namenlos314, Lahi, Gq86,

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2020-10-05 Thread CBogen
CBogen moved this task from All WDQS-related tasks to Current work on the Wikidata-Query-Service board. CBogen added a project: Discovery-Search (Current work). TASK DETAIL https://phabricator.wikimedia.org/T264006 WORKBOARD https://phabricator.wikimedia.org/project/board/891/ EMAIL

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2020-10-05 Thread Gehel
Gehel updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Gehel, Aklapper, CBogen, Akuckartz, darthmon_wmde, Nandana, Namenlos314, Lahi, Gq86,

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

2020-09-28 Thread Gehel
Gehel created this task. Gehel added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION As on operator of WDQS / WCQS, I want to deploy Flink in a way that is robust so that we can deploy