[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

Maintenance_bot removed a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: EBernhardson, Maintenance_bot Cc: EBernhardson, dcausse, Gehel, JAllemandou, Aklapper,

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: EBernhardson, Gehel Cc: EBernhardson, dcausse, Gehel, JAllemandou, Aklapper, AKhatun_WMF, Jersione,

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

JAllemandou added a comment. In T303831#8237323 , @EBernhardson wrote: > data cleanup looks to now have run successfully Thanks a lot @EBernhardson for finalizing on this :) TASK DETAIL https://phabricator.wikimedia.org/T303831

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

EBernhardson added a comment. data cleanup looks to now have run successfully TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: EBernhardson Cc: EBernhardson, dcausse, Gehel, JAllemandou,

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 832331 **merged** by jenkins-bot: [wikimedia/discovery/analytics@master] drop-snapshots: Remove directory handling https://gerrit.wikimedia.org/r/832331 TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 832331 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson): [wikimedia/discovery/analytics@master] drop-snapshots: Remove directory handling https://gerrit.wikimedia.org/r/832331 TASK DETAIL

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 832303 **merged** by jenkins-bot: [wikimedia/discovery/analytics@master] drop-snapshots: Tables are partitioned by wiki https://gerrit.wikimedia.org/r/832303 TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 832303 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson): [wikimedia/discovery/analytics@master] drop-snapshots: Tables are partitioned by wiki https://gerrit.wikimedia.org/r/832303 TASK DETAIL

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 831635 **merged** by jenkins-bot: [wikimedia/discovery/analytics@master] Automatically drop historical partitions of subgraph analysis https://gerrit.wikimedia.org/r/831635 TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 831635 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson): [wikimedia/discovery/analytics@master] Automatically drop historical partitions of subgraph analysis https://gerrit.wikimedia.org/r/831635 TASK DETAIL

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

dcausse added a comment. Discussed this with Joseph as we believe that having to configure the cleanup job in another repo is not ideal. It seems that the long term approach might be around using the data catalog (https://datahub.wikimedia.org/) to store some retention metadata and have

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

JAllemandou added a comment. In T303831#8175252 , @EBernhardson wrote: > @JAllemandou The one remaining piece of this ticket is cleaning up the historical data, per T303831#8081172 .

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

EBernhardson added a comment. @JAllemandou The one remaining piece of this ticket is cleaning up the historical data, per T303831#8081172 . Any suggestions on how we should manage droping old data from tables partitioned by a snapshot

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

Gehel reassigned this task from AKhatun_WMF to EBernhardson. TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: EBernhardson, Gehel Cc: EBernhardson, dcausse, Gehel, JAllemandou, Aklapper,

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 823185 **merged** by jenkins-bot: [wikimedia/discovery/analytics@master] Remove subgraph/query mapping from drop_old_data https://gerrit.wikimedia.org/r/823185 TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AKhatun_WMF, gerritbot Cc: EBernhardson, dcausse, Gehel, JAllemandou, Aklapper, AKhatun_WMF,

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 823185 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson): [wikimedia/discovery/analytics@master] Remove subgraph/query mapping from drop_old_data https://gerrit.wikimedia.org/r/823185 TASK DETAIL

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

EBernhardson removed a project: Patch-For-Review. EBernhardson added a comment. Double checked all linked patches, no patches remain for review. The work still to be done is to decide how to handle pruning data from the `snapshot=` partitioned tables TASK DETAIL

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

EBernhardson added a comment. There is actually one piece remaining, we typically use `refinery-drop-older-than` to prune our tables. That worked when we used `date=...` as the partitioning scheme, but it doesn't support `snapshot=...`. I t takes minimal work (I already have a working POC)

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

JAllemandou added a comment. Thanks a lot @EBernhardson for the help on finishing this! TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AKhatun_WMF, JAllemandou Cc: EBernhardson, dcausse,

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

EBernhardson added a comment. All dags are now enabled and have completed at least one full execution of each dag. - Increased partition count on map_subgraph_queries to 2048, the largest shuffle is ~600GB and this gets the per-executor work down into the desired 256-512M range. -

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 813334 **merged** by jenkins-bot: [wikimedia/discovery/analytics@master] subgraph_and_query_metrics: Drop wiki from sparql event partition spec https://gerrit.wikimedia.org/r/813334 TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 813334 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson): [wikimedia/discovery/analytics@master] subgraph_and_query_metrics: Drop wiki from sparql event partition spec https://gerrit.wikimedia.org/r/813334 TASK DETAIL

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 813190 **merged** by jenkins-bot: [wikimedia/discovery/analytics@master] subgraph_and_query_mapping: Increase memory to 12g, use repartition https://gerrit.wikimedia.org/r/813190 TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 813190 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson): [wikimedia/discovery/analytics@master] subgraph_and_query_mapping: Increase memory to 12g, use repartition https://gerrit.wikimedia.org/r/813190 TASK DETAIL

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 812970 **merged** by jenkins-bot: [wikidata/query/rdf@master] Switch SubgraphQueryMapper from coalesce to repartition https://gerrit.wikimedia.org/r/812970 TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 812970 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson): [wikidata/query/rdf@master] Switch SubgraphQueryMapper from coalesce to repartition https://gerrit.wikimedia.org/r/812970 TASK DETAIL

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 812942 **merged** by jenkins-bot: [wikimedia/discovery/analytics@master] subgraph_query_mapping_daily: Increase partitioning to 2048 https://gerrit.wikimedia.org/r/812942 TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 812942 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson): [wikimedia/discovery/analytics@master] subgraph_query_mapping_daily: Increase partitioning to 2048 https://gerrit.wikimedia.org/r/812942 TASK DETAIL

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 812936 **merged** by jenkins-bot: [wikimedia/discovery/analytics@master] Remove external queries from wait_for_data https://gerrit.wikimedia.org/r/812936 TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 812936 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson): [wikimedia/discovery/analytics@master] Remove external queries from wait_for_data https://gerrit.wikimedia.org/r/812936 TASK DETAIL

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 812927 **merged** by jenkins-bot: [wikimedia/discovery/analytics@master] subgraph: Use HivePartitionRangeSensor to wait for sparql queries https://gerrit.wikimedia.org/r/812927 TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 812927 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson): [wikimedia/discovery/analytics@master] subgraph: Use HivePartitionRangeSensor to wait for sparql queries https://gerrit.wikimedia.org/r/812927 TASK DETAIL

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 812304 **merged** by jenkins-bot: [wikimedia/discovery/analytics@master] Reconsider sensor data dates and use hive range sensor https://gerrit.wikimedia.org/r/812304 TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 812304 had a related patch set uploaded (by AKhatun; author: AKhatun): [wikimedia/discovery/analytics@master] Reconsider sensor data dates and use hive range sensor https://gerrit.wikimedia.org/r/812304 TASK DETAIL

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

AKhatun_WMF added a comment. In T303831#8063021 , @EBernhardson wrote: > In terms of the exact code causing this, spark is terrible at telling us exactly where but trying to infer from the SparkUI output i think it's this join: > >

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

EBernhardson added a comment. Summary of what was done so far to deploy: - Tuned subgraph_mapping_weekly. Set spark parallelism to 4096, Increased memory to 24G (=6g per task) and reduced total executor count to keep total memory usage around 1TB. Changed `coalesce()` into

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

EBernhardson added a comment. Stats on the final join building `topSubgraphTriples`. this is using 4096 partitions and repartition(). It works for now so probably not worth dealing with the skew, but these stats might be useful to compare against in the future if it starts failing: |

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 812143 **merged** by jenkins-bot: [wikimedia/discovery/analytics@master] Update rdf-spark-tools to 0.3.112 https://gerrit.wikimedia.org/r/812143 TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 812143 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson): [wikimedia/discovery/analytics@master] Update rdf-spark-tools to 0.3.112 https://gerrit.wikimedia.org/r/812143 TASK DETAIL https://phabricator.wikimedia.org/T303831

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 812133 **merged** by jenkins-bot: [wikidata/query/rdf@master] Switch SubgraphMapper from coalesce to repartition https://gerrit.wikimedia.org/r/812133 TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 812133 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson): [wikidata/query/rdf@master] Switch SubgraphMapper from coalesce to repartition https://gerrit.wikimedia.org/r/812133 TASK DETAIL

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 812075 **merged** by jenkins-bot: [wikimedia/discovery/analytics@master] Tune subgraph_mapping_weekly based on first prod run https://gerrit.wikimedia.org/r/812075 TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 812075 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson): [wikimedia/discovery/analytics@master] Tune subgraph_mapping_weekly based on first prod run https://gerrit.wikimedia.org/r/812075 TASK DETAIL

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

EBernhardson added a comment. I tried a run with the three coalesce's in SubgraphMapper converted into repartitions. In this case instead of having 8 partitions where 7 finish and the 8th takes forever and then fails, now it has 200 partitions and 199 finish with the 200th taking forever

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

EBernhardson added a comment. In T303831#8060472 , @AKhatun_WMF wrote: > In T303831#8058159 , @EBernhardson wrote: > >> the airflow patch is deployed but i only turned on *_init

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

AKhatun_WMF added a comment. Update: I tested a few options in the statbox, I am not sure how much this will represent the prod env, but here goes: coalesce + 8G driver memory = failed as identified by Erik (SparkOutOfMemoryError at topSubgraphItems,

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

AKhatun_WMF added a comment. In T303831#8058159 , @EBernhardson wrote: > the airflow patch is deployed but i only turned on *_init dags and subgraph_mapping_weekly today (ran out of time, will do rest tomorrow). > >

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

EBernhardson added a comment. the airflow patch is deployed but i only turned on *_init dags and subgraph_mapping_weekly today (ran out of time, will do rest tomorrow). subgraph_mapping_weekly failed the first time through. I updated executor memory from 8g to 12g but the second

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 807977 **merged** by jenkins-bot: [wikimedia/discovery/analytics@master] Airflow dags to generate subgraph and query mapping and their metrics https://gerrit.wikimedia.org/r/807977 TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 808977 **merged** by jenkins-bot: [wikidata/query/rdf@master] Update subgraph table partitions https://gerrit.wikimedia.org/r/808977 TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 803492 **merged** by jenkins-bot: [wikidata/query/rdf@master] Unit tests for subgraph analysis metrics https://gerrit.wikimedia.org/r/803492 TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 800599 **merged** by jenkins-bot: [wikidata/query/rdf@master] Unit tests for subgraph query mapping https://gerrit.wikimedia.org/r/800599 TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 787064 **merged** by jenkins-bot: [wikidata/query/rdf@master] Unit tests for subgraph mapping https://gerrit.wikimedia.org/r/787064 TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 808977 had a related patch set uploaded (by AKhatun; author: AKhatun): [wikidata/query/rdf@master] Update subgraph table partitions https://gerrit.wikimedia.org/r/808977 TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 771077 **merged** by jenkins-bot: [wikidata/query/rdf@master] Productionize subgraph analysis metrics https://gerrit.wikimedia.org/r/771077 TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 807977 had a related patch set uploaded (by AKhatun; author: AKhatun): [wikimedia/discovery/analytics@master] Airflow dags to generate subgraph and query mapping and their metrics https://gerrit.wikimedia.org/r/807977 TASK DETAIL

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 803492 had a related patch set uploaded (by AKhatun; author: AKhatun): [wikidata/query/rdf@master] Unit tests for subgraph analysis metrics https://gerrit.wikimedia.org/r/803492 TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 802506 **merged** by jenkins-bot: [wikidata/query/rdf@master] Add spark-testing-base dependency https://gerrit.wikimedia.org/r/802506 TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 802506 had a related patch set uploaded (by AKhatun; author: AKhatun): [wikidata/query/rdf@master] Add spark-testing-base dependency https://gerrit.wikimedia.org/r/802506 TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 800599 had a related patch set uploaded (by AKhatun; author: AKhatun): [wikidata/query/rdf@master] Unit tests for subgraph query mapping https://gerrit.wikimedia.org/r/800599 TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 787064 had a related patch set uploaded (by AKhatun; author: AKhatun): [wikidata/query/rdf@master] Unit tests for subgraph mapping https://gerrit.wikimedia.org/r/787064 TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 780888 **merged** by jenkins-bot: [wikidata/query/rdf@master] Reorganize rdf-spark-tools submodule https://gerrit.wikimedia.org/r/780888 TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 780888 had a related patch set uploaded (by AKhatun; author: AKhatun): [wikidata/query/rdf@master] Reorganize rdf-spark-tools submodule https://gerrit.wikimedia.org/r/780888 TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AKhatun_WMF, gerritbot Cc: dcausse, Gehel, JAllemandou, Aklapper, AKhatun_WMF, Fernandobacasegua34,

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

gerritbot added a comment. Change 771077 had a related patch set uploaded (by AKhatun; author: AKhatun): [wikidata/query/rdf@master] [WIP] Productionize subgraph analysis metrics https://gerrit.wikimedia.org/r/771077 TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

Maintenance_bot added a project: Wikidata. TASK DETAIL https://phabricator.wikimedia.org/T303831 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AKhatun_WMF, Maintenance_bot Cc: dcausse, Gehel, JAllemandou, Aklapper, AKhatun_WMF, Astuthiodit_1,

[Wikidata-bugs] [Maniphest] T303831: Productionize Wikidata subgraph analysis

AKhatun_WMF created this task. AKhatun_WMF added projects: Discovery-Search (Current work), Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION As a Data Analyst for Wikidata/WDQS, I would like for the metrics from subgraph analysis done in T293628