[Wikidata-bugs] [Maniphest] T288257: Get estimates for size of astronomical objects and queries in Wikidata graph

2022-01-10 Thread Gehel 
Gehel closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T288257

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: AKhatun_WMF, Gehel
Cc: Aklapper, AKhatun_WMF, Addshore, Manuel, MPhamWMF, Invadibot, maantietaja, 
CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T288257: Get estimates for size of astronomical objects and queries in Wikidata graph

2022-01-05 Thread AKhatun_WMF 
AKhatun_WMF moved this task from Incoming to Needs Reporting on the 
Discovery-Search (Current work) board.
AKhatun_WMF added a comment.


  Counts of queries and triples for astronomical objects were done here: 
Wikidata_Subgraph_Query_Analysis 
,
 along with the top ~300 large subgraphs.
  For the specific case of Astronomical objects (and only astronomical 
objects), a list of all its subclasses was obtained and manually inspected for 
relevance to astronomical objects. The subclass list also consists of 
`subclasses of subclasses` and so on.
  
  - Percent of triples: 8.7%
  - Percent of entities: 8.9%
  - Days to recover: 245
  - Query count: 2.5M
  - Percent of queries: 1.3%
  - Percent time of all queries: 0.5%

TASK DETAIL
  https://phabricator.wikimedia.org/T288257

WORKBOARD
  https://phabricator.wikimedia.org/project/board/1227/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: AKhatun_WMF
Cc: Aklapper, AKhatun_WMF, Addshore, Manuel, MPhamWMF, Invadibot, maantietaja, 
CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T288257: Get estimates for size of astronomical objects and queries in Wikidata graph

2022-01-05 Thread AKhatun_WMF 
AKhatun_WMF moved this task from Analysis to Current work on the 
Wikidata-Query-Service board.
AKhatun_WMF added a project: Discovery-Search (Current work).

TASK DETAIL
  https://phabricator.wikimedia.org/T288257

WORKBOARD
  https://phabricator.wikimedia.org/project/board/891/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: AKhatun_WMF
Cc: Aklapper, AKhatun_WMF, Addshore, Manuel, MPhamWMF, Invadibot, maantietaja, 
CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T288257: Get estimates for size of astronomical objects and queries in Wikidata graph

2021-10-26 Thread MPhamWMF 
MPhamWMF triaged this task as "High" priority.

TASK DETAIL
  https://phabricator.wikimedia.org/T288257

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: AKhatun_WMF, MPhamWMF
Cc: Aklapper, AKhatun_WMF, Addshore, Manuel, MPhamWMF, Invadibot, maantietaja, 
CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T288257: Get estimates for size of astronomical objects and queries in Wikidata graph

2021-10-18 Thread AKhatun_WMF 
AKhatun_WMF removed a parent task: T282790: [EPIC] Get estimates for dropping 
data from Wikidata in case of Blazegraph catastrophic failure.

TASK DETAIL
  https://phabricator.wikimedia.org/T288257

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: AKhatun_WMF
Cc: Aklapper, AKhatun_WMF, Addshore, Manuel, MPhamWMF, Invadibot, maantietaja, 
CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T288257: Get estimates for size of astronomical objects and queries in Wikidata graph

2021-10-18 Thread AKhatun_WMF 
AKhatun_WMF added a parent task: T293628: Get baseline 
measurements/expectations for splitting various subgraphs from Wikidata.

TASK DETAIL
  https://phabricator.wikimedia.org/T288257

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: AKhatun_WMF
Cc: Aklapper, AKhatun_WMF, Addshore, Manuel, MPhamWMF, Invadibot, maantietaja, 
CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T288257: Get estimates for size of astronomical objects and queries in Wikidata graph

2021-09-24 Thread AKhatun_WMF 
AKhatun_WMF added a comment.


  Astronomical objects are structured hierarchically and so not everything is 
direct `instance of` Q6999  (unlike 
scholarly articles).
  
  Considering all subclasses of  Q6999 , 
the number of astronomical objects form ~9% of all Wikidata entities. (sparql 
query 
)
  And an approximation of the number of triples 'related to' these entities is 
7.5% (~1B) of all Wikidata triples. Approximated from top 10 subclasses (which 
are 7% of all entities)

TASK DETAIL
  https://phabricator.wikimedia.org/T288257

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: AKhatun_WMF
Cc: Aklapper, AKhatun_WMF, Addshore, Manuel, MPhamWMF, Invadibot, maantietaja, 
CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T288257: Get estimates for size of astronomical objects and queries in Wikidata graph

2021-08-05 Thread MPhamWMF 
MPhamWMF created this task.
MPhamWMF added projects: Wikidata-Query-Service, Wikidata.

TASK DESCRIPTION
  As a user, I want to know the potential cost/benefit estimates for splitting 
off astronomical objects from the Wikidata graph, so that WDQS can scale to my 
needs.
  
  This ticket is a part of WDQS disaster planning, and reflects research into 
mitigation strategies for catastrophic failure of Blazegraph: specifically in 
the case that the Wikidata graph becomes too big for Blazegraph to continue 
supporting. This is not a commitment to a long term state of WDQS or Wikidata, 
but part of the disaster mitigation playbook in a worst case scenario.
  
  For astronomical objects in Wikidata (https://www.wikidata.org/wiki/Q6999):
  
  [ ] Determine the size in Blazegraph (actual, percentage), and how much 
runway time deleting it gains us at current Wikidata growth rate.
  [ ] Estimate how many queries reference/touch astronomical objects in 
Wikidata graph

TASK DETAIL
  https://phabricator.wikimedia.org/T288257

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: AKhatun_WMF, MPhamWMF
Cc: Aklapper, AKhatun_WMF, Addshore, Manuel, MPhamWMF, Invadibot, maantietaja, 
CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org