[Wikidata-bugs] [Maniphest] [Commented On] T133046: WDQS stopped updating during datacenter switch

2016-04-28 Thread Gehel 
Gehel added a comment.


  Nothing to do here on the WDQS side. Closing it.

TASK DETAIL
  https://phabricator.wikimedia.org/T133046

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Smalyshev, Gehel
Cc: daniel, aude, IKhitron, Addshore, Aklapper, Smalyshev, Gehel, TerraCodes, 
Avner, debt, D3r1ck01, FloNight, Izno, jkroll, Wikidata-bugs, Jdouglas, 
Deskana, Manybubbles, Mbch331, Jay8g



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T133046: WDQS stopped updating during datacenter switch

2016-04-19 Thread Smalyshev 
Smalyshev added a comment.


  Yes, WDQS uses recent changes API, so if that one is broken then updates are 
broken too.

TASK DETAIL
  https://phabricator.wikimedia.org/T133046

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Smalyshev
Cc: daniel, aude, IKhitron, Addshore, Aklapper, Smalyshev, Gehel, TerraCodes, 
Avner, debt, D3r1ck01, FloNight, Izno, jkroll, Wikidata-bugs, Jdouglas, 
Deskana, Manybubbles, Mbch331, Jay8g



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T133046: WDQS stopped updating during datacenter switch

2016-04-19 Thread IKhitron 
IKhitron added a comment.


  Well, I made the list of missing edits, and they are not unmarked!

TASK DETAIL
  https://phabricator.wikimedia.org/T133046

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: IKhitron
Cc: daniel, aude, IKhitron, Addshore, Aklapper, Smalyshev, Gehel, TerraCodes, 
Avner, debt, D3r1ck01, FloNight, Izno, jkroll, Wikidata-bugs, Jdouglas, 
Deskana, Manybubbles, Mbch331, Jay8g



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T133046: WDQS stopped updating during datacenter switch

2016-04-19 Thread Addshore 
Addshore added a comment.


  In https://phabricator.wikimedia.org/T133046#2218396, @IKhitron wrote:
  
  > Well, Quarry ignores queries on the lost time in recentchanges table, but 
has all the data in revision table.
  
  
  Indeed, per my edit on test.wikipedia.org never making it to the recent 
changes table many edits will not have made it to the rc table on wikidata.org
  And if this is how WDQS picks up edits WDQS will have missed them.

TASK DETAIL
  https://phabricator.wikimedia.org/T133046

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: IKhitron, Addshore, Aklapper, Smalyshev, Gehel, TerraCodes, Avner, debt, 
D3r1ck01, FloNight, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Deskana, 
Manybubbles, Mbch331, Jay8g



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T133046: WDQS stopped updating during datacenter switch

2016-04-19 Thread IKhitron 
IKhitron added a comment.


  Well, Quarry ignores queries on the lost time in recentchanges table, but has 
all the data in revision table.

TASK DETAIL
  https://phabricator.wikimedia.org/T133046

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: IKhitron
Cc: IKhitron, Addshore, Aklapper, Smalyshev, Gehel, TerraCodes, Avner, debt, 
D3r1ck01, FloNight, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Deskana, 
Manybubbles, Mbch331, Jay8g



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T133046: WDQS stopped updating during datacenter switch

2016-04-19 Thread Gehel 
Gehel added a comment.


  Looking at the code, it seems that updates are fetched by using the MW API. 
Doing the call manually from wdqs1001 seems to return meaningful data:
  
curl -v -s 
https://www.wikidata.org/w/api.php?format=json\=query\=recentchanges\=newer\=title\|ids\|timestamp\=100
  
  It seems that the recent changes as exposed by api.php are populated by job 
queue. Those updates were lost for a moment during the switch. We have lost 
entries in recentchanges during the switch, which means that WDQS has not seen 
those updates either...

TASK DETAIL
  https://phabricator.wikimedia.org/T133046

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Addshore, Aklapper, Smalyshev, Gehel, TerraCodes, Avner, debt, D3r1ck01, 
FloNight, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, 
Mbch331, Jay8g



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T133046: WDQS stopped updating during datacenter switch

2016-04-19 Thread Gehel 
Gehel added a comment.


  Might be related to RCStream breaking during the switch.

TASK DETAIL
  https://phabricator.wikimedia.org/T133046

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Aklapper, Smalyshev, Gehel, TerraCodes, Avner, debt, D3r1ck01, FloNight, 
Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, Mbch331, 
Jay8g



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs