[Wikidata-bugs] [Maniphest] [Commented On] T84923: Reliable publish / subscribe event bus

2015-08-31 Thread GWicke
GWicke added a comment. Etherpad notes: https://etherpad.wikimedia.org/p/scalable_events_system TASK DETAIL https://phabricator.wikimedia.org/T84923 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GWicke Cc: Aklapper, Matanya, Mattflaschen,

[Wikidata-bugs] [Maniphest] [Commented On] T84923: Reliable publish / subscribe event bus

2015-01-26 Thread JanZerebecki
JanZerebecki added a comment. In https://phabricator.wikimedia.org/T84923#993443, @GWicke wrote: Since 0mq is not actually durable or replicated this does not cover the 'reliable' bit. That is done on top of 0mq. Every message is stored and numbered, no number is ever skipped. Thus if you

[Wikidata-bugs] [Maniphest] [Commented On] T84923: Reliable publish / subscribe event bus

2015-01-26 Thread mobrovac
mobrovac added a comment. Re: reliability, RELP http://www.rsyslog.com/doc/relp.html might be of help on the application level. TASK DETAIL https://phabricator.wikimedia.org/T84923 REPLY HANDLER ACTIONS Reply to comment or attach files, or !close, !claim, !unsubscribe or !assign

[Wikidata-bugs] [Maniphest] [Commented On] T84923: Reliable publish / subscribe event bus

2015-01-24 Thread GWicke
GWicke added a comment. In https://phabricator.wikimedia.org/T84923#968636, @JanZerebecki wrote: http://www.fedmsg.com might fit this need. It is used/developed by Fedora and Debian people and is a federated, reliable message bus with history of cryptographically authenticated json messages

[Wikidata-bugs] [Maniphest] [Commented On] T84923: Reliable publish / subscribe event bus

2015-01-07 Thread GWicke
GWicke added a comment. @halfak has written up very similar ideas at https://meta.wikimedia.org/wiki/Research:MediaWiki_events:_a_generalized_public_event_datasource TASK DETAIL https://phabricator.wikimedia.org/T84923 REPLY HANDLER ACTIONS Reply to comment or attach files, or !close,

[Wikidata-bugs] [Maniphest] [Commented On] T84923: Reliable publish / subscribe event bus

2015-01-06 Thread JanZerebecki
JanZerebecki added a comment. As in a diff? Not that I am aware of. The granularity of actual changes in the DB is one entitiy, smaller granularity might only be present before the change is done then a full new revision of the entity is written. Anything smaller would have to be computed from

[Wikidata-bugs] [Maniphest] [Commented On] T84923: Reliable publish / subscribe event bus

2015-01-05 Thread GWicke
GWicke added a comment. In https://phabricator.wikimedia.org/T84923#943464, @JanZerebecki wrote: https://www.wikidata.org/w/api.php?action=helpmodules=wbgetentities and recent changes, see also https://phabricator.wikimedia.org/T85103 and https://phabricator.wikimedia.org/T85100.

[Wikidata-bugs] [Maniphest] [Commented On] T84923: Reliable publish / subscribe event bus

2014-12-23 Thread GWicke
GWicke added a comment. In https://phabricator.wikimedia.org/T84923#940155, @JanZerebecki wrote: The nature of these event type candidates is such that they are changes with a log existing at the provider. Wikidata might be the exeception here. Most other events are not available at the