bd808 added a subscriber: EBernhardson.
bd808 added a comment.

In https://phabricator.wikimedia.org/T114443#1697887, @Ottomata wrote:

> @bd808, what's your timeline on this?  Producing directly into Kafka is fine, 
> but we are trying to do two things with this MVP:
>
> - centralize and standardize schemas
> - provide a REST API for producing to Kafka
>
>   We aren't going to block you on your work, but if you could, would you 
> prefer to produce directly to Kafka, or to POST to a REST api?  Meh, probably 
> you don't care. :)


We have all the tools we need to produce directly into Kafka via Monolog 
<https://gerrit.wikimedia.org/r/#/c/229172/> which makes the MW side of this 
actually fairly trivial at this point. The REST API idea is nice but for us it 
would actually be more work since @EBernhardson has already done most of the 
heavy lifting in pursuit of getting rich search data into Hadoop.


TASK DETAIL
  https://phabricator.wikimedia.org/T114443

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: bd808
Cc: EBernhardson, bd808, Joe, dr0ptp4kt, madhuvishy, Nuria, ori, faidon, aaron, 
GWicke, mobrovac, Halfak, Eevans, Ottomata, Matanya, Aklapper, JAllemandou, 
jkroll, Smalyshev, Hardikj, Wikidata-bugs, Jdouglas, RobH, aude, Deskana, 
Manybubbles, mark, JanZerebecki, RobLa-WMF, fgiunchedi, Dzahn, jeremyb, 
chasemp, Krenair



_______________________________________________
Wikidata-bugs mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

Reply via email to