I’ll let qchris respond in more detail, but I believe(maybe?) there was a request to be able to do some analysis for a site or sites served by misc-web. More immediately, it will be used to generate the ‘5xx’ legacy tsv file. This is one of the outputs still generated by udp2log, and is part of the effort to turn off udp2log.
> On Jan 26, 2015, at 15:56, Faidon Liambotis <[email protected]> wrote: > > On Mon, Jan 26, 2015 at 03:54:42PM -0800, Andrew Otto wrote: >> Today qchris and I deployed some changes[1][2] to bring logs from >> misc_web varnishes into HDFS and Hive via Kafka. This isn’t a huge >> deal, but it does mean that we are now collecting webrequest logs for >> things like phabricator, annual.wikimedia.org >> <http://annual.wikimedia.org/>, graphite, stats.wikimedia.org >> <http://stats.wikimedia.org/>, etc. > > What is this going to be used for? Are we just logging everything from > misc? I personally hate to log things unless we absolutely need to. > > Regards, > Faidon _______________________________________________ Analytics mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/analytics
