telemetry data retention strategy

2012-08-15 Thread Taras Glek
Hi, According to metrics we have about 1TB of telemetry data in hadoop. This is almost a year worth of telemetry data. Our telemetry ping packets keep growing as we add more probes. As the hadoop database gets bigger, query times get worse, etc. We need to decide on what data we can throw

Re: Proposal to remove the function timer code

2012-09-19 Thread Taras Glek
On 9/19/2012 7:04 AM, Ehsan Akhgari wrote: A while ago (I think more than a couple of years ago now), Vlad implemented FunctionTimer which is a facility to time how much each function exactly takes to run. Then, I went ahead and instrumented a whole bunch of code which was triggered

Re: Proposal: Remove Linux PGO Testing

2012-10-12 Thread Taras Glek
On 10/11/2012 1:34 PM, Mike Hommey wrote: On Thu, Oct 11, 2012 at 02:26:33PM -0400, Rafael Ávila de Espíndola wrote: On 10/11/2012 02:33 AM, Mike Hommey wrote: On Wed, Oct 10, 2012 at 05:57:53PM -0400, Justin Lebar wrote: By turning off Linux PGO testing, you really mean stop making and

Re: Benefits of PGO on Windows

2012-10-17 Thread Taras Glek
On 10/17/2012 6:55 PM, Dave Mandelin wrote: Following the recent discussion about PGO, I really wanted to understand what benefits PGO gives Firefox on Windows, if any--I was skeptical. Rafael (IIRC) posted some Talos numbers, but I didn't know how to interpret them. So I decided to try a few

Re: Proposal: Remove Linux PGO Testing

2012-11-13 Thread Taras Glek
On 11/13/2012 3:53 PM, Alex Keybl wrote: If the Snappy initiative (or any other group of Mozillians) has short-term plans to evangelize the perf wins of PGO to Linux distros, I agree that we should leave PGO builds and testing enabled on Linux and further investigate the mysterious crash in

Re: improving access to telemetry data(Help Wanted)

2013-02-28 Thread Taras Glek
Justin Lebar wrote: It sounds to me like people want both 1) Easier access to aggregated data so they can build their own dashboards roughly comparable in features to the current dashboards. I doubt people actually want to build own dashboards. I suspect this is mainly a need because of

Re: improving access to telemetry data(Help Wanted)

2013-02-28 Thread Taras Glek
Robert Kaiser wrote: Taras Glek schrieb: I doubt people actually want to build own dashboards. I suspect this is mainly a need because of deficiencies in the current dashboard. I disagree. I think people will want to integrate Telemetry data in dashboards that connect data from different

Re: Rethinking the amount of system JS we use in Gecko on B2G

2013-04-22 Thread Taras Glek
Mike Hommey wrote: On Sun, Apr 21, 2013 at 07:51:18PM -0400, Justin Lebar wrote: I think we should consider using much less JS in the parts of Gecko that are used in B2G. I'd like us to consider writing new modules in C++ where possible, and I'd like us to consider rewriting existing modules

Re: Storage in Gecko

2013-04-29 Thread Taras Glek
So there is no general 'good for performance' way of doing IO. However I think most people who need this need to write small bits of data and there is a good way to do that. Gregory Szorc wrote: I'd like to start a discussion about the state of storage in Gecko. Currently when you are

Re: Increasing our Aurora and Nightly user populations?

2013-04-29 Thread Taras Glek
What is the problem with current population size? We are not as small as Android on desktop channels :) Chris Peterson wrote: (Sorry if this is not the right forum for this discussion.) To increase our testing populations, I'd like to suggest that we add a periodic channel upsell message to

review stop-energy (was 24hour review)

2013-07-10 Thread Taras Glek
Hi, Browsers are a competitive field. We need to move faster. Eliminating review lag is an obvious step in the right direction. I believe good code review is essential for shipping a good browser. Conversely, poor code review practices hold us back. I am really frustrated with how many

Re: review stop-energy (was 24hour review)

2013-07-10 Thread Taras Glek
Boris Zbarsky wrote: On 7/9/13 9:59 PM, therealbrendane...@gmail.com wrote: Yes, that's what I meant. How else could one respond within a day? Some of the within a day proposals have suggested that it include weekends, fwiw. Ok. Does this need to go on wiki.m.o or MDN somewhere (not that

Re: review stop-energy (was 24hour review)

2013-07-10 Thread Taras Glek
L. David Baron wrote: [ responding to the two months worth flood of email that just resulted from https://bugzilla.mozilla.org/show_bug.cgi?id=891906 ] On Tuesday 2013-07-09 12:14 -0700, Taras Glek wrote: a) Realize that reviewing code is more valuable than writing code as it results

Re: A/B testing with telemetry

2013-11-25 Thread Taras Glek
Henri Sivonen wrote: Do we have a formalized way to do A/B testing with telemetry? That is, assuming that there is a telemetry probe that measures problem symptoms and a boolean pref for turning on a potential solution, is there a way the declare the pref as something that telemetry queries

Re: Mitigating unified build side effects Was: Thinking about the merge with unified build

2013-12-02 Thread Taras Glek
Mike Hommey wrote: On Sat, Nov 30, 2013 at 12:39:59PM +0900, Mike Hommey wrote: Incidentally, in those two weeks, I did two attempts at building without unified sources, resulting in me filing 4 bugs in different modules for problems caused by 6 different landings[1]. I think it is time to

Re: Mitigating unified build side effects Was: Thinking about the merge with unified build

2013-12-02 Thread Taras Glek
Ehsan Akhgari wrote: On 12/2/2013, 2:26 PM, Taras Glek wrote: Mike Hommey wrote: On Sat, Nov 30, 2013 at 12:39:59PM +0900, Mike Hommey wrote: Incidentally, in those two weeks, I did two attempts at building without unified sources, resulting in me filing 4 bugs in different modules

Please give ask.mozilla.org for a spin

2014-02-03 Thread Taras Glek
Hi, A few people noticed that we do not have a nice, searchable knowledge base for Gecko tech. We have places to ask questions such as various newsgroups, irc and places to document things like the wikis. It is hard to search through all of that, so questions get repeated. Lets give

Re: Please give ask.mozilla.org for a spin

2014-02-04 Thread Taras Glek
Gave some karma out. Thanks Benoit Girard mailto:bgir...@mozilla.com Tuesday, February 4, 2014 14:49 I notice that right now we need 5 karma to up vote so there's a bit of a catch-22 for the up voting to start. I think right now it's up to the admin to get a pool of users to break the

Re: DXR UI refresh is live!

2014-02-07 Thread Taras Glek
that's pretty, but where did the list of classes class members go when viewing files like http://dxr.mozilla.org/mozilla-central/source/modules/libjar/nsZipArchive.cpp - Original Message - From: Erik Rose e...@mozilla.com To: dev-platform@lists.mozilla.org,

Re: DXR UI refresh is live!

2014-02-11 Thread Taras Glek
the bumps! Erik Taras Glek mailto:tg...@mozilla.com Friday, February 7, 2014 14:42 that's pretty, but where did the list of classes class members go when viewing files like http://dxr.mozilla.org/mozilla-central/source/modules/libjar/nsZipArchive.cpp - Original Message

Re: Please take ask.mozilla.org for a spin

2014-03-14 Thread Taras Glek
firebot can do rss feeds, how to update it, etc. Can anyone help get some firebot integration? Taras Gregory Szorc wrote: On 2/4/14, 3:33 PM, Nicholas Nethercote wrote: On Mon, Feb 3, 2014 at 2:32 PM, Taras Glek tg...@mozilla.com wrote: A few people noticed that we do not have a nice

Spring cleaning: Reducing Number Footprint of HG Repos

2014-03-26 Thread Taras Glek
*User Repos* TLDR: I would like to make user repos read-only by April 30th. We should archive them by May 31st. Time spent operating user repositories could be spent reducing our end-to-end continuous integration cycles. These do not seem like mission-critical repos, seems like developers

Re: Spring cleaning: Reducing Number Footprint of HG Repos

2014-03-26 Thread Taras Glek
Gregory Szorc mailto:g...@mozilla.com Wednesday, March 26, 2014 17:40 On 3/26/14, 4:53 PM, Taras Glek wrote: *User Repos* TLDR: I would like to make user repos read-only by April 30th. We should archive them by May 31st. Time spent operating user repositories could be spent reducing our end

Re: Spring cleaning: Reducing Number Footprint of HG Repos

2014-03-27 Thread Taras Glek
Also, if you are using a COW filesystem, initial clones should be nearly free and you'd only pay the extra copy cost for changesets added afterwards. This could help dramatically with mozilla-central clones. Out of curiosity, is there open source software for a shared Git object store? git.

Re: Formalising the current 'mozilla-central essential pushes only' recommendation

2014-04-07 Thread Taras Glek
Ed Morley wrote: (Follow-ups to dev.tree-management please) Hi all :-) The vast majority of mozilla-central landings are now via curated merges from integration/team repositories. This dramatically increases the chance that the tip of mozilla-central is in a known-good state, meaning that:

Re: Removing 'jit-tests' from make check: 15% speedup

2014-04-08 Thread Taras Glek
Thanks Dan. This looks to be contributing roughly half to our 30-45% build speedup on Windows this month. Daniel Minor wrote: Hello, Just a heads up that very soon we'll be removing jit-tests from the make check target[1]. The tests have been split out into a separate test job on TBPL[2]

ask.mozilla.org: now with persona support!

2014-05-05 Thread Taras Glek
Hi, https://ask.mozilla.org/questions/ is now ssl-enabled(old news) and features persona support(as of today). Taras ___ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform

Re: Update on sheriff-assisted checkin-needed bugs

2014-05-27 Thread Taras Glek
Ehsan Akhgari wrote: On 2014-05-21, 5:15 PM, Chris Peterson wrote: On 5/21/14, 1:51 PM, Mike Conley wrote: Or, alternatively, attempt to automate this with Autoland (https://bugzilla.mozilla.org/show_bug.cgi?id=657828). Is anyone actively working on Autoland? Rail had been working on