Re: Detection of unlabeled UTF-8

2013-08-30 Thread Gervase Markham
On 29/08/13 19:41, Zack Weinberg wrote: All the discussion of fallback character encodings has reminded me of an issue I've been meaning to bring up for some time: As a user of the en-US localization, nowadays the overwhelmingly most common situation where I see mojibake is when a site puts

Should we build a new in-process unwind library?

2013-08-30 Thread Julian Seward
For a while now, Fennec and Linux-desktop nightlies have had the built-in SPS-based time profiling using native stack unwinding. The unwinding is done using our in-tree Breakpad copy, which includes a bunch of speedup patches that are slowly making their way upstream. What we have works, but is

Re: Should we build a new in-process unwind library?

2013-08-30 Thread Robert O'Callahan
On Fri, Aug 30, 2013 at 8:58 PM, Julian Seward jsew...@acm.org wrote: I am not sure how to deal with (4). Really it's completely unrelated to the unwind mechanism -- it has to do with SPS' sampling policy at the level above. There have been some ideas floated around to detect when a thread

Re: Should we build a new in-process unwind library?

2013-08-30 Thread Robert O'Callahan
On Fri, Aug 30, 2013 at 9:41 PM, Julian Seward jsew...@acm.org wrote: That said, AFAICS the core problem is that once a thread blocks and we drop the sampling rate, we have no obvious (direct, notification-based) way to know when it has resumed, and hence are in danger of losing high-frequency

Re: Detection of unlabeled UTF-8

2013-08-30 Thread Henri Sivonen
On Thu, Aug 29, 2013 at 9:41 PM, Zack Weinberg za...@panix.com wrote: All the discussion of fallback character encodings has reminded me of an issue I've been meaning to bring up for some time: As a user of the en-US localization, nowadays the overwhelmingly most common situation where I see

Re: Detection of unlabeled UTF-8

2013-08-30 Thread Nicholas Nethercote
On Fri, Aug 30, 2013 at 8:03 PM, Henri Sivonen hsivo...@hsivonen.fi wrote: I think we should encourage Web authors to use UTF-8 *and* to *declare* it. I'm no expert on this stuff, but Henri's point sure sound sensible to me. Nick ___ dev-platform

Re: Should we build a new in-process unwind library?

2013-08-30 Thread Jeff Muizelaar
On 2013-08-30, at 4:58 AM, Julian Seward wrote: I am very tempted to create a new custom unwind library designed specifically to support SPS. It needs to be fast, lower-footprint, and multithreaded. Unlike Breakpad, it will -- at least initially -- avoid supporting all Tier 1 targets, and

Re: Should we build a new in-process unwind library?

2013-08-30 Thread Nathan Froyd
- Original Message - On 08/30/2013 11:07 AM, Robert O'Callahan wrote: Being able to sample uniformly whether or not the thread is in a syscall is important sometimes, so let's not lose that. I am not proposing to lose that facility. Am only proposing (really, merely parroting

Re: In 2 hours, our virtual doc sprint starts!

2013-08-30 Thread Eric Shepherd
On 2013-08-30 13:07:14 +, Jean-Yves Perrier said: You didn't forget our monthly Virtual Doc Sprint starting in about 2 hours in #devmo! Even if late, join us! https://wiki.mozilla.org/MDN/Doc_sprints/2013August Ping us on #devmo for anything. And if you don't write English, please

Re: Should we build a new in-process unwind library?

2013-08-30 Thread Ehsan Akhgari
On Fri, Aug 30, 2013 at 9:27 AM, Nathan Froyd froy...@mozilla.com wrote: - Original Message - On 08/30/2013 11:07 AM, Robert O'Callahan wrote: Being able to sample uniformly whether or not the thread is in a syscall is important sometimes, so let's not lose that. I am not

Getting the current release version

2013-08-30 Thread Eric Shepherd
This is sort-of-kind-of platform related, but only indirectly, so let me know if there's a better place to ask this question, please. If a web page needs to be able to display the current release version of Gecko, is there a place we can pull that information from, so that the content doesn't

Re: Detection of unlabeled UTF-8

2013-08-30 Thread Henri Sivonen
On Fri, Aug 30, 2013 at 4:31 PM, Aryeh Gregor a...@aryeh.name wrote: In particular, you need to decide on the encoding before you start running any user script, because you don't want document.characterSet etc. to change once it might have already been accessed. For performance reasons, we

Re: Getting the current release version

2013-08-30 Thread Ed Morley
On 30 August 2013 15:09:08, Eric Shepherd wrote: This could even be a place in the source code we could pull up a MXR link and peel out of the code. I just don't know where in the code to get it. For platform: https://hg.mozilla.org/releases/mozilla-release/file/tip/config/milestone.txt For

Re: Getting the current release version

2013-08-30 Thread Johnathan Nightingale
I don't know if it will serve your purposes, but wiki.mo does have: https://wiki.mozilla.org/Template:CURRENT_VERSION and derivatives: https://wiki.mozilla.org/Template:BETA_VERSION https://wiki.mozilla.org/Template:AURORA_VERSION https://wiki.mozilla.org/Template:CENTRAL_VERSION Doesn't do

Re: Should we build a new in-process unwind library?

2013-08-30 Thread Nathan Froyd
- Original Message - Depending on how deep the call stack is and how frequently we push and pop stack frames, being able to not unwind some number of frames can be a significant savings. Isn't this assuming that the stack frames are unique? How would you handle recursion under

Re: Getting the current release version

2013-08-30 Thread Johnathan Nightingale
(I like Ed's answer more, though) On Aug 30, 2013, at 10:17 AM, Johnathan Nightingale wrote: I don't know if it will serve your purposes, but wiki.mo does have: https://wiki.mozilla.org/Template:CURRENT_VERSION and derivatives: https://wiki.mozilla.org/Template:BETA_VERSION

Re: Getting the current release version

2013-08-30 Thread Ed Morley
On 30 August 2013 15:14:54, Ed Morley wrote: For platform: https://hg.mozilla.org/releases/mozilla-release/file/tip/config/milestone.txt For Firefox (and yeah currently the same as platform): https://hg.mozilla.org/releases/mozilla-release/file/tip/browser/config/version.txt (Although you'll

Re: Getting the current release version

2013-08-30 Thread Eric Shepherd
On 2013-08-30 14:14:54 +, Ed Morley said: For platform: https://hg.mozilla.org/releases/mozilla-release/file/tip/config/milestone.txt For Firefox (and yeah currently the same as platform): https://hg.mozilla.org/releases/mozilla-release/file/tip/browser/config/version.txt This is

Re: Should we build a new in-process unwind library?

2013-08-30 Thread Ehsan Akhgari
On 2013-08-30 10:16 AM, Nathan Froyd wrote: - Original Message - Depending on how deep the call stack is and how frequently we push and pop stack frames, being able to not unwind some number of frames can be a significant savings. Isn't this assuming that the stack frames are unique?

Re: Getting the current release version

2013-08-30 Thread Axel Hecht
On 8/30/13 4:14 PM, Ed Morley wrote: On 30 August 2013 15:09:08, Eric Shepherd wrote: This could even be a place in the source code we could pull up a MXR link and peel out of the code. I just don't know where in the code to get it. For platform:

Re: Getting the current release version

2013-08-30 Thread Eric Shepherd
On 2013-08-30 16:01:21 +, Axel Hecht said: This is going to be off by one release for one week out of 6, though. We're doing the beta-release migration at release minus a week and a day, i.e., we're migrating on Sept 9, and release on Sept 17:

Re: Getting the current release version

2013-08-30 Thread Gregory Szorc
On 8/30/13 7:09 AM, Eric Shepherd wrote: This is sort-of-kind-of platform related, but only indirectly, so let me know if there's a better place to ask this question, please. If a web page needs to be able to display the current release version of Gecko, is there a place we can pull that

Re: Should we build a new in-process unwind library?

2013-08-30 Thread Ehsan Akhgari
On 2013-08-30 11:07 AM, Nathan Froyd wrote: - Original Message - Nevermind, I think your solution is talking about function addresses, not stack frames. If you think my solution is talking about function addresses, then I have explained something poorly. Why do you think it is

Re: Getting the current release version

2013-08-30 Thread Reuben Morais
On Aug 30, 2013, at 1:35 PM, Eric Shepherd esheph...@mozilla.com wrote: On 2013-08-30 16:13:50 +, Jesper Kristensen said: I use http://svn.mozilla.org/libs/product-details/json/firefox_versions.json I use that because that was what the download button on www.mozilla.org did. I don't

Re: Detection of unlabeled UTF-8

2013-08-30 Thread Mike Hoye
On 2013-08-30 11:17 AM, Adam Roach wrote: It seems to me that there's an important balance here between (a) letting developers discover their configuration error and (b) allowing users to render misconfigured content without specialized knowledge. For what it's worth Internet Explorer

Re: Detection of unlabeled UTF-8

2013-08-30 Thread Chris Peterson
On 8/30/13 3:03 AM, Henri Sivonen wrote: Telemetry data suggests that these days the more common reason for seeing mojibake is that there is an encoding declaration but it is wrong. My guess is that this arises from Linux distributions silently changing their Apache defaults to send a charset

Re: Detection of unlabeled UTF-8

2013-08-30 Thread Anne van Kesteren
On Fri, Aug 30, 2013 at 6:31 PM, Chris Peterson cpeter...@mozilla.com wrote: Is there a less error-prone default we can recommend to Linux distribution packagers? Maybe we can squelch the problem upstream instead of adding browser hacks. The number of web server and distro packagers we would

Re: Should we build a new in-process unwind library?

2013-08-30 Thread Steve Fink
On 08/30/2013 06:27 AM, Nathan Froyd wrote: - Original Message - On 08/30/2013 11:07 AM, Robert O'Callahan wrote: Being able to sample uniformly whether or not the thread is in a syscall is important sometimes, so let's not lose that. I am not proposing to lose that facility. Am only

Re: Detection of unlabeled UTF-8

2013-08-30 Thread Joshua Cranmer 
On 8/30/2013 4:01 AM, Anne van Kesteren wrote: On Fri, Aug 30, 2013 at 9:40 AM, Gervase Markham g...@mozilla.org wrote: We don't want people to try and move to UTF-8, but move back because they haven't figured out how (or are technically unable) to label it correctly and it comes out all wrong.

Re: Detection of unlabeled UTF-8

2013-08-30 Thread Anne van Kesteren
On Fri, Aug 30, 2013 at 7:33 PM, Joshua Cranmer  pidgeo...@gmail.com wrote: The problem I have with this approach is that it assumes that the page is authored by someone who definitively knows the charset, which is not a scenario which universally holds. Suppose you have a page that serves up

Re: Detection of unlabeled UTF-8

2013-08-30 Thread Adam Roach
On 8/30/13 14:11, Adam Roach wrote: ...helping the user understand why the headline they're trying to read renders as Ð' ÐоÑ?дÑfме пÑEURедложили оÑ,обÑEURаÑ,ÑOE Ð?обелÑ? Ñf Ðz(Ð±Ð°Ð¼Ñ rather than ? ??? ?? ?? ? ?. Well, *there's* a heavy dose

Re: Detection of unlabeled UTF-8

2013-08-30 Thread Adam Roach
On 8/30/13 12:24, Mike Hoye wrote: On 2013-08-30 11:17 AM, Adam Roach wrote: It seems to me that there's an important balance here between (a) letting developers discover their configuration error and (b) allowing users to render misconfigured content without specialized knowledge. For

Re: Detection of unlabeled UTF-8

2013-08-30 Thread Mike Hoye
On 2013-08-30 3:17 PM, Adam Roach wrote: On 8/30/13 14:11, Adam Roach wrote: ...helping the user understand why the headline they're trying to read renders as Ð' ÐоÑ?дÑfме пÑEURедложили оÑ,обÑEURаÑ,ÑOE Ð?обелÑ? Ñf Ðz(Ð±Ð°Ð¼Ñ rather than ? ??? ??

Re: Detection of unlabeled UTF-8

2013-08-30 Thread Adam Roach
On 8/30/13 13:41, Anne van Kesteren wrote: Where did the text file come from? There's a source somewhere... And these days that's hardly how people create content anyway. Maybe not for the content _you_ consume, but the Internet is a bit larger than our ivory tower. Check out, for example:

Refcounting threadsafety assertions are now fatal in opt builds.

2013-08-30 Thread Kyle Huey
The assertions that we have to catch refcounting objects on the wrong thread are now fatal in opt builds. This change is scoped to the nightly channel to avoid performance penalties on builds that are widely used, and will not propagate to aurora. See bug 907914 for more details. The motivation

Proposal: Removing make targets for running tests

2013-08-30 Thread Gregory Szorc
tl;dr the tree currently allows you to run tests via make targets and mach. The mach commands are more intuitive and easier to support going forward, so I'm proposing we remove support for using make targets to run tests. Please take the survey at http://www.surveymonkey.com/s/H5LB2GF to

Re: Proposal: Removing make targets for running tests

2013-08-30 Thread Joshua Cranmer 
On 8/30/2013 3:59 PM, Gregory Szorc wrote: Aside from obvious I don't want to change complaints, are there any objections to this change? Is anyone not able to run the mach testing commands today? Are there features missing from the mach commands? Please file bugs! Mach and comm-central do

Re: Getting the current release version

2013-08-30 Thread Mike Hommey
On Fri, Aug 30, 2013 at 03:16:27PM +0100, Ed Morley wrote: On 30 August 2013 15:14:54, Ed Morley wrote: For platform: https://hg.mozilla.org/releases/mozilla-release/file/tip/config/milestone.txt For Firefox (and yeah currently the same as platform):

Deploying more robust hg-git replication for gecko

2013-08-30 Thread John O'Duinn
(cross-posting to make sure this is not missed; please respond in dev-planning or bug#847727) tl,dr: we're moving replication of gecko+gaia repos to more robust systems. This email gives quick status, and summary of rollout plan. In the rush to B2G 1.0 release, we had to quickly stand up