Re: [Python-Dev] Help requested with Python 2.7 performance regression

After much testing I found what is causing the regression in 16.04 and later. There are several distinct causes which are attributed to the choices made in debian/rules and the changes in GCC. Cause #1: the decision to compile `Modules/_math.c` with `-fPIC` *and* link it statically into the pytho

Re: [Python-Dev] Help requested with Python 2.7 performance regression

ev-bounces+peter.xihong.wang=intel@python.org] On Behalf Of Louis Bouchard Sent: Friday, March 03, 2017 7:27 AM To: Victor Stinner Cc: Barry Warsaw ; Nick Coghlan ; Python-Dev Subject: Re: [Python-Dev] Help requested with Python 2.7 performance regression Hello, Le 03/03/2017 à 15:37, Louis Boucha

Re: [Python-Dev] Help requested with Python 2.7 performance regression

Hello, Le 03/03/2017 à 15:37, Louis Bouchard a écrit : > Hello, > > Le 03/03/2017 à 15:31, Victor Stinner a écrit : >>> Out of curiosity, I ran the set of benchmarks in two LXC containers running >>> centos7 (2.7.5 + gcc 4.8.5) and Fedora 25 (2.7.13 + gcc 6.3.x). The >>> benchmarks >>> do run fa

Re: [Python-Dev] Help requested with Python 2.7 performance regression

Hello, Le 03/03/2017 à 15:31, Victor Stinner a écrit : >> Out of curiosity, I ran the set of benchmarks in two LXC containers running >> centos7 (2.7.5 + gcc 4.8.5) and Fedora 25 (2.7.13 + gcc 6.3.x). The >> benchmarks >> do run faster in 18 benchmarks, slower on 12 and insignificant for the rest

Re: [Python-Dev] Help requested with Python 2.7 performance regression

> Out of curiosity, I ran the set of benchmarks in two LXC containers running > centos7 (2.7.5 + gcc 4.8.5) and Fedora 25 (2.7.13 + gcc 6.3.x). The benchmarks > do run faster in 18 benchmarks, slower on 12 and insignificant for the rest > (~33 > from memory). "faster" or "slower" is relative: I w

Re: [Python-Dev] Help requested with Python 2.7 performance regression

Hello, Le 03/03/2017 à 08:27, Nick Coghlan a écrit : > On 2 March 2017 at 07:00, Victor Stinner > wrote: > > Hi, > > Your document doesn't explain how you configured the host to run > benchmarks. Maybe you didn't tune Linux or anything else? Be caref

Re: [Python-Dev] Help requested with Python 2.7 performance regression

From: "Victor Stinner" To: "Charalampos Stratakis" Cc: "Nick Coghlan" , "Barry Warsaw" , "Python-Dev" Sent: Friday, March 3, 2017 12:53:00 PM Subject: Re: [Python-Dev] Help requested with Python 2.7 performance regression 2017-03-03 12:18 GM

Re: [Python-Dev] Help requested with Python 2.7 performance regression

2017-03-03 12:18 GMT+01:00 Charalampos Stratakis : > PGO is not enabled in RHEL and Fedora. > > I did some initial testing for Fedora, however it increased the compilation > time of the RPM by approximately two hours, so for the time being I left it > out. Two hours in a *single* build server is

Re: [Python-Dev] Help requested with Python 2.7 performance regression

- Original Message - From: "Victor Stinner" To: "Nick Coghlan" Cc: "Barry Warsaw" , "Python-Dev" Sent: Friday, March 3, 2017 11:21:49 AM Subject: Re: [Python-Dev] Help requested with Python 2.7 performance regression 2017-03-03 8:27 GMT+01:00 Nick C

Re: [Python-Dev] Help requested with Python 2.7 performance regression

2017-03-03 8:27 GMT+01:00 Nick Coghlan : > Victor, do you know if you or anyone else has compared the RHEL/CentOS 7.x > binaries (Python 2.7.5 + patches, built with GCC 4.8.x) with the Fedora 25 > binaries (Python 2.7.13 + patches, built with GCC 6.3.x)? I didn't and I'm not aware of anyone who di

Re: [Python-Dev] Help requested with Python 2.7 performance regression

Hello, Le 03/03/2017 à 08:27, Nick Coghlan a écrit : > On 2 March 2017 at 07:00, Victor Stinner > wrote: > > Hi, > > Your document doesn't explain how you configured the host to run > benchmarks. Maybe you didn't tune Linux or anything else? Be caref

Re: [Python-Dev] Help requested with Python 2.7 performance regression

On 2 March 2017 at 07:00, Victor Stinner wrote: > Hi, > > Your document doesn't explain how you configured the host to run > benchmarks. Maybe you didn't tune Linux or anything else? Be careful > with modern hardware which can make funny (or not) surprises. Victor, do you know if you or anyone

Re: [Python-Dev] Help requested with Python 2.7 performance regression

We updated profile-opt to use the testsuite subset based on what distros had already been using for their training runs. As for the comment about the test suite not being good for training Mostly a myth. The test suite exercises the ceval loop well as well as things like re and json sufficientl

Re: [Python-Dev] Help requested with Python 2.7 performance regression

On Thu, Mar 2, 2017 at 4:07 AM, Antoine Pitrou wrote: > On Wed, 1 Mar 2017 19:58:14 +0100 > Matthias Klose wrote: >> On 01.03.2017 18:51, Antoine Pitrou wrote: >> > As for the high level: what if the training set used for PGO in Xenial >> > has become skewed or inadequate? >> >> running the tests

Re: [Python-Dev] Help requested with Python 2.7 performance regression

Hello, Le 01/03/2017 à 20:40, Antoine Pitrou a écrit : > On Wed, 1 Mar 2017 20:24:03 +0100 > Louis Bouchard wrote: >> >> Indeed, this is something that is in the history of the LP bug so here is the >> URL where those comparison can be found : >> >> https://docs.google.com/spreadsheets/d/1MyNBPVZ

Re: [Python-Dev] Help requested with Python 2.7 performance regression

Hi, Your document doesn't explain how you configured the host to run benchmarks. Maybe you didn't tune Linux or anything else? Be careful with modern hardware which can make funny (or not) surprises. See my recent talk at FOSDEM (last month): "How to run a stable benchmark" https://fosdem.org/201

Re: [Python-Dev] Help requested with Python 2.7 performance regression

On Wed, 1 Mar 2017 20:24:03 +0100 Louis Bouchard wrote: > > Indeed, this is something that is in the history of the LP bug so here is the > URL where those comparison can be found : > > https://docs.google.com/spreadsheets/d/1MyNBPVZlBeic1OLqVKe_bcPk2deO_pQs9trIfOFefM0/edit#gid=2034603487 Some

Re: [Python-Dev] Help requested with Python 2.7 performance regression

Hello, Le 01/03/2017 à 18:51, Antoine Pitrou a écrit : > On Wed, 1 Mar 2017 12:28:24 -0500 > Barry Warsaw wrote: >> >> Louis (Cc'd here) has done a ton of work to measure and analyze the problem, >> but we've more or less hit a roadblock, so we're taking the issue public to >> see if anybody on t

Re: [Python-Dev] Help requested with Python 2.7 performance regression

On Wed, 1 Mar 2017 19:58:14 +0100 Matthias Klose wrote: > On 01.03.2017 18:51, Antoine Pitrou wrote: > > As for the high level: what if the training set used for PGO in Xenial > > has become skewed or inadequate? > > running the testsuite I did some tests a year or two ago, and running the who

Re: [Python-Dev] Help requested with Python 2.7 performance regression

On 01.03.2017 18:51, Antoine Pitrou wrote: > As for the high level: what if the training set used for PGO in Xenial > has become skewed or inadequate? running the testsuite ___ Python-Dev mailing list Python-Dev@python.org https://mail.python.org/mailma

Re: [Python-Dev] Help requested with Python 2.7 performance regression

On Wed, 1 Mar 2017 12:28:24 -0500 Barry Warsaw wrote: > > Louis (Cc'd here) has done a ton of work to measure and analyze the problem, > but we've more or less hit a roadblock, so we're taking the issue public to > see if anybody on this mailing list has further ideas. A detailed analysis is > a

[Python-Dev] Help requested with Python 2.7 performance regression

Hello all, Over in Ubuntu, we've gotten reports about some performance regressions in Python 2.7 when moving from Trusty (14.04 LTS) to Xenial (16.04 LTS). Trusty's version is based on 2.7.6 while Xenial's version is based on 2.7.12 with bits of .13 cherry picked. We've not been able to identify