Re: [Python-Dev] Can I make marshal.dumps() slower but stabler?

2018-07-13 Thread INADA Naoki
On Fri, Jul 13, 2018 at 11:46 PM Ivan Pozdeev via Python-Dev wrote: > > If the use case for stability is only .pyc compilation, I doubt it's even > relevant 'cuz .pyc's are supposed to be compiled in isolation from other > current objects (otherwise, they wouldn't be reusable or would be invalid

Re: [Python-Dev] Can I make marshal.dumps() slower but stabler?

2018-07-13 Thread Ivan Pozdeev via Python-Dev
t;mailto:sdamon@python.org>> On Behalf Of Victor Stinner > Sent: Thursday, July 12, 2018 4:01 AM > To: Serhiy Storchaka mailto:storch...@gmail.com>> > Cc: python-dev mailto:python-dev@python.org>> > Subject: Re: [Python-Dev] Can I make marshal

Re: [Python-Dev] Can I make marshal.dumps() slower but stabler?

2018-07-13 Thread Christian Tismer
Stinner > > Sent: Thursday, July 12, 2018 4:01 AM > > To: Serhiy Storchaka mailto:storch...@gmail.com>> > > Cc: python-dev mailto:python-dev@python.org>> > > Subject: Re: [Python-Dev] Can I make marshal.dumps() slower but stabler? > > >

Re: [Python-Dev] Can I make marshal.dumps() slower but stabler?

2018-07-13 Thread André Malo
On Donnerstag, 12. Juli 2018 22:09:41 CEST Antoine Pitrou wrote: > On Thu, 12 Jul 2018 22:03:30 +0200 > > André Malo wrote: > > * INADA Naoki wrote: > > > Is there any real application which marshal.dumps() performance is > > > critical? > > > > I'm using it for spooling big chunks of data on di

Re: [Python-Dev] Can I make marshal.dumps() slower but stabler?

2018-07-12 Thread INADA Naoki
On Fri, Jul 13, 2018 at 5:03 AM André Malo wrote: > > * INADA Naoki wrote: > > > Is there any real application which marshal.dumps() performance is > > critical? > > I'm using it for spooling big chunks of data on disk, exactly for the reason > that it's faster than pickle. > > Cheers, Does your

Re: [Python-Dev] Can I make marshal.dumps() slower but stabler?

2018-07-12 Thread Antoine Pitrou
On Thu, 12 Jul 2018 22:03:30 +0200 André Malo wrote: > * INADA Naoki wrote: > > > Is there any real application which marshal.dumps() performance is > > critical? > > I'm using it for spooling big chunks of data on disk, exactly for the reason > that it's faster than pickle. Which kind of da

Re: [Python-Dev] Can I make marshal.dumps() slower but stabler?

2018-07-12 Thread André Malo
* INADA Naoki wrote: > Is there any real application which marshal.dumps() performance is > critical? I'm using it for spooling big chunks of data on disk, exactly for the reason that it's faster than pickle. Cheers, -- "Das Verhalten von Gates hatte mir bewiesen, dass ich auf ihn und seine be

Re: [Python-Dev] Can I make marshal.dumps() slower but stabler?

2018-07-12 Thread Antoine Pitrou
On Thu, 12 Jul 2018 09:21:55 +0300 Serhiy Storchaka wrote: > > > Is there any real application which marshal.dumps() performance is > > critical? > EVE Online is a well known example. > > What if write a script which loads .pyc files and stabilize them? This > could solve the problem for app

Re: [Python-Dev] Can I make marshal.dumps() slower but stabler?

2018-07-12 Thread Steve Holden
To: Serhiy Storchaka > > Cc: python-dev > > Subject: Re: [Python-Dev] Can I make marshal.dumps() slower but stabler? > > > > 2018-07-12 8:21 GMT+02:00 Serhiy Storchaka : > > >> Is there any real application which marshal.dumps() performance is > > >&

Re: [Python-Dev] Can I make marshal.dumps() slower but stabler?

2018-07-12 Thread Alex Walters
> -Original Message- > From: Python-Dev list=sdamon@python.org> On Behalf Of Victor Stinner > Sent: Thursday, July 12, 2018 4:01 AM > To: Serhiy Storchaka > Cc: python-dev > Subject: Re: [Python-Dev] Can I make marshal.dumps() slower but stabler? > >

Re: [Python-Dev] Can I make marshal.dumps() slower but stabler?

2018-07-12 Thread INADA Naoki
On Thu, Jul 12, 2018 at 3:22 PM Serhiy Storchaka wrote: > > 12.07.18 08:43, INADA Naoki пише: > > I'm working on making pyc stable, via stablizing marshal.dumps() > > https://bugs.python.org/issue34093 > > This is not enough for making pyc stable. The order in frozesets still > is arbitrary. But

Re: [Python-Dev] Can I make marshal.dumps() slower but stabler?

2018-07-12 Thread Victor Stinner
2018-07-12 8:21 GMT+02:00 Serhiy Storchaka : >> Is there any real application which marshal.dumps() performance is >> critical? > > EVE Online is a well known example. EVE Online has been created in 2003. I guess that it still uses Python 2.7. I'm not sure that a video game would pick marshal in

Re: [Python-Dev] Can I make marshal.dumps() slower but stabler?

2018-07-11 Thread Serhiy Storchaka
12.07.18 08:43, INADA Naoki пише: I'm working on making pyc stable, via stablizing marshal.dumps() https://bugs.python.org/issue34093 This is not enough for making pyc stable. The order in frozesets still is arbitrary. Sadly, it makes marshal.dumps() 40% slower. Luckily, this overhead is sm

[Python-Dev] Can I make marshal.dumps() slower but stabler?

2018-07-11 Thread INADA Naoki
I'm working on making pyc stable, via stablizing marshal.dumps() https://bugs.python.org/issue34093 Sadly, it makes marshal.dumps() 40% slower. Luckily, this overhead is small (only 4%) for dumps(compile(source)) case. So my question is: May I remove unstable but faster code? Or should I make t