Re: [pypy-dev] cpyext: Detecting pypy and other issues

2011-05-14 Thread Armin Rigo
Hi Roger, Ah, sorry. I think I got mistaken in my previous mail. The point is that you are debugging *only* a C extension, and not interested in debugging any of the rest of PyPy. Then all we said about GCs makes no sense: the PyObject* within PyPy are not handled by PyPy's GC. They are

Re: [pypy-dev] Trouble building pypy

2011-05-14 Thread Armin Rigo
Hi Jay, On Sat, May 14, 2011 at 10:20 PM, Jay Parlar par...@gmail.com wrote: I've been trying on-and-off to build PyPy for a few days now, and keep running into various issues. I was hoping someone on the list could give me some pointers as to what I'm doing wrong. As usual it looks like some

Re: [pypy-dev] [freebsd] pypy-1.5.0 fails to compile sandbox

2011-05-28 Thread Armin Rigo
Re-hi, On Sat, May 28, 2011 at 9:19 AM, Armin Rigo ar...@tunes.org wrote: Sorry for the delay.  We don't usually test much on FreeBSD, but I've found the source of the bug: it's not adding the -L/usr/local option in the final Makefile.  Should be fixed by revision e69c2c3e4988. Bah, I wrote

Re: [pypy-dev] JIT for scripts

2011-06-01 Thread Armin Rigo
Hi Alex, On Wed, Jun 1, 2011 at 2:14 PM, Alex Şuhan alex.su...@gmail.com wrote: PyPy works great for our PHP JIT interpreter Great to hear :-) Other than the obvious duct taping, are there any caveats to this solution? Not that I can think of. It sounds like a good solution, or let's say a

Re: [pypy-dev] setpgrp and getpgrp platform:errors

2011-06-08 Thread Armin Rigo
Hi Da_Blitz, On Mon, Jun 6, 2011 at 3:32 PM, Da_Blitz p...@pocketnix.org wrote: according to the man page on linux (debian) there are 2 calling conventions, the System V and the BSD the os.setpgrp and os.getpgrp do not appear to take arguments Yes, it's done for the BSD. According to my

[pypy-dev] Win32: track_and_esp.s

2011-06-12 Thread Armin Rigo
Hi Amaury, Sorry, track_and_esp.s is most probably broken on Windows due to 017e187b2716. This revision contains, among several things, a small simplification of the code because it was (probably) not possible any more to see and esp, xxx from gcc. So, of course, we need to partially and

Re: [pypy-dev] [Pyro] Anyone with Pypy experience?

2011-06-14 Thread Armin Rigo
Hi, On Mon, Jun 13, 2011 at 12:23 PM, Amaury Forgeot d'Arc amaur...@gmail.com wrote: Please file a ticket on https://bugs.pypy.org It looks that a CPython test is not precise enough... Fixed by benjamin (and reviewed by me). Armin ___ pypy-dev

Re: [pypy-dev] Win32: track_and_esp.s

2011-06-15 Thread Armin Rigo
Hi, On Sun, Jun 12, 2011 at 12:50 PM, Armin Rigo ar...@tunes.org wrote: more to see and esp, xxx from gcc.  So, of course, we need to partially and carefully revert this simplification... Done, I think. Please tell me if the Windows build still cannot use asmgcc. A bientôt, Armin

Re: [pypy-dev] Ootypes

2011-06-15 Thread Armin Rigo
Hi Gregn, On Wed, Jun 15, 2011 at 2:29 PM, emailgr...@googlemail.com wrote: Pretty please, can ootypes get some love in the upcoming sprint? It depends on who is there. If you are there and willing to work on it, then sure, we are willing to help you :-) A bientôt, Armin.

Re: [pypy-dev] Floating point computation

2011-07-01 Thread Armin Rigo
Hi, On Fri, Jul 1, 2011 at 2:57 PM, Maciej Fijalkowski fij...@gmail.com wrote: But it won't become an assembler instruction in the JIT, it'll still be a call. Indeed. But fixing this is not too hard. Grep for math_sqrt and MATH_SQRT in pypy/jit/*/*.py for an example of how we turn

Re: [pypy-dev] PyPy is much slower than CPython example / question

2011-07-08 Thread Armin Rigo
Hi Alex, Before attacking the problem with the JIT, we should understand better why PyPy is 4-8 times slower than CPython. Normally you'd expect the factor to be at most 2. I suppose the answer is that our itertools.repeat() is bad for some reason. A bientôt, Armin.

Re: [pypy-dev] Object identity and dict strategies

2011-07-08 Thread Armin Rigo
Hi William, On Fri, Jul 8, 2011 at 10:31 AM, William ML Leslie william.leslie@gmail.com wrote: On another note: what Alex talks about as being two different cases are just one with the small int optimisation - all references can be compared by value in the C backend with small ints

Re: [pypy-dev] Object identity and dict strategies

2011-07-08 Thread Armin Rigo
Hi all, On Fri, Jul 8, 2011 at 12:04 PM, Cesare Di Mauro cesare.di.ma...@gmail.com wrote: So, there must be care about using is. It's safe for some trivial objects (None, False, True, Ellipsis) and, I think, with user-defined classes' instances, but not for everything. The problem is more

Re: [pypy-dev] Floating point computation

2011-07-08 Thread Armin Rigo
Hi, On Thu, Jul 7, 2011 at 10:59 AM, Maciej Fijalkowski fij...@gmail.com wrote: The Translation and JIT backend for PyPy may be able to allow Python programmers to use SIMD instructions directly from Python. We kind of want to do that automatically for numpy operations. Can all basic SIMD

Re: [pypy-dev] Object identity and dict strategies

2011-07-09 Thread Armin Rigo
Hi, On Sat, Jul 9, 2011 at 5:20 AM, William ML Leslie william.leslie@gmail.com wrote: My point about small integers (...) I think that your point about small integers is broken (even assuming that smallints are enabled by default, which is not the case). It means that we'd get an id()

Re: [pypy-dev] Object identity and dict strategies

2011-07-10 Thread Armin Rigo
Hi Bengt, On Sun, Jul 10, 2011 at 3:48 PM, Bengt Richter b...@oz.net wrote:   id([1]) == id([2]) True As pointed out by Carl Friedrich, the real definition of id is: * if x and y are two variables, then x is y = id(x) == id(y). That's why in any Python implementation, x=[1]; y=[2]; id(x)

Re: [pypy-dev] Compiling RPython with ctypes

2011-07-12 Thread Armin Rigo
Hi Andrew, On Tue, Jul 12, 2011 at 6:34 PM, Amaury Forgeot d'Arc amaur...@gmail.com wrote: Hello I am running into some snags developing an executable in pypy with translate.py and wondering what the best method for me to do this with my code would be. In addition to the previous answer,

Re: [pypy-dev] Benchmarks

2011-07-12 Thread Armin Rigo
Hi, On Tue, Jul 12, 2011 at 1:20 AM, Maciej Fijalkowski fij...@gmail.com wrote: http://speed.pypy.org/timeline/?exe=1base=noneben=spitfireenv=tannitrevs=50 This was introduced by the changes we did to the GC to better support resizing big lists: 1bb155fd266f and 324a8265e420. I will look. A

Re: [pypy-dev] Benchmarks

2011-07-12 Thread Armin Rigo
Hi Alex, On Tue, Jul 12, 2011 at 8:36 PM, Alex Gaynor alex.gay...@gmail.com wrote: I just investigated the spitfire regression, it appears to have been caused by 27df060341f0 (merg non-null-app-dict branch) That's not the conclusion I arrived at. The speed.pypy.org website says that revision

Re: [pypy-dev] Benchmarks

2011-07-15 Thread Armin Rigo
Hi, On Fri, Jul 15, 2011 at 10:45 AM, Antonio Cuni anto.c...@gmail.com wrote: I think that armin investigated this, and the outcome was that it's because of the changes we did in the GC during the sprint. Armin, do you confirm? Do we have a solution? I confirm, and still have no solution. I

[pypy-dev] win64

2011-07-18 Thread Armin Rigo
Hi Christian, A quick poll about the 'win64 test' branch. Is it going fine? If ll2ctypes is continuing to give you troubles, I'd suggest to move on; keep in mind that ll2ctypes is only used for testing. I would recommend that your priority should be to pass the tests in pypy/rpython/test/ and

Re: [pypy-dev] Benchmarks

2011-07-18 Thread Armin Rigo
Hi Anto, On Mon, Jul 18, 2011 at 12:28 PM, Antonio Cuni anto.c...@gmail.com wrote: What can we conclude? That compiling the loops is uneffective and we only care about compiling single functions? :-( Or, conversely, that compiling single functions is ineffective and we only care about

Re: [pypy-dev] Benchmarks

2011-07-18 Thread Armin Rigo
Hi Anto, On Mon, Jul 18, 2011 at 2:34 PM, Antonio Cuni anto.c...@gmail.com wrote: Also, we have a speedup of ~2-2.5x which is more or less what you would expect by just removing the interpretation overhead. It probably indicates that we have lrge room for improvements, but I suppose that

Re: [pypy-dev] pypy array module memory leak?

2011-07-22 Thread Armin Rigo
Hi Berend, On Fri, Jul 22, 2011 at 12:42 PM, Berend De Schouwer berend.deschou...@ucs-software.co.za wrote: The following program has constant (+- 10 MB) memory usage in CPython, but it quickly leaks massive amounts of memory in pypy. In theory it's not a leak, because the memory is eventually

Re: [pypy-dev] binascii.crc32() OverflowError?

2011-07-23 Thread Armin Rigo
Hi, On Sat, Jul 23, 2011 at 7:18 AM, Roger Flores aide...@yahoo.com wrote: value = binascii.crc32(new_value, value) 0x value = binascii.crc32(new_value, value) 0x Thanks for the report. This code doesn't run on top of CPython 2.5, too, but works indeed on top of CPython 2.7.

Re: [pypy-dev] Benchmarks

2011-07-23 Thread Armin Rigo
Hi Maciek, On Mon, Jul 18, 2011 at 9:27 PM, Maciej Fijalkowski fij...@gmail.com wrote: What's although worth considering is how to get stuff optimized even if we don't have loops (but I guess carl has already started) I'm unsure what you mean here. The function_threshold stuff you did is

Re: [pypy-dev] [pypy-commit] pypy default: signal.signal() crashes with ValueError when called from a

2011-07-25 Thread Armin Rigo
Hi Anto, On Sun, Jul 24, 2011 at 7:06 PM, Antonio Cuni anto.c...@gmail.com wrote: Note that pyrepl exists as an independent repo and that the one in PyPy is supposed to be a copy of it (similar to what we do in py.test): https://bitbucket.org/pypy/pyrepl Thanks for the reminder! I copied the

Re: [pypy-dev] [pypy-commit] pypy default: don't raise a warning if the restype is not set, and add a test to check that we hit the fastpath even in that case

2011-07-28 Thread Armin Rigo
Hi Maciej, On Thu, Jul 28, 2011 at 6:27 PM, Maciej Fijalkowski fij...@gmail.com wrote: Uh, can we revert this? I think a runtime warning when restype is not set is an excellent idea from the correctness perspective. I'm not sure I agree with this argument. The point I made on irc was that for

Re: [pypy-dev] pypy array module memory leak?

2011-07-30 Thread Armin Rigo
Hi Berend, I think I fixed the original problem too. See the longish checkin message of e7121092d73f. A bientôt, Armin. ___ pypy-dev mailing list pypy-dev@python.org http://mail.python.org/mailman/listinfo/pypy-dev

Re: [pypy-dev] Porting PyPy to OpenBSD/amd64

2011-08-02 Thread Armin Rigo
Hi Laurie, On Tue, Aug 2, 2011 at 8:14 PM, Laurence Tratt lau...@tratt.net wrote: I'm looking to port PyPy to OpenBSD (specifically amd64/x86_64, as I no longer have any i386 machines; that might be the cause of some of my woes). I have fixed the problems you reported (see 109f80dac1c1). I

Re: [pypy-dev] Python vs pypy: interesting performance difference [dict.setdefault]

2011-08-15 Thread Armin Rigo
Hi David, On Sat, Aug 13, 2011 at 8:14 PM, David Naylor naylor.b.da...@gmail.com wrote: So, it appears pypy is failing to speed up this contrived example... I think that it is expected, because the hash is computed entirely as pure Python code in the case of PyPy (doing integer arithmetic with

Re: [pypy-dev] Efficiently piecing together callables with hooks?

2011-08-15 Thread Armin Rigo
Hi Timo, On Sun, Aug 14, 2011 at 6:48 PM, Timo Paulssen timona...@perpetuum-immobile.de wrote: So what would you suggest for making this much faster? I read on the IRC, that in pypy itself, string concatenation is actually used to create python functions, so maybe that would be way to go in

Re: [pypy-dev] Python vs pypy: interesting performance difference [dict.setdefault]

2011-08-15 Thread Armin Rigo
Hi Alex, On Mon, Aug 15, 2011 at 3:36 PM, Alex Gaynor alex.gay...@gmail.com wrote: I'd like to express that, unless we have a very compelling reason, we should try to keep more stuff in pure python, as opposed to RPython.  Mostly because it speeds up translation ;) (also easier to test, easier

Re: [pypy-dev] python 3

2011-08-17 Thread Armin Rigo
Hi Yury, On Wed, Aug 17, 2011 at 5:01 AM, Yury Selivanov yselivanov...@gmail.com wrote: Well, if everybody agrees on the 3rd option, then can we have at least the process of porting outlined and reviewed by core devs?  No need for a super-detailed PEP, though.  A simple guideline would help

Re: [pypy-dev] PPC JIT test_load_and_store()

2011-08-18 Thread Armin Rigo
Hi David, On Thu, Aug 18, 2011 at 4:50 PM, David Edelsohn dje@gmail.com wrote: r8 and r9 are not initialized and point to whatever locations those registers happen to hold. I think that the test is just wrong... You need to load explicitly the address of some CArray in r8 and r9, for

Re: [pypy-dev] pypy1.6 slow on string-heavy ops

2011-08-19 Thread Armin Rigo
Hi Jacob, On Fri, Aug 19, 2011 at 2:10 AM, Jacob Biesinger jake.biesin...@gmail.com wrote: A bit OT:  The recent release of ipython added some powerful multiprocessing features using ZeroMQ.  I've only glanced at pypy's extensive threading optimizations (e.g., greenlets).  Does pypy jit across

Re: [pypy-dev] Saving and reloading JIT optimizations

2011-08-19 Thread Armin Rigo
Hi David, On Fri, Aug 19, 2011 at 1:56 PM, David Fraser dav...@sjsoft.com wrote: The pypy JIT takes a while to work out which parts of python code need optimization etc, and only after that phase do the speedups become relevant. Have there been any efforts (indeed, is it a feasible idea at

Re: [pypy-dev] Saving and reloading JIT optimizations

2011-08-20 Thread Armin Rigo
Hi Zooko, On Fri, Aug 19, 2011 at 5:38 PM, Zooko O'Whielacronx zo...@zooko.com wrote: conservative method of determining if two classes are the same. For example: if they have identical Python source code and their superclasses are the same (in this sense). This cannot be something you can

Re: [pypy-dev] pypy1.6 slow on string-heavy ops

2011-08-20 Thread Armin Rigo
Hi Andy, On Fri, Aug 19, 2011 at 5:48 PM, Andy angelf...@yahoo.com wrote: I remember reading in this list that PyPy-JIT would not work with greenlet because of how greentlet manipulated the C stack and there wasn't any easy solution. No, I think you are confusing two topics. The existing

Re: [pypy-dev] PyGame for translatorshell on Lion

2011-08-20 Thread Armin Rigo
Hi Mitchell, On Sat, Aug 20, 2011 at 8:57 AM, Mitchell Hashimoto mitchell.hashim...@gmail.com wrote: One of the things I wanted to look at was the graph files generated by the shell. I installed PyGame and GraphViz and when I run a t.view on a Translation object, I get the following crazy

Re: [pypy-dev] How to test code in pypy.rpython?

2011-08-22 Thread Armin Rigo
Hi Mitchell, On Mon, Aug 22, 2011 at 8:13 AM, Amaury Forgeot d'Arc amaur...@gmail.com wrote: But it would still be great to see the whole thing work without having to translate all of PyPy. Is this possible? Sure, you must write unit tests anyway. To complete this answer, what you should

Re: [pypy-dev] 1.6 status report

2011-08-23 Thread Armin Rigo
Hi David, On Sun, Aug 21, 2011 at 3:57 PM, David Naylor naylor.b.da...@gmail.com wrote: PYPY_GC_MAX_DELTA=200MB pypy --jit loop_longevity=300 ./translate.py -Ojit FYI, the above options increases the build time by ~30% (on my system at- least). Thank you. That's what I feared. We need to

Re: [pypy-dev] pypy1.6 slow on string-heavy ops

2011-08-24 Thread Armin Rigo
Hi, On Tue, Aug 23, 2011 at 7:28 PM, Yury Selivanov yselivanov...@gmail.com wrote: If you read that Armin's email carefully, you notice that he talks about a low-level primitive called stacklets, which have some limitations, but are not intended for a regular use.  Greenlets will be

Re: [pypy-dev] Anyone interested in a MIPS port...

2011-08-24 Thread Armin Rigo
Hi Vishal, On Sat, Aug 20, 2011 at 3:53 PM, Vishal vsapr...@gmail.com wrote: a) Does it make sense to have a MIPS port of the PyPy JIT. Yes, it definitely makes sense. I assume that the MIPS machines you consider as final targets have *some* amount of RAM, like, say, minimum 32MB or 64MB.

Re: [pypy-dev] Is PyPy appropriate for Django?

2011-08-25 Thread Armin Rigo
Hi Andy, On Wed, Aug 24, 2011 at 11:26 PM, Andy angelf...@yahoo.com wrote: 1) For URL routing Django uses the re module, which is a C extension. Would JIT work with that? Is this re the regular expression module? If so, it's a standard library module, so PyPy provides one too, rewritten in

Re: [pypy-dev] List index out of range for many tests

2011-08-25 Thread Armin Rigo
Hi Mitchell, On Sat, Aug 20, 2011 at 4:47 PM, Mitchell Hashimoto mitchell.hashim...@gmail.com wrote: One question: The tests take quite awhile to run, even for a single file. Is this normal? Yes, kind of. This is particular to test_ctypes. For me it takes about 30 seconds just for the

Re: [pypy-dev] status of scheme implementation

2011-08-25 Thread Armin Rigo
Hi Juergen, On Sun, Aug 21, 2011 at 3:15 PM, Juergen Boemmels boemm...@web.de wrote: I just found the scheme implementation https://bitbucket.org/pypy/lang-scheme/ but there is no history besides the initial import. Is this maintained? I.e. is it usful to send patches for improving this? As

Re: [pypy-dev] Python vs pypy: interesting performance difference [dict.setdefault]

2011-08-25 Thread Armin Rigo
Hi David, On Thu, Aug 25, 2011 at 9:44 PM, David Naylor naylor.b.da...@gmail.com wrote: Below is the patch, and results, for my proposed hash methods for datetime.datetime (and easily adaptable to include tzinfo and the other datetime objects).  I tried to make the hash safe for both 32bit and

[pypy-dev] STM on CPython

2011-08-26 Thread Armin Rigo
Hi, A follow-up to the blog post about Software Transactional Memory (STM) at http://morepypy.blogspot.com/ . First, there is a growing number of papers out there that seems to give solid evidence that STM is better than lock-based systems, for various definitions of better. In fact Greg Wilson

Re: [pypy-dev] Hacking at tarfile.py and gzip.py

2011-08-31 Thread Armin Rigo
Re-hi, On Wed, Aug 31, 2011 at 1:35 PM, Armin Rigo ar...@tunes.org wrote: If you do helpful performance fixes, they are probably helpful for CPython, too, and so they should go to the CPython issue tracker. ...or, I just saw this kind of check-in: pypy doesn't like adding empty strings

Re: [pypy-dev] Stacklets

2011-09-01 Thread Armin Rigo
Hi, The stacklet branch has been merged now. The _continuation module is available on all PyPys with or without the JIT on x86 and x86-64 since a few days, and it will of course be part of release 1.6.1. There is an almost-complete wrapper greenlet.py. For documentation and current limitations

Re: [pypy-dev] Solaris Support?

2011-09-01 Thread Armin Rigo
Hi Peter, On Thu, Sep 1, 2011 at 1:52 PM, Peter Kruse pjo...@gmail.com wrote:    elif platform.cc.startswith('gcc'): AttributeError: 'NoneType' object has no attribute 'startswith' Ah, not-explicitly-supported platforms end up as a platform where cc is None. The line above needs to be fixed

Re: [pypy-dev] Here's a fun one...

2011-09-01 Thread Armin Rigo
Hi Dino, On Thu, Sep 1, 2011 at 7:07 PM, Dino Viehland di...@microsoft.com wrote: Ahh yeah, I think I had some weird 1.5 build on my laptop where I tried it. Guess it's time to upgrade. Same in 1.6, but I fixed it in default today. Armin ___

Re: [pypy-dev] your thoughts on low level optimizations

2011-09-02 Thread Armin Rigo
Hi Yury, On Thu, Sep 1, 2011 at 8:26 PM, Yury Selivanov yselivanov...@gmail.com wrote: Will it be possible at some point to write modules for pypy in RPython without the need to rebuild the entire interpreter? I've added an answer to this Frequently Asked Question to

Re: [pypy-dev] Solaris Support?

2011-09-02 Thread Armin Rigo
Hi Peter, On Fri, Sep 2, 2011 at 9:02 AM, Peter Kruse pjo...@gmail.com wrote: I guess Solaris is an explicitly-not-supported platform then. May well be. But what I had in mind was not to hack at distutils --- because I don't know what this really does --- but instead to write a file called

Re: [pypy-dev] PyCON Finland has just announced its opening

2011-09-03 Thread Armin Rigo
Hi Laura, On Fri, Sep 2, 2011 at 4:31 PM, Laura Creighton l...@openend.se wrote: It's not that far away for some of us, Finland is beautiful, and they still have space for talks and sprints. I appreciate the bait factor in this message :-) But as importantly, I think that you should tell this

Re: [pypy-dev] PyCON UK Sept 24 + 25

2011-09-08 Thread Armin Rigo
Hi Laura, On Thu, Sep 8, 2011 at 6:36 PM, Laura Creighton l...@openend.se wrote: John Pinner wants to know if any of us are coming and will there be a PyPy sprint. I am not --- England is no longer on my yearly road nowadays... Also, maybe it's worth being recalled: the classical PyPy sprint

Re: [pypy-dev] CTypes backend for Cython Status

2011-09-11 Thread Armin Rigo
Hi Romain, Can you give again the location of your work? I have https://github.com/hardshooter/CythonCTypesBackend but I would like to be sure it is the most recent location. If so, then I'm a bit confused because I don't find more than three tests. Where are the tests? (Sorry, anyone with

[pypy-dev] checkout benchmarks failed

2011-09-12 Thread Armin Rigo
Hi all (particularly Fijal or Antonio), Can you explain the current state of the benchmarks, and possibly fix it? As far as I understand it runs fine but no longer updates the benchmarks themselves: http://buildbot.pypy.org/summary?category=benchmark-run A bientôt, Armin.

Re: [pypy-dev] checkout benchmarks failed

2011-09-12 Thread Armin Rigo
Hi Anto, On Mon, Sep 12, 2011 at 11:01 AM, Antonio Cuni anto.c...@gmail.com wrote: yes, I tried to have two checkouts in parallel but failed.  I don't remember the details, only that it looks easy (how hard can it be?), but then I encountered a herd of yaks to shave. Of course, now that I

Re: [pypy-dev] Separate building of the C source files

2011-09-14 Thread Armin Rigo
Hi Elad, On Wed, Sep 14, 2011 at 4:12 PM, Elad Lahav e2la...@gmail.com wrote: The source files were created under the /tmp directory. The first thing I am missing, though, is a makefile. The Makefile should be in /tmp/usession-xxx/testing_1/. A bientôt, Armin.

Re: [pypy-dev] Separate building of the C source files

2011-09-16 Thread Armin Rigo
Hi Elad, On Wed, Sep 14, 2011 at 10:08 PM, Elad Lahav e2la...@gmail.com wrote: Thanks, Armin, but that's the first place I looked. There is no makefile there. Doesn't make much sense to me. A Makefile (not a makefile) should be created. If it wasn't, then maybe it crashed during writing the

Re: [pypy-dev] Detecting numpy vs micronumpy

2011-09-16 Thread Armin Rigo
Hi, On Fri, Sep 16, 2011 at 11:48 AM, Peter Cock p.j.a.c...@googlemail.com wrote: Thanks, I'll use that. Its a shame that wasn't in Python 2.5 though, my copy of Jython doesn't support it either. The older and more robust way to check this is: __pypy__ in sys.builtin_module_names Armin

Re: [pypy-dev] Spurious dict lookups in my JIT loops

2011-09-18 Thread Armin Rigo
Hi Boris, All machine code instructions produced by the JIT have a place that they code from in your RPython code. In this case I suspect that it's from self.compare(), but again, it's a bit hard to know without having access to the complete source code. Alternatively, there is a way to display

Re: [pypy-dev] Gothenburg Sprint Dates

2011-09-19 Thread Armin Rigo
Hi, On Mon, Sep 19, 2011 at 4:58 PM, Christian Tismer tis...@stackless.com wrote: This should work for me as well. So if nothing suddenly happens, count me in. Nice to see you again! Yes, I confirm that I will also be there starting from the 24th or 28th of October (hopefully we know soonish

Re: [pypy-dev] Spurious dict lookups in my JIT loops

2011-09-21 Thread Armin Rigo
Hi Boris, Sorry, I can't help you more from just seeing the fragments of code. I would need to look at the whole source. Armin ___ pypy-dev mailing list pypy-dev@python.org http://mail.python.org/mailman/listinfo/pypy-dev

Re: [pypy-dev] Sandbox examples

2011-09-21 Thread Armin Rigo
Hi Geoffrey, On Mon, Sep 19, 2011 at 9:40 PM, Geoffrey Thomas geo...@mit.edu wrote: I'm looking at building a real application using PyPy's sandbox mode, and am having a harder time than I'd expect finding any examples of people using the sandbox in the real world. This is because, as far as

Re: [pypy-dev] Question about byte-code hacking

2011-09-23 Thread Armin Rigo
Hi, On Fri, Sep 23, 2011 at 6:12 AM, Benjamin Peterson benja...@python.org wrote: What's the PyPy position on bytecode hacking? Good, bad, evil, don't mind either way? (...) Secondly, it's useless for speed when you have a JIT. Indeed, although it is not 100% true, because we also have an

Re: [pypy-dev] Question about byte-code hacking

2011-09-23 Thread Armin Rigo
Hi, On Fri, Sep 23, 2011 at 11:27 AM, Steven D'Aprano st...@pearwood.info wrote: So the question is: would it be a burden for PyPy to make any guarantees about the stability of bytecode? The answer is: Feel free to do anything or nothing with CPython's bytecode. As Fijal says it has little to

Re: [pypy-dev] rlist and ll_delitem_nonneg index

2011-09-23 Thread Armin Rigo
Hi Zariko, On Fri, Sep 23, 2011 at 2:37 PM, Zariko Taba zariko.t...@gmail.com wrote: I hit an assert in pypy/annotation/annrpython.py in addpendingblock line 231 : assert annmodel.unionof(s_oldarg, s_newarg) == s_oldarg This is an assert that we keep hitting from time to time. Your

Re: [pypy-dev] Performance, json and standard library

2011-09-24 Thread Armin Rigo
Hi Maciej, On Sat, Sep 24, 2011 at 2:47 PM, Maciej Fijalkowski fij...@gmail.com wrote: So while I agree that ideally, JIT could handle whatever it has, but maybe json is an example good enough to warrant changes. Yes, I agree in theory. (Didn't look in detail at the proposed patches.)

Re: [pypy-dev] Stacklets

2011-09-26 Thread Armin Rigo
Hi, 2011/9/24 Andrew Francis andrewfr_...@yahoo.com: A suggestion. Perhaps it would be good to keep the test for whether CPython is the interpreter and greenlets ought to be used? Feel free to propose concrete improvements. As I said already, I implemented the code so far but I don't really

Re: [pypy-dev] Pypy jit and (meta) genetic algorithms

2011-09-28 Thread Armin Rigo
Hi David, On Tue, Sep 27, 2011 at 22:43, David Naylor naylor.b.da...@gmail.com wrote: It occurred to me that with the many options available for jit (such as inlining, function_threshold) there may be some merit to optimising those values. You are correct in that it makes sense to try more to

Re: [pypy-dev] thoughts on built-in support for coroutine suspension on lowlevel io

2011-09-28 Thread Armin Rigo
Hi Ronny, On Tue, Sep 27, 2011 at 23:27, Ronny Pfannschmidt ronny.pfannschm...@gmx.de wrote: I’d like to collect thoughts on having built-in primitives for co-routine suspension it would greatly simplify the work for tool-kits like eventlet/gevent, since no longer they would need to

Re: [pypy-dev] SpaceOperation

2011-09-28 Thread Armin Rigo
Hi, 2011/9/28 Amaury Forgeot d'Arc amaur...@gmail.com: What I try to accomplish is to learn whether it is possible to map particular SpaceOperation with right line of original source file. Good luck with this one. You may want to look at the dis module to see how it is used. Note also that

Re: [pypy-dev] I was talking with Russel Winder at PyCON UK.

2011-09-30 Thread Armin Rigo
Hi, Is the conclusion just the fact that, again, the JIT's warm-up time is important, which we know very well? Or is there some other effect that cannot be explained just by that? (BTW, Laura, it's unrelated to multithreading if it's based on the multiprocessing module.) A bientôt, Armin.

Re: [pypy-dev] pypy with virtualenv?

2011-09-30 Thread Armin Rigo
Hi, On Thu, Sep 29, 2011 at 03:16, John Anderson son...@gmail.com wrote: sontek@beast$  pypy --version Python 2.7.1 (?, Sep 12 2011, 23:40:42) [PyPy 1.6.0 with GCC 4.6.0] Try running just pypy and see if it prints the following warning lines: debug: WARNING: Library path not found, using

Re: [pypy-dev] Compile to executable program running in sandboxed environment?

2011-09-30 Thread Armin Rigo
Hi Galfy, On Fri, Sep 30, 2011 at 16:09, Galfy Pundee galfyo.pun...@googlemail.com wrote:  Is it possible to create an executable package, using PyPy, that is running the python code in a sandboxed environment? Unclear what you really mean, but I can answer yes to both interpretations of your

Re: [pypy-dev] gettrace?

2011-10-05 Thread Armin Rigo
Hi Amaury, On Wed, Oct 5, 2011 at 21:54, Amaury Forgeot d'Arc amaur...@gmail.com wrote: Is there any other way to do the equivalent of `sys.gettrace` in PyPy? Hum, it was probably ovelooked. Seems trivial to implement, will give a try. Indeed, sys.gettrace() and sys.getprofile() were added

[pypy-dev] PyCon 2012

2011-10-06 Thread Armin Rigo
Hi all, The deadline for submitting talks to the US PyCon 2012 conference is already coming: October 12. Armin ___ pypy-dev mailing list pypy-dev@python.org http://mail.python.org/mailman/listinfo/pypy-dev

Re: [pypy-dev] PyPy 1.7 coming

2011-10-09 Thread Armin Rigo
Hi Maciej, On Sat, Oct 8, 2011 at 23:06, Maciej Fijalkowski fij...@gmail.com wrote: Anyone wants to get something else there? There is: * continulets/greenlets/stacklets need to be fixed, or disabled, as per https://bugs.pypy.org/issue895 * https://bugs.pypy.org/issue884 on Windows is still

Re: [pypy-dev] PyPy 1.6 not working on Windows XP

2011-10-09 Thread Armin Rigo
Hi, On Sun, Oct 9, 2011 at 12:15, Ram Rachum r...@rachum.com wrote: Did anyone give that a try? Sorry, it may take a while, because Windows is not our primary platform. In the meantime, could you try with this latest version of pypy? Thanks!

Re: [pypy-dev] PyPy 1.6 not working on Windows XP

2011-10-10 Thread Armin Rigo
Hi, On Mon, Oct 10, 2011 at 13:11, Ram Rachum r...@rachum.com wrote: Trying to download this file results in getting a tiny corrupted archive. Also, I don't know whether this is a source release or a binary release. I don't know to compile so I can only use a binary one. Bah, I don't know why

Re: [pypy-dev] Gothenburg Sprint Dates

2011-10-12 Thread Armin Rigo
Hi Maciej, On Wed, Oct 12, 2011 at 12:28, Maciej Fijalkowski fij...@gmail.com wrote: It's not like we even discussed what the general pypy pot will be used for. I think sprint funding is fine, but what are other people opinions? Of course I agree. Note that 6 nights at Chalmers Studenthem is

Re: [pypy-dev] How to organize the py3k branch (was: [pypy-commit] pypy py3k: Remove print statement)

2011-10-13 Thread Armin Rigo
Hi Amaury, r47983 be8493f31b60 py3k | amauryfa | 2011-10-12 22:19 +0200 pypy/module/sys/system.py pypy/module/sys/version.py pypy/module/sys/vm.py Fix some metaclasses, and the sys module can now be imported Please wait a second before doing all these changes. You are

Re: [pypy-dev] How to organize the py3k branch (was: [pypy-commit] pypy py3k: Remove print statement)

2011-10-13 Thread Armin Rigo
Hi Amaury, On Thu, Oct 13, 2011 at 16:37, Amaury Forgeot d'Arc amaur...@gmail.com wrote: All these changes occur in strings that start with   app = gateway.applevel(''' Oups! Indeed. Sorry, I mistook that. A bientôt, Armin. ___ pypy-dev mailing

Re: [pypy-dev] PyPy Sprint Nov 2 - 9 in Gothenburg, Sweden

2011-10-17 Thread Armin Rigo
Hi, On Mon, Oct 17, 2011 at 19:57, Laura Creighton l...@openend.se wrote: .. _`people`: https://bitbucket.org/pypy/extradoc/src/tip/sprintinfo/gothenburg-2011/people.txt This is the file containing the previous sprint's attendance. I suggest we use instead a file in the correct directory,

Re: [pypy-dev] Questions on the pypy+numpy project

2011-10-18 Thread Armin Rigo
Hi, On Tue, Oct 18, 2011 at 11:34, Dirkjan Ochtman dirk...@ochtman.nl wrote: I'm confused -- I'm fairly convinced you think that a reasonable JIT is harder than writing numpy, and not the other way around? Let me chime in --- applying the JIT to numpypy or to any other piece of RPython code

Re: [pypy-dev] Questions on the pypy+numpy project

2011-10-18 Thread Armin Rigo
Hi, On Tue, Oct 18, 2011 at 14:19, Stefan Behnel stefan...@behnel.de wrote: The other situation is where PyPy does its own thing and supports some NumPy code that happens to run faster than in CPython, while other code does not work at all, with the possibility to replace it in a PyPy specific

Re: [pypy-dev] Goteborg sprint - newcomer

2011-10-30 Thread Armin Rigo
Hi Mark, Welcome :-) I shall be looking for cheap accommodation and will try to book the Veckobostader as suggested in the blog. Ok. Sorry, it seems that we are 3 people there in total, so we cannot offer you a shared room. A bientôt, Armin. ___

Re: [pypy-dev] Oops!

2011-11-02 Thread Armin Rigo
Hi Mark, On Wed, Nov 2, 2011 at 10:37, mark.pea...@skynet.be wrote: I assume this will be impractical for use at the sprint, so has someone got a spare x86 machine, preferably linux or Mac that I could borrow for the sprint? That should not be a big problem. You can do a lot of development

Re: [pypy-dev] BUG! file.readlines

2011-11-04 Thread Armin Rigo
Hi, I think I improved the time quite a lot in revision c98931f5191b. The memory usage is known to be larger on PyPy for this kind of operations. For a more general program with a lot of instances it can be equivalent or slightly better than CPython. A bientôt, Armin.

Re: [pypy-dev] Updated 'High Performance Python' tutorial (the one from EuroPython 2011)

2011-11-15 Thread Armin Rigo
Hi, On Tue, Nov 15, 2011 at 15:54, Ian Ozsvald i...@ianozsvald.com wrote: ShedSkin (from memory) requests fast math and a few other things in the generated Makefile. Ah, it is cheating that way. Indeed, I didn't try to play with gcc options; I just used -O2 (or -O3, which made no difference).

Re: [pypy-dev] [pypy-commit] pypy ppc-jit-backend: setarrayitem and getarrayitem offsets are immediate values.

2011-11-16 Thread Armin Rigo
Hi Maciej, On Wed, Nov 16, 2011 at 08:05, Maciej Fijalkowski fij...@gmail.com wrote: Unless I'm missing something offset for get/setarrayitem are not necesarilly intermediate values Assuming you mean immediate values instead of intermediate: the content of the checkin shows that it meant that

Re: [pypy-dev] New pypy website

2011-11-18 Thread Armin Rigo
Hi, I don't really care about the website design, and I will generally tend to prefer what I'm used to over something new. But the fact is that I really prefer *a lot* the existing pypy.org over the new one. It is html-as-expected: pages with reasonably-sized text that contain reasonably-colored

Re: [pypy-dev] Translating pypy-1.7 with -O0

2011-11-24 Thread Armin Rigo
Hi David, On Wed, Nov 23, 2011 at 19:53, David Naylor naylor.b.da...@gmail.com wrote: The binary, however, does not work and core dumps when started with: This looks like a misuse of libgc. If you really care, you need to read the docs of Boehm to see if they say anything specific to FreeBSD

Re: [pypy-dev] Win32 build of the release 1.7

2011-11-29 Thread Armin Rigo
Hi, The build has been officialized and is now available from https://bitbucket.org/pypy/pypy/downloads . A bientôt, Armin. ___ pypy-dev mailing list pypy-dev@python.org http://mail.python.org/mailman/listinfo/pypy-dev

Re: [pypy-dev] Optimizing Append Only structures

2011-11-29 Thread Armin Rigo
Hi, On Tue, Nov 29, 2011 at 21:28, Romain Guillebert romain...@gmail.com wrote: Probably because he (as a clojure developer) likes immutability of data structures. No, it's really needed for the way it is written: by creating a new dict, the old purefunction results no longer apply. But we

Re: [pypy-dev] RPython

2011-12-08 Thread Armin Rigo
Hi, On Thu, Dec 8, 2011 at 06:30, Rinu Boney rinu.mat...@gmail.com wrote: where can i get more information on rpython ( i have already seen what is written in the coding guide! ) ? The coding guide describes the basics, and we have a number of examples of small interpreters besides the Python

Re: [pypy-dev] Clang benchmarks

2011-12-08 Thread Armin Rigo
Hi Justin, On Thu, Dec 8, 2011 at 09:09, Justin Noah justinn...@gmail.com wrote: Here are the llvm/clang build using the shadowstack gc. What do you think? 1. What is the baseline you are comparing it with? 2. I assume these are normal JITting PyPys. In that case, then for benchmarks like

  1   2   3   4   5   6   7   8   9   10   >