Re: [pypy-dev] The Work Plan Re: STM proposal funding

2012-04-16 Thread Armin Rigo
Hi Andrew, On Sun, Apr 15, 2012 at 18:07, Andrew Francis andrewfr_...@yahoo.com wrote: So returning to the example,  a programme more in the spirit of what you are doing is: No, you are still missing my point. The goal is to work on existing stackless programs, not to write custom programs

Re: [pypy-dev] Question about stm_descriptor_init(), tasklets and OS threads

2012-04-17 Thread Armin Rigo
Hi Andrew, On Tue, Apr 17, 2012 at 00:44, Andrew Francis andrewfr_...@yahoo.com wrote: I am looking at stm_descriptor_init(). Right now makes a call to pthread_self(). In a potential Stackless prototype, I would want it to get the current tasklet instead. I don't understand why at all, sorry.

Re: [pypy-dev] The Work Plan Re: STM proposal funding

2012-04-17 Thread Armin Rigo
Hi Bengt, I feel like I have actually already explained over and over again what I am doing. But it's true that such communication has been going on on various channels. So, here is the documentation I've got so far: https://bitbucket.org/pypy/pypy/raw/stm-gc/lib_pypy/transaction.py In

Re: [pypy-dev] Question about stm_descriptor_init(), tasklets and OS threads

2012-04-19 Thread Armin Rigo
Hi Andrew, On Thu, Apr 19, 2012 at 19:43, Andrew Francis andrewfr_...@yahoo.com wrote: I am trying to understand enough to get into a position to attempt an integration. I believe you are trying to approach the problem from the bottom-most level up --- which is a fine way to approach problems;

Re: [pypy-dev] Question about stm_descriptor_init(), tasklets and OS threads

2012-04-19 Thread Armin Rigo
Re-Hi, On Thu, Apr 19, 2012 at 21:37, Armin Rigo ar...@tunes.org wrote: You have to make sure that all tasklet.switch()es internally go back to the main program, and not directly to another tasklet. Ah, sorry, I confused the stackless interface. You don't switch() to tasklets, but instead

Re: [pypy-dev] [cpyext] partial fake PEP393 implementation to provide access to single unicode characters in strings

2012-04-20 Thread Armin Rigo
Hi Amaury, On Fri, Apr 20, 2012 at 11:02, Amaury Forgeot d'Arc amaur...@gmail.com wrote: But is it desirable? The first call to PyUnicode_AsUnicode will allocate and copy the unicode buffer, but subsequent calls will quickly return the same address. Indeed, it's a bit unclear. If I may

[pypy-dev] kwargsdict-strategy

2012-04-21 Thread Armin Rigo
Hi Carl Friedrich, Can you have a look at speed.python.org? It seems that merging the kwargsdict-strategy branch had mostly the effect of making twisted_iteration slower :-( Armin ___ pypy-dev mailing list pypy-dev@python.org

Re: [pypy-dev] output readable c

2012-04-23 Thread Armin Rigo
Hi, On Mon, Apr 23, 2012 at 01:35, s...@pobox.com wrote:    Maciej I would really like this sort of changes to come with it's own    Maciej tests (ones that check what was compiled preferably). What might such tests look like? It is an issue: unit-testing this kind of detail is a bit hard,

[pypy-dev] Syntax for the 'transaction' module

2012-05-01 Thread Armin Rigo
Hi all, Following the blog post about STM, I would like to sollicitate your attention to come up with some better syntax for the 'transaction' module. * First question: 'transaction'. The name is kind of bogus, because it implies that it must be based on transactional memory. Such a name

Re: [pypy-dev] Syntax for the 'transaction' module

2012-05-01 Thread Armin Rigo
Hi Laura, On Tue, May 1, 2012 at 12:03, Laura Creighton l...@openend.se wrote: So how about 'schedule'? Might work :-) How about, if we decide to go for a class, the name of the class? Is it 'schedule.Runner()', 'schedule.Scheduler()', ...? A concrete instance of this class is no longer

Re: [pypy-dev] Syntax for the 'transaction' module

2012-05-02 Thread Armin Rigo
Hi Laura, A note on my two previous messages: in the first one I argued about @breakable, while the second one I suggested to use threads and with atomic. The relationship between the two is: in the first model you would put @breakable on some outer functions until it calls things that are

Re: [pypy-dev] Syntax for the 'transaction' module

2012-05-02 Thread Armin Rigo
Hi Fijal, Or maybe, keeping in touch with concurrent.futures from Python 3.2, should we make it nonconcurrent.schedule...? :-) On Wed, May 2, 2012 at 10:47 AM, Maciej Fijalkowski fij...@gmail.com wrote: In CPython they introduced concurrent.* namespace. How about we reuse it, by say

Re: [pypy-dev] Syntax for the 'transaction' module

2012-05-04 Thread Armin Rigo
Hi Laura, On Thu, May 3, 2012 at 6:25 PM, Laura Creighton l...@openend.se wrote: This is an odd way to think.  Sort of like how the Copenhagen explanation for quantum mechanics implies that classical concepts can be used to describe quantum phenomenon.  You try, and try, and try to think that

Re: [pypy-dev] alioth tests?

2012-05-07 Thread Armin Rigo
Hi, On Sun, May 6, 2012 at 11:12 PM, xancorreu xancor...@gmail.com wrote: By the other hand, saying with other words: with scripts appeared in alioth, pypy is faster? Probably a bit, but does it matter? Consider a completely un-pythonic program that no-one would ever write this way: is the

Re: [pypy-dev] feedback on PEP 421

2012-05-07 Thread Armin Rigo
Hi Laura, hi Eric, On Sun, May 6, 2012 at 10:29 PM, Laura Creighton l...@openend.se wrote: I think a large part of this problem is that CPython implementors are completely unaware of what set of functions PyPy cannot implement. Indeed. From that point of view it would make sense if CPython

Re: [pypy-dev] alioth tests?

2012-05-07 Thread Armin Rigo
Hi Xan, On Mon, May 7, 2012 at 3:04 PM, xancorreu xancor...@gmail.com wrote: The meta-question is: what is the fastest language with comfortable syntax and expressions ;-) Then stop looking at this particular benchmark site :-) The Python programs you see there are not in the slightest way

Re: [pypy-dev] cppyy: C++ bindings for PyPy

2012-05-08 Thread Armin Rigo
Hi Wim, On Fri, May 4, 2012 at 8:16 AM, wlavrij...@lbl.gov wrote: Quick question - if it's mature, why not merge it to default? I presume it should be turned off, since there is a sizeable dependency, but still having it in default can be good. I have a standalone version of Reflex now and

[pypy-dev] Mini-sprint next week in Leysin (14-19th of May)

2012-05-08 Thread Armin Rigo
Hi all, With Maciej showing up, we will have just in time a mini-sprint next week in Leysin: 14-19th of May. Anyone is welcome to show up, from a day to a week, to talk or work on anything preferrably vaguely PyPy-related. As usual the topics are open, but we were thinking at least to implement

[pypy-dev] pypy-stm

2012-05-09 Thread Armin Rigo
Hi all, Here is the very first Python 2.7 interpreter to run existing multithreaded programs on multiple cores. Linux 32 bits. It is horribly slow right now, so consider this as nothing more than a demo :-) http://wyvern.cs.uni-duesseldorf.de/~arigo/pypy-c-r54960-stm.tar.bz2

Re: [pypy-dev] Question about stm_descriptor_init(), tasklets and OS threads

2012-05-10 Thread Armin Rigo
Hi Andrew, Please look at the latest documentation: https://bitbucket.org/pypy/pypy/raw/stm-thread/pypy/doc/stm.rst You should be able to use such a thread.atomic in stackless.py. You need to create N threads and run the tasklets in these threads. As long as each tasklet's user code is

Re: [pypy-dev] pypy-stm

2012-05-10 Thread Armin Rigo
Re-hi, I updated my fork of CPython 3.x to include a very similar functionality, _thread.atomic_enter() and _thread.atomic_exit(). (Of course without any multicore capabilities, but it gives you the atomicity.) A very small diff overall. http://bitbucket.org/arigo/cpython-withatomic A

Re: [pypy-dev] pypy-stm

2012-05-11 Thread Armin Rigo
Hi again, An update of pypy-stm. The previous one was not working properly with any Python function call --- on any example of any non-trivial size, it would not actually run on multiple cores. This one works better. http://wyvern.cs.uni-duesseldorf.de/~arigo/pypy-c-r55013-stm.tar.bz2 I also

Re: [pypy-dev] AOSA book chapter

2012-05-15 Thread Armin Rigo
Hi Benjamin, On Tue, May 15, 2012 at 4:08 AM, Benjamin Peterson benja...@python.org wrote: As some of you may know, this past year I wrote a chapter about PyPy for Architecture of Open Source Applications Volume 2. Great, congratulation :-) It has brought to my attention that my

Re: [pypy-dev] Python FFI

2012-05-15 Thread Armin Rigo
Hi Yury, On Tue, May 15, 2012 at 5:56 PM, Yury Selivanov yselivanov...@gmail.com wrote: While I don't like some design quirks of Cython, I think that it's far better than any ffi or ctypes-like solution.  Essentially, it's an ffi merged with the language, not a separate module.  And that's a

Re: [pypy-dev] pypy-dev Digest, Vol 13, Issue 21

2012-05-16 Thread Armin Rigo
Hi Jean-Paul, On Tue, May 15, 2012 at 9:22 PM, exar...@twistedmatrix.com wrote: I don't think it's true that using strings instead of types (or other rich objects) simplifies anything.  Quite the opposite, it takes all of the complexity which must exist and throws a huge wall up to prevent

Re: [pypy-dev] Python FFI

2012-05-16 Thread Armin Rigo
Hi Stefan, On Wed, May 16, 2012 at 7:01 AM, Stefan Behnel stefan...@behnel.de wrote: I'm with Jean-Paul here. ...for a reason that might be unrelated to Jean-Paul's original complain: it's not like Cython gives first-class object manipulation on the result of parsing its .pyx files... well,

Re: [pypy-dev] Python FFI

2012-05-16 Thread Armin Rigo
Hi Amaury, On Wed, May 16, 2012 at 9:58 AM, Amaury Forgeot d'Arc amaur...@gmail.com wrote: Another incarnation of SWIG? ...I suppose you can say so a priori. The difference is that we won't try to perform conversions for the user. Instead he gets his instances of C types as real Python

Re: [pypy-dev] Python FFI

2012-05-16 Thread Armin Rigo
Hi, On Wed, May 16, 2012 at 12:54 PM, Eleytherios Stamatogiannakis est...@gmail.com wrote: Is there in the plans a Jit friendly callback mechanism (from C to pypy) for the new API? It is far too early to have such plans, but I guess so. Armin ___

Re: [pypy-dev] Python FFI

2012-05-19 Thread Armin Rigo
Hi all, We started working on it a few days ago and it's already progressed well: http://github.com/arigo/ffi A bientôt, Armin. ___ pypy-dev mailing list pypy-dev@python.org http://mail.python.org/mailman/listinfo/pypy-dev

Re: [pypy-dev] bug with MinGW32

2012-05-23 Thread Armin Rigo
Hi Bookaa, On Wed, May 23, 2012 at 6:07 AM, bookaa rors...@gmail.com wrote: ! includes = ['stdlib.h', 'stdio.h', 'sys/types.h', 'stdint.h'] The MSVC compiler before 2010 doesn't provide a 'stdint.h', so this change would break it. You need to come up with a more complicated solution.

Re: [pypy-dev] Jit hints from python

2012-05-24 Thread Armin Rigo
Hi Timothy, On Wed, May 23, 2012 at 2:44 PM, Timothy Baldridge tbaldri...@gmail.com wrote: So my question is, how easy/hard would it be to somehow get a @purefunction decorator in Python instead of just RPython? For that matter, having __immutable_fields__ would also be nice, but that may be

[pypy-dev] buildmaster moved

2012-05-25 Thread Armin Rigo
Hi all, Wyvern, which was the machine serving a few PyPy-related services --- most notably the buildmaster and the nightly builds at buildbot.pypy.org --- more or less died a few days ago. It was after a long life: we had the server around 2005, and now the particular small piece that broke down

Re: [pypy-dev] Differences between app and interp level calling methods

2012-05-27 Thread Armin Rigo
Hi Timothy, On Fri, May 25, 2012 at 10:48 PM, Timothy Baldridge tbaldri...@gmail.com wrote: For something like this, am I going to see much of a performance boost by dropping to the interpreter level from the dispatch between these three sub-function types? I can't answer this question,

Re: [pypy-dev] Python FFI

2012-05-27 Thread Armin Rigo
Hi Laura, On Wed, May 23, 2012 at 6:29 AM, Laura Creighton l...@openend.se wrote: tons of things that I agree with more or less wholesale, though I think that there is a slightly larger market for Cython in the immediate future ... Sure, I never meant to give any market size estimate.

Re: [pypy-dev] Python FFI

2012-05-30 Thread Armin Rigo
Hi Robert, On Tue, May 29, 2012 at 3:49 PM, Robert Zaremba robert.zare...@zoho.com wrote: Whats the problem with cppyy? Why don't extend it rather than build new solution based on pycparser? Once again the design goals are different. Note that the first mail in this thread was 15 days ago.

Re: [pypy-dev] Python FFI

2012-06-03 Thread Armin Rigo
Hi Alex, On Sun, Jun 3, 2012 at 10:16 AM, Alex Pyattaev alex.pyatt...@gmail.com wrote: So, when would users be able to test it? I'd like to compare the overhead with ctypes and cppyy for instance. The first version is ready for testing at https://github.com/arigo/ffi . Note that the goal is

Re: [pypy-dev] cppyy use case question

2012-06-05 Thread Armin Rigo
Hi Wim, On Tue, Jun 5, 2012 at 1:53 AM, wlavrij...@lbl.gov wrote: Overall, I'm happy enough with the result (I'm going to need handling of PyObject*'s later for my own nefarious purposes). Maybe we can motivate you to look for and fix inefficiencies in cpyext :-) As far as I know it's still

Re: [pypy-dev] cppyy use case question

2012-06-06 Thread Armin Rigo
Hi Wim, On Wed, Jun 6, 2012 at 9:10 AM, wlavrij...@lbl.gov wrote: If I understand correctly what you describe above, then perhaps giving the PyPyObject by pointer as payload to the PyObject could help, too. Yes: so far, most PyObjects are small structures containing just the refcount and the

Re: [pypy-dev] Patches for Pypy under cygwin

2012-06-07 Thread Armin Rigo
Hi Uwe, On Thu, Jun 7, 2012 at 9:21 PM, Uwe F. Mayer uwe_f_ma...@yahoo.com wrote:       3 [main] pypy-c 11788 fixup_mmaps_after_fork: ReadProcessMemory failed for MAP_PRIVATE address 0xB001, Win32 error 998 Yes, that's one of the mmap addresses used by the JIT, if available. More to the

Re: [pypy-dev] update (+patch) on embedding pypy

2012-06-09 Thread Armin Rigo
Hi Roberto, On Wed, Apr 4, 2012 at 5:55 PM, Roberto De Ioris robe...@unbit.it wrote: Ok, i am pretty satisfied with the current code (i have made a pull request). Trying to figure out what is the status of the pending pull requests, I came across:

Re: [pypy-dev] update (+patch) on embedding pypy

2012-06-09 Thread Armin Rigo
Hi Roberto, On Sat, Jun 9, 2012 at 11:34 AM, Roberto De Ioris robe...@unbit.it wrote: Hi Armin, the whole newer code is under cpyext. Last time i checked (a week ago) the asmgcc failure was still there, so i think it is better to force shadowstack when --shared is specified. Ok, done. And I

Re: [pypy-dev] PyPy-Sprint Leipzig 2012 sign up

2012-06-11 Thread Armin Rigo
Hi Jasper, On Mon, Jun 11, 2012 at 12:39 AM, Jasper Schulz jas...@dqi06.de wrote: So, I'm really looking forward to meet you and get my brain crushed :-). Welcome :-) Armin ___ pypy-dev mailing list pypy-dev@python.org

Re: [pypy-dev] Patches for Pypy under cygwin

2012-06-11 Thread Armin Rigo
Hi, On Sun, Jun 10, 2012 at 11:12 AM, Amaury Forgeot d'Arc amaur...@gmail.com wrote: I think memory allocated for JIT must be marked with PROT_EXEC (it contains machine code), so malloc() is not an option. Exactly. On Linux it would work, because you can use mprotect() to make even

Re: [pypy-dev] CLI translate error with pypy-1.9

2012-06-13 Thread Armin Rigo
Hi David, On Tue, Jun 12, 2012 at 11:58 AM, David Naylor naylor.b.da...@gmail.com wrote: [translation:ERROR] .. (pypy.rlib.jit:557)set_param__None_enable_opts Nowadays, you cannot use the JIT with the CLI backend. Armin ___ pypy-dev mailing list

Re: [pypy-dev] CLI translate error with pypy-1.9

2012-06-13 Thread Armin Rigo
Hi Fijal, On Wed, Jun 13, 2012 at 1:17 PM, Maciej Fijalkowski fij...@gmail.com wrote: That probably does not mean that someone somewhere is not calling set_param, like from command line parsing. It does mean it. At RPython level the only callers of rlib.jit.set_param() are all from

Re: [pypy-dev] CLI translate error with pypy-1.9

2012-06-17 Thread Armin Rigo
Hi David, On Sat, Jun 16, 2012 at 4:41 PM, David Naylor naylor.b.da...@gmail.com wrote: Oh, okay.  I don't have access to the latest sources.  I normally work of the released sources.  But thanks for looking at this. It's going to take us a loong time to fix CLI translation if the process

Re: [pypy-dev] A very easy bug for newcomers

2012-06-18 Thread Armin Rigo
Hi Konstantin, On Mon, Jun 18, 2012 at 3:19 PM, Костя Лопухин kostia.lopu...@gmail.com wrote: May I try? :) Sure :-) A first quick remark: you should add a test in pypy's own tests, in pypy/objspace/std/test/test_newformat.py. Then run it with python pytest.py pypy/obj.../test_newformat.py.

[pypy-dev] CFFI release 0.1

2012-06-18 Thread Armin Rigo
Hi all, Announcing the release 0.1 of CFFI, the new Python interface to call C libraries done (mostly) by Maciek and myself: http://morepypy.blogspot.ch/2012/06/release-01-of-cffi.html A bientôt, Armin. ___ pypy-dev mailing list pypy-dev@python.org

Re: [pypy-dev] Internship and bug report

2012-06-21 Thread Armin Rigo
Hi Léonard, On Wed, Jun 20, 2012 at 6:23 PM, Léonard de Haro leonard.de.h...@ens.fr wrote: - What is the stack overflow? It's just what it says: a stack overflow. RPython has no CPS or tail-recursion support, so it doesn't support arbitrary heap-limited recursion. Have a look at the Prolog

Re: [pypy-dev] Translation with pypy picking up wrong libraries

2012-06-24 Thread Armin Rigo
Hi David, On Fri, Jun 22, 2012 at 1:05 PM, David Naylor naylor.b.da...@gmail.com wrote: And attached is a patch for fixing (2), which works around (1). Your patch modifies the py lib, more precisely py/_path. The py lib is nowadays a separate project. You should try to discuss it and submit

Re: [pypy-dev] [pypy/pypy] rbigint.py improvements (pull request #72)

2012-06-27 Thread Armin Rigo
Hi Stian, On Fri, Jun 22, 2012 at 3:59 AM, Stian Andreassen pullrequests-nore...@bitbucket.org wrote: https://bitbucket.org/pypy/pypy/pull-request/72/rbigintpy-improvements Title: rbigint.py improvements I suppose this needs discussion on pypy-dev. It is great, but the major issue is that it

Re: [pypy-dev] __pycache__ folders

2012-07-31 Thread Armin Rigo
Hi Marcus, PyPy contains no logic to create or search for __pycache__. A grep tells me that neither does CPython 2.7. You are probably confused by py.test creating them. A bientôt, Armin. ___ pypy-dev mailing list pypy-dev@python.org

Re: [pypy-dev] __pycache__ folders

2012-07-31 Thread Armin Rigo
Hi Stefano, On Tue, Jul 31, 2012 at 1:34 PM, Stefano Rivera stef...@rivera.za.net wrote: And I do my best to minimize that. In this case, I thought it was worth the delta. My point of view is that this goes in the same pack of incompatibilities introduced by some distributions as splitting the

Re: [pypy-dev] Fatal RPython error: MemoryError

2012-08-07 Thread Armin Rigo
Hi Roger, On Tue, Aug 7, 2012 at 7:41 AM, Roger Flores aide...@yahoo.com wrote: Can someone else at least confirm this? Yes, I can reproduce it easily running in a 32-bit chroot on a machine with more than 4GB of RAM. The problem is the same, and is still not solved: we run out of memory when

Re: [pypy-dev] Fatal RPython error: MemoryError

2012-08-07 Thread Armin Rigo
Re-hi, I tried to debug it more precisely, and it seems that the problem is even more basic than I thought. It is very hard to solve in general. The issue is that when we are really out of memory, then *every* single allocation is going to fail. The difference with CPython is that in the same

Re: [pypy-dev] Fatal RPython error: MemoryError

2012-08-07 Thread Armin Rigo
Hi Harald, On Tue, Aug 7, 2012 at 10:23 AM, Massa, Harald Armin c...@ghum.de wrote: outside of programming there is the concept of having a secret backup (nest egg). Would'nt it be a solution to preallocate some bytes on startup for really, really bad times? It might help in general, but not

Re: [pypy-dev] Fatal RPython error: MemoryError

2012-08-07 Thread Armin Rigo
Hi Ronny, On Tue, Aug 7, 2012 at 1:56 PM, Ronny Pfannschmidt ronny.pfannschm...@gmx.de wrote: However in some cases (like the example) the memory error is caused by accumulating more and more smaller objects, in which case the memory one would use for a Stack-trace is used up and the extra

Re: [pypy-dev] Fatal RPython error: MemoryError

2012-08-08 Thread Armin Rigo
Hi Eli, hi Roger, Both of your solutions might work. Roger, you overlook a problem in this pseudo-code: print 'MemoryError' print stack_trace() # of app We can't suddenly print the stack trace of the application from inside the GC. In order to have a regular stack

Re: [pypy-dev] Dependence Graphs in Pypy?

2012-08-08 Thread Armin Rigo
Hi Tim, An additional remark: if you're looking for a tool that is able to extract a complete call graph from a random Python program, then it's impossible. Only approximations can be done, like e.g. done in pylint, I believe. Such tools are pointless in PyPy but could be useful in other

Re: [pypy-dev] Invitation to participate in SIAM CSE Minisymposium

2012-08-10 Thread Armin Rigo
Hi Fijal, On Thu, Aug 9, 2012 at 5:23 PM, Maciej Fijalkowski fij...@gmail.com wrote: I would like to come, but I'll absolutely not make commitments right now, 9 months in advance. Noone will pay me to do that and I'm incapable of saying if flying halfway across the world from South Africa in

Re: [pypy-dev] custom interpreter split_block error

2012-08-10 Thread Armin Rigo
Hi, On Fri, Aug 10, 2012 at 11:06 PM, Timothy Baldridge tbaldri...@gmail.com wrote: jitdriver.jit_merge_point(ip = self._ip, func = self._call_stack[-1], args = self._arg_stack[-1],

Re: [pypy-dev] jvm tests failing on os x

2012-08-11 Thread Armin Rigo
Hi Fijal, On Sat, Aug 11, 2012 at 10:43 AM, Maciej Fijalkowski fij...@gmail.com wrote: Anyone has any idea how to fix/disable them? Obviously you can disable them by saying if sys.platform = 'darwin': py.test.skip('XXX') a few lines before the crash, but is that really your question? Armin

Re: [pypy-dev] jvm-improvements branch

2012-08-12 Thread Armin Rigo
Hi Michal, On Wed, Aug 1, 2012 at 9:20 PM, Michal Bendowski mic...@bendowski.pl wrote: 3. If my code from jvm-improvements looks good I would love to get it merged into default, to close one chapter of work (a working rjvm module) and start working on whatever's next. Can someone take a look?

Re: [pypy-dev] jvm tests failing on os x

2012-08-14 Thread Armin Rigo
Hi, On Mon, Aug 13, 2012 at 1:44 PM, Michal Bendowski mic...@bendowski.pl wrote: I don't think I introduced any Java 6 specific code. Nevertheless Java 6 will be EOL'd soon as well (Scala is dropping Java 6 support in the next release for example) so I agree that requiring at least Java 6

Re: [pypy-dev] what does the debug cycle look like?

2012-08-14 Thread Armin Rigo
Hi, A quick note: On Tue, Aug 14, 2012 at 10:59 AM, Maciej Fijalkowski fij...@gmail.com wrote: (not sure why your translation take so long) Because of swapping: translating on a 64-bit Mac requires 5-6 GB of RAM ideally. A bientôt, Armin. ___

Re: [pypy-dev] Translator error on Windows: error C2036: 'void *' : unknown size

2012-08-14 Thread Armin Rigo
Hi Timothy, On Tue, Aug 14, 2012 at 4:26 PM, Timothy Baldridge tbaldri...@gmail.com wrote: error C2036: 'void *' : unknown size Fixed yesterday evening in 9e9b39337354. Indeed, http://buildbot.pypy.org/nightly/trunk/ shows that Win32 has successfully built this night. A bientôt, Armin.

Re: [pypy-dev] Hello World in Windows with MinGW

2012-08-23 Thread Armin Rigo
Hi, On Fri, Aug 17, 2012 at 3:04 PM, Welch, Matt matt.we...@compuware.com wrote: Any help would be appreciated. Do I need a different environment? Is it not MinGW/Msys friendly? Sorry, at least I don't know MinGW/Msys at all. The PyPy translation toolchain is tested on Linux, OS/X, and

Re: [pypy-dev] PPC64 backend compile_framework_7_interior failure

2012-08-24 Thread Armin Rigo
Hi David, From your mail, 904 seems to be a typeid. It cannot be a variable computed as n + 100 * i + ..., because it appears directly in assembler as li r3, 904. It seems the problem is more subtle than that, reusing bogus memory and falling over a 904 that is a typeid when reading 16(r3),

Re: [pypy-dev] graph not in self.fixed_graphs

2012-08-25 Thread Armin Rigo
Hi Timothy, On Sat, Aug 25, 2012 at 3:26 PM, Timothy Baldridge tbaldri...@gmail.com wrote: ... [translation:ERROR] assert graph not in self.fixed_graphs [translation:ERROR] AssertionError For this case, we'd need to see the complete traceback. It's a situation of finding out late the

Re: [pypy-dev] graph not in self.fixed_graphs

2012-08-25 Thread Armin Rigo
Hi Timothy, On Sat, Aug 25, 2012 at 4:16 PM, Timothy Baldridge tbaldri...@gmail.com wrote: [translation:ERROR] llvalue = r_value.convert_const(dictvalue) [translation:ERROR]File /home/tim/pypy/pypy/rpython/rclass.py, line 322, in convert_const [translation:ERROR] classdef =

Re: [pypy-dev] PPC64 backend compile_framework_7_interior failure

2012-08-25 Thread Armin Rigo
Hi all, For reference, we found the answer on IRC: On Sat, Aug 25, 2012 at 9:01 PM, David Edelsohn dje@gmail.com wrote: ; cond_call_gc_wb 0xfffb74e0e10: lbz r0,3(r30) 0xfffb74e0e14: andi. r0,r0,1 0xfffb74e0e18: beq 0xfffb74e0e3c 0xfffb74e0e1c:

Re: [pypy-dev] numpypy array expressions

2012-08-28 Thread Armin Rigo
Hi Mark, On Mon, Aug 27, 2012 at 3:09 PM, mark florisson markflorisso...@gmail.com wrote: For this year's summer of code, and for my master dissertation, we created a project to compile array expressions efficiently (Dag was my mentor, CCed), which can be found here:

Re: [pypy-dev] cpyext performance

2012-08-30 Thread Armin Rigo
Hi Stefan, On Wed, Aug 29, 2012 at 10:29 PM, Stefan Behnel stefan...@behnel.de wrote: Ok, so where would this have to be done? Is there a way to implement it generically in that ubiquitous space.wrap() kind of call (whatever that does internally), or would it have to be done explicitly

Re: [pypy-dev] cpyext performance

2012-08-30 Thread Armin Rigo
Hi Stefan, On Thu, Aug 30, 2012 at 10:06 AM, Stefan Behnel stefan...@behnel.de wrote: This may not even be that hard to do, but it's unlikely that I'll give this a try myself. The turn-over times of building PyPy for an hour or so on a remote machine (RAM!) for most non-trivial changes are

Re: [pypy-dev] cpyext performance

2012-08-31 Thread Armin Rigo
Hi, On Thu, Aug 30, 2012 at 10:28 AM, Armin Rigo ar...@tunes.org wrote: This is a blocker, and one that the plan towards CFFI should completely fix. A quick but successful attempt can be found in cffi/demo/{api,pyobj}.py. api.py is a bit of a hack but lets you declare functions

Re: [pypy-dev] STM and concurrent GC

2012-09-06 Thread Armin Rigo
Hi Wiktor, On Thu, Sep 6, 2012 at 1:36 PM, Wiktor Mizdal wiktor8...@o2.pl wrote: will STM can help implement concurrent garbage collector? No, that's the wrong way around. A concurrent GC might be needed at some point in order to help STM. But you don't want to write a GC *using* the STM

Re: [pypy-dev] Locals clearing in RPython

2012-09-06 Thread Armin Rigo
Hi Timothy, On Thu, Sep 6, 2012 at 8:34 PM, Timothy Baldridge tbaldri...@gmail.com wrote: The question is: when is the GC free to free data passed into a function's arguments. Will that function hold on to all data passed in through arguments until the execution of the function terminates? If

Re: [pypy-dev] Flow graphs, backends and JIT

2012-09-18 Thread Armin Rigo
Hi Haael, Here is again a high-level overview. Although we use the term backend for both, there are two completely unrelated components: the JIT backends and the translation backends. The translation backends are part of the static translation of a PyPy (with or without the JIT) to C code. The

Re: [pypy-dev] Flow graphs, backends and JIT

2012-09-19 Thread Armin Rigo
Hi Carl Friedrich, On Tue, Sep 18, 2012 at 10:00 PM, Carl Friedrich Bolz cfb...@gmx.de wrote: 2. More fundamentally (and this is where I think you have missed a detail about the JIT so far) the JIT ist trace-based. The JIT backends cannot deal with arbitrary control flow, only with linear

Re: [pypy-dev] MinGW32 support PyPy with mscr90.dll

2012-09-19 Thread Armin Rigo
Hi Bookaa, On Tue, Jun 5, 2012 at 3:46 AM, bookaa rors...@gmail.com wrote: ... I suggest this instruction should be add to PyPy doc: MinGW32 support Sorry for the delay. As you noticed, generally our interest in mingw32 is close to zero, with Visual Studio taking up all of our (already very

Re: [pypy-dev] Bachelor Thesis - STM / ATM

2012-09-30 Thread Armin Rigo
Hi Andreas, On Sun, Sep 30, 2012 at 8:34 AM, Andreas Pedersen andreasdamgaardpeder...@gmail.com wrote: I don't currently have an overview of the code, so I can't see how far you are and what subproblems you are tackling. Any help on finding a good subject would be appreciated. Someone else is

Re: [pypy-dev] PyPy STM

2012-09-30 Thread Armin Rigo
Hi Ronny, On Sun, Sep 30, 2012 at 3:50 PM, Ronny Pfannschmidt ronny.pfannschm...@gmx.de wrote: after my thesis i'll be experimenting with a relaxed csp-ish model based on python native generator based continuations as well as the new continulet-jit-3 based greenlets. my basic assumption is

Re: [pypy-dev] PyPy STM

2012-10-04 Thread Armin Rigo
Hi Bengt, On Tue, Oct 2, 2012 at 1:40 PM, Bengt Richter b...@oz.net wrote: Just a triggered thought: I am wondering if Conway's Game of Life http://en.wikipedia.org/wiki/Conway%27s_Game_of_Life might be be an interesting/fun basis for experiments and maybe a benchmark for STM use in the

Re: [pypy-dev] Weird C code in crashing code line

2012-10-11 Thread Armin Rigo
Hi Stefan, On Thu, Oct 11, 2012 at 7:41 AM, Stefan Behnel stefan...@behnel.de wrote: it crashes in line 606 of obmalloc.c, which reads as follows: 583block *bp; [...] 604 bp = pool-freeblock; 605 assert(bp != NULL); 606 if ((pool-freeblock =

Re: [pypy-dev] Splitting RPython and PyPy

2012-10-22 Thread Armin Rigo
Hi Ronan, On Sun, Oct 21, 2012 at 9:28 PM, Ronan Lamy ronan.l...@gmail.com wrote: I think that the changes should go deeper. I see model.py and operation.py as defining the flowgraph-based intermediate representation on which the rest of the tool chain operates. (...) I believe you're putting

Re: [pypy-dev] Need help in concluding Multi-Thread based model thoughts between Python and PyPy

2012-10-30 Thread Armin Rigo
Hi, On Tue, Oct 30, 2012 at 4:19 PM, Sasikanth Eda sasikanth@gmail.com wrote: 1. Has PyPy optimized / reduced the GIL limitation ? Not so far: PyPy has a GIL, similar to CPython. (Note that I'm answering with CPython here to make it clearer; Python means the language which both CPython

Re: [pypy-dev] Need help in concluding Multi-Thread based model thoughts between Python and PyPy

2012-10-31 Thread Armin Rigo
Hi, On Wed, Oct 31, 2012 at 3:14 PM, Phyo Arkar phyo.arkarl...@gmail.com wrote: Jython is wayyy much slower than CPython in many cases. I can't even find its use. If your problem is hard to divide in multiple processes but easy to divide in multiple threads, and if you have a machine with

Re: [pypy-dev] Questions about CFFI and JITted callbacks

2012-11-07 Thread Armin Rigo
Hi Eleytherios, On Wed, Nov 7, 2012 at 6:25 PM, Eleytherios Stamatogiannakis est...@gmail.com wrote: - From what i understand, right now when a python function is called through a callback, the JIT compiler does not notice it, so it doesn't JIT the function at all. So is it possible to specify

Re: [pypy-dev] Is cffi fixed for win32?

2012-11-07 Thread Armin Rigo
Hi Matti, hi all, On Tue, Nov 6, 2012 at 10:54 PM, Matti Picus matti.pi...@gmail.com wrote: Are there anymore failing win32 tests for cffi, or is cffi fully supported for windows now? There are no failure left from test_c, and running (manually) the full test suite from cffi/testing mostly

Re: [pypy-dev] Translation PDF link is broken

2012-11-28 Thread Armin Rigo
Hi Anatoly, On Tue, Nov 27, 2012 at 2:38 AM, anatoly techtonik techto...@gmail.com wrote: This page - http://doc.pypy.org/en/latest/translation.html - links to http://doc.pypy.org/en/latest/image/translation.pdf which is 404. Fixed, thanks. (Unsure what's the point of this pdf, as it's just

Re: [pypy-dev] Scrapy fails in PyPy

2012-12-03 Thread Armin Rigo
Hi, On Sun, Dec 2, 2012 at 4:09 PM, Joe Hillenbrand joehil...@gmail.com wrote: (...) response=response, request=request, spider=spider) (...) return receiver(*arguments, **named) exceptions.TypeError: response_received() got 4 unexpected keyword arguments No real clue,

Re: [pypy-dev] Javascript interpreter and r_uint

2012-12-06 Thread Armin Rigo
Hi, On Thu, Dec 6, 2012 at 1:01 PM, Maciej Fijalkowski fij...@gmail.com wrote: The problem, *right now* is that it's a proof of concept that requires some work to be finished and/or to use JIT and be fast. I won't do it, also because I have other Open Source commitments at hand. Same here.

Re: [pypy-dev] pypy services hosting / action needed!

2012-12-06 Thread Armin Rigo
Hi, On Thu, Dec 6, 2012 at 5:30 PM, Maciej Fijalkowski fij...@gmail.com wrote: So let's wait for a group decision. Right now, we have extra servers sitting around not doing much. I'm for moving all three services there. Fijal and me have access, and I'm sure anyone else that needs it would

Re: [pypy-dev] Raymond's proposed new dict layout

2012-12-12 Thread Armin Rigo
Hi Carl Friedrich, On Wed, Dec 12, 2012 at 2:03 PM, Carl Friedrich Bolz cfb...@gmx.de wrote: I've been wondering whether the recipe that Raymond Hettinger posted would also solve PyPy's performance problems with making huge dictionaries: Yes, we've been wondering the same thing on IRC :-)

Re: [pypy-dev] CFFI speed results

2012-12-15 Thread Armin Rigo
Hi, On Sat, Dec 15, 2012 at 7:51 AM, Maciej Fijalkowski fij...@gmail.com wrote: And ASPW does the same right? I understand the general need for UTF8, I just didn't find it in this particular query. Fwiw, I wonder again if we couldn't have all our unicode strings internally be UTF8 instead of

Re: [pypy-dev] CFFI speed results

2012-12-15 Thread Armin Rigo
Hi, On Sat, Dec 15, 2012 at 12:00 PM, Maciej Fijalkowski fij...@gmail.com wrote: Some sort of string strategies? like we know it's ascii or so as well? Something like that, but that strategy would be the only one needed. We don't need ascii-only nor two-bytes-only strategies (nor, of course,

Re: [pypy-dev] CFFI speed results

2012-12-15 Thread Armin Rigo
Hi Bengt, On Sat, Dec 15, 2012 at 12:14 PM, Bengt Richter b...@oz.net wrote: I wonder whether something could be gained by having an alternative internal unicode representation in the form of latin1 8-bit byte strings. This has been already implemented in CPython 3.x, based on earlier

Re: [pypy-dev] Scrapy fails in PyPy

2012-12-17 Thread Armin Rigo
Hi Maciej, On Mon, Dec 17, 2012 at 3:46 PM, Maciej Fijalkowski fij...@gmail.com wrote: If you have a dictionary, then the pypy object does not keep the cpy object alive (or the dictionary keeps both of them alive or some other stuff). Obviouly it should be a dictionary with weak keys. The

Re: [pypy-dev] I have a question...

2012-12-21 Thread Armin Rigo
Hi all, On Fri, Dec 21, 2012 at 8:10 AM, Matti Picus matti.pi...@gmail.com wrote: Could someone with superpowers please replace the package at https://bitbucket.org/pypy/pypy/downloads/pypy-2.0-beta1-win32.zip and fix the md5 checksum at http://www.pypy.org/download.html ? Done. Thanks for

Re: [pypy-dev] a question about pypy-sandbox

2012-12-21 Thread Armin Rigo
Hi Zhoucan. On Fri, Dec 21, 2012 at 8:15 AM, 周灿 zhoucan1...@gmail.com wrote: But i feel puzzled pypy sandbox is not compatible with all the standard libs(such as threading), since pypy does not allow interperter to load native C modules. There is some confusion here. The regular PyPy (no

<    1   2   3   4   5   6   7   8   9   10   >