Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-28 Thread Frédéric Bastien
Hi, Up to now, I didn't post frequently to this mailing list. So I present myself a little bit. I'm Frédéric Bastien, one of Theano senior developer. I'm not a student nor a professor, but a staff of our lab. So I more time for Theano then most people in our lab, but I have other work too. From

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-25 Thread Mic
How about: * http://www.hotpy.org/ * http://pypy.org/numpydonate.html On Wed, Mar 21, 2012 at 11:14 PM, mark florisson markflorisso...@gmail.comwrote: On 20 March 2012 20:49, Olivier Delalleau sh...@keba.be wrote: I doubt Theano is already as smart as you'd want it to be right now, however

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-25 Thread Dag Sverre Seljebotn
On 03/25/2012 08:44 PM, Mic wrote: How about: * http://www.hotpy.org/ The front page says a 10x speedup. That's a bit short of the almost 1000x speedup required for numerical code (that is, for some examples Python is thousands of times slower than C or Fortran). Well -- I'm sure hotpy could

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-21 Thread mark florisson
On 21 March 2012 05:20, Dag Sverre Seljebotn d.s.seljeb...@astro.uio.no wrote: On 03/20/2012 12:56 PM, Francesc Alted wrote: On Mar 20, 2012, at 2:29 PM, Dag Sverre Seljebotn wrote: Francesc Altedfranc...@continuum.io  wrote: On Mar 20, 2012, at 12:49 PM, mark florisson wrote: Cython and

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-21 Thread mark florisson
On 20 March 2012 20:49, Olivier Delalleau sh...@keba.be wrote: I doubt Theano is already as smart as you'd want it to be right now, however the core mechanisms are there to perform graph optimizations and move computations to GPU. It may save time to start from there instead of starting all

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-20 Thread mark florisson
On 13 March 2012 18:18, Travis Oliphant tra...@continuum.io wrote: (Mark F., how does the above match how you feel about this?) I would like collaboration, but from a technical perspective I think this would be much more involved than just dumping the AST to an IR and generating some code

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-20 Thread Olivier Delalleau
This sounds a lot like Theano, did you look into it? -=- Olivier Le 20 mars 2012 13:49, mark florisson markflorisso...@gmail.com a écrit : On 13 March 2012 18:18, Travis Oliphant tra...@continuum.io wrote: (Mark F., how does the above match how you feel about this?) I would like

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-20 Thread Francesc Alted
On Mar 20, 2012, at 12:49 PM, mark florisson wrote: Cython and Numba certainly overlap. However, Cython requires: 1) learning another language 2) creating an extension module --- loading bit-code files and dynamically executing (even on a different machine from the one that

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-20 Thread Dag Sverre Seljebotn
We talked some about Theano. There are some differences in project goals which means that it makes sense to make this a seperate project: Cython wants to use this to generate C code up front from the Cython AST at compilation time; numba also has a different frontend (parsing of python

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-20 Thread Dag Sverre Seljebotn
Sorry, forgot to CC list on this. Lines staring with single greater-than are mine. -- Sent from my Android phone with K-9 Mail. Please excuse my brevity. Dag Sverre Seljebotn d.s.seljeb...@astro.uio.no wrote: Francesc Alted franc...@continuum.io wrote: On Mar 20, 2012, at 12:49 PM, mark

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-20 Thread Olivier Delalleau
I doubt Theano is already as smart as you'd want it to be right now, however the core mechanisms are there to perform graph optimizations and move computations to GPU. It may save time to start from there instead of starting all over from scratch. I'm not sure though, but it looks like it would be

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-20 Thread Francesc Alted
On Mar 20, 2012, at 2:29 PM, Dag Sverre Seljebotn wrote: Francesc Alted franc...@continuum.io wrote: On Mar 20, 2012, at 12:49 PM, mark florisson wrote: Cython and Numba certainly overlap. However, Cython requires: 1) learning another language 2) creating an extension module

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-20 Thread Dag Sverre Seljebotn
On 03/20/2012 12:56 PM, Francesc Alted wrote: On Mar 20, 2012, at 2:29 PM, Dag Sverre Seljebotn wrote: Francesc Altedfranc...@continuum.io wrote: On Mar 20, 2012, at 12:49 PM, mark florisson wrote: Cython and Numba certainly overlap. However, Cython requires: 1) learning another

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-20 Thread Dag Sverre Seljebotn
On 03/20/2012 09:20 PM, Dag Sverre Seljebotn wrote: On 03/20/2012 12:56 PM, Francesc Alted wrote: On Mar 20, 2012, at 2:29 PM, Dag Sverre Seljebotn wrote: Francesc Altedfranc...@continuum.io wrote: On Mar 20, 2012, at 12:49 PM, mark florisson wrote: Cython and Numba certainly overlap.

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-13 Thread Travis Oliphant
On Mar 13, 2012, at 12:58 AM, Dag Sverre Seljebotn wrote: On 03/10/2012 10:35 PM, Travis Oliphant wrote: Hey all, I gave a lightning talk this morning on numba which is the start of a Python compiler to machine code through the LLVM tool-chain. It is proof of concept stage only at this

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-13 Thread mark florisson
On 13 March 2012 09:19, Travis Oliphant tra...@continuum.io wrote: On Mar 13, 2012, at 12:58 AM, Dag Sverre Seljebotn wrote: On 03/10/2012 10:35 PM, Travis Oliphant wrote: Hey all, I gave a lightning talk this morning on numba which is the start of a Python compiler to machine code

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-13 Thread Travis Oliphant
(Mark F., how does the above match how you feel about this?) I would like collaboration, but from a technical perspective I think this would be much more involved than just dumping the AST to an IR and generating some code from there. For vector expressions I think sharing code would be

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-13 Thread Nathaniel Smith
On Tue, Mar 13, 2012 at 5:18 PM, Travis Oliphant tra...@continuum.io wrote: Cython and Numba certainly overlap.  However, Cython requires:        1) learning another language So is the goal for numba to actually handle arbitrary Python code with correct semantics, i.e., it's actually a

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-13 Thread Ilan Schnell
As far as I understand, the goal is not to handle arbitrary Python code, because this would become too difficult as is not necessary when you have a simple math oriented function which you want to speed up. The idea is to create something similar to http://www.enthought.com/~ischnell/paper.html

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-12 Thread Till Stensitzki
Doesent Theano does the same, only via GCC compilation? ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-12 Thread Olivier Delalleau
One major difference is that Theano doesn't attempt to parse existing Python (byte)code: you need to explicitly code with the Theano syntax (which tries to be close to Numpy, but can end up looking quite different, especially if you want to control the program flow with loops and ifs for

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-12 Thread Pierre Haessig
Hi, Le 12/03/2012 00:21, Sturla Molden a écrit : It could also put Python/Numba high up on the Debian shootout ;-) Can you tell a bit more about it ? (I just didn't understand the whole sentence in fact ;-) ) Thanks ! -- Pierre signature.asc Description: OpenPGP digital signature

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-12 Thread Dag Sverre Seljebotn
On 03/10/2012 10:35 PM, Travis Oliphant wrote: Hey all, I gave a lightning talk this morning on numba which is the start of a Python compiler to machine code through the LLVM tool-chain. It is proof of concept stage only at this point (use it only if you are interested in helping develop the

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-11 Thread xavier.gn...@gmail.com
It says : Numba is a NumPy aware optimizing compiler for Python. It uses the remarkable LLVM compiler infrastructure to compile Python byte-code to machine code especially for use in the NumPy run-time and SciPy modules.* * If this description is correct, Numba is an additional pass once the

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-11 Thread Pauli Virtanen
11.03.2012 15:12, xavier.gn...@gmail.com kirjoitti: [clip] If this description is correct, Numba is an additional pass once the cpython bytecode has be produced by cpython. Is it correct?? Is python bytecote a good intermediate representation to perform numpy related optimization? One

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-11 Thread xavier.gn...@gmail.com
On 03/11/2012 03:52 PM, Pauli Virtanen wrote: 11.03.2012 15:12, xavier.gn...@gmail.com kirjoitti: [clip] If this description is correct, Numba is an additional pass once the cpython bytecode has be produced by cpython. Is it correct?? Is python bytecote a good intermediate representation to

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-11 Thread Sturla Molden
Den 11. mars 2012 kl. 15:52 skrev Pauli Virtanen p...@iki.fi: To get speed gains, you need to optimize not only the bytecode interpreter side, but also the object space --- Python classes, strings and all that. Keeping in mind Python's dynamism, there are potential side effects everywhere.

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-11 Thread Travis Oliphant
On Mar 11, 2012, at 1:59 AM, Mic wrote: what is the difference to http://www.python.org/dev/peps/pep-3146/ ? To fully expound the difference would take a lot of discussion. But, summarizing: * Numba is not nearly as ambitious as US (Numba will be fine with some user-directed

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-11 Thread Sturla Molden
Den 11.03.2012 15:52, skrev Pauli Virtanen: To get speed gains, you need to optimize not only the bytecode interpreter side, but also the object space --- Python classes, strings and all that. Keeping in mind Python's dynamism, there are potential side effects everywhere. I guess this is

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-11 Thread Sturla Molden
Den 11.03.2012 23:11, skrev Travis Oliphant: * Numba will be much closer to Cython in spirit than Unladen Swallow (or PyPy) --- people who just use Cython for a loop or two will be able to use Numba instead This is perhaps the most important issue for scientific and algorithmic codes.

[Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-10 Thread Travis Oliphant
Hey all, I gave a lightning talk this morning on numba which is the start of a Python compiler to machine code through the LLVM tool-chain. It is proof of concept stage only at this point (use it only if you are interested in helping develop the code at this point). The only thing that

Re: [Numpy-discussion] Looking for people interested in helping with Python compiler to LLVM

2012-03-10 Thread Mic
what is the difference to http://www.python.org/dev/peps/pep-3146/ ? On Sun, Mar 11, 2012 at 4:35 PM, Travis Oliphant teoliph...@gmail.comwrote: Hey all, I gave a lightning talk this morning on numba which is the start of a Python compiler to machine code through the LLVM tool-chain. It is