[Numpy-discussion] Using numpy on hadoop streaming: ImportError: cannot import name multiarray

2015-02-10 Thread Kartik Kumar Perisetla
Hi all, for one of my projects I am using basically using NLTK for pos tagging, which internally uses a 'english.pickle' file. I managed to package the nltk library with these pickle files to make them available to mapper and reducer for hadoop streaming job using -file option. However, when

[Numpy-discussion] Aligned / configurable memory allocation

2015-02-10 Thread Antoine Pitrou
Hello, I apologize for pinging the list, but I was wondering if there was interest in either of https://github.com/numpy/numpy/pull/5457 (make array data aligned by default) or https://github.com/numpy/numpy/pull/5470 (make the array data allocator configurable)? Regards Antoine.

Re: [Numpy-discussion] Silent Broadcasting considered harmful

2015-02-10 Thread Sturla Molden
Chris Barker chris.bar...@noaa.gov wrote: The strongest use-case seems to be for teaching that involves linear algebra concepts, not real production code. Not really. SymPy is a better teaching tool. Some find A*B easier to read than dot(A,B). But with the @ operator in Python 3.5 it does

Re: [Numpy-discussion] Silent Broadcasting considered harmful

2015-02-10 Thread Todd
On Feb 10, 2015 1:03 AM, cjw c...@ncf.ca wrote: On 09-Feb-15 2:34 AM, Stefan Reiterer wrote: Ok that are indeed some good reasons to keep the status quo, especially since performance is crucial for numpy. It's a dillemma: Using the matrix class for linear algebra would be the correct way

Re: [Numpy-discussion] Aligned / configurable memory allocation

2015-02-10 Thread Nathaniel Smith
On 10 Feb 2015 09:11, Antoine Pitrou solip...@pitrou.net wrote: Hello, I apologize for pinging the list, but I was wondering if there was interest in either of https://github.com/numpy/numpy/pull/5457 (make array data aligned by default) or https://github.com/numpy/numpy/pull/5470 (make

Re: [Numpy-discussion] Aligned / configurable memory allocation

2015-02-10 Thread Nathaniel Smith
On 10 Feb 2015 13:10, Antoine Pitrou solip...@pitrou.net wrote: On Tue, 10 Feb 2015 11:26:22 -0800 Nathaniel Smith n...@pobox.com wrote: On 10 Feb 2015 09:11, Antoine Pitrou solip...@pitrou.net wrote: Hello, I apologize for pinging the list, but I was wondering if there was

Re: [Numpy-discussion] Aligned / configurable memory allocation

2015-02-10 Thread Julian Taylor
On 10.02.2015 22:33, Nathaniel Smith wrote: On 10 Feb 2015 13:10, Antoine Pitrou solip...@pitrou.net mailto:solip...@pitrou.net wrote: On Tue, 10 Feb 2015 11:26:22 -0800 Nathaniel Smith n...@pobox.com mailto:n...@pobox.com wrote: On 10 Feb 2015 09:11, Antoine Pitrou solip...@pitrou.net

Re: [Numpy-discussion] Silent Broadcasting considered harmful

2015-02-10 Thread Ralf Gommers
On Tue, Feb 10, 2015 at 5:40 PM, Chris Barker chris.bar...@noaa.gov wrote: On Tue, Feb 10, 2015 at 12:28 AM, Todd toddr...@gmail.com wrote: So maybe the better way would be not to add warnings to braodcasting operations, but to overhaul the matrix class to make it more attractive for

Re: [Numpy-discussion] Silent Broadcasting considered harmful

2015-02-10 Thread Sturla Molden
Chris Barker chris.bar...@noaa.gov wrote: Well, splitting it off is a good idea, seeing as how it hasn't gotten much love. But if the rest of numpy does not work well with it, then it becomes even less useful. PEP 3118 takes care of that. Sturla

Re: [Numpy-discussion] Using numpy on hadoop streaming: ImportError: cannot import name multiarray

2015-02-10 Thread Kartik Kumar Perisetla
Thanks David. But do I need to install virtualenv on every node in hadoop cluster? Actually I am not very sure whether same namenodes are assigned for my every hadoop job. So how shall I proceed on such scenario. Thanks for your inputs. Kartik On Feb 11, 2015 1:56 AM, Daπid davidmen...@gmail.com

Re: [Numpy-discussion] Using numpy on hadoop streaming: ImportError: cannot import name multiarray

2015-02-10 Thread Daπid
On 11 February 2015 at 03:38, Kartik Kumar Perisetla kartik.p...@gmail.com wrote: Also, I don't have root access thus, can't install numpy or any other package on cluster You can create a virtualenv, and install packages on it without needing root access. To minimize trouble, you can ensure it

[Numpy-discussion] Matrix Class

2015-02-10 Thread cjw
It seems to be agreed that there are weaknesses in the existing Numpy Matrix Class. Some problems are illustrated below. I'll try to put some suggestions over the coming weeks and would appreciate comments. Colin W. Test Script: if __name__ == '__main__': a= mat([4, 5, 6])