Re: [Numpy-discussion] Using numpy on hadoop streaming: ImportError: cannot import name multiarray

2015-02-10 Thread Kartik Kumar Perisetla
Thanks David. But do I need to install virtualenv on every node in hadoop cluster? Actually I am not very sure whether same namenodes are assigned for my every hadoop job. So how shall I proceed on such scenario. Thanks for your inputs. Kartik On Feb 11, 2015 1:56 AM, "Daπid" wrote: > On 11 Febr

Re: [Numpy-discussion] Using numpy on hadoop streaming: ImportError: cannot import name multiarray

2015-02-10 Thread Daπid
On 11 February 2015 at 03:38, Kartik Kumar Perisetla wrote: > Also, I don't have root access thus, can't install numpy or any other > package on cluster You can create a virtualenv, and install packages on it without needing root access. To minimize trouble, you can ensure it uses the system pack

Re: [Numpy-discussion] Silent Broadcasting considered harmful

2015-02-10 Thread Sturla Molden
Chris Barker wrote: > Well, splitting it off is a good idea, seeing as how it hasn't gotten much > love. But if the rest of numpy does not work well with it, then it becomes > even less useful. PEP 3118 takes care of that. Sturla ___ NumPy-Discussi

[Numpy-discussion] Using numpy on hadoop streaming: ImportError: cannot import name multiarray

2015-02-10 Thread Kartik Kumar Perisetla
Hi all, for one of my projects I am using basically using NLTK for pos tagging, which internally uses a 'english.pickle' file. I managed to package the nltk library with these pickle files to make them available to mapper and reducer for hadoop streaming job using -file option. However, when nltk

[Numpy-discussion] Matrix Class

2015-02-10 Thread cjw
It seems to be agreed that there are weaknesses in the existing Numpy Matrix Class. Some problems are illustrated below. I'll try to put some suggestions over the coming weeks and would appreciate comments. Colin W. Test Script: if __name__ == '__main__': a= mat([4, 5, 6])

Re: [Numpy-discussion] Aligned / configurable memory allocation

2015-02-10 Thread Julian Taylor
On 10.02.2015 22:33, Nathaniel Smith wrote: > On 10 Feb 2015 13:10, "Antoine Pitrou" > wrote: >> >> On Tue, 10 Feb 2015 11:26:22 -0800 >> Nathaniel Smith mailto:n...@pobox.com>> wrote: >> > On 10 Feb 2015 09:11, "Antoine Pitrou" > wrote: >>

Re: [Numpy-discussion] Aligned / configurable memory allocation

2015-02-10 Thread Nathaniel Smith
On 10 Feb 2015 13:10, "Antoine Pitrou" wrote: > > On Tue, 10 Feb 2015 11:26:22 -0800 > Nathaniel Smith wrote: > > On 10 Feb 2015 09:11, "Antoine Pitrou" wrote: > > > > > > > > > Hello, > > > > > > I apologize for pinging the list, but I was wondering if there was > > > interest in either of http

Re: [Numpy-discussion] Aligned / configurable memory allocation

2015-02-10 Thread Antoine Pitrou
On Tue, 10 Feb 2015 11:26:22 -0800 Nathaniel Smith wrote: > On 10 Feb 2015 09:11, "Antoine Pitrou" wrote: > > > > > > Hello, > > > > I apologize for pinging the list, but I was wondering if there was > > interest in either of https://github.com/numpy/numpy/pull/5457 (make > > array data aligned b

[Numpy-discussion] How to debugging python crash in ipython notebook

2015-02-10 Thread Åsmund Hjulstad
Hello all, I am struggling with a python crash of an ipython notebook (kernel) that I do not know how to debug. If I run this: (valgt is a pandas dataframe with 354 lines and 14 numerical columns) sns.pairplot(valgt) plt.savefig('parvis.png', dpi=600) in the same cell, the kernel consistently

Re: [Numpy-discussion] Silent Broadcasting considered harmful

2015-02-10 Thread Ralf Gommers
On Tue, Feb 10, 2015 at 5:40 PM, Chris Barker wrote: > > On Tue, Feb 10, 2015 at 12:28 AM, Todd wrote: > >> >> So maybe the better way would be not to add warnings to braodcasting >> operations, >> >> but to overhaul the matrix class >> >> to make it more attractive for numerical linear algebra(

Re: [Numpy-discussion] Aligned / configurable memory allocation

2015-02-10 Thread Nathaniel Smith
On 10 Feb 2015 09:11, "Antoine Pitrou" wrote: > > > Hello, > > I apologize for pinging the list, but I was wondering if there was > interest in either of https://github.com/numpy/numpy/pull/5457 (make > array data aligned by default) or > https://github.com/numpy/numpy/pull/5470 (make the array da

[Numpy-discussion] Aligned / configurable memory allocation

2015-02-10 Thread Antoine Pitrou
Hello, I apologize for pinging the list, but I was wondering if there was interest in either of https://github.com/numpy/numpy/pull/5457 (make array data aligned by default) or https://github.com/numpy/numpy/pull/5470 (make the array data allocator configurable)? Regards Antoine.

Re: [Numpy-discussion] Silent Broadcasting considered harmful

2015-02-10 Thread Chris Barker
On Tue, Feb 10, 2015 at 12:28 AM, Todd wrote: > >> So maybe the better way would be not to add warnings to braodcasting > operations, > >> but to overhaul the matrix class > >> to make it more attractive for numerical linear algebra(?) > > What about splitting it off into a scikit, or at least

Re: [Numpy-discussion] Silent Broadcasting considered harmful

2015-02-10 Thread Todd
On Feb 10, 2015 1:03 AM, "cjw" wrote: > > > On 09-Feb-15 2:34 AM, Stefan Reiterer wrote: >> >> Ok that are indeed some good reasons to keep the status quo, especially since >> performance is crucial for numpy. >> It's a dillemma: Using the matrix class for linear algebra would be the correct >> wa

Re: [Numpy-discussion] Silent Broadcasting considered harmful

2015-02-10 Thread Sturla Molden
Chris Barker wrote: > The strongest use-case seems to be > for teaching that involves linear algebra concepts, not real production > code. Not really. SymPy is a better teaching tool. Some find A*B easier to read than dot(A,B). But with the @ operator in Python 3.5 it does not have a usecase a