[jira] [Commented] (ARROW-1346) [Python] pypi packages compatible with setuptools

2017-08-10 Thread Wes McKinney (JIRA)

[ 
https://issues.apache.org/jira/browse/ARROW-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121835#comment-16121835
 ] 

Wes McKinney commented on ARROW-1346:
-

Yeah, I agree that the state of Python packaging continues to be very sad. 26 
years into the Python programming language I'm not optimistic that things will 
get much better

> [Python] pypi packages compatible with setuptools
> -
>
> Key: ARROW-1346
> URL: https://issues.apache.org/jira/browse/ARROW-1346
> Project: Apache Arrow
>  Issue Type: Wish
>  Components: Python
>Affects Versions: 0.5.0
>Reporter: Antony Mayi
> Attachments: setup.py
>
>
> setuptools is internally using easy_install for pulling packages from pypi. 
> easy_install doesn't support wheel so since pyarrow is in pypi distributed 
> only as wheels it is not possible to package a product depending on pyarrow 
> using setuptools.
> see attached [^setup.py]:
> {code}
> $ python setup.py test
> running test
> Searching for pyarrow==0.5.0.post2
> Reading https://pypi.python.org/simple/pyarrow/
> No local packages or working download links found for pyarrow==0.5.0.post2
> error: Could not find suitable distribution for 
> Requirement.parse('pyarrow==0.5.0.post2')
> {code}
> It's a shame setuptools don't support wheels. unfortunately it supports only 
> eggs or raw source packages (see 
> [distro_for_location|https://github.com/pypa/setuptools/blob/master/setuptools/package_index.py#L112]).
>  I am not suggesting providing eggs but perhaps publishing raw tar.gz should 
> be considered so that setuptools can at least build the dependency itself.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (ARROW-1346) [Python] pypi packages compatible with setuptools

2017-08-10 Thread Antony Mayi (JIRA)

[ 
https://issues.apache.org/jira/browse/ARROW-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121829#comment-16121829
 ] 

Antony Mayi commented on ARROW-1346:


Right, that's why said I am not suggesting to publish eggs. No probs. It's just 
odd that setuptools is still the main python packaging concept that can nicely 
define dependencies ([even in pyarrow 
iself|https://github.com/apache/arrow/blob/master/python/setup.py#L371]) and is 
unable to deploy such packages itself (in case of wheel deps) but needs another 
tools to resolve its dependencies. But I understand this is not a problem of 
arrow...


> [Python] pypi packages compatible with setuptools
> -
>
> Key: ARROW-1346
> URL: https://issues.apache.org/jira/browse/ARROW-1346
> Project: Apache Arrow
>  Issue Type: Wish
>  Components: Python
>Affects Versions: 0.5.0
>Reporter: Antony Mayi
> Attachments: setup.py
>
>
> setuptools is internally using easy_install for pulling packages from pypi. 
> easy_install doesn't support wheel so since pyarrow is in pypi distributed 
> only as wheels it is not possible to package a product depending on pyarrow 
> using setuptools.
> see attached [^setup.py]:
> {code}
> $ python setup.py test
> running test
> Searching for pyarrow==0.5.0.post2
> Reading https://pypi.python.org/simple/pyarrow/
> No local packages or working download links found for pyarrow==0.5.0.post2
> error: Could not find suitable distribution for 
> Requirement.parse('pyarrow==0.5.0.post2')
> {code}
> It's a shame setuptools don't support wheels. unfortunately it supports only 
> eggs or raw source packages (see 
> [distro_for_location|https://github.com/pypa/setuptools/blob/master/setuptools/package_index.py#L112]).
>  I am not suggesting providing eggs but perhaps publishing raw tar.gz should 
> be considered so that setuptools can at least build the dependency itself.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (ARROW-1346) [Python] pypi packages compatible with setuptools

2017-08-10 Thread Wes McKinney (JIRA)

[ 
https://issues.apache.org/jira/browse/ARROW-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121746#comment-16121746
 ] 

Wes McKinney commented on ARROW-1346:
-

My understanding is that installing packages via {{setup.py}} (i.e. 
easy_install) is effectively deprecated, and so it's unlikely we'll support it 
here. See associated discussion in the TensorFlow issue tracker 
https://github.com/tensorflow/tensorflow/issues/6540 ("Building and 
distributing an egg file is not planned for tensorflow, as it is the old 
deprecated standard. I will close this issue now.") . I would recommend 
changing your software deployment process to use pip and requirements.txt. You 
can also use conda to achieve the same result. 

> [Python] pypi packages compatible with setuptools
> -
>
> Key: ARROW-1346
> URL: https://issues.apache.org/jira/browse/ARROW-1346
> Project: Apache Arrow
>  Issue Type: Wish
>  Components: Python
>Affects Versions: 0.5.0
>Reporter: Antony Mayi
> Attachments: setup.py
>
>
> setuptools is internally using easy_install for pulling packages from pypi. 
> easy_install doesn't support wheel so since pyarrow is in pypi distributed 
> only as wheels it is not possible to package a product depending on pyarrow 
> using setuptools.
> see attached [^setup.py]:
> {code}
> $ python setup.py test
> running test
> Searching for pyarrow==0.5.0.post2
> Reading https://pypi.python.org/simple/pyarrow/
> No local packages or working download links found for pyarrow==0.5.0.post2
> error: Could not find suitable distribution for 
> Requirement.parse('pyarrow==0.5.0.post2')
> {code}
> It's a shame setuptools don't support wheels. unfortunately it supports only 
> eggs or raw source packages (see 
> [distro_for_location|https://github.com/pypa/setuptools/blob/master/setuptools/package_index.py#L112]).
>  I am not suggesting providing eggs but perhaps publishing raw tar.gz should 
> be considered so that setuptools can at least build the dependency itself.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (ARROW-1346) [Python] pypi packages compatible with setuptools

2017-08-10 Thread Antony Mayi (JIRA)

[ 
https://issues.apache.org/jira/browse/ARROW-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121684#comment-16121684
 ] 

Antony Mayi commented on ARROW-1346:


I am on linux.

Yes, pip works fine, but setuptools is not using pip. Any version of setuptools 
(I am on the latest 36.2.7).

The attached [^setup.py] demonstrates the problem - ie if I am trying to 
distribute my python project that depends on pyarrow as per the [^setup.py] it 
won't pull pyarrow out of the box (running the typical {{python setup.py 
install}} fails as per the error shown above due to the setuptools inability to 
pull wheels from pypi).

> [Python] pypi packages compatible with setuptools
> -
>
> Key: ARROW-1346
> URL: https://issues.apache.org/jira/browse/ARROW-1346
> Project: Apache Arrow
>  Issue Type: Wish
>  Components: Python
>Affects Versions: 0.5.0
>Reporter: Antony Mayi
> Attachments: setup.py
>
>
> setuptools is internally using easy_install for pulling packages from pypi. 
> easy_install doesn't support wheel so since pyarrow is in pypi distributed 
> only as wheels it is not possible to package a product depending on pyarrow 
> using setuptools.
> see attached [^setup.py]:
> {code}
> $ python setup.py test
> running test
> Searching for pyarrow==0.5.0.post2
> Reading https://pypi.python.org/simple/pyarrow/
> No local packages or working download links found for pyarrow==0.5.0.post2
> error: Could not find suitable distribution for 
> Requirement.parse('pyarrow==0.5.0.post2')
> {code}
> It's a shame setuptools don't support wheels. unfortunately it supports only 
> eggs or raw source packages (see 
> [distro_for_location|https://github.com/pypa/setuptools/blob/master/setuptools/package_index.py#L112]).
>  I am not suggesting providing eggs but perhaps publishing raw tar.gz should 
> be considered so that setuptools can at least build the dependency itself.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)