mjpieters opened a new issue #11546:
URL: https://github.com/apache/airflow/issues/11546


   **Apache Airflow version**: 2.0.0a1
   
   **Environment**:
   
   - **OS** (e.g. from /etc/os-release): MacOS
   - **Install tools**: pip
   
   **What happened**:
   
   Installing from the 0.0.1a1 release tarballs fails as there is no `setup.py` 
file:
   
   ```bash
   $ pip install 
https://dist.apache.org/repos/dist/dev/airflow/providers/0.0.1a1/apache-airflow-providers-amazon-0.0.1a1-bin.tar.gz
   Looking in links: /.../pip/wheelhouse/
   Collecting 
https://dist.apache.org/repos/dist/dev/airflow/providers/0.0.1a1/apache-airflow-providers-amazon-0.0.1a1-bin.tar.gz
     Using cached 
https://dist.apache.org/repos/dist/dev/airflow/providers/0.0.1a1/apache-airflow-providers-amazon-0.0.1a1-bin.tar.gz
 (167 kB)
       ERROR: Command errored out with exit status 1:
        command: /.../bin/python -c 'import sys, setuptools, tokenize; 
sys.argv[0] = 
'"'"'/private/var/folders/vh/.../T/pip-req-build-vo6wt0kh/setup.py'"'"'; 
__file__='"'"'/private/var/folders/vh/.../T/pip-req-build-vo6wt0kh/setup.py'"'"';f=getattr(tokenize,
 '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', 
'"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info 
--egg-base /private/var/folders/vh/.../T/pip-req-build-vo6wt0kh/pip-egg-info
            cwd: /private/var/folders/vh/.../T/pip-req-build-vo6wt0kh/
       Complete output (5 lines):
       Traceback (most recent call last):
         File "<string>", line 1, in <module>
         File "/.../lib/python3.6/tokenize.py", line 452, in open
           buffer = _builtin_open(filename, 'rb')
       FileNotFoundError: [Errno 2] No such file or directory: 
'/private/var/folders/vh/.../T/pip-req-build-vo6wt0kh/setup.py'
       ----------------------------------------
   ERROR: Command errored out with exit status 1: python setup.py egg_info 
Check the logs for full command output.
   ```
   
   Instead of `setup.py`, there is a `setup_providers_package.py` file:
   
   ```bash
   $ curl -s 
https://dist.apache.org/repos/dist/dev/airflow/providers/0.0.1a1/apache-airflow-providers-amazon-0.0.1a1-bin.tar.gz
 | tar tzv | grep setup
   -rw-r--r--  0 root   root     1456 Oct 14 07:45 
apache-airflow-providers-amazon-0.0.1/setup.cfg
   -rw-r--r--  0 root   root    55159 Oct 14 07:30 
apache-airflow-providers-amazon-0.0.1/setup_provider_packages.py
   ```
   
   If I re-package the tarbal with that file moved to `setup.py` I get a 
different error:
   
   ```bash
   $ tbtemp=$( mktemp -d -t airflow-porviders); pushd $tbtemp
   /var/folders/vh/.../T/airflow-porviders.MwwV87dG ~/oldlocation
   $ curl -s 
https://dist.apache.org/repos/dist/dev/airflow/providers/0.0.1a1/apache-airflow-providers-amazon-0.0.1a1-bin.tar.gz
 | tar xz
   $ mv apache-airflow-providers-amazon-0.0.1/setup_provider_packages.py 
apache-airflow-providers-amazon-0.0.1/setup.py
   $ tar czf apache-airflow-providers-amazon-0.0.1a1-bin.tar.gz 
apache-airflow-providers-amazon-0.0.1/
   $ popd
   ~/oldlocation
   $ pip install $tbtemp/apache-airflow-providers-amazon-0.0.1a1-bin.tar.gz
   Looking in links: /.../pip/wheelhouse/
   Processing 
/var/folders/vh/.../T/airflow-porviders.MwwV87dG/apache-airflow-providers-amazon-0.0.1a1-bin.tar.gz
       ERROR: Command errored out with exit status 1:
        command: /.../bin/python -c 'import sys, setuptools, tokenize; 
sys.argv[0] = 
'"'"'/private/var/folders/vh/.../T/pip-req-build-15bh7ahl/setup.py'"'"'; 
__file__='"'"'/private/var/folders/vh/.../T/pip-req-build-15bh7ahl/setup.py'"'"';f=getattr(tokenize,
 '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', 
'"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info 
--egg-base /private/var/folders/vh/.../T/pip-req-build-15bh7ahl/pip-egg-info
            cwd: /private/var/folders/vh/.../T/pip-req-build-15bh7ahl/
       Complete output (5 lines):
       Traceback (most recent call last):
         File "<string>", line 1, in <module>
         File "/private/var/folders/vh/.../T/pip-req-build-15bh7ahl/setup.py", 
line 37, in <module>
           import semver
       ModuleNotFoundError: No module named 'semver'
       ----------------------------------------
   ERROR: Command errored out with exit status 1: python setup.py egg_info 
Check the logs for full command output.
   ```
   
   This indicates `setup_requires` dependencies have not been specified. 
   
   **Anything else we need to know**:
   
   The provided wheels work fine, so 
`https://dist.apache.org/repos/dist/dev/airflow/providers/0.0.1a1/apache_airflow_providers_amazon-0.0.1a1-py3-none-any.whl`,
 etc. (note the underscores in the filename where the `tgz` used dashes), 
presuably because these have been built by running `setup_provider_packages.py` 
directly with the setup dependencies installed locally.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to