shlomiken commented on issue #10007: URL: https://github.com/apache/airflow/issues/10007#issuecomment-663992896
> Oh. I think I understand. The Sagemaker SDK requires numpy. > https://github.com/aws/sagemaker-python-sdk/blob/master/setup.py#L38 > So I think it is best to create a ticket in that project so that they don't use this dependency. > > You can also isolate this library by installing it in a separate virtual environment. > https://airflow.readthedocs.io/en/1.10.11/_api/airflow/operators/python_operator/index.html?highlight=PythonVirtualenvOperator#airflow.operators.python_operator.PythonVirtualenvOperator The problem is NOT with sagemaker SDK and its dependencies. the problem is that several Sage maker operators (which are part of airflow codebase) require you to install sagemaker SDK. and by that expose you to libraries you don't need or conflict with your deployment. it also make the package very big - where it should be very light. i thought this is the project that the contribution of sagemaker is being done - isn't it ? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
