[jira] [Commented] (AIRFLOW-2524) Airflow integration with AWS Sagemaker

2018-08-12 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577696#comment-16577696 ] ASF subversion and git services commented on AIRFLOW-2524: -- Commit

[GitHub] Fokko closed pull request #3658: [AIRFLOW-2524] Add Amazon SageMaker Training

2018-08-12 Thread GitBox
Fokko closed pull request #3658: [AIRFLOW-2524] Add Amazon SageMaker Training URL: https://github.com/apache/incubator-airflow/pull/3658 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is

[jira] [Commented] (AIRFLOW-2524) Airflow integration with AWS Sagemaker

2018-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577695#comment-16577695 ] ASF GitHub Bot commented on AIRFLOW-2524: - Fokko closed pull request #3658: [AIRFLOW-2524] Add

[GitHub] Fokko commented on issue #3658: [AIRFLOW-2524] Add Amazon SageMaker Training

2018-08-12 Thread GitBox
Fokko commented on issue #3658: [AIRFLOW-2524] Add Amazon SageMaker Training URL: https://github.com/apache/incubator-airflow/pull/3658#issuecomment-412360645 Thanks @troychen728. Looks good, thanks for the PR. Merging to master!

[GitHub] Fokko commented on a change in pull request #3560: [AIRFLOW-2697] Drop snakebite in favour of hdfs3

2018-08-12 Thread GitBox
Fokko commented on a change in pull request #3560: [AIRFLOW-2697] Drop snakebite in favour of hdfs3 URL: https://github.com/apache/incubator-airflow/pull/3560#discussion_r209463470 ## File path: airflow/sensors/hdfs_sensor.py ## @@ -17,103 +17,231 @@ # specific language

[GitHub] Fokko commented on a change in pull request #3560: [AIRFLOW-2697] Drop snakebite in favour of hdfs3

2018-08-12 Thread GitBox
Fokko commented on a change in pull request #3560: [AIRFLOW-2697] Drop snakebite in favour of hdfs3 URL: https://github.com/apache/incubator-airflow/pull/3560#discussion_r209463485 ## File path: tests/contrib/sensors/test_hdfs_sensor.py ## @@ -7,247 +7,199 @@ # to you

[GitHub] Fokko commented on a change in pull request #3560: [AIRFLOW-2697] Drop snakebite in favour of hdfs3

2018-08-12 Thread GitBox
Fokko commented on a change in pull request #3560: [AIRFLOW-2697] Drop snakebite in favour of hdfs3 URL: https://github.com/apache/incubator-airflow/pull/3560#discussion_r209463504 ## File path: tests/sensors/test_hdfs_sensor.py ## @@ -7,85 +7,368 @@ # to you under the

[GitHub] Fokko commented on a change in pull request #3703: [AIRFLOW-2857] Fix broken RTD env

2018-08-12 Thread GitBox
Fokko commented on a change in pull request #3703: [AIRFLOW-2857] Fix broken RTD env URL: https://github.com/apache/incubator-airflow/pull/3703#discussion_r209463769 ## File path: setup.py ## @@ -161,6 +164,7 @@ def write_version(filename=os.path.join(*['airflow',

[GitHub] anne-chu opened a new pull request #3742: [AIRFLOW-2892] Add CC, BCC for SLA/Retry/Failure Emailing

2018-08-12 Thread GitBox
anne-chu opened a new pull request #3742: [AIRFLOW-2892] Add CC,BCC for SLA/Retry/Failure Emailing URL: https://github.com/apache/incubator-airflow/pull/3742 ### Jira - [x] My PR addresses the following [Airflow Jira](https://issues.apache.org/jira/browse/AIRFLOW/) issues and

[jira] [Created] (AIRFLOW-2892) Add CC for SLA/Retry/Failure Email Notification

2018-08-12 Thread Anne (JIRA)
Anne created AIRFLOW-2892: - Summary: Add CC for SLA/Retry/Failure Email Notification Key: AIRFLOW-2892 URL: https://issues.apache.org/jira/browse/AIRFLOW-2892 Project: Apache Airflow Issue Type:

[GitHub] Fokko commented on a change in pull request #3741: [AIRFLOW-1368] Add auto_remove for DockerOperator

2018-08-12 Thread GitBox
Fokko commented on a change in pull request #3741: [AIRFLOW-1368] Add auto_remove for DockerOperator URL: https://github.com/apache/incubator-airflow/pull/3741#discussion_r209462359 ## File path: airflow/operators/docker_operator.py ## @@ -115,6 +117,7 @@ def __init__(

[GitHub] Fokko commented on issue #3475: [AIRFLOW-2315] Improve S3Hook

2018-08-12 Thread GitBox
Fokko commented on issue #3475: [AIRFLOW-2315] Improve S3Hook URL: https://github.com/apache/incubator-airflow/pull/3475#issuecomment-412361667 @jbacon can you also squash your commits? Thanks! This is an automated message

[GitHub] Fokko commented on a change in pull request #3475: [AIRFLOW-2315] Improve S3Hook

2018-08-12 Thread GitBox
Fokko commented on a change in pull request #3475: [AIRFLOW-2315] Improve S3Hook URL: https://github.com/apache/incubator-airflow/pull/3475#discussion_r209463662 ## File path: airflow/hooks/S3_hook.py ## @@ -275,7 +275,8 @@ def load_file(self, key,

[jira] [Commented] (AIRFLOW-1368) Automatically remove the container when it exits

2018-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577586#comment-16577586 ] ASF GitHub Bot commented on AIRFLOW-1368: - Wouter-M opened a new pull request #3741:

[GitHub] Wouter-M opened a new pull request #3741: [AIRFLOW-1368] Add auto_remove for DockerOperator

2018-08-12 Thread GitBox
Wouter-M opened a new pull request #3741: [AIRFLOW-1368] Add auto_remove for DockerOperator URL: https://github.com/apache/incubator-airflow/pull/3741 Dear Airflow maintainers, Please take this PR into consideration. It adds the ability for containers created by the

[GitHub] Fokko commented on issue #3738: [AIRFLOW-2886] Secure Flask SECRET_KEY

2018-08-12 Thread GitBox
Fokko commented on issue #3738: [AIRFLOW-2886] Secure Flask SECRET_KEY URL: https://github.com/apache/incubator-airflow/pull/3738#issuecomment-412359813 Are people using clusters of webservers? I've never seen such a setup to be honest.

[jira] [Resolved] (AIRFLOW-2524) Airflow integration with AWS Sagemaker

2018-08-12 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved AIRFLOW-2524. --- Resolution: Fixed Fix Version/s: 2.0.0 > Airflow integration with AWS

[jira] [Commented] (AIRFLOW-2799) Filtering UI objects by datetime is broken

2018-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577794#comment-16577794 ] ASF GitHub Bot commented on AIRFLOW-2799: - kevcampb opened a new pull request #3743:

[GitHub] caddac edited a comment on issue #3684: [AIRFLOW-2840] - add update connections cli option

2018-08-12 Thread GitBox
caddac edited a comment on issue #3684: [AIRFLOW-2840] - add update connections cli option URL: https://github.com/apache/incubator-airflow/pull/3684#issuecomment-412351673 @ashb @bolkedebruin I've been working on refactoring the connection api and wanted to run the implementation by

[GitHub] XD-DENG commented on issue #3738: [AIRFLOW-2886] Secure Flask SECRET_KEY

2018-08-12 Thread GitBox
XD-DENG commented on issue #3738: [AIRFLOW-2886] Secure Flask SECRET_KEY URL: https://github.com/apache/incubator-airflow/pull/3738#issuecomment-412386245 @Fokko @feng-tao : If users are running a cluster for `webservers`, we can leave it to users to ensure configuration settings being

[jira] [Created] (AIRFLOW-2894) Allow Users to "bake-in" DAGs in Airflow images

2018-08-12 Thread Daniel Imberman (JIRA)
Daniel Imberman created AIRFLOW-2894: Summary: Allow Users to "bake-in" DAGs in Airflow images Key: AIRFLOW-2894 URL: https://issues.apache.org/jira/browse/AIRFLOW-2894 Project: Apache Airflow

[jira] [Created] (AIRFLOW-2893) Stuck dataflow job due to jobName mismatch.

2018-08-12 Thread Feng Lu (JIRA)
Feng Lu created AIRFLOW-2893: Summary: Stuck dataflow job due to jobName mismatch. Key: AIRFLOW-2893 URL: https://issues.apache.org/jira/browse/AIRFLOW-2893 Project: Apache Airflow Issue Type:

[GitHub] bolkedebruin commented on issue #3740: [AIRFLOW-2888] Remove shell=True and bash from task launch

2018-08-12 Thread GitBox
bolkedebruin commented on issue #3740: [AIRFLOW-2888] Remove shell=True and bash from task launch URL: https://github.com/apache/incubator-airflow/pull/3740#issuecomment-412364062 @Fokko backwards compatibility isn’t really required I think. I haven’t heard about executors in the wild. A

[jira] [Updated] (AIRFLOW-2891) Option to set container_name for DockerOperator

2018-08-12 Thread Wouter Menninga (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wouter Menninga updated AIRFLOW-2891: - Description: It would be nice if the name of a Docker container created using the

[jira] [Created] (AIRFLOW-2891) Option to set container_name for DockerOperator

2018-08-12 Thread Wouter Menninga (JIRA)
Wouter Menninga created AIRFLOW-2891: Summary: Option to set container_name for DockerOperator Key: AIRFLOW-2891 URL: https://issues.apache.org/jira/browse/AIRFLOW-2891 Project: Apache Airflow

[GitHub] caddac commented on issue #3684: [AIRFLOW-2840] - add update connections cli option

2018-08-12 Thread GitBox
caddac commented on issue #3684: [AIRFLOW-2840] - add update connections cli option URL: https://github.com/apache/incubator-airflow/pull/3684#issuecomment-412351673 @ashb I've been working on refactoring the connection api and wanted to run the implementation by you before going too

[GitHub] Fokko commented on a change in pull request #3740: [AIRFLOW-2888] Remove shell=True and bash from task launch

2018-08-12 Thread GitBox
Fokko commented on a change in pull request #3740: [AIRFLOW-2888] Remove shell=True and bash from task launch URL: https://github.com/apache/incubator-airflow/pull/3740#discussion_r209462759 ## File path: airflow/task/task_runner/base_task_runner.py ## @@ -106,7 +106,7 @@

[GitHub] linevahe commented on issue #2955: [AIRFLOW-1966] fix PasswordUser.password setter

2018-08-12 Thread GitBox
linevahe commented on issue #2955: [AIRFLOW-1966] fix PasswordUser.password setter URL: https://github.com/apache/incubator-airflow/pull/2955#issuecomment-412324297 @eschwartz Hello, I have the same problem as you. Could you tell me how you solved it

[GitHub] ron819 commented on issue #3702: [AIRFLOW-81] Add ScheduleBlackoutSensor

2018-08-12 Thread GitBox
ron819 commented on issue #3702: [AIRFLOW-81] Add ScheduleBlackoutSensor URL: https://github.com/apache/incubator-airflow/pull/3702#issuecomment-412326321 I must say that it would be nice if there will be a way that the "blackout" won't be Airflow wide.. For example if it would be

[jira] [Closed] (AIRFLOW-2870) Migrations fail when upgrading from below cc1e65623dc7_add_max_tries_column_to_task_instance

2018-08-12 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin closed AIRFLOW-2870. --- Resolution: Fixed Fix Version/s: 1.10.0 > Migrations fail when upgrading from below