[jira] [Updated] (AIRFLOW-1070) Task instance run should catch SIGINT as well as SIGTERM

2017-04-04 Thread Andrew Chen (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Chen updated AIRFLOW-1070: - Priority: Trivial (was: Major) > Task instance run should catch SIGINT as well as SIGTERM >

[jira] [Created] (AIRFLOW-1070) Task instance run should catch SIGINT as well as SIGTERM

2017-04-04 Thread Andrew Chen (JIRA)
Andrew Chen created AIRFLOW-1070: Summary: Task instance run should catch SIGINT as well as SIGTERM Key: AIRFLOW-1070 URL: https://issues.apache.org/jira/browse/AIRFLOW-1070 Project: Apache Airflow

[jira] [Closed] (AIRFLOW-1069) Pool slots not obeyed

2017-04-04 Thread Alex Guziel (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alex Guziel closed AIRFLOW-1069. Resolution: Invalid > Pool slots not obeyed > - > > Key:

[jira] [Created] (AIRFLOW-1069) Pool slots not obeyed

2017-04-04 Thread Alex Guziel (JIRA)
Alex Guziel created AIRFLOW-1069: Summary: Pool slots not obeyed Key: AIRFLOW-1069 URL: https://issues.apache.org/jira/browse/AIRFLOW-1069 Project: Apache Airflow Issue Type: Bug

[jira] [Updated] (AIRFLOW-1068) Autocommit error with Airflow v1.7.1.3 and pymssql v2.1.3

2017-04-04 Thread Thomas Christie (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Christie updated AIRFLOW-1068: - Environment: OS: Centos 6 pymssql: 2.1.3 was:OS: Centos 6 Description: After

[jira] [Created] (AIRFLOW-1068) Autocommit error with Airflow v1.7.1.3 and pymssql v2.1.3

2017-04-04 Thread Thomas Christie (JIRA)
Thomas Christie created AIRFLOW-1068: Summary: Autocommit error with Airflow v1.7.1.3 and pymssql v2.1.3 Key: AIRFLOW-1068 URL: https://issues.apache.org/jira/browse/AIRFLOW-1068 Project: Apache

[jira] [Resolved] (AIRFLOW-947) Make PrestoHook surface better messages when the Presto Cluster is unavailable.

2017-04-04 Thread Arthur Wiedmer (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arthur Wiedmer resolved AIRFLOW-947. Resolution: Fixed Fix Version/s: 1.9.0 Issue resolved by pull request #2128

[jira] [Commented] (AIRFLOW-947) Make PrestoHook surface better messages when the Presto Cluster is unavailable.

2017-04-04 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1590#comment-1590 ] ASF subversion and git services commented on AIRFLOW-947: - Commit

[2/2] incubator-airflow git commit: Merge pull request #2128 from artwr/artwr-improve_presto_hook_error_when_cluster_is_unavailable

2017-04-04 Thread arthur
Merge pull request #2128 from artwr/artwr-improve_presto_hook_error_when_cluster_is_unavailable Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/f5462c78 Tree:

[jira] [Commented] (AIRFLOW-1060) dag lost tracking the status of tasks and stuck in running state

2017-04-04 Thread Serhii (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955370#comment-15955370 ] Serhii commented on AIRFLOW-1060: - I have the same issue. It is 100% reproducible on 17.1.2 and 1.7.1.3

incubator-airflow git commit: [AIRFLOW-1067] use example.com in examples

2017-04-04 Thread arthur
Repository: incubator-airflow Updated Branches: refs/heads/master 8fdfb16cc -> 70f1bf10a [AIRFLOW-1067] use example.com in examples We use airf...@airflow.com in examples. However, https://airflow.com is owned by a company named Airflow (selling fans, etc). We should use airf...@example.com

[jira] [Commented] (AIRFLOW-1067) Should not use airf...@airflow.com in examples

2017-04-04 Thread Arthur Wiedmer (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955329#comment-15955329 ] Arthur Wiedmer commented on AIRFLOW-1067: - Duplicate of

[jira] [Work started] (AIRFLOW-1067) Should not use airf...@airflow.com in examples

2017-04-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-1067 started by Xiangrui Meng. -- > Should not use airf...@airflow.com in examples >

[jira] [Commented] (AIRFLOW-1067) Should not use airf...@airflow.com in examples

2017-04-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955302#comment-15955302 ] Xiangrui Meng commented on AIRFLOW-1067: https://github.com/apache/incubator-airflow/pull/2217

[jira] [Created] (AIRFLOW-1067) Should not use airf...@airflow.com in examples

2017-04-04 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created AIRFLOW-1067: -- Summary: Should not use airf...@airflow.com in examples Key: AIRFLOW-1067 URL: https://issues.apache.org/jira/browse/AIRFLOW-1067 Project: Apache Airflow

[jira] [Created] (AIRFLOW-1066) Replace instances of airf...@airflow.com with airf...@example.com

2017-04-04 Thread Arthur Wiedmer (JIRA)
Arthur Wiedmer created AIRFLOW-1066: --- Summary: Replace instances of airf...@airflow.com with airf...@example.com Key: AIRFLOW-1066 URL: https://issues.apache.org/jira/browse/AIRFLOW-1066 Project:

incubator-airflow git commit: [AIRFLOW-1064] Change default sort to job_id for TaskInstanceModelView

2017-04-04 Thread bolke
Repository: incubator-airflow Updated Branches: refs/heads/master 4a6bef69d -> 8fdfb16cc [AIRFLOW-1064] Change default sort to job_id for TaskInstanceModelView The TaskInstanceModelView default sort column is on an unindexed column. We shouldn't need an index on start_date, and job_id is just

[3/4] incubator-airflow git commit: Merge branch 'AIRFLOW-719' into AIRFLOW-719-3

2017-04-04 Thread bolke
Merge branch 'AIRFLOW-719' into AIRFLOW-719-3 Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/15fd4d98 Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/15fd4d98 Diff:

[4/4] incubator-airflow git commit: Merge pull request #2195 from bolkedebruin/AIRFLOW-719

2017-04-04 Thread bolke
Merge pull request #2195 from bolkedebruin/AIRFLOW-719 Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/4a6bef69 Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/4a6bef69 Diff:

[1/4] incubator-airflow git commit: Revert "[AIRFLOW-719] Prevent DAGs from ending prematurely"

2017-04-04 Thread bolke
Repository: incubator-airflow Updated Branches: refs/heads/master f2dae7d15 -> 4a6bef69d Revert "[AIRFLOW-719] Prevent DAGs from ending prematurely" This reverts commit 1fdcf2480555f06cce3fc9bba97fbf3d64f074d3. This reinstates the previous logic (< 1.8.0) that ALL_SUCCESS requires all tasks

[2/4] incubator-airflow git commit: [AIRFLOW-719] Fix race condition in ShortCircuit, Branch and LatestOnly

2017-04-04 Thread bolke
[AIRFLOW-719] Fix race condition in ShortCircuit, Branch and LatestOnly Both the ShortCircuitOperator, Branchoperator and LatestOnlyOperator were arbitrarily changing the states of TaskInstances without locking them in the database. As the scheduler checks the state of dag runs asynchronously

[jira] [Assigned] (AIRFLOW-1065) Add functionality for Azure Blob Storage

2017-04-04 Thread Henk Griffioen (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henk Griffioen reassigned AIRFLOW-1065: --- Assignee: Henk Griffioen > Add functionality for Azure Blob Storage >

[jira] [Updated] (AIRFLOW-1065) Add functionality for Azure Blob Storage

2017-04-04 Thread Henk Griffioen (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henk Griffioen updated AIRFLOW-1065: Description: Currently Airflow has sensors and operators for S3 and GCE but it does not

[jira] [Created] (AIRFLOW-1065) Add functionality for Azure Blob Storage

2017-04-04 Thread Henk Griffioen (JIRA)
Henk Griffioen created AIRFLOW-1065: --- Summary: Add functionality for Azure Blob Storage Key: AIRFLOW-1065 URL: https://issues.apache.org/jira/browse/AIRFLOW-1065 Project: Apache Airflow

[jira] [Resolved] (AIRFLOW-1030) HttpHook error when creating HttpSensor

2017-04-04 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin resolved AIRFLOW-1030. - Resolution: Fixed Fix Version/s: 1.8.1 Issue resolved by pull request #2180

[jira] [Commented] (AIRFLOW-1) Migrate GitHub code to Apache git

2017-04-04 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954650#comment-15954650 ] ASF subversion and git services commented on AIRFLOW-1: --- Commit

[jira] [Commented] (AIRFLOW-1) Migrate GitHub code to Apache git

2017-04-04 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954652#comment-15954652 ] ASF subversion and git services commented on AIRFLOW-1: --- Commit

[jira] [Commented] (AIRFLOW-1030) HttpHook error when creating HttpSensor

2017-04-04 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954651#comment-15954651 ] ASF subversion and git services commented on AIRFLOW-1030: -- Commit

[jira] [Resolved] (AIRFLOW-1051) Add a test for resetdb to CliTests

2017-04-04 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin resolved AIRFLOW-1051. - Resolution: Fixed Fix Version/s: 1.9.0 Issue resolved by pull request #2198

[jira] [Commented] (AIRFLOW-1051) Add a test for resetdb to CliTests

2017-04-04 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954642#comment-15954642 ] ASF subversion and git services commented on AIRFLOW-1051: -- Commit

incubator-airflow git commit: [AIRFLOW-1051] Add a test for resetdb to CliTests

2017-04-04 Thread bolke
Repository: incubator-airflow Updated Branches: refs/heads/master a9b20a04b -> 15aee05dd [AIRFLOW-1051] Add a test for resetdb to CliTests CliTests lacks a test for resetdb command for now. It should be added. Closes #2198 from sekikn/AIRFLOW-1051 Project:

[jira] [Commented] (AIRFLOW-1051) Add a test for resetdb to CliTests

2017-04-04 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954643#comment-15954643 ] ASF subversion and git services commented on AIRFLOW-1051: -- Commit

[jira] [Resolved] (AIRFLOW-1004) `airflow webserver -D` runs in foreground

2017-04-04 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin resolved AIRFLOW-1004. - Resolution: Fixed > `airflow webserver -D` runs in foreground >

[jira] [Commented] (AIRFLOW-276) List of dags does not refresh in UI for a while

2017-04-04 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954636#comment-15954636 ] ASF subversion and git services commented on AIRFLOW-276: - Commit

[jira] [Commented] (AIRFLOW-1004) `airflow webserver -D` runs in foreground

2017-04-04 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954637#comment-15954637 ] ASF subversion and git services commented on AIRFLOW-1004: -- Commit

[jira] [Commented] (AIRFLOW-276) List of dags does not refresh in UI for a while

2017-04-04 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954635#comment-15954635 ] ASF subversion and git services commented on AIRFLOW-276: - Commit

[jira] [Commented] (AIRFLOW-1004) `airflow webserver -D` runs in foreground

2017-04-04 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954634#comment-15954634 ] ASF subversion and git services commented on AIRFLOW-1004: -- Commit

incubator-airflow git commit: [AIRFLOW-1004][AIRFLOW-276] Fix `airflow webserver -D` to run in background

2017-04-04 Thread bolke
Repository: incubator-airflow Updated Branches: refs/heads/master e4494f85e -> a9b20a04b [AIRFLOW-1004][AIRFLOW-276] Fix `airflow webserver -D` to run in background AIRFLOW-276 introduced a monitor process for gunicorn to find new files in the dag folder, but it also changed `airflow

[jira] [Commented] (AIRFLOW-1062) DagRun#find returns wrong result if external_trigger=False is specified

2017-04-04 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954629#comment-15954629 ] ASF subversion and git services commented on AIRFLOW-1062: -- Commit

[jira] [Resolved] (AIRFLOW-1062) DagRun#find returns wrong result if external_trigger=False is specified

2017-04-04 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin resolved AIRFLOW-1062. - Resolution: Fixed Fix Version/s: 1.8.1 Issue resolved by pull request #2210

[jira] [Commented] (AIRFLOW-1062) DagRun#find returns wrong result if external_trigger=False is specified

2017-04-04 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954628#comment-15954628 ] ASF subversion and git services commented on AIRFLOW-1062: -- Commit

incubator-airflow git commit: [AIRFLOW-1062] Fix DagRun#find to return correct result

2017-04-04 Thread bolke
Repository: incubator-airflow Updated Branches: refs/heads/v1-8-test 2bebeaf95 -> 010b80aa8 [AIRFLOW-1062] Fix DagRun#find to return correct result DagRun#find returns wrong result if external_trigger=False is specified, because adding filter is skipped on that condition. This PR fixes it.

[jira] [Commented] (AIRFLOW-1062) DagRun#find returns wrong result if external_trigger=False is specified

2017-04-04 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954630#comment-15954630 ] ASF subversion and git services commented on AIRFLOW-1062: -- Commit

[jira] [Commented] (AIRFLOW-1062) DagRun#find returns wrong result if external_trigger=False is specified

2017-04-04 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954627#comment-15954627 ] ASF subversion and git services commented on AIRFLOW-1062: -- Commit

incubator-airflow git commit: [AIRFLOW-1062] Fix DagRun#find to return correct result

2017-04-04 Thread bolke
Repository: incubator-airflow Updated Branches: refs/heads/master 56501e606 -> e4494f85e [AIRFLOW-1062] Fix DagRun#find to return correct result DagRun#find returns wrong result if external_trigger=False is specified, because adding filter is skipped on that condition. This PR fixes it.

[jira] [Commented] (AIRFLOW-1011) Fix bug in BackfillJob._execute() for SubDAGs

2017-04-04 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954623#comment-15954623 ] ASF subversion and git services commented on AIRFLOW-1011: -- Commit

[jira] [Commented] (AIRFLOW-1011) Fix bug in BackfillJob._execute() for SubDAGs

2017-04-04 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954624#comment-15954624 ] ASF subversion and git services commented on AIRFLOW-1011: -- Commit

[jira] [Resolved] (AIRFLOW-1011) Fix bug in BackfillJob._execute() for SubDAGs

2017-04-04 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin resolved AIRFLOW-1011. - Resolution: Fixed Issue resolved by pull request #2179

[jira] [Commented] (AIRFLOW-1011) Fix bug in BackfillJob._execute() for SubDAGs

2017-04-04 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954620#comment-15954620 ] ASF subversion and git services commented on AIRFLOW-1011: -- Commit

[jira] [Commented] (AIRFLOW-1011) Fix bug in BackfillJob._execute() for SubDAGs

2017-04-04 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954621#comment-15954621 ] ASF subversion and git services commented on AIRFLOW-1011: -- Commit

incubator-airflow git commit: [AIRFLOW-1011] Fix bug in BackfillJob._execute() for SubDAGs

2017-04-04 Thread bolke
Repository: incubator-airflow Updated Branches: refs/heads/master 75addb4a9 -> 56501e606 [AIRFLOW-1011] Fix bug in BackfillJob._execute() for SubDAGs BackfillJob._execute() checks that the next run date is less than or equal to the end date before creating a DAG run and task instances. For

incubator-airflow git commit: [AIRFLOW-1011] Fix bug in BackfillJob._execute() for SubDAGs

2017-04-04 Thread bolke
Repository: incubator-airflow Updated Branches: refs/heads/v1-8-test 68b1c982e -> 2bebeaf95 [AIRFLOW-1011] Fix bug in BackfillJob._execute() for SubDAGs BackfillJob._execute() checks that the next run date is less than or equal to the end date before creating a DAG run and task instances. For