[jira] [Created] (AIRFLOW-3542) next_ds semantics broken for manually triggered runs

2018-12-19 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-3542: Summary: next_ds semantics broken for manually triggered runs Key: AIRFLOW-3542 URL: https://issues.apache.org/jira/browse/AIRFLOW-3542 Project: Apache Airflow

[jira] [Updated] (AIRFLOW-3233) Dag deletion in the UI doesn't work

2018-10-19 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-3233: - Affects Version/s: 1.10.0 > Dag deletion in the UI doesn't w

[jira] [Created] (AIRFLOW-3233) Dag deletion in the UI doesn't work

2018-10-19 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-3233: Summary: Dag deletion in the UI doesn't work Key: AIRFLOW-3233 URL: https://issues.apache.org/jira/browse/AIRFLOW-3233 Project: Apache Airflow Issue Type

[jira] [Updated] (AIRFLOW-3191) Fix not being able to specify execution_date when creating dagrun

2018-10-11 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-3191: - Description: Creating a dagrun using the flask web UI is not possible because execution_date

[jira] [Created] (AIRFLOW-3191) Can not specify execution_date when creating dagrun

2018-10-11 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-3191: Summary: Can not specify execution_date when creating dagrun Key: AIRFLOW-3191 URL: https://issues.apache.org/jira/browse/AIRFLOW-3191 Project: Apache Airflow

[jira] [Updated] (AIRFLOW-3191) Fix not being able to specify execution_date when creating dagrun

2018-10-11 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-3191: - Summary: Fix not being able to specify execution_date when creating dagrun (was: Can

[jira] [Commented] (AIRFLOW-3160) Load latest_dagruns asynchronously

2018-10-05 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639886#comment-16639886 ] Dan Davydov commented on AIRFLOW-3160: -- Latency is still an issue if the DB is not e.g. collocated

[jira] [Created] (AIRFLOW-3160) Load latest_dagruns asynchronously

2018-10-04 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-3160: Summary: Load latest_dagruns asynchronously Key: AIRFLOW-3160 URL: https://issues.apache.org/jira/browse/AIRFLOW-3160 Project: Apache Airflow Issue Type

[jira] [Created] (AIRFLOW-3050) Deactivate Stale DAGs in the Main Scheduler Loop

2018-09-12 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-3050: Summary: Deactivate Stale DAGs in the Main Scheduler Loop Key: AIRFLOW-3050 URL: https://issues.apache.org/jira/browse/AIRFLOW-3050 Project: Apache Airflow

[jira] [Created] (AIRFLOW-2895) Prevent scheduler from spamming heartbeats/logs

2018-08-13 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-2895: Summary: Prevent scheduler from spamming heartbeats/logs Key: AIRFLOW-2895 URL: https://issues.apache.org/jira/browse/AIRFLOW-2895 Project: Apache Airflow

incubator-airflow git commit: [AIRFLOW-2810] Fix typo in Xcom model timestamp

2018-07-27 Thread davydov
iff/a338f327 Branch: refs/heads/master Commit: a338f3276835af45765d24a6e6d43ad4ba4d66ba Parents: 233056e Author: Andy Wilcox Authored: Fri Jul 27 13:03:30 2018 -0400 Committer: Dan Davydov Committed: Fri Jul 27 13:03:36 2018 -0

[jira] [Created] (AIRFLOW-2422) Batch manage_slas queries

2018-05-04 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-2422: Summary: Batch manage_slas queries Key: AIRFLOW-2422 URL: https://issues.apache.org/jira/browse/AIRFLOW-2422 Project: Apache Airflow Issue Type: Bug

incubator-airflow git commit: [Airflow-2202] Add filter support in HiveMetastoreHook().max_partition()

2018-03-16 Thread davydov
: Fri Mar 16 18:01:48 2018 -0700 Committer: Dan Davydov <dan.davy...@airbnb.com> Committed: Fri Mar 16 18:01:54 2018 -0700 -- airflow/hooks/hive_hooks.py | 109 - airflow/macros/hive.

incubator-airflow git commit: [AIRFLOW-2150] Use lighter call in HiveMetastoreHook().max_partition()

2018-03-07 Thread davydov
tter: Dan Davydov <dan.davy...@airbnb.com> Committed: Wed Mar 7 16:12:18 2018 -0800 -- airflow/hooks/hive_hooks.py | 64 ++ airflow/macros/hive.py| 2 +- tests/hooks/test_hi

[jira] [Reopened] (AIRFLOW-226) Create separate pip packages for webserver and hooks

2018-03-05 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov reopened AIRFLOW-226: - > Create separate pip packages for webserver and ho

[jira] [Commented] (AIRFLOW-226) Create separate pip packages for webserver and hooks

2018-03-05 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16387016#comment-16387016 ] Dan Davydov commented on AIRFLOW-226: - I feel strongly (at least for hooks) that they should be moved

[jira] [Created] (AIRFLOW-2173) Don't check task IDs for concurrency reached check

2018-03-03 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-2173: Summary: Don't check task IDs for concurrency reached check Key: AIRFLOW-2173 URL: https://issues.apache.org/jira/browse/AIRFLOW-2173 Project: Apache Airflow

[jira] [Created] (AIRFLOW-2156) Parallelize Celery Executor

2018-02-27 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-2156: Summary: Parallelize Celery Executor Key: AIRFLOW-2156 URL: https://issues.apache.org/jira/browse/AIRFLOW-2156 Project: Apache Airflow Issue Type

[jira] [Resolved] (AIRFLOW-908) Airflow run should print worker name at top of log

2018-02-14 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov resolved AIRFLOW-908. - Resolution: Fixed > Airflow run should print worker name at top of

incubator-airflow git commit: [AIRFLOW-1985] Impersonation fixes for using `run_as_user`

2018-02-07 Thread davydov
uez <edgar.rodrig...@airbnb.com> Authored: Wed Feb 7 14:33:36 2018 -0800 Committer: Dan Davydov <dan.davy...@airbnb.com> Committed: Wed Feb 7 14:33:40 2018 -0800 -- airflow/executors/base_executor.py | 11

[jira] [Created] (AIRFLOW-2061) Remove expensive redundant async.state calls in celery executor

2018-02-02 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-2061: Summary: Remove expensive redundant async.state calls in celery executor Key: AIRFLOW-2061 URL: https://issues.apache.org/jira/browse/AIRFLOW-2061 Project: Apache

[jira] [Updated] (AIRFLOW-2027) Only trigger sleep in scheduler after all files have parsed

2018-01-29 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-2027: - Description: The scheduler loop sleeps for 1 second every loop unnecessarily. Remove

incubator-airflow git commit: [AIRFLOW-2023] Add debug logging around number of queued files

2018-01-29 Thread davydov
wip-us.apache.org/repos/asf/incubator-airflow/tree/61ff29e5 Diff: http://git-wip-us.apache.org/repos/asf/incubator-airflow/diff/61ff29e5 Branch: refs/heads/master Commit: 61ff29e578d1121ab4606fe122fb4e2db8f075b9 Parents: da0e628 Author: Dan Davydov <dan.davy...@airbnb.com> Authored: Mon Jan 29

[jira] [Updated] (AIRFLOW-2027) Only trigger sleep in scheduler after all files have parsed

2018-01-29 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-2027: - Summary: Only trigger sleep in scheduler after all files have parsed (was: Remove unnecessary

[jira] [Commented] (AIRFLOW-2027) Remove unnecessary 1s sleep in scheduler loop

2018-01-26 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16341861#comment-16341861 ] Dan Davydov commented on AIRFLOW-2027: -- the PR I'm about to cut will sleep 1s - time it took

[jira] [Created] (AIRFLOW-2027) Remove unnecessary 1s sleep in scheduler loop

2018-01-24 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-2027: Summary: Remove unnecessary 1s sleep in scheduler loop Key: AIRFLOW-2027 URL: https://issues.apache.org/jira/browse/AIRFLOW-2027 Project: Apache Airflow

[jira] [Updated] (AIRFLOW-1985) Subdag tasks do not work with impersonation

2018-01-18 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-1985: - Description: When using {{run_as_user}} for impersonation, airflow creates a subset

[jira] [Updated] (AIRFLOW-1980) Scheduler DB Queries Should be Batched

2018-01-09 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-1980: - Description: DB queries in the scheduler should be batched, since the larger ones can get

[jira] [Updated] (AIRFLOW-1980) Scheduler DB Queries Should be Batched

2018-01-09 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-1980: - Description: DB queries in the scheduler should be batched, since the larger ones can get

[jira] [Created] (AIRFLOW-1980) Scheduler DB Queries Should be Batched

2018-01-09 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1980: Summary: Scheduler DB Queries Should be Batched Key: AIRFLOW-1980 URL: https://issues.apache.org/jira/browse/AIRFLOW-1980 Project: Apache Airflow Issue Type

incubator-airflow git commit: [AIRFLOW-1971] Propagate hive config on impersonation

2018-01-08 Thread davydov
5:12 2018 -0800 Committer: Dan Davydov <dan.davy...@airbnb.com> Committed: Mon Jan 8 11:25:16 2018 -0800 -- airflow/task/task_runner/base_task_runner.py | 1 + tests/dags/test_impersonation_custom.py | 10 ++ 2 fi

incubator-airflow git commit: [AIRFLOW-1963] Add config for HiveOperator mapred_queue

2018-01-03 Thread davydov
tor-airflow/diff/b3489b99 Branch: refs/heads/master Commit: b3489b99e9140e25bdd08b78f57ba845c3edb358 Parents: 07c2a51 Author: Edgar Rodriguez <edgar.rodrig...@airbnb.com> Authored: Wed Jan 3 14:23:09 2018 -0800 Committer: Dan Davydov <dan.davy...@airbnb.com> Committed: Wed Jan 3 14:2

[jira] [Commented] (AIRFLOW-511) DagRun Failure: Retry, Email, Callbacks

2017-12-13 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16290485#comment-16290485 ] Dan Davydov commented on AIRFLOW-511: - You might be able to accomplish this for now using the task

incubator-airflow git commit: [AIRFLOW-1819] Fix slack operator unittest bug

2017-11-15 Thread davydov
mit: 3c8f7747b08ca5c23233799e56a040f60e3d0fc6 Parents: d8e8f90 Author: Kevin Yang <kevin.y...@airbnb.com> Authored: Wed Nov 15 17:52:06 2017 -0800 Committer: Dan Davydov <dan.davy...@airbnb.com> Committed: Wed Nov 15 17:5

incubator-airflow git commit: [AIRFLOW-1805] Allow Slack token to be passed through connection

2017-11-15 Thread davydov
asf/incubator-airflow/tree/d8e8f901 Diff: http://git-wip-us.apache.org/repos/asf/incubator-airflow/diff/d8e8f901 Branch: refs/heads/master Commit: d8e8f90142246ae5b02c1a0f9649ea5a419a5afc Parents: d04519e Author: Kevin Yang <kevin.y...@airbnb.com> Authored: Wed Nov 15 14:53:56 2017 -0800 Committer: Da

incubator-airflow git commit: [AIRFLOW-1787] Fix task instance batch clear and set state bugs

2017-11-07 Thread davydov
ang <kevin.y...@airbnb.com> Authored: Tue Nov 7 11:22:58 2017 -0800 Committer: Dan Davydov <dan.davy...@airbnb.com> Committed: Tue Nov 7 11:23:00 2017 -0800 -- airflow/utils/dates.py| 14 ++ airfl

incubator-airflow git commit: [AIRFLOW-1780] Fix long output lines with unicode from hanging parent

2017-11-06 Thread davydov
ree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/1a7b63eb Diff: http://git-wip-us.apache.org/repos/asf/incubator-airflow/diff/1a7b63eb Branch: refs/heads/master Commit: 1a7b63eb16ffa1cb97cb09f71997dcd39f28e645 Parents: 3fde104 Author: Dan Davydov <dan.davy...@airbnb.com> Auth

[jira] [Commented] (AIRFLOW-1143) Tasks rejected by workers get stuck in QUEUED

2017-11-06 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241002#comment-16241002 ] Dan Davydov commented on AIRFLOW-1143: -- It may fix it, I'm not sure we were ever sure

[jira] [Updated] (AIRFLOW-1780) Long Unicode Characters In BashOperator Output Cause Task Hang

2017-11-02 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-1780: - Summary: Long Unicode Characters In BashOperator Output Cause Task Hang (was: Long Unicode

[jira] [Created] (AIRFLOW-1780) Long Unicode Characters Cause Logging

2017-11-02 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1780: Summary: Long Unicode Characters Cause Logging Key: AIRFLOW-1780 URL: https://issues.apache.org/jira/browse/AIRFLOW-1780 Project: Apache Airflow Issue Type

[jira] [Created] (AIRFLOW-1733) BashOperator readline can hang

2017-10-18 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1733: Summary: BashOperator readline can hang Key: AIRFLOW-1733 URL: https://issues.apache.org/jira/browse/AIRFLOW-1733 Project: Apache Airflow Issue Type: Bug

incubator-airflow git commit: [AIRFLOW-1631] Fix timing issue in unit test

2017-10-17 Thread davydov
6ac Parents: cdfced3 Author: Edgar Rodriguez <edgar.rodrig...@airbnb.com> Authored: Tue Oct 17 17:51:34 2017 -0700 Committer: Dan Davydov <dan.davy...@airbnb.com> Committed: Tue Oct 17 17:51:58 2017 -0700 -- ai

incubator-airflow git commit: [AIRFLOW-1631] Fix local executor unbound parallelism

2017-10-17 Thread davydov
mit: cdfced3248c7f14b639919c093f4f3042deb754b Parents: 707ab69 Author: Edgar Rodriguez <edgar.rodrig...@airbnb.com> Authored: Tue Oct 17 11:39:06 2017 -0700 Committer: Dan Davydov <dan.davy...@airbnb.com> Committed: Tue Oct 17 11:39:22 2017 -0700

[jira] [Commented] (AIRFLOW-1670) Make Airflow Viewable By Color-blind Users

2017-10-12 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202413#comment-16202413 ] Dan Davydov commented on AIRFLOW-1670: -- Took a stab at it here: https://github.com/apache/incubator

incubator-airflow git commit: [AIRFLOW-1681] Add batch clear in task instance view

2017-10-11 Thread davydov
-airflow/tree/9f2c16a0 Diff: http://git-wip-us.apache.org/repos/asf/incubator-airflow/diff/9f2c16a0 Branch: refs/heads/master Commit: 9f2c16a0ac261888fe2ee4671538201c273f82d5 Parents: 98b4df9 Author: Kevin Yang <kevin.y...@airbnb.com> Authored: Wed Oct 11 14:05:33 2017 -0700 Committer: Dan Davydov <

[jira] [Resolved] (AIRFLOW-1697) Mode to disable Airflow Charts

2017-10-10 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov resolved AIRFLOW-1697. -- Resolution: Fixed > Mode to disable Airflow Cha

incubator-airflow git commit: [AIRFLOW-1697] Mode to disable charts endpoint

2017-10-10 Thread davydov
ree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/21e94c7d Diff: http://git-wip-us.apache.org/repos/asf/incubator-airflow/diff/21e94c7d Branch: refs/heads/master Commit: 21e94c7d1594c5e0806d9e1ae1205a41bf98b5d3 Parents: ebe715c Author: Dan Davydov <dan.davy...@airbnb.com>

[jira] [Created] (AIRFLOW-1697) Mode to disable Airflow Charts

2017-10-09 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1697: Summary: Mode to disable Airflow Charts Key: AIRFLOW-1697 URL: https://issues.apache.org/jira/browse/AIRFLOW-1697 Project: Apache Airflow Issue Type: Bug

[jira] [Created] (AIRFLOW-1681) Create way to batch retry task instances in the CRUD

2017-10-04 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1681: Summary: Create way to batch retry task instances in the CRUD Key: AIRFLOW-1681 URL: https://issues.apache.org/jira/browse/AIRFLOW-1681 Project: Apache Airflow

[jira] [Created] (AIRFLOW-1670) Make Airflow Viewable By Color-blind Users

2017-10-02 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1670: Summary: Make Airflow Viewable By Color-blind Users Key: AIRFLOW-1670 URL: https://issues.apache.org/jira/browse/AIRFLOW-1670 Project: Apache Airflow Issue

[jira] [Created] (AIRFLOW-1651) Accessibility Mode

2017-09-27 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1651: Summary: Accessibility Mode Key: AIRFLOW-1651 URL: https://issues.apache.org/jira/browse/AIRFLOW-1651 Project: Apache Airflow Issue Type: Bug

incubator-airflow git commit: [AIRFLOW-1621] Add tests for server side paging

2017-09-19 Thread davydov
mit: 656d045e90bf67ca484a3778b2a07a419bfb324a Parents: 6e52070 Author: Edgar Rodriguez <edgar.rodrig...@airbnb.com> Authored: Tue Sep 19 15:52:26 2017 -0700 Committer: Dan Davydov <dan.davy...@airbnb.com> Committed: Tue Sep 19 15:5

[jira] [Created] (AIRFLOW-1624) Consolidate airflow clear and airflow run

2017-09-19 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1624: Summary: Consolidate airflow clear and airflow run Key: AIRFLOW-1624 URL: https://issues.apache.org/jira/browse/AIRFLOW-1624 Project: Apache Airflow Issue

[jira] [Created] (AIRFLOW-1620) Support granular and customizable hook retries

2017-09-18 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1620: Summary: Support granular and customizable hook retries Key: AIRFLOW-1620 URL: https://issues.apache.org/jira/browse/AIRFLOW-1620 Project: Apache Airflow

incubator-airflow git commit: [AIRFLOW-1519] Add server side paging in DAGs list

2017-09-15 Thread davydov
iff/b6d2e0a4 Branch: refs/heads/master Commit: b6d2e0a46978e93e16576604624f57d1388814f2 Parents: 6632b0c Author: Edgar Rodriguez <edgar.rodrig...@airbnb.com> Authored: Fri Sep 15 16:41:25 2017 -0700 Committer: Dan Davydov <dan.davy...@airbnb.com> Committed: Fri Sep 15 16:4

[jira] [Updated] (AIRFLOW-1584) Remove the insecure /headers endpoints

2017-09-08 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-1584: - Description: Impact: An XSS vulnerability on Airflow would be able to read a user's auth_proxy

[jira] [Updated] (AIRFLOW-1584) Remove the insecure /headers endpoints

2017-09-08 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-1584: - Description: Impact: An XSS vulnerability on Airflow would be able to read a user's auth_proxy

[jira] [Created] (AIRFLOW-1584) Remove the insecure /headers endpoints

2017-09-08 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1584: Summary: Remove the insecure /headers endpoints Key: AIRFLOW-1584 URL: https://issues.apache.org/jira/browse/AIRFLOW-1584 Project: Apache Airflow Issue Type

incubator-airflow git commit: [AIRFLOW-1574] add 'to' attribute to templated vars of email operator

2017-09-07 Thread davydov
mit: 2d40694482df7c9c1c02a61e11d51bedb9034a93 Parents: 8f1ec4d Author: Ace Haidrey <ahaid...@pandora.com> Authored: Thu Sep 7 11:53:16 2017 -0700 Committer: Dan Davydov <dan.davy...@airbnb.com> Committed: Thu Sep 7 11:53:20 2017 -0700 -- ai

incubator-airflow git commit: [AIRFLOW-1541] Add channel to template fields of slack_operator

2017-08-30 Thread davydov
nts: b1f902e Author: Ace Haidrey <ahaid...@pandora.com> Authored: Wed Aug 30 11:52:47 2017 -0700 Committer: Dan Davydov <dan.davy...@airbnb.com> Committed: Wed Aug 30 11:52:48 2017 -0700 -- airflow/operators/slack_operator.py

[jira] [Commented] (AIRFLOW-1311) Improve Webserver Load Time For Large DAGs

2017-08-15 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128134#comment-16128134 ] Dan Davydov commented on AIRFLOW-1311: -- Edgar assigning to you, feel free to mark as dupe or merge

[jira] [Resolved] (AIRFLOW-1266) Long task names are truncated in gannt view

2017-08-15 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov resolved AIRFLOW-1266. -- Resolution: Fixed > Long task names are truncated in gannt v

[jira] [Assigned] (AIRFLOW-1311) Improve Webserver Load Time For Large DAGs

2017-08-15 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov reassigned AIRFLOW-1311: Assignee: Edgar Rodriguez (was: Dan Davydov) > Improve Webserver Load Time For La

[jira] [Assigned] (AIRFLOW-1311) Improve Webserver Load Time For Large DAGs

2017-08-15 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov reassigned AIRFLOW-1311: Assignee: Dan Davydov > Improve Webserver Load Time For Large D

[jira] [Resolved] (AIRFLOW-1442) Airflow Ignore All Deps Command Generation Has an Extra Space

2017-08-15 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov resolved AIRFLOW-1442. -- Resolution: Fixed > Airflow Ignore All Deps Command Generation Has an Extra Sp

incubator-airflow git commit: [AIRFLOW-1495] Fix migration on index on job_id

2017-08-15 Thread davydov
gar Rodriguez <edgar.rodrig...@airbnb.com> Authored: Tue Aug 15 15:27:04 2017 -0700 Committer: Dan Davydov <dan.davy...@airbnb.com> Committed: Tue Aug 15 15:27:06 2017 -0700 -- .../7171349d4c73_add_ti_job_id_index.

incubator-airflow git commit: [AIRFLOW-1483] Making page size consistent in list

2017-08-15 Thread davydov
low/diff/04bfba3a Branch: refs/heads/master Commit: 04bfba3aa97deab850c14763279d33a6dfceb205 Parents: e1772c0 Author: Edgar Rodriguez <edgar.rodrig...@airbnb.com> Authored: Tue Aug 15 15:01:17 2017 -0700 Committer: Dan Davydov <dan.davy...@airbnb.com> Committed: Tue Aug 15 15:0

incubator-airflow git commit: [AIRFLOW-1495] Add TaskInstance index on job_id

2017-08-15 Thread davydov
Committer: Dan Davydov <dan.davy...@airbnb.com> Committed: Tue Aug 15 14:57:28 2017 -0700 -- .../7171349d4c73_add_ti_job_id_index.py | 38 1 file changed

[jira] [Created] (AIRFLOW-1513) Come up with an abstraction to set defaults per task

2017-08-15 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1513: Summary: Come up with an abstraction to set defaults per task Key: AIRFLOW-1513 URL: https://issues.apache.org/jira/browse/AIRFLOW-1513 Project: Apache Airflow

incubator-airflow git commit: [AIRFLOW-855] Replace PickleType with LargeBinary in XCom

2017-08-15 Thread davydov
ncubator-airflow/commit/4cf904cf Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/4cf904cf Diff: http://git-wip-us.apache.org/repos/asf/incubator-airflow/diff/4cf904cf Branch: refs/heads/master Commit: 4cf904cf5a7a070bbeaf3a0e985ed2b840276015 Parents: 984a87c Author: Dan Davydov

incubator-airflow git commit: [AIRFLOW-1239] Fix unicode error for logs in base_task_runner

2017-08-14 Thread davydov
ra.com> Authored: Mon Aug 14 15:13:01 2017 -0700 Committer: Dan Davydov <dan.davy...@airbnb.com> Committed: Mon Aug 14 15:13:02 2017 -0700 -- airflow/task_runner/base_task_runner.py | 1 + 1 file chang

incubator-airflow git commit: [AIRFLOW-1452] workaround lock on method

2017-08-11 Thread davydov
master Commit: 0d0cc62f49525166bc877606affa5a623ba52c4d Parents: b0669b5 Author: k.privezentsev <konstantin.privezent...@kaspersky.com> Authored: Fri Aug 11 11:47:35 2017 -0700 Committer: Dan Davydov <dan.davy...@airbnb.com> Committed: Fri A

incubator-airflow git commit: [AIRFLOW-1385] Make Airflow task logging configurable

2017-08-11 Thread davydov
il.com> Authored: Fri Aug 11 11:38:37 2017 -0700 Committer: Dan Davydov <dan.davy...@airbnb.com> Committed: Fri Aug 11 11:38:39 2017 -0700 -- airflow/bin/cli.py | 106 ++--- airflow/config_templa

[jira] [Resolved] (AIRFLOW-1349) Max active dagrun check for backfills shouldn't include the backfilled dagrun

2017-08-09 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov resolved AIRFLOW-1349. -- Resolution: Fixed > Max active dagrun check for backfills shouldn't include the backfil

incubator-airflow git commit: [AIRFLOW-1443] Update Airflow configuration documentation

2017-08-09 Thread davydov
asf/incubator-airflow/diff/6825d97b Branch: refs/heads/master Commit: 6825d97b82a3b235685ea8265380a20eea90c990 Parents: d9109d6 Author: AllisonWang <allisonwang...@gmail.com> Authored: Wed Aug 9 14:49:54 2017 -0700 Committer: Dan Davydov <dan.davy...@airbnb.com> Committed: Wed Aug

[jira] [Closed] (AIRFLOW-672) Allow logs to be piped into another process

2017-08-09 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov closed AIRFLOW-672. --- Resolution: Fixed Not really relevant with the new logging abstraction anymore. We can create

incubator-airflow git commit: [AIRFLOW-1486] Unexpected S3 writing log error

2017-08-07 Thread davydov
mit: d9109d6458d136cd2b76ef7180be498ae09b3ea3 Parents: f5c8457 Author: Stanislav Kudriashev <stas.kudrias...@gmail.com> Authored: Mon Aug 7 15:52:51 2017 -0700 Committer: Dan Davydov <dan.davy...@airbnb.com> Committed: Mon Aug 7 15:5

incubator-airflow git commit: [AIRFLOW-1487] Added links to all companies officially using Airflow

2017-08-07 Thread davydov
nts: 111ce57 Author: Tanmay <tanmaythak...@gmail.com> Authored: Mon Aug 7 11:39:10 2017 -0700 Committer: Dan Davydov <dan.davy...@airbnb.com> Committed: Mon Aug 7 11:39:36 2017 -0700 -- README.md | 12 ++-- 1

incubator-airflow git commit: [AIRFLOW-1349] Fix backfill to respect limits

2017-08-04 Thread davydov
mit: ddc50269431d8715e0eaeed7be5f522fed5521da Parents: 651e606 Author: Edgar Rodriguez <edgar.rodrig...@airbnb.com> Authored: Fri Aug 4 14:08:17 2017 -0700 Committer: Dan Davydov <dan.davy...@airbnb.com> Committed: Fri Aug 4 14:08:20 2017 -0700 -- air

[jira] [Commented] (AIRFLOW-774) dagbag_size/collect_dags/dagbag_import_errors stats incorrect

2017-08-02 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111825#comment-16111825 ] Dan Davydov commented on AIRFLOW-774: - Yes to master, IIRC they should appear starting from release

incubator-airflow git commit: [AIRFLOW-1445] Changing HivePartitionSensor UI color to lighter shade

2017-08-01 Thread davydov
0:36 2017 -0700 Committer: Dan Davydov <dan.davy...@airbnb.com> Committed: Tue Aug 1 09:20:39 2017 -0700 -- airflow/operators/sensors.py | 2 +- 1 file changed, 1 insertion

incubator-airflow git commit: [AIRFLOW-1349] Refactor BackfillJob _execute

2017-07-28 Thread davydov
nts: 322ec96 Author: Edgar Rodriguez <edgar.rodrig...@airbnb.com> Authored: Fri Jul 28 15:49:50 2017 -0700 Committer: Dan Davydov <dan.davy...@airbnb.com> Committed: Fri Jul 28 15:50:24 2017 -0700 -- airflow/

[jira] [Created] (AIRFLOW-1448) Revert PR 2433 which added merge conflicts to master

2017-07-24 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1448: Summary: Revert PR 2433 which added merge conflicts to master Key: AIRFLOW-1448 URL: https://issues.apache.org/jira/browse/AIRFLOW-1448 Project: Apache Airflow

incubator-airflow git commit: [AIRFLOW-1442] Remove extra space from ignore_all_deps generated command

2017-07-21 Thread davydov
asf/incubator-airflow/diff/aa64f370 Branch: refs/heads/master Commit: aa64f370b28935a9fe0e692864a94fca89113bfe Parents: 3547cbf Author: Dan Davydov <dan.davy...@airbnb.com> Authored: Fri Jul 21 14:06:29 2017 -0700 Committer: Dan Davydov <dan.davy...@airbnb.com> Committed: Fri Jul 21 14:0

[jira] [Created] (AIRFLOW-1442) Airflow Ignore All Deps Command Generation Has an Extra Space

2017-07-21 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1442: Summary: Airflow Ignore All Deps Command Generation Has an Extra Space Key: AIRFLOW-1442 URL: https://issues.apache.org/jira/browse/AIRFLOW-1442 Project: Apache

incubator-airflow git commit: [Airflow 1332] Split logs based on try number

2017-07-20 Thread davydov
6c3 Diff: http://git-wip-us.apache.org/repos/asf/incubator-airflow/diff/b49986c3 Branch: refs/heads/master Commit: b49986c3b24a5382f817d5a3fc40add87b464ba2 Parents: b9576d5 Author: AllisonWang <allisonwang...@gmail.com> Authored: Thu Jul 20 18:08:15 2017 -0700 Committer: Dan Davydov

incubator-airflow git commit: Revert "[AIRFLOW-1385] Create abstraction for Airflow task logging"

2017-07-20 Thread davydov
master Commit: b9576d57b6063908e488654f0b21b338c10069fd Parents: e6ef06c Author: Dan Davydov <dan.davy...@airbnb.com> Authored: Thu Jul 20 18:07:17 2017 -0700 Committer: Dan Davydov <dan.davy...@airbnb.com> Committed: Thu J

incubator-airflow git commit: [AIRFLOW-1385] Create abstraction for Airflow task logging

2017-07-20 Thread davydov
hor: AllisonWang <allisonwang...@gmail.com> Authored: Thu Jul 20 18:03:23 2017 -0700 Committer: Dan Davydov <dan.davy...@airbnb.com> Committed: Thu Jul 20 18:03:26 2017 -0700 -- airflow/bin/cli.py

[jira] [Created] (AIRFLOW-1432) NVD3 Charts do not have labeled axes and units change dynamically

2017-07-19 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1432: Summary: NVD3 Charts do not have labeled axes and units change dynamically Key: AIRFLOW-1432 URL: https://issues.apache.org/jira/browse/AIRFLOW-1432 Project: Apache

incubator-airflow git commit: [AIRFLOW-1247] Fix ignore all dependencies argument ignored

2017-07-13 Thread davydov
ads/master Commit: e88ecff6ac71758d763dd5037b177e7a2fbc9896 Parents: 4322d6d Author: Dan Davydov <dan.davy...@airbnb.com> Authored: Thu Jul 13 15:38:00 2017 -0700 Committer: Dan Davydov <dan.davy...@airbnb.com> Committed: Thu Jul 13 15:3

[jira] [Assigned] (AIRFLOW-1247) CLI: ignore all dependencies argument ignored

2017-07-13 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov reassigned AIRFLOW-1247: Assignee: Dan Davydov (was: Matti Remes) > CLI: ignore all dependencies argum

incubator-airflow git commit: [AIRFLOW-1366] Add max_tries to task instance

2017-07-10 Thread davydov
017 -0700 Committer: Dan Davydov <dan.davy...@airbnb.com> Committed: Mon Jul 10 15:26:12 2017 -0700 -- ...dc7_add_max_tries_column_to_task_instance.py | 106 +++ airflow/models.py |

[jira] [Created] (AIRFLOW-1351) airflow cli commands should log error/debug to stderr

2017-06-27 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1351: Summary: airflow cli commands should log error/debug to stderr Key: AIRFLOW-1351 URL: https://issues.apache.org/jira/browse/AIRFLOW-1351 Project: Apache Airflow

[jira] [Created] (AIRFLOW-1311) Improve Webserver Load Time For Large DAGs

2017-06-15 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1311: Summary: Improve Webserver Load Time For Large DAGs Key: AIRFLOW-1311 URL: https://issues.apache.org/jira/browse/AIRFLOW-1311 Project: Apache Airflow Issue

incubator-airflow git commit: [AIRFLOW-936] Add clear/mark success for DAG in the UI

2017-06-13 Thread davydov
c6e29b4ad8d0f Parents: 6e3bcd3 Author: Allison Wang <allisonwang...@gmail.com> Authored: Tue Jun 13 18:56:41 2017 -0700 Committer: Dan Davydov <dan.davy...@airbnb.com> Committed: Tue Jun 13 18:56:44 2017 -0700 -- airflo

[jira] [Resolved] (AIRFLOW-1024) Handle CeleryExecutor errors gracefully

2017-06-08 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov resolved AIRFLOW-1024. -- Resolution: Fixed > Handle CeleryExecutor errors gracefu

[jira] [Updated] (AIRFLOW-1288) Bad owners field in DAGs breaks Airflow front page

2017-06-07 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-1288: - Description: DAGs that have owners set to a bad value break the front page of the webserver

[jira] [Created] (AIRFLOW-1288) Bad owners field in DAGs breaks Airflow front page

2017-06-07 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1288: Summary: Bad owners field in DAGs breaks Airflow front page Key: AIRFLOW-1288 URL: https://issues.apache.org/jira/browse/AIRFLOW-1288 Project: Apache Airflow

[jira] [Created] (AIRFLOW-1280) Gantt Chart Height Isn't Set Properly

2017-06-05 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1280: Summary: Gantt Chart Height Isn't Set Properly Key: AIRFLOW-1280 URL: https://issues.apache.org/jira/browse/AIRFLOW-1280 Project: Apache Airflow Issue Type

incubator-airflow git commit: [AIRFLOW-1263] Dynamic height for charts

2017-06-05 Thread davydov
ter Commit: e3e6aa71984f5fe2e9c36d1f177054b4457f5b34 Parents: 53ad991 Author: Dan Davydov <dan.davy...@airbnb.com> Authored: Mon Jun 5 16:32:42 2017 -0700 Committer: Dan Davydov <dan.davy...@airbnb.com> Committed: Mon Jun 5 16:3

  1   2   3   4   >