[jira] [Updated] (AIRFLOW-921) 1.8.0rc Issues

2017-02-27 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-921: Description: These are the pending issues for the Airflow 1.8.0 release: Blockers: [~bolke

[jira] [Assigned] (AIRFLOW-919) Setting a task to running manually breaks a DAGs UI

2017-02-27 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov reassigned AIRFLOW-919: --- Assignee: Dan Davydov > Setting a task to running manually breaks a DAGs

[jira] [Updated] (AIRFLOW-921) 1.8.0rc Issues

2017-02-27 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-921: Description: These are the pending issues for the Airflow 1.8.0 release: Blockers: - https

[jira] [Updated] (AIRFLOW-921) 1.8.0rc Issues

2017-02-27 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-921: Description: These are the pending issues for the Airflow 1.8.0 release: Blockers: [~bolke

[jira] [Created] (AIRFLOW-494) Add per-operator success/failure metrics.

2016-09-07 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-494: --- Summary: Add per-operator success/failure metrics. Key: AIRFLOW-494 URL: https://issues.apache.org/jira/browse/AIRFLOW-494 Project: Apache Airflow Issue Type

[jira] [Updated] (AIRFLOW-149) Blocked TI Explainer + Dependency Engine

2016-08-26 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-149: External issue URL: https://github.com/apache/incubator-airflow/pull/1729 (was: https

[jira] [Resolved] (AIRFLOW-149) Blocked TI Explainer + Dependency Engine

2016-08-26 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov resolved AIRFLOW-149. - Resolution: Fixed > Blocked TI Explainer + Dependency Eng

[jira] [Created] (AIRFLOW-536) Dags only get one dagrun is scheduled per scheduler loop

2016-09-30 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-536: --- Summary: Dags only get one dagrun is scheduled per scheduler loop Key: AIRFLOW-536 URL: https://issues.apache.org/jira/browse/AIRFLOW-536 Project: Apache Airflow

[jira] [Created] (AIRFLOW-633) Show task instance attributes in task instance view

2016-11-15 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-633: --- Summary: Show task instance attributes in task instance view Key: AIRFLOW-633 URL: https://issues.apache.org/jira/browse/AIRFLOW-633 Project: Apache Airflow

[jira] [Updated] (AIRFLOW-536) Dags only get one dagrun is scheduled per scheduler loop

2016-11-29 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-536: Description: At the moment Dags only get one dag scheduled per scheduler loop (which can be quite

[jira] [Created] (AIRFLOW-682) Bump MAX_PERIODS

2016-12-07 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-682: --- Summary: Bump MAX_PERIODS Key: AIRFLOW-682 URL: https://issues.apache.org/jira/browse/AIRFLOW-682 Project: Apache Airflow Issue Type: Bug Reporter

[jira] [Created] (AIRFLOW-684) Add task log pagination to webservers

2016-12-07 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-684: --- Summary: Add task log pagination to webservers Key: AIRFLOW-684 URL: https://issues.apache.org/jira/browse/AIRFLOW-684 Project: Apache Airflow Issue Type

[jira] [Created] (AIRFLOW-698) dag_run "scheduled" property should be it's own DB column

2016-12-13 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-698: --- Summary: dag_run "scheduled" property should be it's own DB column Key: AIRFLOW-698 URL: https://issues.apache.org/jira/browse/AIRFLOW-698 Project: Apac

[jira] [Commented] (AIRFLOW-747) retry_delay not honored

2017-01-11 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819176#comment-15819176 ] Dan Davydov commented on AIRFLOW-747: - The cgroups PR is my priority right now but happy to look

[jira] [Updated] (AIRFLOW-536) Dags only get one dagrun is scheduled per scheduler loop

2016-11-29 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-536: Description: At the moment Dags only get one dag scheduled per scheduler loop (which can be quite

[jira] [Updated] (AIRFLOW-536) Dags only get one dagrun is scheduled per scheduler loop

2016-11-29 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-536: Description: At the moment Dags only get one dag scheduled per scheduler loop (which can be quite

[jira] [Created] (AIRFLOW-672) Allow logs to be piped into another process

2016-12-05 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-672: --- Summary: Allow logs to be piped into another process Key: AIRFLOW-672 URL: https://issues.apache.org/jira/browse/AIRFLOW-672 Project: Apache Airflow Issue

[jira] [Created] (AIRFLOW-674) Ability to add descriptions for DAGs

2016-12-05 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-674: --- Summary: Ability to add descriptions for DAGs Key: AIRFLOW-674 URL: https://issues.apache.org/jira/browse/AIRFLOW-674 Project: Apache Airflow Issue Type

[jira] [Updated] (AIRFLOW-674) Ability to add descriptions for DAGs

2016-12-05 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-674: Description: Add a "description" property to DAGs that will be shown in vari

[jira] [Resolved] (AIRFLOW-682) Bump MAX_PERIODS

2016-12-07 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov resolved AIRFLOW-682. - Resolution: Fixed > Bump MAX_PERIODS > > > Key:

[jira] [Commented] (AIRFLOW-719) Skipped operations make DAG finish prematurely

2017-03-17 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15930930#comment-15930930 ] Dan Davydov commented on AIRFLOW-719: - [~dgies] We found the same, this is considered a bug

[jira] [Comment Edited] (AIRFLOW-992) Skipped tasks do not propagate correctly

2017-03-17 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15930940#comment-15930940 ] Dan Davydov edited comment on AIRFLOW-992 at 3/18/17 12:39 AM: --- Good point

[jira] [Updated] (AIRFLOW-992) Skipped tasks do not propagate correctly

2017-03-17 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-992: Description: We are seeing skipped tasks not being propagated correctly: E.g. A->B `-->C

[jira] [Commented] (AIRFLOW-992) Skipped tasks do not propagate correctly

2017-03-17 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15930940#comment-15930940 ] Dan Davydov commented on AIRFLOW-992: - Good point I'll do both edit + comment in the future

[jira] [Updated] (AIRFLOW-983) Make trigger rules more explicit regarding success vs skipped

2017-03-20 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-983: Priority: Blocker (was: Major) > Make trigger rules more explicit regarding success vs skip

[jira] [Created] (AIRFLOW-1017) get_task_instance should return None instead of throw an exception for non-existent TIs

2017-03-20 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1017: Summary: get_task_instance should return None instead of throw an exception for non-existent TIs Key: AIRFLOW-1017 URL: https://issues.apache.org/jira/browse/AIRFLOW-1017

[jira] [Updated] (AIRFLOW-983) Make trigger rules more explicit regarding success vs skipped

2017-03-20 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-983: Priority: Critical (was: Blocker) > Make trigger rules more explicit regarding success vs skip

[jira] [Created] (AIRFLOW-1019) active_dagruns shouldn't include paused DAGs

2017-03-20 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1019: Summary: active_dagruns shouldn't include paused DAGs Key: AIRFLOW-1019 URL: https://issues.apache.org/jira/browse/AIRFLOW-1019 Project: Apache Airflow

[jira] [Created] (AIRFLOW-992) Skipped tasks do not propagate correctly

2017-03-15 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-992: --- Summary: Skipped tasks do not propagate correctly Key: AIRFLOW-992 URL: https://issues.apache.org/jira/browse/AIRFLOW-992 Project: Apache Airflow Issue Type

[jira] [Commented] (AIRFLOW-992) Skipped tasks do not propagate correctly

2017-03-15 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927332#comment-15927332 ] Dan Davydov commented on AIRFLOW-992: - This is the expected behavior after the semantics changes made

[jira] [Created] (AIRFLOW-1024) Handle CeleryExecutor errors gracefully

2017-03-21 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1024: Summary: Handle CeleryExecutor errors gracefully Key: AIRFLOW-1024 URL: https://issues.apache.org/jira/browse/AIRFLOW-1024 Project: Apache Airflow Issue

[jira] [Updated] (AIRFLOW-983) Make trigger rules more explicit regarding success vs skipped

2017-03-21 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-983: Description: Since AIRFLOW-719, the trigger rules all_success/one_success include both success

[jira] [Commented] (AIRFLOW-983) Make trigger rules more explicit regarding success vs skipped

2017-03-21 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935420#comment-15935420 ] Dan Davydov commented on AIRFLOW-983: - It's possible the reason for the change in semantics (which

[jira] [Commented] (AIRFLOW-983) Make trigger rules more explicit regarding success vs skipped

2017-03-21 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935444#comment-15935444 ] Dan Davydov commented on AIRFLOW-983: - No, and I'll be out for a couple of weeks unfortunately

[jira] [Commented] (AIRFLOW-1019) active_dagruns shouldn't include paused DAGs

2017-04-11 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965082#comment-15965082 ] Dan Davydov commented on AIRFLOW-1019: -- Probably not a blocker, just a performance degradation

[jira] [Commented] (AIRFLOW-983) Make trigger rules more explicit regarding success vs skipped

2017-04-11 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965060#comment-15965060 ] Dan Davydov commented on AIRFLOW-983: - It seems like the commit was reverted but I'm not sure

[jira] [Updated] (AIRFLOW-940) Failing to unencrypt one variable shouldn't break the admin/variable page

2017-03-03 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-940: Labels: beginner starter (was: ) > Failing to unencrypt one variable shouldn't break the ad

[jira] [Created] (AIRFLOW-940) Failing to unencrypt one variable shouldn't break the admin/variable page

2017-03-03 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-940: --- Summary: Failing to unencrypt one variable shouldn't break the admin/variable page Key: AIRFLOW-940 URL: https://issues.apache.org/jira/browse/AIRFLOW-940 Project

[jira] [Updated] (AIRFLOW-940) Failing to unencrypt one variable shouldn't break the admin/variable page

2017-03-03 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-940: Description: At the moment failing to decrypt one of the airflow variables in the database using

[jira] [Commented] (AIRFLOW-976) Mark success running task causes it to fail

2017-03-13 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15922930#comment-15922930 ] Dan Davydov commented on AIRFLOW-976: - It is but I wouldn't say it's a blocker for release. > M

[jira] [Created] (AIRFLOW-976) Mark success running task causes it to fail

2017-03-13 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-976: --- Summary: Mark success running task causes it to fail Key: AIRFLOW-976 URL: https://issues.apache.org/jira/browse/AIRFLOW-976 Project: Apache Airflow Issue

[jira] [Commented] (AIRFLOW-932) Backfills delete existing task instances and mark them as removed

2017-03-02 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15893135#comment-15893135 ] Dan Davydov commented on AIRFLOW-932: - I think tasks should only be verified/removed in the scheduler

[jira] [Commented] (AIRFLOW-932) Backfills delete existing task instances and mark them as removed

2017-03-02 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15893157#comment-15893157 ] Dan Davydov commented on AIRFLOW-932: - If the goal is to eventually move all the logic

[jira] [Commented] (AIRFLOW-932) Backfills delete existing task instances and mark them as removed

2017-03-02 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15893158#comment-15893158 ] Dan Davydov commented on AIRFLOW-932: - Thanks for fixing! > Backfills delete existing task instan

[jira] [Created] (AIRFLOW-936) Ability to clear/mark success all tasks in a dagrun in the UI

2017-03-02 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-936: --- Summary: Ability to clear/mark success all tasks in a dagrun in the UI Key: AIRFLOW-936 URL: https://issues.apache.org/jira/browse/AIRFLOW-936 Project: Apache Airflow

[jira] [Comment Edited] (AIRFLOW-932) Backfills delete existing task instances and mark them as removed

2017-03-02 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15892818#comment-15892818 ] Dan Davydov edited comment on AIRFLOW-932 at 3/2/17 7:14 PM: - This is off

[jira] [Comment Edited] (AIRFLOW-932) Backfills delete existing task instances and mark them as removed

2017-03-02 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15892823#comment-15892823 ] Dan Davydov edited comment on AIRFLOW-932 at 3/2/17 7:17 PM: - Ah I think I

[jira] [Comment Edited] (AIRFLOW-932) Backfills delete existing task instances and mark them as removed

2017-03-02 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15892823#comment-15892823 ] Dan Davydov edited comment on AIRFLOW-932 at 3/2/17 7:21 PM: - Ah I think I

[jira] [Created] (AIRFLOW-932) Backfills delete existing task instances and mark them as removed

2017-03-01 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-932: --- Summary: Backfills delete existing task instances and mark them as removed Key: AIRFLOW-932 URL: https://issues.apache.org/jira/browse/AIRFLOW-932 Project: Apache

[jira] [Commented] (AIRFLOW-932) Backfills delete existing task instances and mark them as removed

2017-03-01 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15890822#comment-15890822 ] Dan Davydov commented on AIRFLOW-932: - I'm still investigating and will update the ticket with more

[jira] [Commented] (AIRFLOW-920) Can't mark non-existent tasks as successful from graph view

2017-03-01 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15890870#comment-15890870 ] Dan Davydov commented on AIRFLOW-920: - [~bolke] Where does ```from subdags.subdag import subdag

[jira] [Comment Edited] (AIRFLOW-920) Can't mark non-existent tasks as successful from graph view

2017-03-01 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15890870#comment-15890870 ] Dan Davydov edited comment on AIRFLOW-920 at 3/1/17 7:29 PM: - [~bolke] Where

[jira] [Issue Comment Deleted] (AIRFLOW-920) Can't mark non-existent tasks as successful from graph view

2017-03-01 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-920: Comment: was deleted (was: [~bolke] Where does {quote}from subdags.subdag import subdag{quote

[jira] [Commented] (AIRFLOW-920) Can't mark non-existent tasks as successful from graph view

2017-02-28 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15888701#comment-15888701 ] Dan Davydov commented on AIRFLOW-920: - [~bolke] I'm not seeing this behavior. Marking

[jira] [Updated] (AIRFLOW-921) 1.8.0rc Issues

2017-03-02 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-921: Description: These are the pending issues for the Airflow 1.8.0 release: Blockers: [~bolke

[jira] [Resolved] (AIRFLOW-920) Can't mark non-existent tasks as successful from graph view

2017-03-01 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov resolved AIRFLOW-920. - Resolution: Cannot Reproduce > Can't mark non-existent tasks as successful from graph v

[jira] [Commented] (AIRFLOW-920) Can't mark non-existent tasks as successful from graph view

2017-03-01 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15891122#comment-15891122 ] Dan Davydov commented on AIRFLOW-920: - I can confirm that this subdag works (even on Airbnb's

[jira] [Updated] (AIRFLOW-953) Tasks marked as successful should have complete state set

2017-03-07 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-953: Summary: Tasks marked as successful should have complete state set (was: Tasks marked

[jira] [Created] (AIRFLOW-953) Tasks marked as successful should have start/end_date/duration set

2017-03-07 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-953: --- Summary: Tasks marked as successful should have start/end_date/duration set Key: AIRFLOW-953 URL: https://issues.apache.org/jira/browse/AIRFLOW-953 Project: Apache

[jira] [Updated] (AIRFLOW-1111) Make logs easier to read and separate infra/task logs

2017-04-14 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-: - Description: Ideally there would be tabs for logs: Dag-parsing (needs a better name) 1 (Short

[jira] [Created] (AIRFLOW-1111) Make logs easier to read and separate infra/task logs

2017-04-14 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-: Summary: Make logs easier to read and separate infra/task logs Key: AIRFLOW- URL: https://issues.apache.org/jira/browse/AIRFLOW- Project: Apache Airflow

[jira] [Created] (AIRFLOW-1123) Airflow workers should handle shutdowns gracefully

2017-04-18 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1123: Summary: Airflow workers should handle shutdowns gracefully Key: AIRFLOW-1123 URL: https://issues.apache.org/jira/browse/AIRFLOW-1123 Project: Apache Airflow

[jira] [Commented] (AIRFLOW-774) dagbag_size/collect_dags/dagbag_import_errors stats incorrect

2017-08-02 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111825#comment-16111825 ] Dan Davydov commented on AIRFLOW-774: - Yes to master, IIRC they should appear starting from release

[jira] [Created] (AIRFLOW-1513) Come up with an abstraction to set defaults per task

2017-08-15 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1513: Summary: Come up with an abstraction to set defaults per task Key: AIRFLOW-1513 URL: https://issues.apache.org/jira/browse/AIRFLOW-1513 Project: Apache Airflow

[jira] [Assigned] (AIRFLOW-1311) Improve Webserver Load Time For Large DAGs

2017-08-15 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov reassigned AIRFLOW-1311: Assignee: Dan Davydov > Improve Webserver Load Time For Large D

[jira] [Assigned] (AIRFLOW-1311) Improve Webserver Load Time For Large DAGs

2017-08-15 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov reassigned AIRFLOW-1311: Assignee: Edgar Rodriguez (was: Dan Davydov) > Improve Webserver Load Time For La

[jira] [Resolved] (AIRFLOW-1442) Airflow Ignore All Deps Command Generation Has an Extra Space

2017-08-15 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov resolved AIRFLOW-1442. -- Resolution: Fixed > Airflow Ignore All Deps Command Generation Has an Extra Sp

[jira] [Commented] (AIRFLOW-1311) Improve Webserver Load Time For Large DAGs

2017-08-15 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128134#comment-16128134 ] Dan Davydov commented on AIRFLOW-1311: -- Edgar assigning to you, feel free to mark as dupe or merge

[jira] [Resolved] (AIRFLOW-1266) Long task names are truncated in gannt view

2017-08-15 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov resolved AIRFLOW-1266. -- Resolution: Fixed > Long task names are truncated in gannt v

[jira] [Assigned] (AIRFLOW-1247) CLI: ignore all dependencies argument ignored

2017-07-13 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov reassigned AIRFLOW-1247: Assignee: Dan Davydov (was: Matti Remes) > CLI: ignore all dependencies argum

[jira] [Created] (AIRFLOW-1442) Airflow Ignore All Deps Command Generation Has an Extra Space

2017-07-21 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1442: Summary: Airflow Ignore All Deps Command Generation Has an Extra Space Key: AIRFLOW-1442 URL: https://issues.apache.org/jira/browse/AIRFLOW-1442 Project: Apache

[jira] [Created] (AIRFLOW-1448) Revert PR 2433 which added merge conflicts to master

2017-07-24 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1448: Summary: Revert PR 2433 which added merge conflicts to master Key: AIRFLOW-1448 URL: https://issues.apache.org/jira/browse/AIRFLOW-1448 Project: Apache Airflow

[jira] [Created] (AIRFLOW-1432) NVD3 Charts do not have labeled axes and units change dynamically

2017-07-19 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1432: Summary: NVD3 Charts do not have labeled axes and units change dynamically Key: AIRFLOW-1432 URL: https://issues.apache.org/jira/browse/AIRFLOW-1432 Project: Apache

[jira] [Created] (AIRFLOW-1351) airflow cli commands should log error/debug to stderr

2017-06-27 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1351: Summary: airflow cli commands should log error/debug to stderr Key: AIRFLOW-1351 URL: https://issues.apache.org/jira/browse/AIRFLOW-1351 Project: Apache Airflow

[jira] [Created] (AIRFLOW-1152) Backfill dagruns should not hang DAGs

2017-04-26 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1152: Summary: Backfill dagruns should not hang DAGs Key: AIRFLOW-1152 URL: https://issues.apache.org/jira/browse/AIRFLOW-1152 Project: Apache Airflow Issue Type

[jira] [Commented] (AIRFLOW-1143) Tasks rejected by workers get stuck in QUEUED

2017-04-27 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987188#comment-15987188 ] Dan Davydov commented on AIRFLOW-1143: -- I agree the NONE solution is OK for now (need to be careful

[jira] [Updated] (AIRFLOW-1143) Tasks rejected by workers get stuck in QUEUED

2017-04-24 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-1143: - Description: If the scheduler schedules a task that is sent to a worker that then rejects

[jira] [Closed] (AIRFLOW-672) Allow logs to be piped into another process

2017-08-09 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov closed AIRFLOW-672. --- Resolution: Fixed Not really relevant with the new logging abstraction anymore. We can create

[jira] [Resolved] (AIRFLOW-1349) Max active dagrun check for backfills shouldn't include the backfilled dagrun

2017-08-09 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov resolved AIRFLOW-1349. -- Resolution: Fixed > Max active dagrun check for backfills shouldn't include the backfil

[jira] [Updated] (AIRFLOW-908) Airflow run should print worker name at top of log

2017-05-02 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-908: Description: Airflow run should log the worker hostname at top of log. (was: Airflow run should

[jira] [Closed] (AIRFLOW-907) Ability to clear all task_instances for a dagrun in the UI

2017-05-02 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov closed AIRFLOW-907. --- Resolution: Duplicate > Ability to clear all task_instances for a dagrun in the

[jira] [Resolved] (AIRFLOW-395) Remove commas from resoures in config

2017-05-03 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov resolved AIRFLOW-395. - Resolution: Fixed > Remove commas from resoures in con

[jira] [Resolved] (AIRFLOW-385) Scheduler logs should have a "latest" directory

2017-05-03 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov resolved AIRFLOW-385. - Resolution: Fixed > Scheduler logs should have a "latest&qu

[jira] [Commented] (AIRFLOW-908) Airflow run should print worker name at top of log

2017-05-15 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16011029#comment-16011029 ] Dan Davydov commented on AIRFLOW-908: - I'm planning on giving this task to my intern as part

[jira] [Assigned] (AIRFLOW-908) Airflow run should print worker name at top of log

2017-05-15 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov reassigned AIRFLOW-908: --- Assignee: Dan Davydov (was: Phawin Khongkhasawan) > Airflow run should print worker n

[jira] [Assigned] (AIRFLOW-936) Ability to clear/mark success all tasks in a dagrun in the UI

2017-05-17 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov reassigned AIRFLOW-936: --- Assignee: Dan Davydov > Ability to clear/mark success all tasks in a dagrun in the

[jira] [Resolved] (AIRFLOW-1024) Handle CeleryExecutor errors gracefully

2017-06-08 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov resolved AIRFLOW-1024. -- Resolution: Fixed > Handle CeleryExecutor errors gracefu

[jira] [Created] (AIRFLOW-1241) Allow airflow test and airflow run to take arguments to pass to DAGs

2017-05-23 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1241: Summary: Allow airflow test and airflow run to take arguments to pass to DAGs Key: AIRFLOW-1241 URL: https://issues.apache.org/jira/browse/AIRFLOW-1241 Project

[jira] [Updated] (AIRFLOW-1249) Running tasks from backfills with unmet conditions are stuck running

2017-05-26 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-1249: - Description: Running tasks from backfills with unmet conditions are stuck running. E.g. create

[jira] [Updated] (AIRFLOW-1249) Running tasks from backfills with unmet conditions are stuck running

2017-05-26 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-1249: - Description: Running tasks from backfills with unmet conditions are stuck running. E.g. create

[jira] [Updated] (AIRFLOW-1249) Running tasks from backfills with unmet conditions are stuck running

2017-05-26 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-1249: - Description: Running tasks from backfills with unmet conditions are stuck running. E.g. create

[jira] [Created] (AIRFLOW-1263) Airflow Task Tries Page

2017-06-01 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1263: Summary: Airflow Task Tries Page Key: AIRFLOW-1263 URL: https://issues.apache.org/jira/browse/AIRFLOW-1263 Project: Apache Airflow Issue Type: Bug

[jira] [Created] (AIRFLOW-1266) Long task names are truncated in gannt view

2017-06-01 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1266: Summary: Long task names are truncated in gannt view Key: AIRFLOW-1266 URL: https://issues.apache.org/jira/browse/AIRFLOW-1266 Project: Apache Airflow Issue

[jira] [Updated] (AIRFLOW-1263) Airflow Charts Pages Should Have Dynamic Heights

2017-06-01 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-1263: - Summary: Airflow Charts Pages Should Have Dynamic Heights (was: Airflow Task Tries Page

[jira] [Updated] (AIRFLOW-1263) Airflow Charts Pages Should Have Dynamic Heights

2017-06-01 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-1263: - Description: Currently Airflow has a fixed height of 600px for the airflow task tries page

[jira] [Updated] (AIRFLOW-1288) Bad owners field in DAGs breaks Airflow front page

2017-06-07 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-1288: - Description: DAGs that have owners set to a bad value break the front page of the webserver

[jira] [Created] (AIRFLOW-1288) Bad owners field in DAGs breaks Airflow front page

2017-06-07 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1288: Summary: Bad owners field in DAGs breaks Airflow front page Key: AIRFLOW-1288 URL: https://issues.apache.org/jira/browse/AIRFLOW-1288 Project: Apache Airflow

[jira] [Created] (AIRFLOW-1257) Manually Created Dagruns Are Broken In Multiple Ways

2017-05-31 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1257: Summary: Manually Created Dagruns Are Broken In Multiple Ways Key: AIRFLOW-1257 URL: https://issues.apache.org/jira/browse/AIRFLOW-1257 Project: Apache Airflow

[jira] [Created] (AIRFLOW-1311) Improve Webserver Load Time For Large DAGs

2017-06-15 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1311: Summary: Improve Webserver Load Time For Large DAGs Key: AIRFLOW-1311 URL: https://issues.apache.org/jira/browse/AIRFLOW-1311 Project: Apache Airflow Issue

[jira] [Created] (AIRFLOW-1280) Gantt Chart Height Isn't Set Properly

2017-06-05 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-1280: Summary: Gantt Chart Height Isn't Set Properly Key: AIRFLOW-1280 URL: https://issues.apache.org/jira/browse/AIRFLOW-1280 Project: Apache Airflow Issue Type

<    1   2   3   4   >