[jira] [Created] (AIRFLOW-222) Running Task Instances in UI should show duration

2016-06-08 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-222: --- Summary: Running Task Instances in UI should show duration Key: AIRFLOW-222 URL: https://issues.apache.org/jira/browse/AIRFLOW-222 Project: Apache Airflow

[jira] [Updated] (AIRFLOW-222) Running task instances should show duration in UI

2016-06-08 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-222: Summary: Running task instances should show duration in UI (was: Running Task Instances in UI

[jira] [Resolved] (AIRFLOW-218) Option to enable error/access log for gunicorn

2016-06-07 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov resolved AIRFLOW-218. - Resolution: Fixed Issue resolved by pull request #1577

[jira] [Work started] (AIRFLOW-218) Option to enable error/access log for gunicorn

2016-06-07 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-218 started by Dan Davydov. --- > Option to enable error/access log for gunicorn >

[jira] [Commented] (AIRFLOW-184) Add clear/mark success to CLI

2016-06-06 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15317128#comment-15317128 ] Dan Davydov commented on AIRFLOW-184: - I agree that mark_success should be moved into a separate

[jira] [Created] (AIRFLOW-226) Create separate pip packages for webserver and hooks

2016-06-09 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-226: --- Summary: Create separate pip packages for webserver and hooks Key: AIRFLOW-226 URL: https://issues.apache.org/jira/browse/AIRFLOW-226 Project: Apache Airflow

[jira] [Resolved] (AIRFLOW-223) Make parametrable the IP on which Flower binds to

2016-06-15 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov resolved AIRFLOW-223. - Resolution: Fixed > Make parametrable the IP on which Flower binds to >

[jira] [Created] (AIRFLOW-241) Add testing done section to PR template

2016-06-14 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-241: --- Summary: Add testing done section to PR template Key: AIRFLOW-241 URL: https://issues.apache.org/jira/browse/AIRFLOW-241 Project: Apache Airflow Issue Type:

[jira] [Resolved] (AIRFLOW-241) Add testing done section to PR template

2016-06-21 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov resolved AIRFLOW-241. - Resolution: Fixed > Add testing done section to PR template >

[jira] [Resolved] (AIRFLOW-112) Change default view from graph view to tree view

2016-06-21 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov resolved AIRFLOW-112. - Resolution: Fixed > Change default view from graph view to tree view >

[jira] [Created] (AIRFLOW-149) Blocked TI Explainer + Dependency Engine

2016-05-19 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-149: --- Summary: Blocked TI Explainer + Dependency Engine Key: AIRFLOW-149 URL: https://issues.apache.org/jira/browse/AIRFLOW-149 Project: Apache Airflow Issue Type:

[jira] [Commented] (AIRFLOW-150) setup.py classifiers should be a list not a dict

2016-05-20 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15293843#comment-15293843 ] Dan Davydov commented on AIRFLOW-150: - Ah it looks like it was assigned to me, oh well. > setup.py

[jira] [Assigned] (AIRFLOW-150) setup.py classifiers should be a list not a dict

2016-05-20 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov reassigned AIRFLOW-150: --- Assignee: Dan Davydov (was: Chris Riccomini) > setup.py classifiers should be a list not a

[jira] [Commented] (AIRFLOW-150) setup.py classifiers should be a list not a dict

2016-05-20 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15293837#comment-15293837 ] Dan Davydov commented on AIRFLOW-150: - That's weird I thought I assigned the issue to myself (it's

[jira] [Commented] (AIRFLOW-94) 'Mark upstream tasks as successful' does not actually select upstream tasks

2016-05-10 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-94?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278790#comment-15278790 ] Dan Davydov commented on AIRFLOW-94: I couldn't reproduce this on airbnb_rb1.7.1rc4 (this branch is a

[jira] [Commented] (AIRFLOW-95) 'Mark downstream tasks as successful' raises an exception

2016-05-10 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-95?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278791#comment-15278791 ] Dan Davydov commented on AIRFLOW-95: FWIW I couldn't reproduce this on airbnb_rb1.7.1rc4 (this branch

[jira] [Commented] (AIRFLOW-52) Release airflow 1.7.1

2016-05-10 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-52?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279187#comment-15279187 ] Dan Davydov commented on AIRFLOW-52: Update: I'm going to let the release bake in our staging cluster

[jira] [Commented] (AIRFLOW-52) Release airflow 1.7.1

2016-05-17 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-52?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287075#comment-15287075 ] Dan Davydov commented on AIRFLOW-52: Update: I released to production yesterday and so far things have

[jira] [Updated] (AIRFLOW-126) Client facing functions should not raise exceptions but have proper exit codes

2016-05-17 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-126: Description: Many client facing functions (cli) raise exceptions on failure, which is not very

[jira] [Resolved] (AIRFLOW-118) use targetPartitionSize as the default partition spec for HiveToDruidTransfer operator

2016-05-16 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov resolved AIRFLOW-118. - Resolution: Fixed > use targetPartitionSize as the default partition spec for

[jira] [Created] (AIRFLOW-52) Release airflow 1.7.1

2016-05-05 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-52: -- Summary: Release airflow 1.7.1 Key: AIRFLOW-52 URL: https://issues.apache.org/jira/browse/AIRFLOW-52 Project: Apache Airflow Issue Type: Task

[jira] [Updated] (AIRFLOW-52) Release airflow 1.7.1

2016-05-05 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-52?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-52: --- Description: Release the airflow 1.7.1 tag. Current status: I found the commit that caused the

[jira] [Commented] (AIRFLOW-61) Corner case with deadlocked multiprocessing queues

2016-05-06 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-61?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15274695#comment-15274695 ] Dan Davydov commented on AIRFLOW-61: We rolled back pretty quickly once we saw errors in production so

[jira] [Updated] (AIRFLOW-52) Release airflow 1.7.1

2016-05-05 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-52?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-52: --- Description: Release the airflow 1.7.1 tag. Current status: There are two issues blocking this

[jira] [Commented] (AIRFLOW-52) Release airflow 1.7.1

2016-05-05 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-52?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273389#comment-15273389 ] Dan Davydov commented on AIRFLOW-52: Updated the ticket with details on the blockers. > Release

[jira] [Commented] (AIRFLOW-52) Release airflow 1.7.1

2016-05-10 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-52?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278503#comment-15278503 ] Dan Davydov commented on AIRFLOW-52: Roger. > Release airflow 1.7.1 > - > >

[jira] [Updated] (AIRFLOW-52) Release airflow 1.7.1

2016-05-09 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-52?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-52: --- Description: Release the airflow 1.7.1 tag. Current status: There are three issues blocking this

[jira] [Resolved] (AIRFLOW-341) Add Resources To Tasks

2016-07-27 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov resolved AIRFLOW-341. - Resolution: Fixed > Add Resources To Tasks > -- > > Key:

[jira] [Updated] (AIRFLOW-417) UI should not print traceback for missing dag/task in URL

2016-08-11 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-417: Labels: UI (was: ) > UI should not print traceback for missing dag/task in URL >

[jira] [Updated] (AIRFLOW-417) UI should not print traceback for missing dag/task in URL

2016-08-11 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-417: Component/s: webserver > UI should not print traceback for missing dag/task in URL >

[jira] [Created] (AIRFLOW-415) Make dag_id not found error due to dag failing to parse clearer

2016-08-10 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-415: --- Summary: Make dag_id not found error due to dag failing to parse clearer Key: AIRFLOW-415 URL: https://issues.apache.org/jira/browse/AIRFLOW-415 Project: Apache

[jira] [Created] (AIRFLOW-413) Backfilling pickled DAG hits undefined variable

2016-08-10 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-413: --- Summary: Backfilling pickled DAG hits undefined variable Key: AIRFLOW-413 URL: https://issues.apache.org/jira/browse/AIRFLOW-413 Project: Apache Airflow Issue

[jira] [Created] (AIRFLOW-349) Metric for zombies killed

2016-07-20 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-349: --- Summary: Metric for zombies killed Key: AIRFLOW-349 URL: https://issues.apache.org/jira/browse/AIRFLOW-349 Project: Apache Airflow Issue Type: Improvement

[jira] [Updated] (AIRFLOW-349) Metric for zombies killed

2016-07-20 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-349: External issue URL: https://github.com/apache/incubator-airflow/pull/1673 > Metric for zombies

[jira] [Created] (AIRFLOW-347) Empty dagruns don't appear in tree view

2016-07-19 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-347: --- Summary: Empty dagruns don't appear in tree view Key: AIRFLOW-347 URL: https://issues.apache.org/jira/browse/AIRFLOW-347 Project: Apache Airflow Issue Type:

[jira] [Created] (AIRFLOW-341) Add Resources To Tasks

2016-07-15 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-341: --- Summary: Add Resources To Tasks Key: AIRFLOW-341 URL: https://issues.apache.org/jira/browse/AIRFLOW-341 Project: Apache Airflow Issue Type: New Feature

[jira] [Updated] (AIRFLOW-341) Add Resources To Tasks

2016-07-15 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-341: External issue URL: https://github.com/apache/incubator-airflow/pull/1669 > Add Resources To Tasks

[jira] [Created] (AIRFLOW-316) Always check DB state for Backfill Job execution

2016-07-06 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-316: --- Summary: Always check DB state for Backfill Job execution Key: AIRFLOW-316 URL: https://issues.apache.org/jira/browse/AIRFLOW-316 Project: Apache Airflow

[jira] [Resolved] (AIRFLOW-316) Always check DB state for Backfill Job execution

2016-07-06 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov resolved AIRFLOW-316. - Resolution: Fixed > Always check DB state for Backfill Job execution >

[jira] [Updated] (AIRFLOW-316) Always check DB state for Backfill Job execution

2016-07-06 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-316: External issue URL: https://github.com/apache/incubator-airflow/pull/1654 > Always check DB state

[jira] [Created] (AIRFLOW-395) Remove commas from resoures in config

2016-08-04 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-395: --- Summary: Remove commas from resoures in config Key: AIRFLOW-395 URL: https://issues.apache.org/jira/browse/AIRFLOW-395 Project: Apache Airflow Issue Type: Bug

[jira] [Created] (AIRFLOW-385) Scheduler logs should have a "latest" directory

2016-07-29 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-385: --- Summary: Scheduler logs should have a "latest" directory Key: AIRFLOW-385 URL: https://issues.apache.org/jira/browse/AIRFLOW-385 Project: Apache Airflow Issue

[jira] [Created] (AIRFLOW-299) Evaluate a plugin architecture to replace contrib

2016-06-30 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-299: --- Summary: Evaluate a plugin architecture to replace contrib Key: AIRFLOW-299 URL: https://issues.apache.org/jira/browse/AIRFLOW-299 Project: Apache Airflow

[jira] [Resolved] (AIRFLOW-780) The UI no longer shows broken DAGs

2017-02-02 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov resolved AIRFLOW-780. - Resolution: Fixed > The UI no longer shows broken DAGs > -- > >

[jira] [Resolved] (AIRFLOW-778) Metastore Partition Sensor Broken

2017-02-02 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov resolved AIRFLOW-778. - Resolution: Fixed > Metastore Partition Sensor Broken > - > >

[jira] [Resolved] (AIRFLOW-844) CgroupTaskRunner does not create cgroups correctly

2017-02-06 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov resolved AIRFLOW-844. - Resolution: Fixed > CgroupTaskRunner does not create cgroups correctly >

[jira] [Created] (AIRFLOW-844) CgroupTaskRunner does not create cgroups correctly

2017-02-06 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-844: --- Summary: CgroupTaskRunner does not create cgroups correctly Key: AIRFLOW-844 URL: https://issues.apache.org/jira/browse/AIRFLOW-844 Project: Apache Airflow

[jira] [Created] (AIRFLOW-778) Metastore Partition Sensor Broken

2017-01-20 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-778: --- Summary: Metastore Partition Sensor Broken Key: AIRFLOW-778 URL: https://issues.apache.org/jira/browse/AIRFLOW-778 Project: Apache Airflow Issue Type: Bug

[jira] [Commented] (AIRFLOW-778) Metastore Partition Sensor Broken

2017-01-20 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15832444#comment-15832444 ] Dan Davydov commented on AIRFLOW-778: - Yes (this was the original code). The reason is it skips the

[jira] [Updated] (AIRFLOW-780) The UI no longer shows broken DAGs

2017-01-20 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-780: Priority: Critical (was: Major) > The UI no longer shows broken DAGs >

[jira] [Created] (AIRFLOW-897) Dagruns get marked as failed as soon as one root task fails

2017-02-23 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-897: --- Summary: Dagruns get marked as failed as soon as one root task fails Key: AIRFLOW-897 URL: https://issues.apache.org/jira/browse/AIRFLOW-897 Project: Apache Airflow

[jira] [Commented] (AIRFLOW-891) Webserver Clock Should Include Day

2017-02-23 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881363#comment-15881363 ] Dan Davydov commented on AIRFLOW-891: - I feel like that might be a bit busy but I don't have a strong

[jira] [Created] (AIRFLOW-893) Webservers crash when a DAG doesn't have a start date set

2017-02-22 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-893: --- Summary: Webservers crash when a DAG doesn't have a start date set Key: AIRFLOW-893 URL: https://issues.apache.org/jira/browse/AIRFLOW-893 Project: Apache Airflow

[jira] [Created] (AIRFLOW-899) Tasks in SCHEDULED state should appear as white in the UI

2017-02-23 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-899: --- Summary: Tasks in SCHEDULED state should appear as white in the UI Key: AIRFLOW-899 URL: https://issues.apache.org/jira/browse/AIRFLOW-899 Project: Apache Airflow

[jira] [Updated] (AIRFLOW-904) UPSTREAM_FAILED tasks should run when their upstream task changes state

2017-02-24 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-904: Issue Type: Improvement (was: Bug) > UPSTREAM_FAILED tasks should run when their upstream task

[jira] [Created] (AIRFLOW-904) UPSTREAM_FAILED tasks should run when their upstream task changes state

2017-02-24 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-904: --- Summary: UPSTREAM_FAILED tasks should run when their upstream task changes state Key: AIRFLOW-904 URL: https://issues.apache.org/jira/browse/AIRFLOW-904 Project:

[jira] [Updated] (AIRFLOW-904) UPSTREAM_FAILED tasks should run when their upstream task changes state

2017-02-24 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-904: Description: Right now if you have a task that depends on UPSTREAM_FAILED and the UPSTREAM_FAILED

[jira] [Updated] (AIRFLOW-904) UPSTREAM_FAILED tasks should run when their upstream task changes state

2017-02-24 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-904: Description: Right now if you have a task that depends on UPSTREAM_FAILED and the UPSTREAM_FAILED

[jira] [Updated] (AIRFLOW-904) UPSTREAM_FAILED tasks should run when their upstream task changes state

2017-02-24 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-904: Description: Right now if you have a task that depends on UPSTREAM_FAILED and the UPSTREAM_FAILED

[jira] [Updated] (AIRFLOW-904) UPSTREAM_FAILED tasks should run when their upstream task changes state

2017-02-24 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-904: Description: Right now if you have a task that depends on UPSTREAM_FAILED and the UPSTREAM_FAILED

[jira] [Created] (AIRFLOW-907) Ability to clear all task_instances for a dagrun in the UI

2017-02-24 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-907: --- Summary: Ability to clear all task_instances for a dagrun in the UI Key: AIRFLOW-907 URL: https://issues.apache.org/jira/browse/AIRFLOW-907 Project: Apache Airflow

[jira] [Created] (AIRFLOW-908) Airflow run should print worker name at top of log

2017-02-24 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-908: --- Summary: Airflow run should print worker name at top of log Key: AIRFLOW-908 URL: https://issues.apache.org/jira/browse/AIRFLOW-908 Project: Apache Airflow

[jira] [Closed] (AIRFLOW-897) Dagruns get marked as failed as soon as one root task fails

2017-02-24 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov closed AIRFLOW-897. --- Resolution: Fixed > Dagruns get marked as failed as soon as one root task fails >

[jira] [Resolved] (AIRFLOW-880) Fix remote log functionality inconsistencies for Webservers

2017-02-21 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov resolved AIRFLOW-880. - Resolution: Fixed > Fix remote log functionality inconsistencies for Webservers >

[jira] [Created] (AIRFLOW-891) Webserver Clock Should Include Day

2017-02-21 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-891: --- Summary: Webserver Clock Should Include Day Key: AIRFLOW-891 URL: https://issues.apache.org/jira/browse/AIRFLOW-891 Project: Apache Airflow Issue Type:

[jira] [Created] (AIRFLOW-880) Fix remote log functionality inconsistencies for Webservers

2017-02-16 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-880: --- Summary: Fix remote log functionality inconsistencies for Webservers Key: AIRFLOW-880 URL: https://issues.apache.org/jira/browse/AIRFLOW-880 Project: Apache Airflow

[jira] [Created] (AIRFLOW-771) S3 logs should appended instead of clobbered by default

2017-01-19 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-771: --- Summary: S3 logs should appended instead of clobbered by default Key: AIRFLOW-771 URL: https://issues.apache.org/jira/browse/AIRFLOW-771 Project: Apache Airflow

[jira] [Resolved] (AIRFLOW-674) Ability to add descriptions for DAGs

2017-01-19 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov resolved AIRFLOW-674. - Resolution: Fixed > Ability to add descriptions for DAGs >

[jira] [Created] (AIRFLOW-772) Handle failed DAG parsing on workers

2017-01-19 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-772: --- Summary: Handle failed DAG parsing on workers Key: AIRFLOW-772 URL: https://issues.apache.org/jira/browse/AIRFLOW-772 Project: Apache Airflow Issue Type: Bug

[jira] [Updated] (AIRFLOW-774) dagbag_size stat incorrect

2017-01-19 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-774: Component/s: logging > dagbag_size stat incorrect > -- > >

[jira] [Updated] (AIRFLOW-774) dagbag_size stat incorrect

2017-01-19 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-774: Description: After the multiprocessor change was made (dag folders are processed in parallel), the

[jira] [Created] (AIRFLOW-774) dagbag_size stat incorrect

2017-01-19 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-774: --- Summary: dagbag_size stat incorrect Key: AIRFLOW-774 URL: https://issues.apache.org/jira/browse/AIRFLOW-774 Project: Apache Airflow Issue Type: Bug

[jira] [Updated] (AIRFLOW-774) dagbag_size/collect_dags/dagbag_import_errors stats incorrect

2017-01-19 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-774: Summary: dagbag_size/collect_dags/dagbag_import_errors stats incorrect (was: dagbag_size stat

[jira] [Updated] (AIRFLOW-774) dagbag_size stat incorrect

2017-01-19 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-774: Description: After the multiprocessor change was made (dag folders are processed in parallel), the

[jira] [Resolved] (AIRFLOW-924) (Named)HivePartitionSensor broken if hook attr not set

2017-02-28 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov resolved AIRFLOW-924. - Resolution: Duplicate > (Named)HivePartitionSensor broken if hook attr not set >

[jira] [Created] (AIRFLOW-925) (Named)HivePartitionSensor broken if hook attr not set

2017-02-28 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-925: --- Summary: (Named)HivePartitionSensor broken if hook attr not set Key: AIRFLOW-925 URL: https://issues.apache.org/jira/browse/AIRFLOW-925 Project: Apache Airflow

[jira] [Assigned] (AIRFLOW-925) (Named)HivePartitionSensor broken if hook attr not set

2017-02-28 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov reassigned AIRFLOW-925: --- Assignee: Alex Guziel > (Named)HivePartitionSensor broken if hook attr not set >

[jira] [Updated] (AIRFLOW-921) 1.8.0rc Issues

2017-02-28 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-921: Description: These are the pending issues for the Airflow 1.8.0 release: Blockers: [~bolke]

[jira] [Issue Comment Deleted] (AIRFLOW-921) 1.8.0rc Issues

2017-02-28 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-921: Comment: was deleted (was: Also add this https://issues.apache.org/jira/browse/AIRFLOW-924) >

[jira] [Updated] (AIRFLOW-925) (Named)HivePartitionSensor broken if hook attr not set

2017-02-28 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-925: Description: Right now, the import statement for (Named)HivePartitionSensor uses the wrong path >

[jira] [Commented] (AIRFLOW-920) Can't mark non-existent tasks as successful from graph view

2017-02-28 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15888949#comment-15888949 ] Dan Davydov commented on AIRFLOW-920: - Mark success doesn't propagate to the subdag dummy task though

[jira] [Commented] (AIRFLOW-932) Backfills delete existing task instances and mark them as removed

2017-03-01 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15891251#comment-15891251 ] Dan Davydov commented on AIRFLOW-932: - Command: {quote}airflow backfill teztg -t

[jira] [Comment Edited] (AIRFLOW-932) Backfills delete existing task instances and mark them as removed

2017-03-01 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15891251#comment-15891251 ] Dan Davydov edited comment on AIRFLOW-932 at 3/1/17 11:01 PM: -- Command:

[jira] [Commented] (AIRFLOW-920) Can't mark non-existent tasks as successful from graph view

2017-02-28 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889151#comment-15889151 ] Dan Davydov commented on AIRFLOW-920: - This propagation does not occur on our branch which includes

[jira] [Updated] (AIRFLOW-921) 1.8.0rc Issues

2017-02-27 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-921: Description: These are the pending issues for the Airflow 1.8.0 release: -

[jira] [Updated] (AIRFLOW-921) 1.8.0rc Issues

2017-02-27 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-921: Description: These are the pending issues for the Airflow 1.8.0 release: -

[jira] [Updated] (AIRFLOW-921) 1.8.0rc Issues

2017-02-27 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-921: Description: These are the pending issues for the Airflow 1.8.0 release: Blockers: -

[jira] [Created] (AIRFLOW-921) 1.8.0rc Issues

2017-02-27 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-921: --- Summary: 1.8.0rc Issues Key: AIRFLOW-921 URL: https://issues.apache.org/jira/browse/AIRFLOW-921 Project: Apache Airflow Issue Type: Task Reporter:

[jira] [Updated] (AIRFLOW-921) 1.8.0rc Issues

2017-02-27 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-921: Description: These are the pending issues for the Airflow 1.8.0 release: -

[jira] [Updated] (AIRFLOW-919) Setting a task to running manually breaks a DAGs UI

2017-02-27 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-919: Description: If you set a task instance with no start date to the RUNNING state manually (e.g. in

[jira] [Updated] (AIRFLOW-921) 1.8.0rc Issues

2017-02-27 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-921: Description: These are the pending issues for the Airflow 1.8.0 release: Blockers: [~bolke]

[jira] [Assigned] (AIRFLOW-919) Setting a task to running manually breaks a DAGs UI

2017-02-27 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov reassigned AIRFLOW-919: --- Assignee: Dan Davydov > Setting a task to running manually breaks a DAGs UI >

[jira] [Updated] (AIRFLOW-921) 1.8.0rc Issues

2017-02-27 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-921: Description: These are the pending issues for the Airflow 1.8.0 release: Blockers: -

[jira] [Updated] (AIRFLOW-921) 1.8.0rc Issues

2017-02-27 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-921: Description: These are the pending issues for the Airflow 1.8.0 release: Blockers: [~bolke]

[jira] [Created] (AIRFLOW-494) Add per-operator success/failure metrics.

2016-09-07 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-494: --- Summary: Add per-operator success/failure metrics. Key: AIRFLOW-494 URL: https://issues.apache.org/jira/browse/AIRFLOW-494 Project: Apache Airflow Issue Type:

[jira] [Updated] (AIRFLOW-149) Blocked TI Explainer + Dependency Engine

2016-08-26 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-149: External issue URL: https://github.com/apache/incubator-airflow/pull/1729 (was:

[jira] [Resolved] (AIRFLOW-149) Blocked TI Explainer + Dependency Engine

2016-08-26 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov resolved AIRFLOW-149. - Resolution: Fixed > Blocked TI Explainer + Dependency Engine >

[jira] [Created] (AIRFLOW-536) Dags only get one dagrun is scheduled per scheduler loop

2016-09-30 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-536: --- Summary: Dags only get one dagrun is scheduled per scheduler loop Key: AIRFLOW-536 URL: https://issues.apache.org/jira/browse/AIRFLOW-536 Project: Apache Airflow

[jira] [Created] (AIRFLOW-633) Show task instance attributes in task instance view

2016-11-15 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-633: --- Summary: Show task instance attributes in task instance view Key: AIRFLOW-633 URL: https://issues.apache.org/jira/browse/AIRFLOW-633 Project: Apache Airflow

[jira] [Updated] (AIRFLOW-536) Dags only get one dagrun is scheduled per scheduler loop

2016-11-29 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-536: Description: At the moment Dags only get one dag scheduled per scheduler loop (which can be quite

  1   2   3   >