[jira] [Commented] (AIRFLOW-2109) scheduler stopped picking up jobs suddenly

2018-02-15 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16365283#comment-16365283 ] Fokko Driesprong commented on AIRFLOW-2109: --- We need much more information to give some

[jira] [Commented] (AIRFLOW-2065) Worker logging can raise FileExistsError when more than one process execute concurrently

2018-02-15 Thread JIRA
[ https://issues.apache.org/jira/browse/AIRFLOW-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16365272#comment-16365272 ] Sébastien Brochet commented on AIRFLOW-2065: I've opened a new PR with my fix:

[jira] [Commented] (AIRFLOW-215) Airflow worker (CeleryExecutor) needs to be restarted to pick up tasks

2018-02-15 Thread Yuliya Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16366680#comment-16366680 ] Yuliya Volkova commented on AIRFLOW-215: [~bolke], is this issue fixed already? If is, maybe

[jira] [Updated] (AIRFLOW-336) extra variable in celery_executor.py

2018-02-15 Thread Yuliya Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuliya Volkova updated AIRFLOW-336: --- Attachment: Screen Shot 2018-02-16 at 101648 AM.png > extra variable in celery_executor.py >

[jira] [Commented] (AIRFLOW-336) extra variable in celery_executor.py

2018-02-15 Thread Yuliya Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16366670#comment-16366670 ] Yuliya Volkova commented on AIRFLOW-336: I think, question is, why this:  !Screen Shot

[jira] [Commented] (AIRFLOW-2105) Exception on known event creation

2018-02-15 Thread Yuliya Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16366681#comment-16366681 ] Yuliya Volkova commented on AIRFLOW-2105: - [~paymahn], try to airflow upgradedb, will it gone

[jira] [Created] (AIRFLOW-2115) Default Airflow.cfg & Airflow Web UI contains links to pythonhosted

2018-02-15 Thread Kaxil Naik (JIRA)
Kaxil Naik created AIRFLOW-2115: --- Summary: Default Airflow.cfg & Airflow Web UI contains links to pythonhosted Key: AIRFLOW-2115 URL: https://issues.apache.org/jira/browse/AIRFLOW-2115 Project: Apache

[jira] [Comment Edited] (AIRFLOW-336) extra variable in celery_executor.py

2018-02-15 Thread Yuliya Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16366670#comment-16366670 ] Yuliya Volkova edited comment on AIRFLOW-336 at 2/16/18 7:23 AM: - I

[jira] [Commented] (AIRFLOW-2109) scheduler stopped picking up jobs suddenly

2018-02-15 Thread rahul (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16365285#comment-16365285 ] rahul commented on AIRFLOW-2109: We are using local executor and airflow is configured on AWS ec2

[jira] [Commented] (AIRFLOW-83) Add MongoDB hook and operator

2018-02-15 Thread Simon Dubois (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-83?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16365498#comment-16365498 ] Simon Dubois commented on AIRFLOW-83: - Hey [~andscoop]. Any news of this ? > Add MongoDB hook and

[jira] [Commented] (AIRFLOW-2109) scheduler stopped picking up jobs suddenly

2018-02-15 Thread rahul (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16365286#comment-16365286 ] rahul commented on AIRFLOW-2109: And we are using MySQL rds as airflow metstore db > scheduler stopped

[jira] [Created] (AIRFLOW-2110) Enhance Http Hook to use a header in passed in the "extra" argument and add tenacity retry

2018-02-15 Thread Alberto Calderari (JIRA)
Alberto Calderari created AIRFLOW-2110: -- Summary: Enhance Http Hook to use a header in passed in the "extra" argument and add tenacity retry Key: AIRFLOW-2110 URL:

[jira] [Work started] (AIRFLOW-2107) add time_partitioning to run_query

2018-02-15 Thread Ben Marengo (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-2107 started by Ben Marengo. > add time_partitioning to run_query > -- > >

[jira] [Created] (AIRFLOW-2111) Add the ability to pause/unpause a task within a DAG

2018-02-15 Thread Mark Reid (JIRA)
Mark Reid created AIRFLOW-2111: -- Summary: Add the ability to pause/unpause a task within a DAG Key: AIRFLOW-2111 URL: https://issues.apache.org/jira/browse/AIRFLOW-2111 Project: Apache Airflow

[jira] [Updated] (AIRFLOW-2113) Address missing DagRuns callbacks

2018-02-15 Thread Alan Ma (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Ma updated AIRFLOW-2113: - Summary: Address missing DagRuns callbacks (was: DagRuns does not complete callbacks) > Address

[jira] [Updated] (AIRFLOW-2113) Address missing DagRun callbacks

2018-02-15 Thread Alan Ma (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Ma updated AIRFLOW-2113: - Summary: Address missing DagRun callbacks (was: Address missing DagRuns callbacks) > Address missing

[jira] [Assigned] (AIRFLOW-2058) Scheduler uses MainThread for DAG file processing

2018-02-15 Thread Anonymous (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anonymous reassigned AIRFLOW-2058: -- Assignee: Yang Pan > Scheduler uses MainThread for DAG file processing >

[jira] [Created] (AIRFLOW-2113) DagRuns sometimes does not execute callbacks

2018-02-15 Thread Alan Ma (JIRA)
Alan Ma created AIRFLOW-2113: Summary: DagRuns sometimes does not execute callbacks Key: AIRFLOW-2113 URL: https://issues.apache.org/jira/browse/AIRFLOW-2113 Project: Apache Airflow Issue Type:

[jira] [Updated] (AIRFLOW-2113) DagRuns sometimes does not complete callbacks

2018-02-15 Thread Alan Ma (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Ma updated AIRFLOW-2113: - Summary: DagRuns sometimes does not complete callbacks (was: DagRuns sometimes does not execute

[jira] [Commented] (AIRFLOW-2113) DagRuns sometimes does not complete callbacks

2018-02-15 Thread Alan Ma (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16366251#comment-16366251 ] Alan Ma commented on AIRFLOW-2113: -- Given that the *handle_callback* method belongs to the DAG object,

[jira] [Commented] (AIRFLOW-835) SMTP Mail delivery fails with server using CRAM-MD5 auth

2018-02-15 Thread James Davidheiser (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16366192#comment-16366192 ] James Davidheiser commented on AIRFLOW-835: --- I ran into this in 1.9.0 as well.  I solved it by

[jira] [Created] (AIRFLOW-2112) Recent Tasks UI cell does not show all items

2018-02-15 Thread Diego Rabatone Oliveira (JIRA)
Diego Rabatone Oliveira created AIRFLOW-2112: Summary: Recent Tasks UI cell does not show all items Key: AIRFLOW-2112 URL: https://issues.apache.org/jira/browse/AIRFLOW-2112 Project:

[jira] [Assigned] (AIRFLOW-2108) BashOperator discards process indentation

2018-02-15 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik reassigned AIRFLOW-2108: --- Assignee: Kaxil Naik > BashOperator discards process indentation >

[jira] [Work started] (AIRFLOW-2110) Enhance Http Hook to use a header in passed in the "extra" argument and add tenacity retry

2018-02-15 Thread Alberto Calderari (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-2110 started by Alberto Calderari. -- > Enhance Http Hook to use a header in passed in the "extra"

[jira] [Commented] (AIRFLOW-83) Add MongoDB hook and operator

2018-02-15 Thread Andy Cooper (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-83?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16366285#comment-16366285 ] Andy Cooper commented on AIRFLOW-83: [~simasim] I have created the PR and the code - waiting for a

[jira] [Commented] (AIRFLOW-2103) Authentication using password_auth backend prevents webserver from running

2018-02-15 Thread Marcos Bernardelli (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16366282#comment-16366282 ] Marcos Bernardelli commented on AIRFLOW-2103: - PR : 

[jira] [Created] (AIRFLOW-2114) Add AIRFLOW_HOME_VAR to PythonVirtualenvOperator inline with the BashOperator

2018-02-15 Thread John Bodley (JIRA)
John Bodley created AIRFLOW-2114: Summary: Add AIRFLOW_HOME_VAR to PythonVirtualenvOperator inline with the BashOperator Key: AIRFLOW-2114 URL: https://issues.apache.org/jira/browse/AIRFLOW-2114

[jira] [Updated] (AIRFLOW-2114) Add AIRFLOW_HOME_VAR to PythonVirtualenvOperator

2018-02-15 Thread John Bodley (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Bodley updated AIRFLOW-2114: - Summary: Add AIRFLOW_HOME_VAR to PythonVirtualenvOperator (was: Add AIRFLOW_HOME_VAR to

[jira] [Updated] (AIRFLOW-2114) Add AIRFLOW_HOME to PythonVirtualenvOperator

2018-02-15 Thread John Bodley (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Bodley updated AIRFLOW-2114: - Description: The subprocess used by the PythonVirtualenvOperator should be passed the 

[jira] [Updated] (AIRFLOW-2114) Add AIRFLOW_HOME to PythonVirtualenvOperator

2018-02-15 Thread John Bodley (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Bodley updated AIRFLOW-2114: - Summary: Add AIRFLOW_HOME to PythonVirtualenvOperator (was: Add AIRFLOW_HOME_VAR to