[jira] [Commented] (AIRFLOW-47) ExternalTaskSensor causes scheduling dead lock

2016-05-10 Thread Amikam Snir (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-47?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278658#comment-15278658 ] Amikam Snir commented on AIRFLOW-47: p.s. I think that you should update the severity of this bug. >

[jira] [Commented] (AIRFLOW-94) 'Mark upstream tasks as successful' does not actually select upstream tasks

2016-05-10 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-94?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278790#comment-15278790 ] Dan Davydov commented on AIRFLOW-94: I couldn't reproduce this on airbnb_rb1.7.1rc4 (this branch is a

[jira] [Commented] (AIRFLOW-95) 'Mark downstream tasks as successful' raises an exception

2016-05-10 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-95?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278791#comment-15278791 ] Dan Davydov commented on AIRFLOW-95: FWIW I couldn't reproduce this on airbnb_rb1.7.1rc4 (this branch

[jira] [Updated] (AIRFLOW-47) ExternalTaskSensor causes scheduling dead lock

2016-05-10 Thread Chris Riccomini (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-47?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Riccomini updated AIRFLOW-47: --- Priority: Major (was: Trivial) > ExternalTaskSensor causes scheduling dead lock >

[jira] [Commented] (AIRFLOW-47) ExternalTaskSensor causes scheduling dead lock

2016-05-10 Thread Amikam Snir (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-47?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278649#comment-15278649 ] Amikam Snir commented on AIRFLOW-47: [~criccomini], Task that is being blocked by something should

[jira] [Commented] (AIRFLOW-22) Google cloud code needs tests

2016-05-10 Thread Jeremiah Lowin (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-22?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278660#comment-15278660 ] Jeremiah Lowin commented on AIRFLOW-22: --- A very cool global dataset that is freely available through

[jira] [Updated] (AIRFLOW-52) Release airflow 1.7.1

2016-05-10 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-52?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin updated AIRFLOW-52: -- Description: Release the airflow 1.7.1 tag. Current status: There are three issues blocking

[jira] [Commented] (AIRFLOW-47) ExternalTaskSensor causes scheduling dead lock

2016-05-10 Thread Hila Visan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-47?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278680#comment-15278680 ] Hila Visan commented on AIRFLOW-47: --- I opened a new issue:

[jira] [Commented] (AIRFLOW-94) 'Mark upstream tasks as successful' does not actually select upstream tasks

2016-05-10 Thread Chris Riccomini (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-94?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279063#comment-15279063 ] Chris Riccomini commented on AIRFLOW-94: I suspect this will be an issue on the next release then.

[jira] [Commented] (AIRFLOW-47) ExternalTaskSensor causes scheduling dead lock

2016-05-10 Thread Chris Riccomini (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-47?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279167#comment-15279167 ] Chris Riccomini commented on AIRFLOW-47: (So it never marks itself as deadlocked and fails. The

[jira] [Commented] (AIRFLOW-47) ExternalTaskSensor causes scheduling dead lock

2016-05-10 Thread Jeremiah Lowin (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-47?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279142#comment-15279142 ] Jeremiah Lowin commented on AIRFLOW-47: --- I think you're right. We already have special logic for

[jira] [Commented] (AIRFLOW-47) ExternalTaskSensor causes scheduling dead lock

2016-05-10 Thread Chris Riccomini (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-47?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279153#comment-15279153 ] Chris Riccomini commented on AIRFLOW-47: Yea, this sounds like a better design. >

[jira] [Commented] (AIRFLOW-99) Scheduler bug causing dead-lock

2016-05-10 Thread Chris Riccomini (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-99?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279152#comment-15279152 ] Chris Riccomini commented on AIRFLOW-99: Yea, not sure what happened here. It seems like someone

[jira] [Commented] (AIRFLOW-47) ExternalTaskSensor causes scheduling dead lock

2016-05-10 Thread Jeremiah Lowin (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-47?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279194#comment-15279194 ] Jeremiah Lowin commented on AIRFLOW-47: --- That may be right, though my impression was that the first

[jira] [Closed] (AIRFLOW-99) Scheduler bug causing dead-lock

2016-05-10 Thread Jeremiah Lowin (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-99?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremiah Lowin closed AIRFLOW-99. - Resolution: Duplicate Duplicate of AIRFLOW-47? > Scheduler bug causing dead-lock >

[jira] [Commented] (AIRFLOW-47) ExternalTaskSensor causes scheduling dead lock

2016-05-10 Thread Jeremiah Lowin (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-47?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279148#comment-15279148 ] Jeremiah Lowin commented on AIRFLOW-47: --- Sorry Hila, I closed the issue. It's a duplicate of the

[jira] [Commented] (AIRFLOW-52) Release airflow 1.7.1

2016-05-10 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-52?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279187#comment-15279187 ] Dan Davydov commented on AIRFLOW-52: Update: I'm going to let the release bake in our staging cluster

[jira] [Comment Edited] (AIRFLOW-67) Dag is not avaialble on UI

2016-05-10 Thread nirav pranami (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-67?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279559#comment-15279559 ] nirav pranami edited comment on AIRFLOW-67 at 5/11/16 5:16 AM: --- I ran

[jira] [Commented] (AIRFLOW-47) ExternalTaskSensor causes scheduling dead lock

2016-05-10 Thread Amikam Snir (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-47?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278117#comment-15278117 ] Amikam Snir commented on AIRFLOW-47: [~criccomini] > ExternalTaskSensor causes scheduling dead lock >

[jira] [Updated] (AIRFLOW-92) Tasks not being retried at all due to a 'obj not bound to a Session' exception

2016-05-10 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-92?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin updated AIRFLOW-92: -- Fix Version/s: Airflow 1.7.1 > Tasks not being retried at all due to a 'obj not bound to a

[jira] [Commented] (AIRFLOW-52) Release airflow 1.7.1

2016-05-10 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-52?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278025#comment-15278025 ] Bolke de Bruin commented on AIRFLOW-52: --- [~aoen] Linked an additional issue that I also consider a

[jira] [Updated] (AIRFLOW-52) Release airflow 1.7.1

2016-05-10 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-52?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin updated AIRFLOW-52: -- Description: Release the airflow 1.7.1 tag. Current status: There are three issues blocking

[jira] [Comment Edited] (AIRFLOW-47) ExternalTaskSensor causes scheduling dead lock

2016-05-10 Thread Amikam Snir (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-47?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277884#comment-15277884 ] Amikam Snir edited comment on AIRFLOW-47 at 5/10/16 1:47 PM: - [~hilaviz],

[jira] [Commented] (AIRFLOW-92) Tasks not being retried at all due to a 'obj not bound to a Session' exception

2016-05-10 Thread Bence Nagy (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-92?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278028#comment-15278028 ] Bence Nagy commented on AIRFLOW-92: --- While I agree that a design change is needed here, I don't think

incubator-airflow git commit: AIRFLOW-92 Avoid unneeded upstream_failed session closes apache/incubator-airflow#1485

2016-05-10 Thread bolke
Repository: incubator-airflow Updated Branches: refs/heads/master 40b3fffa0 -> dddfd3b5b AIRFLOW-92 Avoid unneeded upstream_failed session closes apache/incubator-airflow#1485 Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

[jira] [Created] (AIRFLOW-94) Mark upstream tasks successful does not actually select upstream tasks

2016-05-10 Thread Bence Nagy (JIRA)
Bence Nagy created AIRFLOW-94: - Summary: Mark upstream tasks successful does not actually select upstream tasks Key: AIRFLOW-94 URL: https://issues.apache.org/jira/browse/AIRFLOW-94 Project: Apache

[jira] [Updated] (AIRFLOW-94) Mark upstream tasks successful does not actually select upstream tasks

2016-05-10 Thread Bence Nagy (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-94?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bence Nagy updated AIRFLOW-94: -- Issue Type: Bug (was: Improvement) > Mark upstream tasks successful does not actually select upstream

[jira] [Commented] (AIRFLOW-92) Tasks not being retried at all due to a 'obj not bound to a Session' exception

2016-05-10 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-92?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278023#comment-15278023 ] Bolke de Bruin commented on AIRFLOW-92: --- The issue here is that a session is opened in

[jira] [Commented] (AIRFLOW-92) Tasks not being retried at all due to a 'obj not bound to a Session' exception

2016-05-10 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-92?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278062#comment-15278062 ] ASF subversion and git services commented on AIRFLOW-92: Commit

[jira] [Updated] (AIRFLOW-94) 'Mark upstream tasks as successful' does not actually select upstream tasks

2016-05-10 Thread Bence Nagy (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-94?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bence Nagy updated AIRFLOW-94: -- Summary: 'Mark upstream tasks as successful' does not actually select upstream tasks (was: Mark

[jira] [Updated] (AIRFLOW-67) Problem with SSHExecuteOperator

2016-05-10 Thread nirav pranami (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-67?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav pranami updated AIRFLOW-67: - Description: Dear Airflow Maintainers, Before I tell you about my issue, let me describe my

[jira] [Updated] (AIRFLOW-67) Problem with SSHExecuteOperator

2016-05-10 Thread nirav pranami (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-67?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav pranami updated AIRFLOW-67: - Description: Dear Airflow Maintainers, Before I tell you about my issue, let me describe my

[jira] [Commented] (AIRFLOW-89) Documentation error on Tutorial site

2016-05-10 Thread Dimitri Vasdekis (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-89?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277668#comment-15277668 ] Dimitri Vasdekis commented on AIRFLOW-89: - I closed this as the code sample can be inferred to

[jira] [Closed] (AIRFLOW-90) `[celery]` section needed even if CeleryExecutor not used

2016-05-10 Thread Chris Riccomini (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-90?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Riccomini closed AIRFLOW-90. -- Resolution: Duplicate Duplicate of AIRFLOW-25 > `[celery]` section needed even if

[jira] [Commented] (AIRFLOW-25) Configuration for Celery always required

2016-05-10 Thread Chris Riccomini (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-25?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278351#comment-15278351 ] Chris Riccomini commented on AIRFLOW-25: There have already been two dupes filed of this issue. It

[jira] [Updated] (AIRFLOW-67) Dag is not avaialble on UI

2016-05-10 Thread nirav pranami (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-67?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav pranami updated AIRFLOW-67: - Summary: Dag is not avaialble on UI (was: Problem with SSHExecuteOperator) > Dag is not

[jira] [Commented] (AIRFLOW-87) Setup a development environment

2016-05-10 Thread Chris Riccomini (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-87?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278318#comment-15278318 ] Chris Riccomini commented on AIRFLOW-87: Re: vagrant, there was also discussion on the mailing

[jira] [Commented] (AIRFLOW-84) Queued tasks in Airflow not being prioritized and scheduled

2016-05-10 Thread Kevin Lin (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-84?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277715#comment-15277715 ] Kevin Lin commented on AIRFLOW-84: -- [~jlowin] Thanks for the response! In the above logs, the failure

[jira] [Commented] (AIRFLOW-92) Tasks not being retried at all due to a 'obj not bound to a Session' exception

2016-05-10 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-92?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278493#comment-15278493 ] ASF subversion and git services commented on AIRFLOW-92: Commit

[jira] [Commented] (AIRFLOW-52) Release airflow 1.7.1

2016-05-10 Thread Dan Davydov (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-52?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278503#comment-15278503 ] Dan Davydov commented on AIRFLOW-52: Roger. > Release airflow 1.7.1 > - > >

incubator-airflow git commit: AIRFLOW-92 Avoid unneeded upstream_failed session closes apache/incubator-airflow#1485

2016-05-10 Thread davydov
Repository: incubator-airflow Updated Branches: refs/heads/airbnb_rb1.7.1_3 77c7bc4ac -> 4a5f4a0ba AIRFLOW-92 Avoid unneeded upstream_failed session closes apache/incubator-airflow#1485 Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

[jira] [Updated] (AIRFLOW-94) 'Mark upstream tasks as successful' does not actually select upstream tasks

2016-05-10 Thread Chris Riccomini (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-94?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Riccomini updated AIRFLOW-94: --- Attachment: 4.png 3.png 2.png 1.png > 'Mark

[jira] [Commented] (AIRFLOW-94) 'Mark upstream tasks as successful' does not actually select upstream tasks

2016-05-10 Thread Chris Riccomini (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-94?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278541#comment-15278541 ] Chris Riccomini commented on AIRFLOW-94: Note: I'm using 1.7.0, not master. This could be a

[jira] [Commented] (AIRFLOW-94) 'Mark upstream tasks as successful' does not actually select upstream tasks

2016-05-10 Thread Chris Riccomini (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-94?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278537#comment-15278537 ] Chris Riccomini commented on AIRFLOW-94: Note: Clicking 'Upstream" on the PARENT

[jira] [Commented] (AIRFLOW-87) Setup a development environment

2016-05-10 Thread Amikam Snir (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-87?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278553#comment-15278553 ] Amikam Snir commented on AIRFLOW-87: You have [this repo| https://github.com/puckel/docker-airflow]

[jira] [Commented] (AIRFLOW-47) ExternalTaskSensor causes scheduling dead lock

2016-05-10 Thread Chris Riccomini (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-47?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278568#comment-15278568 ] Chris Riccomini commented on AIRFLOW-47: {quote} These tasks should move to the waiting queue

[jira] [Commented] (AIRFLOW-96) s3_conn_id of s3KeySensor cannot be defined using an environment variable

2016-05-10 Thread Chris Riccomini (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-96?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278584#comment-15278584 ] Chris Riccomini commented on AIRFLOW-96: It sounds like the S3 key sensor needs to be updated to

[jira] [Created] (AIRFLOW-92) Tasks not being retried at all due to a 'obj not bound to a Session' exception

2016-05-10 Thread Bence Nagy (JIRA)
Bence Nagy created AIRFLOW-92: - Summary: Tasks not being retried at all due to a 'obj not bound to a Session' exception Key: AIRFLOW-92 URL: https://issues.apache.org/jira/browse/AIRFLOW-92 Project:

[jira] [Updated] (AIRFLOW-92) Tasks not being retried at all due to a 'obj not bound to a Session' exception

2016-05-10 Thread Bence Nagy (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-92?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bence Nagy updated AIRFLOW-92: -- Description: I have some tasks that are stuck in {{up_for_retry}} state, below is an extract from the

[jira] [Updated] (AIRFLOW-92) Tasks not being retried at all due to a 'obj not bound to a Session' exception

2016-05-10 Thread Bence Nagy (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-92?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bence Nagy updated AIRFLOW-92: -- Environment: EC2 t2.medium instance, Docker `version 1.11.1, build 5604cbe`, Host is `Linux

[jira] [Comment Edited] (AIRFLOW-47) ExternalTaskSensor causes scheduling dead lock

2016-05-10 Thread Amikam Snir (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-47?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277884#comment-15277884 ] Amikam Snir edited comment on AIRFLOW-47 at 5/10/16 10:07 AM: -- [~hilaviz],

[jira] [Created] (AIRFLOW-93) Allow specifying multiple task execution deltas for ExternalTaskSensors

2016-05-10 Thread Bence Nagy (JIRA)
Bence Nagy created AIRFLOW-93: - Summary: Allow specifying multiple task execution deltas for ExternalTaskSensors Key: AIRFLOW-93 URL: https://issues.apache.org/jira/browse/AIRFLOW-93 Project: Apache