[GitHub] [airflow] stale[bot] commented on issue #6501: [AIRFLOW-5831] Prod image support. Depends on [AIRFLOW-5704] [AIRFLOW-5842] [AIRFLOW-5828]

2020-01-02 Thread GitBox
stale[bot] commented on issue #6501: [AIRFLOW-5831] Prod image support. Depends on [AIRFLOW-5704] [AIRFLOW-5842] [AIRFLOW-5828] URL: https://github.com/apache/airflow/pull/6501#issuecomment-570488487 This issue has been automatically marked as stale because it has not had recent activity.

[GitHub] [airflow-site] chandulal opened a new pull request #231: Add blogs for airflow DAGs testing

2020-01-02 Thread GitBox
chandulal opened a new pull request #231: Add blogs for airflow DAGs testing URL: https://github.com/apache/airflow-site/pull/231 This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [airflow] codecov-io edited a comment on issue #7015: [AIRFLOW-6436] Create & Automate docs on Airflow Configs

2020-01-02 Thread GitBox
codecov-io edited a comment on issue #7015: [AIRFLOW-6436] Create & Automate docs on Airflow Configs URL: https://github.com/apache/airflow/pull/7015#issuecomment-570480731 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7015?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #7015: [AIRFLOW-6436] Create & Automate docs on Airflow Configs

2020-01-02 Thread GitBox
codecov-io edited a comment on issue #7015: [AIRFLOW-6436] Create & Automate docs on Airflow Configs URL: https://github.com/apache/airflow/pull/7015#issuecomment-570480731 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7015?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #7015: [AIRFLOW-6436] Create & Automate docs on Airflow Configs

2020-01-02 Thread GitBox
codecov-io edited a comment on issue #7015: [AIRFLOW-6436] Create & Automate docs on Airflow Configs URL: https://github.com/apache/airflow/pull/7015#issuecomment-570480731 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7015?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #7015: [AIRFLOW-6436] Create & Automate docs on Airflow Configs

2020-01-02 Thread GitBox
codecov-io edited a comment on issue #7015: [AIRFLOW-6436] Create & Automate docs on Airflow Configs URL: https://github.com/apache/airflow/pull/7015#issuecomment-570480731 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7015?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #7015: [AIRFLOW-6436] Create & Automate docs on Airflow Configs

2020-01-02 Thread GitBox
codecov-io edited a comment on issue #7015: [AIRFLOW-6436] Create & Automate docs on Airflow Configs URL: https://github.com/apache/airflow/pull/7015#issuecomment-570480731 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7015?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #7015: [AIRFLOW-6436] Create & Automate docs on Airflow Configs

2020-01-02 Thread GitBox
codecov-io edited a comment on issue #7015: [AIRFLOW-6436] Create & Automate docs on Airflow Configs URL: https://github.com/apache/airflow/pull/7015#issuecomment-570480731 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7015?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #7015: [AIRFLOW-6436] Create & Automate docs on Airflow Configs

2020-01-02 Thread GitBox
codecov-io edited a comment on issue #7015: [AIRFLOW-6436] Create & Automate docs on Airflow Configs URL: https://github.com/apache/airflow/pull/7015#issuecomment-570480731 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7015?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #7015: [AIRFLOW-6436] Create & Automate docs on Airflow Configs

2020-01-02 Thread GitBox
codecov-io edited a comment on issue #7015: [AIRFLOW-6436] Create & Automate docs on Airflow Configs URL: https://github.com/apache/airflow/pull/7015#issuecomment-570480731 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7015?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io commented on issue #7015: [AIRFLOW-6436] Create & Automate docs on Airflow Configs

2020-01-02 Thread GitBox
codecov-io commented on issue #7015: [AIRFLOW-6436] Create & Automate docs on Airflow Configs URL: https://github.com/apache/airflow/pull/7015#issuecomment-570480731 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7015?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #7015: [AIRFLOW-6436] Create & Automate docs on Airflow Configs

2020-01-02 Thread GitBox
codecov-io edited a comment on issue #7015: [AIRFLOW-6436] Create & Automate docs on Airflow Configs URL: https://github.com/apache/airflow/pull/7015#issuecomment-570480731 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7015?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #7015: [AIRFLOW-6436] Create & Automate docs on Airflow Configs

2020-01-02 Thread GitBox
codecov-io edited a comment on issue #7015: [AIRFLOW-6436] Create & Automate docs on Airflow Configs URL: https://github.com/apache/airflow/pull/7015#issuecomment-570480731 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7015?src=pr=h1) Report > Merging

[GitHub] [airflow] kaxil commented on issue #7007: [AIRFLOW-6428] Fix import path for airflow.utils.dates.days_ago in Example DAGs

2020-01-02 Thread GitBox
kaxil commented on issue #7007: [AIRFLOW-6428] Fix import path for airflow.utils.dates.days_ago in Example DAGs URL: https://github.com/apache/airflow/pull/7007#issuecomment-570477304 > Just wanted to discuss general import approach in this case. I agree the 2nd option sounds lot

[jira] [Updated] (AIRFLOW-6428) Fix import path for airflow.utils.dates.days_ago

2020-01-02 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-6428: Summary: Fix import path for airflow.utils.dates.days_ago (was: Add dates module to

[jira] [Updated] (AIRFLOW-6428) Fix import path for airflow.utils.dates.days_ago in Example DAGs

2020-01-02 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-6428: Summary: Fix import path for airflow.utils.dates.days_ago in Example DAGs (was: Fix import path

[jira] [Commented] (AIRFLOW-6427) Fix broken example_qubole_operator dag

2020-01-02 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17007250#comment-17007250 ] ASF subversion and git services commented on AIRFLOW-6427: -- Commit

[jira] [Resolved] (AIRFLOW-6427) Fix broken example_qubole_operator dag

2020-01-02 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-6427. - Resolution: Fixed > Fix broken example_qubole_operator dag >

[GitHub] [airflow] kaxil merged pull request #7005: [AIRFLOW-6427] Fix error in example_qubole_operator dag

2020-01-02 Thread GitBox
kaxil merged pull request #7005: [AIRFLOW-6427] Fix error in example_qubole_operator dag URL: https://github.com/apache/airflow/pull/7005 This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Commented] (AIRFLOW-6427) Fix broken example_qubole_operator dag

2020-01-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17007249#comment-17007249 ] ASF GitHub Bot commented on AIRFLOW-6427: - kaxil commented on pull request #7005:

[jira] [Comment Edited] (AIRFLOW-6435) Mount secret files from secrets config

2020-01-02 Thread Brandon Clark (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17007248#comment-17007248 ] Brandon Clark edited comment on AIRFLOW-6435 at 1/3/20 6:15 AM: I have

[jira] [Comment Edited] (AIRFLOW-6435) Mount secret files from secrets config

2020-01-02 Thread Brandon Clark (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17007248#comment-17007248 ] Brandon Clark edited comment on AIRFLOW-6435 at 1/3/20 6:15 AM: I have

[jira] [Commented] (AIRFLOW-6435) Mount secret files from secrets config

2020-01-02 Thread Brandon Clark (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17007248#comment-17007248 ] Brandon Clark commented on AIRFLOW-6435: I have created an implementation which requires the

[GitHub] [airflow] codecov-io edited a comment on issue #6604: [AIRFLOW-5920] Neo4j operator and hook

2020-01-02 Thread GitBox
codecov-io edited a comment on issue #6604: [AIRFLOW-5920] Neo4j operator and hook URL: https://github.com/apache/airflow/pull/6604#issuecomment-558902885 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6604?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6604: [AIRFLOW-5920] Neo4j operator and hook

2020-01-02 Thread GitBox
codecov-io edited a comment on issue #6604: [AIRFLOW-5920] Neo4j operator and hook URL: https://github.com/apache/airflow/pull/6604#issuecomment-558902885 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6604?src=pr=h1) Report > Merging

[jira] [Work started] (AIRFLOW-6436) Create & Automate docs on Airflow Configs

2020-01-02 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-6436 started by Kaxil Naik. --- > Create & Automate docs on Airflow Configs >

[GitHub] [airflow] kaxil commented on issue #7015: [AIRFLOW-6436] Create & Automate docs on Airflow Configs

2020-01-02 Thread GitBox
kaxil commented on issue #7015: [AIRFLOW-6436] Create & Automate docs on Airflow Configs URL: https://github.com/apache/airflow/pull/7015#issuecomment-570472178 This PR needs a bit of polishing but its overall logic or structure would remain same.

[jira] [Commented] (AIRFLOW-6436) Create & Automate docs on Airflow Configs

2020-01-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17007245#comment-17007245 ] ASF GitHub Bot commented on AIRFLOW-6436: - kaxil commented on pull request #7015:

[GitHub] [airflow] kaxil opened a new pull request #7015: [AIRFLOW-6436] Create & Automate docs on Airflow Configs

2020-01-02 Thread GitBox
kaxil opened a new pull request #7015: [AIRFLOW-6436] Create & Automate docs on Airflow Configs URL: https://github.com/apache/airflow/pull/7015 This PR aims to automate the creation of Config docs and add pre-commit hooks that would also serve as tests. **Preview**: - **Layout

[jira] [Created] (AIRFLOW-6436) Create & Automate docs on Airflow Configs

2020-01-02 Thread Kaxil Naik (Jira)
Kaxil Naik created AIRFLOW-6436: --- Summary: Create & Automate docs on Airflow Configs Key: AIRFLOW-6436 URL: https://issues.apache.org/jira/browse/AIRFLOW-6436 Project: Apache Airflow Issue

[GitHub] [airflow] tfindlay-au commented on a change in pull request #6604: [AIRFLOW-5920] Neo4j operator and hook

2020-01-02 Thread GitBox
tfindlay-au commented on a change in pull request #6604: [AIRFLOW-5920] Neo4j operator and hook URL: https://github.com/apache/airflow/pull/6604#discussion_r362707463 ## File path: airflow/providers/neo4j/operators/neo4j.py ## @@ -0,0 +1,90 @@ +# -*- coding: utf-8 -*- +#

[GitHub] [airflow] tfindlay-au commented on a change in pull request #6604: [AIRFLOW-5920] Neo4j operator and hook

2020-01-02 Thread GitBox
tfindlay-au commented on a change in pull request #6604: [AIRFLOW-5920] Neo4j operator and hook URL: https://github.com/apache/airflow/pull/6604#discussion_r362707277 ## File path: airflow/providers/neo4j/hook.py ## @@ -0,0 +1,133 @@ +# -*- coding: utf-8 -*- +# +#

[GitHub] [airflow] codecov-io edited a comment on issue #6999: [AIRFLOW-XXXX] Clarify wait_for_downstream and execution_date

2020-01-02 Thread GitBox
codecov-io edited a comment on issue #6999: [AIRFLOW-] Clarify wait_for_downstream and execution_date URL: https://github.com/apache/airflow/pull/6999#issuecomment-570196566 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6999?src=pr=h1) Report > Merging

[GitHub] [airflow] tfindlay-au commented on a change in pull request #6604: [AIRFLOW-5920] Neo4j operator and hook

2020-01-02 Thread GitBox
tfindlay-au commented on a change in pull request #6604: [AIRFLOW-5920] Neo4j operator and hook URL: https://github.com/apache/airflow/pull/6604#discussion_r362704832 ## File path: airflow/providers/neo4j/hook.py ## @@ -0,0 +1,133 @@ +# -*- coding: utf-8 -*- +# +#

[GitHub] [airflow] baolsen commented on a change in pull request #6999: [AIRFLOW-XXXX] Clarify wait_for_downstream and execution_date

2020-01-02 Thread GitBox
baolsen commented on a change in pull request #6999: [AIRFLOW-] Clarify wait_for_downstream and execution_date URL: https://github.com/apache/airflow/pull/6999#discussion_r362704684 ## File path: docs/tutorial.rst ## @@ -313,8 +315,16 @@ to track the progress.

[GitHub] [airflow] mik-laj commented on a change in pull request #6756: [AIRFLOW-6198] Add types to core classes.

2020-01-02 Thread GitBox
mik-laj commented on a change in pull request #6756: [AIRFLOW-6198] Add types to core classes. URL: https://github.com/apache/airflow/pull/6756#discussion_r362701017 ## File path: airflow/cli/commands/dag_command.py ## @@ -41,7 +41,7 @@ def _tabulate_dag_runs(dag_runs:

[jira] [Commented] (AIRFLOW-4453) none_failed trigger rule cascading skipped state to downstream tasks

2020-01-02 Thread Joel Croteau (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17007203#comment-17007203 ] Joel Croteau commented on AIRFLOW-4453: --- I can actually reproduce this on 1.10.3 with a much

[jira] [Updated] (AIRFLOW-4453) none_failed trigger rule cascading skipped state to downstream tasks

2020-01-02 Thread Joel Croteau (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Croteau updated AIRFLOW-4453: -- Attachment: simple_skip.png > none_failed trigger rule cascading skipped state to downstream

[jira] [Updated] (AIRFLOW-6435) Mount secret files from secrets config

2020-01-02 Thread Brandon Clark (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Clark updated AIRFLOW-6435: --- Description: There should be a dynamic way to add protected files to pod.  Just as

[jira] [Updated] (AIRFLOW-6435) Mount secret files from secrets config

2020-01-02 Thread Brandon Clark (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Clark updated AIRFLOW-6435: --- Description: There should be a dynamic way to add protected files to pod.  Just as

[jira] [Updated] (AIRFLOW-6435) Mount secret files from secrets config

2020-01-02 Thread Brandon Clark (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Clark updated AIRFLOW-6435: --- Description: There should be a dynamic way to add protected files to pod.  Just as

[jira] [Created] (AIRFLOW-6435) Mount secret files from secrets config

2020-01-02 Thread Brandon Clark (Jira)
Brandon Clark created AIRFLOW-6435: -- Summary: Mount secret files from secrets config Key: AIRFLOW-6435 URL: https://issues.apache.org/jira/browse/AIRFLOW-6435 Project: Apache Airflow Issue

[GitHub] [airflow] codecov-io edited a comment on issue #6999: [AIRFLOW-XXXX] Clarify wait_for_downstream and execution_date

2020-01-02 Thread GitBox
codecov-io edited a comment on issue #6999: [AIRFLOW-] Clarify wait_for_downstream and execution_date URL: https://github.com/apache/airflow/pull/6999#issuecomment-570196566 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6999?src=pr=h1) Report > Merging

[GitHub] [airflow] mik-laj opened a new pull request #7014: [AIRFLOW-XXXX] Add `airflow dags show` command guide

2020-01-02 Thread GitBox
mik-laj opened a new pull request #7014: [AIRFLOW-] Add `airflow dags show` command guide URL: https://github.com/apache/airflow/pull/7014 Add documentation about the unpopular feature. --- Link to JIRA issue: https://issues.apache.org/jira/browse/AIRFLOW- - [X]

[GitHub] [airflow] bphillips-exos opened a new pull request #7013: [AIRFLOW-6434] Add return back to DockerOperator.execute

2020-01-02 Thread GitBox
bphillips-exos opened a new pull request #7013: [AIRFLOW-6434] Add return back to DockerOperator.execute URL: https://github.com/apache/airflow/pull/7013 https://issues.apache.org/jira/browse/AIRFLOW-6434 This change

[jira] [Commented] (AIRFLOW-6434) Docker Operator No Longer XComs Result in 1.10.7

2020-01-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17007172#comment-17007172 ] ASF GitHub Bot commented on AIRFLOW-6434: - bphillips-exos commented on pull request #7013:

[jira] [Commented] (AIRFLOW-4453) none_failed trigger rule cascading skipped state to downstream tasks

2020-01-02 Thread Joel Croteau (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17007170#comment-17007170 ] Joel Croteau commented on AIRFLOW-4453: --- [https://xkcd.com/979/.|https://xkcd.com/979/]

[GitHub] [airflow] codecov-io edited a comment on issue #7006: [AIRFLOW-6112] [AIP-21] Rename GCP SQL operators and hooks

2020-01-02 Thread GitBox
codecov-io edited a comment on issue #7006: [AIRFLOW-6112] [AIP-21] Rename GCP SQL operators and hooks URL: https://github.com/apache/airflow/pull/7006#issuecomment-570254220 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7006?src=pr=h1) Report > Merging

[jira] [Updated] (AIRFLOW-6434) Docker Operator No Longer XComs Result in 1.10.7

2020-01-02 Thread Brian Phillips (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Phillips updated AIRFLOW-6434: Description: This change

[jira] [Updated] (AIRFLOW-6434) Docker Operator No Longer XComs Result in 1.10.7

2020-01-02 Thread Brian Phillips (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Phillips updated AIRFLOW-6434: Description: This

[jira] [Created] (AIRFLOW-6434) Docker Operator No Longer XComs Result in 1.10.7

2020-01-02 Thread Brian Phillips (Jira)
Brian Phillips created AIRFLOW-6434: --- Summary: Docker Operator No Longer XComs Result in 1.10.7 Key: AIRFLOW-6434 URL: https://issues.apache.org/jira/browse/AIRFLOW-6434 Project: Apache Airflow

[GitHub] [airflow] houqp commented on issue #6342: [AIRFLOW-5662] fix incorrect naming for scheduler used slot metric

2020-01-02 Thread GitBox
houqp commented on issue #6342: [AIRFLOW-5662] fix incorrect naming for scheduler used slot metric URL: https://github.com/apache/airflow/pull/6342#issuecomment-570424113 @ashb ready for another round of review :) Now pool slot metrics collection has been reduced to 2 DB queries

[GitHub] [airflow] codecov-io edited a comment on issue #6342: [AIRFLOW-5662] fix incorrect naming for scheduler used slot metric

2020-01-02 Thread GitBox
codecov-io edited a comment on issue #6342: [AIRFLOW-5662] fix incorrect naming for scheduler used slot metric URL: https://github.com/apache/airflow/pull/6342#issuecomment-547121627 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6342?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6342: [AIRFLOW-5662] fix incorrect naming for scheduler used slot metric

2020-01-02 Thread GitBox
codecov-io edited a comment on issue #6342: [AIRFLOW-5662] fix incorrect naming for scheduler used slot metric URL: https://github.com/apache/airflow/pull/6342#issuecomment-547121627 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6342?src=pr=h1) Report > Merging

[jira] [Commented] (AIRFLOW-6433) reduce conf.get lookups in scheduler_job.py loops

2020-01-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17007142#comment-17007142 ] ASF GitHub Bot commented on AIRFLOW-6433: - tooptoop4 commented on pull request #7012:

[jira] [Work started] (AIRFLOW-6433) reduce conf.get lookups in scheduler_job.py loops

2020-01-02 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-6433 started by t oo. - > reduce conf.get lookups in scheduler_job.py loops >

[GitHub] [airflow] tooptoop4 opened a new pull request #7012: [AIRFLOW-6433] reduce conf.get lookups in scheduler_job.py loops

2020-01-02 Thread GitBox
tooptoop4 opened a new pull request #7012: [AIRFLOW-6433] reduce conf.get lookups in scheduler_job.py loops URL: https://github.com/apache/airflow/pull/7012 --- Link to JIRA issue: https://issues.apache.org/jira/browse/AIRFLOW-6433 - [ X] Description above provides context of the

[jira] [Updated] (AIRFLOW-6433) reduce conf.get lookups in scheduler_job.py loops

2020-01-02 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated AIRFLOW-6433: -- Description: trivial perf benefit available > reduce conf.get lookups in scheduler_job.py loops >

[jira] [Created] (AIRFLOW-6433) reduce conf.get lookups in scheduler_job.py loops

2020-01-02 Thread t oo (Jira)
t oo created AIRFLOW-6433: - Summary: reduce conf.get lookups in scheduler_job.py loops Key: AIRFLOW-6433 URL: https://issues.apache.org/jira/browse/AIRFLOW-6433 Project: Apache Airflow Issue Type:

[GitHub] [airflow] mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs

2020-01-02 Thread GitBox
mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs URL: https://github.com/apache/airflow/pull/6983#discussion_r362663382 ## File path: docs/howto/configurations-ref.rst ## @@ -0,0 +1,1141 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] dstandish edited a comment on issue #6850: [AIRFLOW-6296] add mssql odbc hook

2020-01-02 Thread GitBox
dstandish edited a comment on issue #6850: [AIRFLOW-6296] add mssql odbc hook URL: https://github.com/apache/airflow/pull/6850#issuecomment-570388793 @baolsen > I really feel that SQL Alchemy might be useful here. Using different dialects allows us to be backwards compatible and let

[GitHub] [airflow] dstandish commented on issue #6850: [AIRFLOW-6296] add mssql odbc hook

2020-01-02 Thread GitBox
dstandish commented on issue #6850: [AIRFLOW-6296] add mssql odbc hook URL: https://github.com/apache/airflow/pull/6850#issuecomment-570388793 @baolsen > I really feel that SQL Alchemy might be useful here. Using different dialects allows us to be backwards compatible and let the user

[GitHub] [airflow] mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs

2020-01-02 Thread GitBox
mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs URL: https://github.com/apache/airflow/pull/6983#discussion_r362656314 ## File path: docs/howto/configurations-ref.rst ## @@ -0,0 +1,1141 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs

2020-01-02 Thread GitBox
mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs URL: https://github.com/apache/airflow/pull/6983#discussion_r362656314 ## File path: docs/howto/configurations-ref.rst ## @@ -0,0 +1,1141 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] potiuk edited a comment on issue #7007: [AIRFLOW-6428] Add dates module to airflow/utils/__init__.py

2020-01-02 Thread GitBox
potiuk edited a comment on issue #7007: [AIRFLOW-6428] Add dates module to airflow/utils/__init__.py URL: https://github.com/apache/airflow/pull/7007#issuecomment-570373212 Why don't we do it "differently" ... I am not sure why we are using those imports in this form? Do we have

[GitHub] [airflow] potiuk edited a comment on issue #7007: [AIRFLOW-6428] Add dates module to airflow/utils/__init__.py

2020-01-02 Thread GitBox
potiuk edited a comment on issue #7007: [AIRFLOW-6428] Add dates module to airflow/utils/__init__.py URL: https://github.com/apache/airflow/pull/7007#issuecomment-570373212 Why don't we do it "differently" ... I am not sure why we are using those imports in this form? Do we have

[GitHub] [airflow] potiuk edited a comment on issue #7007: [AIRFLOW-6428] Add dates module to airflow/utils/__init__.py

2020-01-02 Thread GitBox
potiuk edited a comment on issue #7007: [AIRFLOW-6428] Add dates module to airflow/utils/__init__.py URL: https://github.com/apache/airflow/pull/7007#issuecomment-570373212 Why don't we do it "differently" ... I am not sure why we are using those imports in this form? Do we have

[GitHub] [airflow] potiuk edited a comment on issue #7007: [AIRFLOW-6428] Add dates module to airflow/utils/__init__.py

2020-01-02 Thread GitBox
potiuk edited a comment on issue #7007: [AIRFLOW-6428] Add dates module to airflow/utils/__init__.py URL: https://github.com/apache/airflow/pull/7007#issuecomment-570373212 Why don't we do it "differently" ... I am not sure why we are using those imports in this form? Do we have

[GitHub] [airflow] potiuk edited a comment on issue #7007: [AIRFLOW-6428] Add dates module to airflow/utils/__init__.py

2020-01-02 Thread GitBox
potiuk edited a comment on issue #7007: [AIRFLOW-6428] Add dates module to airflow/utils/__init__.py URL: https://github.com/apache/airflow/pull/7007#issuecomment-570373212 Why don't we do it "differently" ... I am not sure why we are using those imports in this form? Do we have

[GitHub] [airflow] potiuk edited a comment on issue #7007: [AIRFLOW-6428] Add dates module to airflow/utils/__init__.py

2020-01-02 Thread GitBox
potiuk edited a comment on issue #7007: [AIRFLOW-6428] Add dates module to airflow/utils/__init__.py URL: https://github.com/apache/airflow/pull/7007#issuecomment-570373212 Why don't we do it "properly" ... I am not sure why we are using those imports in this form? Do we have something

[GitHub] [airflow] potiuk edited a comment on issue #7007: [AIRFLOW-6428] Add dates module to airflow/utils/__init__.py

2020-01-02 Thread GitBox
potiuk edited a comment on issue #7007: [AIRFLOW-6428] Add dates module to airflow/utils/__init__.py URL: https://github.com/apache/airflow/pull/7007#issuecomment-570373212 Why don't we do it "properly" ... I am not sure why we are using those imports in this form? Do we have something

[jira] [Created] (AIRFLOW-6432) Dataproc cluster creation

2020-01-02 Thread David Rabinowitz (Jira)
David Rabinowitz created AIRFLOW-6432: - Summary: Dataproc cluster creation Key: AIRFLOW-6432 URL: https://issues.apache.org/jira/browse/AIRFLOW-6432 Project: Apache Airflow Issue Type:

[GitHub] [airflow] potiuk edited a comment on issue #7007: [AIRFLOW-6428] Add dates module to airflow/utils/__init__.py

2020-01-02 Thread GitBox
potiuk edited a comment on issue #7007: [AIRFLOW-6428] Add dates module to airflow/utils/__init__.py URL: https://github.com/apache/airflow/pull/7007#issuecomment-570373212 Why don't we do it "properly" ... I am not sure why we are using those imports in this form? Do we have something

[GitHub] [airflow] potiuk edited a comment on issue #7007: [AIRFLOW-6428] Add dates module to airflow/utils/__init__.py

2020-01-02 Thread GitBox
potiuk edited a comment on issue #7007: [AIRFLOW-6428] Add dates module to airflow/utils/__init__.py URL: https://github.com/apache/airflow/pull/7007#issuecomment-570373212 Why don't we do it "properly" ... I am not sure why we are using those imports in this form? Do we have something

[GitHub] [airflow] potiuk commented on issue #7007: [AIRFLOW-6428] Add dates module to airflow/utils/__init__.py

2020-01-02 Thread GitBox
potiuk commented on issue #7007: [AIRFLOW-6428] Add dates module to airflow/utils/__init__.py URL: https://github.com/apache/airflow/pull/7007#issuecomment-570373212 Why don't we do it "properly" ... I am not sure why we are using those imports in this form? Do we have something that

[GitHub] [airflow] potiuk commented on issue #5788: [POC] multi-threading using asyncio

2020-01-02 Thread GitBox
potiuk commented on issue #5788: [POC] multi-threading using asyncio URL: https://github.com/apache/airflow/pull/5788#issuecomment-570369090 Just a comment. I think we might want to discuss and rethink the approach we have for different executors including the Local Executor as well.

[GitHub] [airflow] tfindlay-au commented on issue #6604: [AIRFLOW-5920] Neo4j operator and hook

2020-01-02 Thread GitBox
tfindlay-au commented on issue #6604: [AIRFLOW-5920] Neo4j operator and hook URL: https://github.com/apache/airflow/pull/6604#issuecomment-570364751 > I really like the PR, is neat and clean Just few nits and a question: would you mind to add example DAG that uses the new operator? It

[GitHub] [airflow] potiuk commented on issue #5788: [POC] multi-threading using asyncio

2020-01-02 Thread GitBox
potiuk commented on issue #5788: [POC] multi-threading using asyncio URL: https://github.com/apache/airflow/pull/5788#issuecomment-570364547 @nuclearpinguin -> I think this might also be interesting w/regards to NativeExecutor #6750

[GitHub] [airflow] mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs

2020-01-02 Thread GitBox
mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs URL: https://github.com/apache/airflow/pull/6983#discussion_r362642651 ## File path: docs/howto/configurations-ref.rst ## @@ -0,0 +1,1141 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs

2020-01-02 Thread GitBox
mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs URL: https://github.com/apache/airflow/pull/6983#discussion_r362642651 ## File path: docs/howto/configurations-ref.rst ## @@ -0,0 +1,1141 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs

2020-01-02 Thread GitBox
mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs URL: https://github.com/apache/airflow/pull/6983#discussion_r362642481 ## File path: docs/howto/configurations-ref.rst ## @@ -0,0 +1,1141 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs

2020-01-02 Thread GitBox
mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs URL: https://github.com/apache/airflow/pull/6983#discussion_r362642398 ## File path: docs/howto/configurations-ref.rst ## @@ -0,0 +1,1141 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs

2020-01-02 Thread GitBox
mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs URL: https://github.com/apache/airflow/pull/6983#discussion_r362642448 ## File path: docs/howto/configurations-ref.rst ## @@ -0,0 +1,1141 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs

2020-01-02 Thread GitBox
mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs URL: https://github.com/apache/airflow/pull/6983#discussion_r362642513 ## File path: docs/howto/configurations-ref.rst ## @@ -0,0 +1,1141 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs

2020-01-02 Thread GitBox
mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs URL: https://github.com/apache/airflow/pull/6983#discussion_r362642040 ## File path: docs/howto/configurations-ref.rst ## @@ -0,0 +1,1141 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs

2020-01-02 Thread GitBox
mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs URL: https://github.com/apache/airflow/pull/6983#discussion_r362642362 ## File path: docs/howto/configurations-ref.rst ## @@ -0,0 +1,1141 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs

2020-01-02 Thread GitBox
mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs URL: https://github.com/apache/airflow/pull/6983#discussion_r362642317 ## File path: docs/howto/configurations-ref.rst ## @@ -0,0 +1,1141 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs

2020-01-02 Thread GitBox
mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs URL: https://github.com/apache/airflow/pull/6983#discussion_r362641997 ## File path: docs/howto/configurations-ref.rst ## @@ -0,0 +1,1141 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs

2020-01-02 Thread GitBox
mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs URL: https://github.com/apache/airflow/pull/6983#discussion_r362641891 ## File path: docs/howto/configurations-ref.rst ## @@ -0,0 +1,1141 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs

2020-01-02 Thread GitBox
mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs URL: https://github.com/apache/airflow/pull/6983#discussion_r362641928 ## File path: docs/howto/configurations-ref.rst ## @@ -0,0 +1,1141 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs

2020-01-02 Thread GitBox
mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs URL: https://github.com/apache/airflow/pull/6983#discussion_r362641970 ## File path: docs/howto/configurations-ref.rst ## @@ -0,0 +1,1141 @@ + .. Licensed to the Apache Software

[jira] [Commented] (AIRFLOW-6430) BigQuery hook - add tests for BigQueryBaseCursor

2020-01-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17007097#comment-17007097 ] ASF GitHub Bot commented on AIRFLOW-6430: - potiuk commented on pull request #7010:

[GitHub] [airflow] potiuk commented on issue #7010: [AIRFLOW-6430] - BigQuery hook - add tests for BigQueryBaseCursor

2020-01-02 Thread GitBox
potiuk commented on issue #7010: [AIRFLOW-6430] - BigQuery hook - add tests for BigQueryBaseCursor URL: https://github.com/apache/airflow/pull/7010#issuecomment-570361840 Thanks @TobKed ! This is an automated message from

[GitHub] [airflow] mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs

2020-01-02 Thread GitBox
mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs URL: https://github.com/apache/airflow/pull/6983#discussion_r362641080 ## File path: docs/howto/configurations-ref.rst ## @@ -0,0 +1,1141 @@ + .. Licensed to the Apache Software

[jira] [Resolved] (AIRFLOW-6430) BigQuery hook - add tests for BigQueryBaseCursor

2020-01-02 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-6430. --- Fix Version/s: 2.0.0 Resolution: Fixed > BigQuery hook - add tests for

[jira] [Commented] (AIRFLOW-6430) BigQuery hook - add tests for BigQueryBaseCursor

2020-01-02 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17007099#comment-17007099 ] ASF subversion and git services commented on AIRFLOW-6430: -- Commit

[GitHub] [airflow] mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs

2020-01-02 Thread GitBox
mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs URL: https://github.com/apache/airflow/pull/6983#discussion_r362640800 ## File path: docs/howto/configurations-ref.rst ## @@ -0,0 +1,1141 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs

2020-01-02 Thread GitBox
mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs URL: https://github.com/apache/airflow/pull/6983#discussion_r362641027 ## File path: docs/howto/configurations-ref.rst ## @@ -0,0 +1,1141 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs

2020-01-02 Thread GitBox
mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs URL: https://github.com/apache/airflow/pull/6983#discussion_r362640991 ## File path: docs/howto/configurations-ref.rst ## @@ -0,0 +1,1141 @@ + .. Licensed to the Apache Software

[GitHub] [airflow] mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs

2020-01-02 Thread GitBox
mik-laj commented on a change in pull request #6983: [AIRFLOW-6414] configuration docs URL: https://github.com/apache/airflow/pull/6983#discussion_r362640959 ## File path: docs/howto/configurations-ref.rst ## @@ -0,0 +1,1141 @@ + .. Licensed to the Apache Software

  1   2   3   4   >