[GitHub] [airflow] rafyzg commented on issue #9708: Increase typing coverage

2020-07-08 Thread GitBox
rafyzg commented on issue #9708: URL: https://github.com/apache/airflow/issues/9708#issuecomment-655933146 > @rafyzg I assigned you to the ticket. Which provider is interesting for you? I will try first with one file in mysql providers.

[GitHub] [airflow] OmairK opened a new pull request #9733: [WIP] Increasing typing coverage for Docker

2020-07-08 Thread GitBox
OmairK opened a new pull request #9733: URL: https://github.com/apache/airflow/pull/9733 This PR would increase typing coverage for docker provider #9708 --- Make sure to mark the boxes below before creating PR: [x] - [ ] Description above provides context of the change - [ ] Un

[GitHub] [airflow] mik-laj commented on issue #9109: API Endpoint - CRUD - DAG

2020-07-08 Thread GitBox
mik-laj commented on issue #9109: URL: https://github.com/apache/airflow/issues/9109#issuecomment-655921897 @OmairK I assigned you to this ticket. This is an automated message from the Apache Git Service. To respond to the me

[GitHub] [airflow] OmairK commented on issue #9109: API Endpoint - CRUD - DAG

2020-07-08 Thread GitBox
OmairK commented on issue #9109: URL: https://github.com/apache/airflow/issues/9109#issuecomment-655920082 @mik-laj can you assign me this task please? This is an automated message from the Apache Git Service. To respond to

[GitHub] [airflow] sahil-b-shah opened a new issue #9732: DockerOperator does not support wait timeout for container

2020-07-08 Thread GitBox
sahil-b-shah opened a new issue #9732: URL: https://github.com/apache/airflow/issues/9732 **Apache Airflow version**: 1.10.10 **Kubernetes version (if you are using kubernetes)** (use `kubectl version`): **Environment**: - **Cloud provider or hardwar

[GitHub] [airflow] boring-cyborg[bot] commented on issue #9732: DockerOperator does not support wait timeout for container

2020-07-08 Thread GitBox
boring-cyborg[bot] commented on issue #9732: URL: https://github.com/apache/airflow/issues/9732#issuecomment-655913141 Thanks for opening your first issue here! Be sure to follow the issue template! This is an automated

[GitHub] [airflow] Fokko commented on pull request #9715: create CODE_OF_CONDUCT.md

2020-07-08 Thread GitBox
Fokko commented on pull request #9715: URL: https://github.com/apache/airflow/pull/9715#issuecomment-655912419 I'm not against it, but why have another CoC next to the Apache one. I would suggest that we also refer to the Apache one. ---

[airflow] branch master updated: Add read-only endpoints for DAG Model (#9045)

2020-07-08 Thread kamilbregula
This is an automated email from the ASF dual-hosted git repository. kamilbregula pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new 8b94ace Add read-only endpoints for DAG

[GitHub] [airflow] mik-laj merged pull request #9045: Add read-only endpoints for DAG Model

2020-07-08 Thread GitBox
mik-laj merged pull request #9045: URL: https://github.com/apache/airflow/pull/9045 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] mik-laj closed issue #8128: API Endpoints - Read-only - DAG

2020-07-08 Thread GitBox
mik-laj closed issue #8128: URL: https://github.com/apache/airflow/issues/8128 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

[GitHub] [airflow] boring-cyborg[bot] commented on issue #9731: Task instance null, execution date skipped

2020-07-08 Thread GitBox
boring-cyborg[bot] commented on issue #9731: URL: https://github.com/apache/airflow/issues/9731#issuecomment-655904657 Thanks for opening your first issue here! Be sure to follow the issue template! This is an automated

[GitHub] [airflow] AyWa opened a new issue #9731: Task instance null, execution date skipped

2020-07-08 Thread GitBox
AyWa opened a new issue #9731: URL: https://github.com/apache/airflow/issues/9731 **Apache Airflow version**: `1.10.9` **DB**: `Postgre11.6` (aws rds) **Environment**: - **Cloud provider or hardware configuration**: `AWS BEANSTALK - DOCKER` in a `Local` executor **W

[GitHub] [airflow] zikun commented on pull request #9730: DbApiHook: Support kwargs in get_pandas_df

2020-07-08 Thread GitBox
zikun commented on pull request #9730: URL: https://github.com/apache/airflow/pull/9730#issuecomment-655886583 Static check failed: airflow/providers/google/cloud/hooks/bigquery.py:166: error: Signature of "get_pandas_df" incompatible with supertype "DbApiHook" Let me add kwargs

[GitHub] [airflow] zikun opened a new pull request #9730: DbApiHook: Support kwargs in get_pandas_df

2020-07-08 Thread GitBox
zikun opened a new pull request #9730: URL: https://github.com/apache/airflow/pull/9730 Support all parameters that are supported by pandas `read_sql` function: https://github.com/pandas-dev/pandas/blob/1.0.x/pandas/io/sql.py#L336-L345 Closes #8468 --- Make sure to mark the

[airflow] tag nightly-master updated (6c15885 -> 0aea648)

2020-07-08 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from 6c15885 (commit) to 0aea648 (commit) from 6c

[GitHub] [airflow] houqp commented on pull request #9725: Add Qingping Hou to committers list

2020-07-08 Thread GitBox
houqp commented on pull request #9725: URL: https://github.com/apache/airflow/pull/9725#issuecomment-655827817 Sorry, late to the party, thank you all for taking care of it :D This is an automated message from the Apache Git

[GitHub] [airflow] morrme commented on issue #9708: Increase typing coverage

2020-07-08 Thread GitBox
morrme commented on issue #9708: URL: https://github.com/apache/airflow/issues/9708#issuecomment-655826410 @mik-laj Thank you! I will try celery! This is an automated message from the Apache Git Service. To respond to the mes

[GitHub] [airflow] mik-laj commented on issue #9708: Increase typing coverage

2020-07-08 Thread GitBox
mik-laj commented on issue #9708: URL: https://github.com/apache/airflow/issues/9708#issuecomment-655825714 These are small providers and this can be a good start to the adventure. - discord - dingding - datadog - cloudant - celery If you need help, you can ask @e

[GitHub] [airflow] mik-laj edited a comment on issue #9708: Increase typing coverage

2020-07-08 Thread GitBox
mik-laj edited a comment on issue #9708: URL: https://github.com/apache/airflow/issues/9708#issuecomment-655825714 These are small providers and this can be a good start to the adventure. - discord - dingding - datadog - cloudant - celery If you need help, you can

[GitHub] [airflow] morrme edited a comment on issue #9708: Increase typing coverage

2020-07-08 Thread GitBox
morrme edited a comment on issue #9708: URL: https://github.com/apache/airflow/issues/9708#issuecomment-655824265 I would like to help with this. I am new to the project, so I may need some guidance, if available. I have no provider preference. ---

[GitHub] [airflow] morrme commented on issue #9708: Increase typing coverage

2020-07-08 Thread GitBox
morrme commented on issue #9708: URL: https://github.com/apache/airflow/issues/9708#issuecomment-655824265 I would like to help with this. I am new to the project, so I may need some guidance, if available. This is an autom

[GitHub] [airflow] mik-laj commented on issue #9708: Increase typing coverage

2020-07-08 Thread GitBox
mik-laj commented on issue #9708: URL: https://github.com/apache/airflow/issues/9708#issuecomment-655821620 @rafyzg I assigned you to the ticket. Which provider is interesting for you? This is an automated message from the Ap

[GitHub] [airflow] mik-laj commented on pull request #9544: Add metric for scheduling delay between first run task & expected start time

2020-07-08 Thread GitBox
mik-laj commented on pull request #9544: URL: https://github.com/apache/airflow/pull/9544#issuecomment-655818454 Can you add this test case to avoid regression in number of queries? ```python @provide_session def test_process_dags_queries_count_after_finish_dag_run(self, ses

[GitHub] [airflow] rafyzg commented on issue #9708: Increase typing coverage

2020-07-08 Thread GitBox
rafyzg commented on issue #9708: URL: https://github.com/apache/airflow/issues/9708#issuecomment-655813328 Hi @mik-laj , I would love to help with one of the providers. This is an automated message from the Apache Git Servi

[GitHub] [airflow] mik-laj commented on pull request #9544: Add metric for scheduling delay between first run task & expected start time

2020-07-08 Thread GitBox
mik-laj commented on pull request #9544: URL: https://github.com/apache/airflow/pull/9544#issuecomment-655812648 I have the answer to the 3rd question. We only test cases when DAG Run are still running. This is an automated

[GitHub] [airflow] mik-laj commented on a change in pull request #9544: Add metric for scheduling delay between first run task & expected start time

2020-07-08 Thread GitBox
mik-laj commented on a change in pull request #9544: URL: https://github.com/apache/airflow/pull/9544#discussion_r451883526 ## File path: airflow/models/dagrun.py ## @@ -411,6 +412,44 @@ def _are_premature_tis( return True return False +@provide_

[GitHub] [airflow] mik-laj commented on pull request #9544: Add metric for scheduling delay between first run task & expected start time

2020-07-08 Thread GitBox
mik-laj commented on pull request #9544: URL: https://github.com/apache/airflow/pull/9544#issuecomment-655809178 I started looking at this change and I have three questions. 1. What is your average difference in value between `dagrun.schedule_delay.` and `dagrun..first_task_scheduling_d

[jira] [Updated] (AIRFLOW-5071) Thousand os Executor reports task instance X finished (success) although the task says its queued. Was the task killed externally?

2020-07-08 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-5071: Fix Version/s: 1.10.12 > Thousand os Executor reports task instance X finished (success) although

[jira] [Commented] (AIRFLOW-5071) Thousand os Executor reports task instance X finished (success) although the task says its queued. Was the task killed externally?

2020-07-08 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17154068#comment-17154068 ] Kaxil Naik commented on AIRFLOW-5071: - Thanks for the info [~sgrzemski]. [~potiuk]

[GitHub] [airflow] ephraimbuddy commented on a change in pull request #9729: Increase typing coverage for Apache provider package

2020-07-08 Thread GitBox
ephraimbuddy commented on a change in pull request #9729: URL: https://github.com/apache/airflow/pull/9729#discussion_r451870163 ## File path: airflow/hooks/base_hook.py ## @@ -21,7 +21,7 @@ from typing import List Review comment: ```suggestion from typing import An

[GitHub] [airflow] kaxil edited a comment on issue #9713: Looping issue using Hashicorp Vault

2020-07-08 Thread GitBox
kaxil edited a comment on issue #9713: URL: https://github.com/apache/airflow/issues/9713#issuecomment-655796847 Currently there is no built-in retry strategy to prevent the issue you mentioned I am happy for you to take on this ticket and implement a strategy to prevent this kind o

[GitHub] [airflow] kaxil commented on issue #9713: Looping issue using Hashicorp Vault

2020-07-08 Thread GitBox
kaxil commented on issue #9713: URL: https://github.com/apache/airflow/issues/9713#issuecomment-655796847 I am happy for you to take on this ticket and implement a strategy to prevent this kind of issue This is an automated

[GitHub] [airflow] mik-laj commented on a change in pull request #9729: Increase typing coverage for Apache provider package

2020-07-08 Thread GitBox
mik-laj commented on a change in pull request #9729: URL: https://github.com/apache/airflow/pull/9729#discussion_r451865773 ## File path: airflow/utils/decorators.py ## @@ -21,13 +21,14 @@ import os from copy import copy from functools import wraps +from typing import Any, C

[GitHub] [airflow] ephraimbuddy commented on a change in pull request #9729: Increase typing coverage for Apache provider package

2020-07-08 Thread GitBox
ephraimbuddy commented on a change in pull request #9729: URL: https://github.com/apache/airflow/pull/9729#discussion_r451863059 ## File path: airflow/utils/decorators.py ## @@ -21,13 +21,14 @@ import os from copy import copy from functools import wraps +from typing import A

[GitHub] [airflow] kaxil commented on pull request #9715: create CODE_OF_CONDUCT.md

2020-07-08 Thread GitBox
kaxil commented on pull request #9715: URL: https://github.com/apache/airflow/pull/9715#issuecomment-655791145 The only thing I see missing in this PR's COC is section around Reporting Guidelines which ASF COC covers (https://www.apache.org/foundation/policies/conduct#reporting-guidelines)

[GitHub] [airflow] vanka56 commented on a change in pull request #9472: Add drop_partition functionality for HiveMetastoreHook

2020-07-08 Thread GitBox
vanka56 commented on a change in pull request #9472: URL: https://github.com/apache/airflow/pull/9472#discussion_r451859081 ## File path: tests/providers/apache/hive/hooks/test_hive.py ## @@ -383,6 +383,10 @@ def test_table_exists(self): self.hook.table_exists(str(

[GitHub] [airflow] mik-laj commented on a change in pull request #9729: Increase typing coverage for Apache provider package

2020-07-08 Thread GitBox
mik-laj commented on a change in pull request #9729: URL: https://github.com/apache/airflow/pull/9729#discussion_r451859421 ## File path: airflow/hooks/base_hook.py ## @@ -82,6 +82,6 @@ def get_hook(cls, conn_id: str) -> "BaseHook": connection = cls.get_connection(conn

[GitHub] [airflow] dossett commented on a change in pull request #9079: [8970] Improve KubernetesPodOperator guide

2020-07-08 Thread GitBox
dossett commented on a change in pull request #9079: URL: https://github.com/apache/airflow/pull/9079#discussion_r451814841 ## File path: docs/howto/operator/kubernetes.rst ## @@ -22,150 +22,96 @@ KubernetesPodOperator = +The :class:`~airflow.providers.

[GitHub] [airflow] ephraimbuddy opened a new pull request #9729: Increase typing coverage for Apache provider package

2020-07-08 Thread GitBox
ephraimbuddy opened a new pull request #9729: URL: https://github.com/apache/airflow/pull/9729 --- Make sure to mark the boxes below before creating PR: [x] - [ ] Description above provides context of the change - [ ] Unit tests coverage for changes (not needed for documentation

[airflow] branch master updated: Skip one version of Python for each test.

2020-07-08 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new 0aea648 Skip one version of Python for each te

[GitHub] [airflow] potiuk merged pull request #9716: Remove 3.7 tests for MySQL, Postgres, and Sqlite.

2020-07-08 Thread GitBox
potiuk merged pull request #9716: URL: https://github.com/apache/airflow/pull/9716 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [airflow] potiuk merged pull request #9723: Error in description after deployment

2020-07-08 Thread GitBox
potiuk merged pull request #9723: URL: https://github.com/apache/airflow/pull/9723 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[airflow] branch master updated (47c9f75 -> 9db1fa3)

2020-07-08 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 47c9f75 Add new fantastic team member of Polidea. (#9724) add 9db1fa3 Error in description after deployment (

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #9723: Error in description after deployment

2020-07-08 Thread GitBox
boring-cyborg[bot] commented on pull request #9723: URL: https://github.com/apache/airflow/pull/9723#issuecomment-655737425 Awesome work, congrats on your first merged pull request! This is an automated message from the A

[airflow] branch master updated (b26017d -> 576100b)

2020-07-08 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from b26017d Add The Climate Corporation to user list (#9726) add 576100b Add Qingping Hou to committers list (#97

[airflow] branch master updated: Add new fantastic team member of Polidea. (#9724)

2020-07-08 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new 47c9f75 Add new fantastic team member of Polid

[GitHub] [airflow] potiuk merged pull request #9725: Add Qingping Hou to committers list

2020-07-08 Thread GitBox
potiuk merged pull request #9725: URL: https://github.com/apache/airflow/pull/9725 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [airflow] potiuk merged pull request #9724: Add new fantastic team member of Polidea

2020-07-08 Thread GitBox
potiuk merged pull request #9724: URL: https://github.com/apache/airflow/pull/9724 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [airflow] dossett commented on a change in pull request #9079: [8970] Improve KubernetesPodOperator guide

2020-07-08 Thread GitBox
dossett commented on a change in pull request #9079: URL: https://github.com/apache/airflow/pull/9079#discussion_r451802108 ## File path: docs/howto/operator/kubernetes.rst ## @@ -22,150 +22,96 @@ KubernetesPodOperator = +The :class:`~airflow.providers.

[airflow] branch master updated (38a0b1d -> b26017d)

2020-07-08 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 38a0b1d fix grammar in prereq tasks gcp operator docs (#9728) add b26017d Add The Climate Corporation to u

[GitHub] [airflow] kaxil commented on pull request #9726: add The Climate Corporation to user list

2020-07-08 Thread GitBox
kaxil commented on pull request #9726: URL: https://github.com/apache/airflow/pull/9726#issuecomment-655734870 Thanks for adding :) This is an automated message from the Apache Git Service. To respond to the message, please l

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #9726: add The Climate Corporation to user list

2020-07-08 Thread GitBox
boring-cyborg[bot] commented on pull request #9726: URL: https://github.com/apache/airflow/pull/9726#issuecomment-655734754 Awesome work, congrats on your first merged pull request! This is an automated message from the A

[GitHub] [airflow] kaxil merged pull request #9726: add The Climate Corporation to user list

2020-07-08 Thread GitBox
kaxil merged pull request #9726: URL: https://github.com/apache/airflow/pull/9726 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[airflow] branch master updated (dfe8337 -> 38a0b1d)

2020-07-08 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from dfe8337 YAML file supports extra json parameters (#9549) add 38a0b1d fix grammar in prereq tasks gcp operator

[GitHub] [airflow] mik-laj commented on pull request #9079: [8970] Improve KubernetesPodOperator guide

2020-07-08 Thread GitBox
mik-laj commented on pull request #9079: URL: https://github.com/apache/airflow/pull/9079#issuecomment-655724857 I would be happy to add information that Kubernetes Executor is not required for Kubernetes Pod Operator. Two sentences about the behavior of KubernetesPodOperator when installi

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #9728: Fix grammar in prerequisite tasks for GCP operator documentation

2020-07-08 Thread GitBox
boring-cyborg[bot] commented on pull request #9728: URL: https://github.com/apache/airflow/pull/9728#issuecomment-655725020 Awesome work, congrats on your first merged pull request! This is an automated message from the A

[GitHub] [airflow] potiuk merged pull request #9728: Fix grammar in prerequisite tasks for GCP operator documentation

2020-07-08 Thread GitBox
potiuk merged pull request #9728: URL: https://github.com/apache/airflow/pull/9728 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [airflow] vuppalli opened a new pull request #9728: Fix grammar in prerequisite tasks for GCP operator documentation

2020-07-08 Thread GitBox
vuppalli opened a new pull request #9728: URL: https://github.com/apache/airflow/pull/9728 --- This PR is an attempt to fix some grammar issues in prerequisite_tasks.rst for GCP operator documentation. Make sure to mark the boxes below before creating PR: [x] - [x] Descript

[GitHub] [airflow] vuppalli edited a comment on issue #9418: Deprecated AI Platform Operators and Runtimes in Example DAG

2020-07-08 Thread GitBox
vuppalli edited a comment on issue #9418: URL: https://github.com/apache/airflow/issues/9418#issuecomment-652672779 Thank you for the information! I created a PR for this issue here: https://github.com/apache/airflow/pull/9727.

[GitHub] [airflow] vuppalli opened a new pull request #9727: fix depr operators, versions, and typos

2020-07-08 Thread GitBox
vuppalli opened a new pull request #9727: URL: https://github.com/apache/airflow/pull/9727 --- The AI platform example DAG had typos, was using older versions, and had deprecated operators. This PR is an attempt to fix these problems and corresponds to [this Github issue](https://githu

[GitHub] [airflow] vuppalli closed pull request #9618: Fix typos, older versions, and deprecated operators with AI platform example DAG

2020-07-08 Thread GitBox
vuppalli closed pull request #9618: URL: https://github.com/apache/airflow/pull/9618 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] HenryLinTw commented on issue #9717: airflow initdb failed on ORA-22858 altering xcom.value to BLOB with Oracle (ATP) DB as backend DB

2020-07-08 Thread GitBox
HenryLinTw commented on issue #9717: URL: https://github.com/apache/airflow/issues/9717#issuecomment-655703660 From documentation: https://airflow.apache.org/docs/stable/howto/initialize-database.html it mentions "As Airflow was built to interact with its metadata using the great Sq

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #9726: add The Climate Corporation to user list

2020-07-08 Thread GitBox
boring-cyborg[bot] commented on pull request #9726: URL: https://github.com/apache/airflow/pull/9726#issuecomment-655695716 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contr

[GitHub] [airflow] jmelching opened a new pull request #9726: add The Climate Corporation to user list

2020-07-08 Thread GitBox
jmelching opened a new pull request #9726: URL: https://github.com/apache/airflow/pull/9726 --- Make sure to mark the boxes below before creating PR: [x] - [ x] Description above provides context of the change - [ x] Unit tests coverage for changes (not needed for documentation

[GitHub] [airflow] turbaszek commented on pull request #9725: Add Qingping Hou to committers list

2020-07-08 Thread GitBox
turbaszek commented on pull request #9725: URL: https://github.com/apache/airflow/pull/9725#issuecomment-655687358 @houqp would you mind taking a look? 😄 This is an automated message from the Apache Git Service. To respond t

[GitHub] [airflow] turbaszek opened a new pull request #9725: Add Qingping Hou to committers list

2020-07-08 Thread GitBox
turbaszek opened a new pull request #9725: URL: https://github.com/apache/airflow/pull/9725 --- Make sure to mark the boxes below before creating PR: [x] - [x] Description above provides context of the change - [x] Unit tests coverage for changes (not needed for documentation ch

[GitHub] [airflow] mik-laj opened a new pull request #9724: Add new fantastic team member of Polidea.

2020-07-08 Thread GitBox
mik-laj opened a new pull request #9724: URL: https://github.com/apache/airflow/pull/9724 CC: @mschickensoup @debek --- Make sure to mark the boxes below before creating PR: [x] - [X] Description above provides context of the change - [X] Unit tests coverage for changes

[GitHub] [airflow] debek edited a comment on pull request #9723: Error in description after deployment

2020-07-08 Thread GitBox
debek edited a comment on pull request #9723: URL: https://github.com/apache/airflow/pull/9723#issuecomment-655665824 > template > @debek thanks for the description! What do you think about updating the title to "Add namespace flag in helm template notes"? I think that

[GitHub] [airflow] debek commented on pull request #9723: Error in description after deployment

2020-07-08 Thread GitBox
debek commented on pull request #9723: URL: https://github.com/apache/airflow/pull/9723#issuecomment-655665824 > template > @debek thanks for the description! What do you think about updating the title to "Add namespace flag in helm template notes"? I think that it is a go

[GitHub] [airflow] turbaszek commented on pull request #9723: Error in description after deployment

2020-07-08 Thread GitBox
turbaszek commented on pull request #9723: URL: https://github.com/apache/airflow/pull/9723#issuecomment-655664004 @debek thanks for the description! What do you think about updating the title to "Add namespace flag in helm template notes"? ---

[GitHub] [airflow] potiuk commented on a change in pull request #9723: Error in description after deployment

2020-07-08 Thread GitBox
potiuk commented on a change in pull request #9723: URL: https://github.com/apache/airflow/pull/9723#discussion_r451720394 ## File path: chart/templates/NOTES.txt ## @@ -22,8 +22,8 @@ Your release is named {{ .Release.Name }}. You can now access your dashboard(s) by executin

[GitHub] [airflow] potiuk commented on a change in pull request #9723: Error in description after deployment

2020-07-08 Thread GitBox
potiuk commented on a change in pull request #9723: URL: https://github.com/apache/airflow/pull/9723#discussion_r451720254 ## File path: chart/templates/NOTES.txt ## @@ -22,8 +22,8 @@ Your release is named {{ .Release.Name }}. You can now access your dashboard(s) by executin

[GitHub] [airflow] turbaszek commented on pull request #9723: Error in description after deployment

2020-07-08 Thread GitBox
turbaszek commented on pull request #9723: URL: https://github.com/apache/airflow/pull/9723#issuecomment-655659197 @debek thanks for the PR! Could you please add some description to your PR? Meaningful commit messages and descriptions make code review easier 👌 ---

[GitHub] [airflow] tooptoop4 commented on pull request #3250: [WIP] Add dms raw

2020-07-08 Thread GitBox
tooptoop4 commented on pull request #3250: URL: https://github.com/apache/airflow/pull/3250#issuecomment-655654441 @jzucker2 do u have any updates? This is an automated message from the Apache Git Service. To respond to the m

[GitHub] [airflow] debek opened a new pull request #9723: Error in description after deployment

2020-07-08 Thread GitBox
debek opened a new pull request #9723: URL: https://github.com/apache/airflow/pull/9723 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #9723: Error in description after deployment

2020-07-08 Thread GitBox
boring-cyborg[bot] commented on pull request #9723: URL: https://github.com/apache/airflow/pull/9723#issuecomment-655653141 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contr

[GitHub] [airflow] zikun commented on issue #9610: Pod logs from KubernetesPodOperator occasionally get replaced with "Task is not able to run"

2020-07-08 Thread GitBox
zikun commented on issue #9610: URL: https://github.com/apache/airflow/issues/9610#issuecomment-655617057 Similar issue in #9626 This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] boring-cyborg[bot] commented on issue #9722: Airflow can't import DAG in UI and logs, but manual DAG trigger works

2020-07-08 Thread GitBox
boring-cyborg[bot] commented on issue #9722: URL: https://github.com/apache/airflow/issues/9722#issuecomment-655607231 Thanks for opening your first issue here! Be sure to follow the issue template! This is an automated

[GitHub] [airflow] BobasB opened a new issue #9722: Airflow can't import DAG in UI and logs, but manual DAG trigger works

2020-07-08 Thread GitBox
BobasB opened a new issue #9722: URL: https://github.com/apache/airflow/issues/9722 Hi, I have a very strange and specific behaviour of Airflow on AWS EKS cluster after deploying Calico to enforce network policies. I have also created AWS support case, but I also need support from Airflow

[airflow] branch master updated: YAML file supports extra json parameters (#9549)

2020-07-08 Thread kamilbregula
This is an automated email from the ASF dual-hosted git repository. kamilbregula pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new dfe8337 YAML file supports extra json pa

[GitHub] [airflow] mik-laj merged pull request #9549: YAML file supports extra json parameters

2020-07-08 Thread GitBox
mik-laj merged pull request #9549: URL: https://github.com/apache/airflow/pull/9549 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] klyusba opened a new issue #9721: InvalidToken error

2020-07-08 Thread GitBox
klyusba opened a new issue #9721: URL: https://github.com/apache/airflow/issues/9721 **Apache Airflow version**: 1.10.10 **Environment**: puckel/docker-airflow with celery executor **What happened**: PostgresHook inside PythonOperator causes cryptography.fernet.InvalidTo

[GitHub] [airflow] boring-cyborg[bot] commented on issue #9721: InvalidToken error

2020-07-08 Thread GitBox
boring-cyborg[bot] commented on issue #9721: URL: https://github.com/apache/airflow/issues/9721#issuecomment-69904 Thanks for opening your first issue here! Be sure to follow the issue template! This is an automated

[jira] [Commented] (AIRFLOW-6786) Adding KafkaConsumerHook, KafkaProducerHook, and KafkaSensor

2020-07-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17153647#comment-17153647 ] ASF GitHub Bot commented on AIRFLOW-6786: - dferguson992 commented on pull reque

[GitHub] [airflow] dferguson992 commented on pull request #7407: [AIRFLOW-6786] Add KafkaConsumerHook, KafkaProduerHook and KafkaSensor

2020-07-08 Thread GitBox
dferguson992 commented on pull request #7407: URL: https://github.com/apache/airflow/pull/7407#issuecomment-66027 Working on it @haidaraM, the build process is taking longer than I expected This is an automated message fr

[GitHub] [airflow] potiuk commented on issue #9720: how to use airflow with all extra by docker

2020-07-08 Thread GitBox
potiuk commented on issue #9720: URL: https://github.com/apache/airflow/issues/9720#issuecomment-655547447 Pleas use slack on Github to ask questions like that - that's why your task was marked as invalid because this is not a place to ask questions. Generally - you have to rebuild the ima

[GitHub] [airflow] potiuk closed issue #9720: how to use airflow with all extra by docker

2020-07-08 Thread GitBox
potiuk closed issue #9720: URL: https://github.com/apache/airflow/issues/9720 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

[GitHub] [airflow] turbaszek commented on pull request #9712: Use namedtuple for TaskInstanceKeyType

2020-07-08 Thread GitBox
turbaszek commented on pull request #9712: URL: https://github.com/apache/airflow/pull/9712#issuecomment-655541034 > LGTM overall, but I noticed that you usually refer to instances of `TaskInstanceKeyType` as `key`, but in airflow/jobs/backfill_job.py you use `ti_key` and `ti` in airflow/m

[jira] [Comment Edited] (AIRFLOW-5071) Thousand os Executor reports task instance X finished (success) although the task says its queued. Was the task killed externally?

2020-07-08 Thread Lindsay Portelli (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152897#comment-17152897 ] Lindsay Portelli edited comment on AIRFLOW-5071 at 7/8/20, 1:53 PM: -

[GitHub] [airflow] geosmart opened a new issue #9720: how to use airflow with all extra by docker

2020-07-08 Thread GitBox
geosmart opened a new issue #9720: URL: https://github.com/apache/airflow/issues/9720 my dockerfile like this ```dockerfile FROM apache/airflow:1.10.10-python3.6 ``` as airflow dockfile comment ```md # This is a multi-segmented image. It actually contains two images:

[GitHub] [airflow] boring-cyborg[bot] commented on issue #9720: how to use airflow with all extra by docker

2020-07-08 Thread GitBox
boring-cyborg[bot] commented on issue #9720: URL: https://github.com/apache/airflow/issues/9720#issuecomment-655524333 Thanks for opening your first issue here! Be sure to follow the issue template! This is an automated

[GitHub] [airflow] kaxil commented on a change in pull request #9719: Pre-create Celery db result tables before running Celery worker

2020-07-08 Thread GitBox
kaxil commented on a change in pull request #9719: URL: https://github.com/apache/airflow/pull/9719#discussion_r451536099 ## File path: airflow/cli/commands/celery_command.py ## @@ -112,6 +113,24 @@ def worker(args): log=args.log_file, ) +backend = celery_ap

[GitHub] [airflow] ashb opened a new pull request #9719: Pre-create Celery db result tables before running Celery worker

2020-07-08 Thread GitBox
ashb opened a new pull request #9719: URL: https://github.com/apache/airflow/pull/9719 Otherwise at large scale this can end up with some tasks failing as they try to create the result table at the same time. This was always possible before, just exceedingly rare, but in large s

[GitHub] [airflow] subkanthi commented on issue #9134: Support Flink operator

2020-07-08 Thread GitBox
subkanthi commented on issue #9134: URL: https://github.com/apache/airflow/issues/9134#issuecomment-655501248 I thought this was very similar to the SparkSubmit operator where it expects spark-submit to be in the path and takes the jar file as a parameter. ---

[GitHub] [airflow] kaxil merged pull request #9645: Get Airflow configs with sensitive data from Secret Backends

2020-07-08 Thread GitBox
kaxil merged pull request #9645: URL: https://github.com/apache/airflow/pull/9645 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[airflow] branch master updated (c353fed -> 2f31b30)

2020-07-08 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from c353fed Make airflow/migrations/env.py Pylint Compatible (#9670) add 2f31b30 Get Airflow configs with sens

[GitHub] [airflow] ashb commented on issue #9718: store_serialized_dags causes a pile up of open connections to the database backend with ~3000 DagRuns

2020-07-08 Thread GitBox
ashb commented on issue #9718: URL: https://github.com/apache/airflow/issues/9718#issuecomment-655472447 Could you also please run `EXPLAIN ANALYZE` on that delete query in your DB? This is an automated message from the Apach

[GitHub] [airflow] ashb commented on issue #9718: store_serialized_dags causes a pile up of open connections to the database backend with ~3000 DagRuns

2020-07-08 Thread GitBox
ashb commented on issue #9718: URL: https://github.com/apache/airflow/issues/9718#issuecomment-655471935 Can you give us an example dag that shows this problem too please? This is an automated message from the Apache Git Serv

[GitHub] [airflow] amr-noureldin commented on issue #9718: store_serialized_dags causes a pile up of open connections to the database backend with ~3000 DagRuns

2020-07-08 Thread GitBox
amr-noureldin commented on issue #9718: URL: https://github.com/apache/airflow/issues/9718#issuecomment-655469482 Sorry for the typo, this issue was encountered when running on Potgres 10 This is an automated message from the

[GitHub] [airflow] turbaszek commented on issue #8923: Google AdManager

2020-07-08 Thread GitBox
turbaszek commented on issue #8923: URL: https://github.com/apache/airflow/issues/8923#issuecomment-655469510 @kweitzner @dephusluke @Handtaker23 do anyone of you would like work on this one? We are happy to help 👌 This is

  1   2   >