[GitHub] [airflow] chinwobble removed a comment on issue #18999: Update databricks provider to use TriggerOperator

2021-11-01 Thread GitBox
chinwobble removed a comment on issue #18999: URL: https://github.com/apache/airflow/issues/18999#issuecomment-957090940 > runtime ![image](https://user-images.githubusercontent.com/18226001/139786606-5a718625-1a8b-4db6-82d3-4f8cd416a3e6.png) -- This is an automated message

[GitHub] [airflow] chinwobble commented on issue #18999: Update databricks provider to use TriggerOperator

2021-11-01 Thread GitBox
chinwobble commented on issue #18999: URL: https://github.com/apache/airflow/issues/18999#issuecomment-957090940 > runtime ![image](https://user-images.githubusercontent.com/18226001/139786606-5a718625-1a8b-4db6-82d3-4f8cd416a3e6.png) -- This is an automated message from the

[GitHub] [airflow] mik-laj removed a comment on pull request #18249: Add support for securityContext per deployment

2021-11-01 Thread GitBox
mik-laj removed a comment on pull request #18249: URL: https://github.com/apache/airflow/pull/18249#issuecomment-957039017 What do you think about adding a guide about this feature similar to [init/sidecar container

[GitHub] [airflow] mik-laj commented on pull request #19181: More strict schema for values.yaml

2021-11-01 Thread GitBox
mik-laj commented on pull request #19181: URL: https://github.com/apache/airflow/pull/19181#issuecomment-957070404 I have resolved all the problems except the following ``` $ cat chart/values.schema.json | jq 'recurse | objects | select(.type == "array") | select(.items == null)'

[GitHub] [airflow] ZackingIt edited a comment on issue #10605: Use private docker repository with K8S operator and XCOM sidecar container

2021-11-01 Thread GitBox
ZackingIt edited a comment on issue #10605: URL: https://github.com/apache/airflow/issues/10605#issuecomment-957069715 > > airflowLocalSettings: | > > from airflow.providers.cncf.kubernetes.utils.xcom_sidecar import PodDefaults > > PodDefaults.SIDECAR_CONTAINER.image =

[GitHub] [airflow] ZackingIt commented on issue #10605: Use private docker repository with K8S operator and XCOM sidecar container

2021-11-01 Thread GitBox
ZackingIt commented on issue #10605: URL: https://github.com/apache/airflow/issues/10605#issuecomment-957069715 > > airflowLocalSettings: | > > from airflow.providers.cncf.kubernetes.utils.xcom_sidecar import PodDefaults > > PodDefaults.SIDECAR_CONTAINER.image =

[GitHub] [airflow] boring-cyborg[bot] commented on issue #19360: Airflow Helm chart fails on Apple Silicon + kind

2021-11-01 Thread GitBox
boring-cyborg[bot] commented on issue #19360: URL: https://github.com/apache/airflow/issues/19360#issuecomment-957066969 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] ralleman-quasarsat opened a new issue #19360: Airflow Helm chart fails on Apple Silicon + kind

2021-11-01 Thread GitBox
ralleman-quasarsat opened a new issue #19360: URL: https://github.com/apache/airflow/issues/19360 ### Apache Airflow version 2.2.1 (latest released) ### Operating System Mac OS Big Sur (2021 Mac Air M1) ### Versions of Apache Airflow Providers - ###

[GitHub] [airflow] dstandish commented on a change in pull request #18249: Add support for securityContext per deployment

2021-11-01 Thread GitBox
dstandish commented on a change in pull request #18249: URL: https://github.com/apache/airflow/pull/18249#discussion_r740672226 ## File path: docs/helm-chart/production-guide.rst ## @@ -258,3 +258,140 @@ In order to enable the usage of SCCs, one must set the parameter

[GitHub] [airflow] calfzhou commented on issue #19342: Webserver shows wrong datetime (timezone) in log

2021-11-01 Thread GitBox
calfzhou commented on issue #19342: URL: https://github.com/apache/airflow/issues/19342#issuecomment-957060303 2.2.0 and 2.2.1 both facing the same issue. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [airflow] josh-fell commented on a change in pull request #19356: Add influxdb operator

2021-11-01 Thread GitBox
josh-fell commented on a change in pull request #19356: URL: https://github.com/apache/airflow/pull/19356#discussion_r740674861 ## File path: airflow/providers/influxdb/example_dags/example_influxdb_operator.py ## @@ -0,0 +1,39 @@ +# Licensed to the Apache Software Foundation

[GitHub] [airflow] mik-laj commented on a change in pull request #18249: Add support for securityContext per deployment

2021-11-01 Thread GitBox
mik-laj commented on a change in pull request #18249: URL: https://github.com/apache/airflow/pull/18249#discussion_r740674914 ## File path: chart/values.schema.json ## @@ -1203,6 +1216,18 @@ ] } } +

[GitHub] [airflow] mik-laj commented on pull request #18249: Add support for securityContext per deployment

2021-11-01 Thread GitBox
mik-laj commented on pull request #18249: URL: https://github.com/apache/airflow/pull/18249#issuecomment-957039017 What do you think about adding a guide about this feature similar to [init/sidecar container

[GitHub] [airflow] mik-laj commented on a change in pull request #18249: Add support for securityContext per deployment

2021-11-01 Thread GitBox
mik-laj commented on a change in pull request #18249: URL: https://github.com/apache/airflow/pull/18249#discussion_r740674914 ## File path: chart/values.schema.json ## @@ -1203,6 +1216,18 @@ ] } } +

[GitHub] [airflow] mariotaddeucci edited a comment on issue #19328: Status of testing Providers that were prepared on October 30, 2021

2021-11-01 Thread GitBox
mariotaddeucci edited a comment on issue #19328: URL: https://github.com/apache/airflow/issues/19328#issuecomment-957034378 > > #18844 got errors using `RedshiftSQLHook ` when executing multiple commands into a prepared statement. I'll fix it. > > How serious / how much of a

[GitHub] [airflow] mariotaddeucci commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021

2021-11-01 Thread GitBox
mariotaddeucci commented on issue #19328: URL: https://github.com/apache/airflow/issues/19328#issuecomment-957034378 > > #18844 got errors using `RedshiftSQLHook ` when executing multiple commands into a prepared statement. I'll fix it. > > How serious / how much of a regression

[GitHub] [airflow] dstandish opened a new pull request #19359: Task should fail immediately when pod is unprocessable

2021-11-01 Thread GitBox
dstandish opened a new pull request #19359: URL: https://github.com/apache/airflow/pull/19359 When pod has invalid requirements, e.g. resource limit < resource request, the kubernetes api may return "Unprocessable Entity". In this scenario, the kubernetes executor should fail the

[GitHub] [airflow] mik-laj commented on pull request #17996: Update production-guide.rst - include datadog

2021-11-01 Thread GitBox
mik-laj commented on pull request #17996: URL: https://github.com/apache/airflow/pull/17996#issuecomment-957026577 We should add a section about Datadog to `apache-airflow` docs also. http://airflow.apache.org/docs/apache-airflow/stable/logging-monitoring/metrics.html -- This is an

[GitHub] [airflow] subkanthi commented on issue #19080: Display DAGs dependencies in CLI

2021-11-01 Thread GitBox
subkanthi commented on issue #19080: URL: https://github.com/apache/airflow/issues/19080#issuecomment-957013159 can I take this on please. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] julienledem commented on issue #17984: Add possibility to LineageBackend to be notified of task instance execution start and failure

2021-11-01 Thread GitBox
julienledem commented on issue #17984: URL: https://github.com/apache/airflow/issues/17984#issuecomment-957011915 It makes sense to me. The intension is to track task execution including the lineage (what the task reads and where it writes). We're happy to adjust to this. It depends a bit

[GitHub] [airflow] mariotaddeucci opened a new pull request #19358: Fix S3 to redshift operator

2021-11-01 Thread GitBox
mariotaddeucci opened a new pull request #19358: URL: https://github.com/apache/airflow/pull/19358 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)** for more

[GitHub] [airflow] mik-laj commented on issue #19357: DatabricksHook method get_run_state returns error

2021-11-01 Thread GitBox
mik-laj commented on issue #19357: URL: https://github.com/apache/airflow/issues/19357#issuecomment-956995208 @alexott @robertsaxby Can you look at it? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[airflow] branch main updated: Enable mouse mode by default in start_airflow tmux session (#19325)

2021-11-01 Thread kamilbregula
This is an automated email from the ASF dual-hosted git repository. kamilbregula pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 4299751 Enable mouse mode by default in

[GitHub] [airflow] mik-laj merged pull request #19325: Enable mouse mode by default in start_airflow tmux session

2021-11-01 Thread GitBox
mik-laj merged pull request #19325: URL: https://github.com/apache/airflow/pull/19325 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] jedcunningham commented on pull request #18808: Extra containers, volumes and volume mounts for jobs

2021-11-01 Thread GitBox
jedcunningham commented on pull request #18808: URL: https://github.com/apache/airflow/pull/18808#issuecomment-956980708 Thanks @pvanliefland! Could you rebase on main and look at resolving the merge conflicts when you get the chance? -- This is an automated message from the Apache Git

[GitHub] [airflow] jedcunningham commented on pull request #17996: Update production-guide.rst - include datadog

2021-11-01 Thread GitBox
jedcunningham commented on pull request #17996: URL: https://github.com/apache/airflow/pull/17996#issuecomment-956975490 @a-nascimento, gentle ping. I'd love to get this merged for the next helm chart release. -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [airflow] jedcunningham commented on a change in pull request #18249: Add support for securityContext per deployment

2021-11-01 Thread GitBox
jedcunningham commented on a change in pull request #18249: URL: https://github.com/apache/airflow/pull/18249#discussion_r740594865 ## File path: chart/values.schema.json ## @@ -1629,6 +1666,18 @@ "description": "Annotations to add to the triggerer pods.",

[GitHub] [airflow] github-actions[bot] closed issue #9656: Webserver times out when running a task by ignoring all dependencies

2021-11-01 Thread GitBox
github-actions[bot] closed issue #9656: URL: https://github.com/apache/airflow/issues/9656 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] github-actions[bot] commented on issue #9656: Webserver times out when running a task by ignoring all dependencies

2021-11-01 Thread GitBox
github-actions[bot] commented on issue #9656: URL: https://github.com/apache/airflow/issues/9656#issuecomment-956951346 This issue has been closed because it has not received response from the issue author. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] mik-laj commented on a change in pull request #19355: Update the example DAGs

2021-11-01 Thread GitBox
mik-laj commented on a change in pull request #19355: URL: https://github.com/apache/airflow/pull/19355#discussion_r740628714 ## File path: airflow/example_dags/example_kubernetes_executor.py ## @@ -18,86 +18,114 @@ """ This is an example dag for using the Kubernetes

[GitHub] [airflow] mik-laj commented on a change in pull request #19355: Update the example DAGs

2021-11-01 Thread GitBox
mik-laj commented on a change in pull request #19355: URL: https://github.com/apache/airflow/pull/19355#discussion_r740628714 ## File path: airflow/example_dags/example_kubernetes_executor.py ## @@ -18,86 +18,114 @@ """ This is an example dag for using the Kubernetes

[GitHub] [airflow] pohek321 opened a new issue #19357: DatabricksHook method get_run_state returns error

2021-11-01 Thread GitBox
pohek321 opened a new issue #19357: URL: https://github.com/apache/airflow/issues/19357 ### Apache Airflow Provider(s) databricks ### Versions of Apache Airflow Providers apache-airflow-providers-databricks==1!2.0.2 ### Apache Airflow version 2.1.4

[GitHub] [airflow] boring-cyborg[bot] commented on issue #19357: DatabricksHook method get_run_state returns error

2021-11-01 Thread GitBox
boring-cyborg[bot] commented on issue #19357: URL: https://github.com/apache/airflow/issues/19357#issuecomment-956811100 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] jhtimmins closed pull request #19190: Use active record pattern for fab

2021-11-01 Thread GitBox
jhtimmins closed pull request #19190: URL: https://github.com/apache/airflow/pull/19190 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] subkanthi opened a new pull request #19356: Add influxdb operator

2021-11-01 Thread GitBox
subkanthi opened a new pull request #19356: URL: https://github.com/apache/airflow/pull/19356 Added influxdb operator to enable running queries on influxdb --- **^ Add meaningful description above** Read the **[Pull Request

[GitHub] [airflow] ephraimbuddy opened a new pull request #19355: Update the example DAGs

2021-11-01 Thread GitBox
ephraimbuddy opened a new pull request #19355: URL: https://github.com/apache/airflow/pull/19355 DETAILS LATER --- **^ Add meaningful description above** Read the **[Pull Request

[GitHub] [airflow] ShakaibKhan commented on issue #19224: Add subprocess.DEVNULL to LoggingCommandExecutor stdout

2021-11-01 Thread GitBox
ShakaibKhan commented on issue #19224: URL: https://github.com/apache/airflow/issues/19224#issuecomment-956674169 PR for this: https://github.com/apache/airflow/pull/19354 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [airflow] ShakaibKhan opened a new pull request #19354: Refactor LoggingCommandExecutor to use subprocess devnull

2021-11-01 Thread GitBox
ShakaibKhan opened a new pull request #19354: URL: https://github.com/apache/airflow/pull/19354 refactoring LoggingCommandExecutor to stop using legacy logic for stdout -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [airflow] ShakaibKhan commented on pull request #18557: Warning of public exposure of deployment in UI with on/off config

2021-11-01 Thread GitBox
ShakaibKhan commented on pull request #18557: URL: https://github.com/apache/airflow/pull/18557#issuecomment-956663711 quarantined test are failing but having trouble running them locally to fix -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] potiuk commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021

2021-11-01 Thread GitBox
potiuk commented on issue #19328: URL: https://github.com/apache/airflow/issues/19328#issuecomment-956618907 Good progress so far :)! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] morhook commented on issue #18041: Tasks intermittently gets terminated with SIGTERM on kubernetes executor

2021-11-01 Thread GitBox
morhook commented on issue #18041: URL: https://github.com/apache/airflow/issues/18041#issuecomment-956541946 On our cluster we suspect it is related with running out of disk space on the "node" level of Kubernetes.

[airflow] branch main updated (ddcc848 -> dc4dcaa)

2021-11-01 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from ddcc848 Modernize dockerfiles builds (#19327) add dc4dcaa Bugfix: Check next run exists before reading data

[GitHub] [airflow] kaxil closed issue #19343: Airflow 2.2.1 : airflow scheduler is not able to start: AttributeError: 'NoneType' object has no attribute 'utcoffset'

2021-11-01 Thread GitBox
kaxil closed issue #19343: URL: https://github.com/apache/airflow/issues/19343 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] kaxil merged pull request #19307: Check next run exists before reading data interval

2021-11-01 Thread GitBox
kaxil merged pull request #19307: URL: https://github.com/apache/airflow/pull/19307 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] kaxil closed issue #19304: "Not a valid timetable" when returning None from next_dagrun_info in a custom timetable

2021-11-01 Thread GitBox
kaxil closed issue #19304: URL: https://github.com/apache/airflow/issues/19304 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] kaxil edited a comment on issue #19343: Airflow 2.2.1 : airflow scheduler is not able to start: AttributeError: 'NoneType' object has no attribute 'utcoffset'

2021-11-01 Thread GitBox
kaxil edited a comment on issue #19343: URL: https://github.com/apache/airflow/issues/19343#issuecomment-956303269 https://github.com/apache/airflow/pull/19307 should fix this issue -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] kd2718 commented on pull request #19036: replaced '.' with '-' and adjusted trimmed_pod_id per ticket comments

2021-11-01 Thread GitBox
kd2718 commented on pull request #19036: URL: https://github.com/apache/airflow/pull/19036#issuecomment-956504650 hoping this is good to go... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] github-actions[bot] commented on pull request #19307: Check next run exists before reading data interval

2021-11-01 Thread GitBox
github-actions[bot] commented on pull request #19307: URL: https://github.com/apache/airflow/pull/19307#issuecomment-956501600 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] o-nikolas commented on a change in pull request #19022: CloudwatchTaskHandler params to create log group/stream

2021-11-01 Thread GitBox
o-nikolas commented on a change in pull request #19022: URL: https://github.com/apache/airflow/pull/19022#discussion_r740443741 ## File path: airflow/config_templates/airflow_local_settings.py ## @@ -194,13 +193,17 @@

[GitHub] [airflow] tnyz commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021

2021-11-01 Thread GitBox
tnyz commented on issue #19328: URL: https://github.com/apache/airflow/issues/19328#issuecomment-956487076 tested #18676 and working -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] Jorricks opened a new pull request #19353: Introduce DagRun action to change state to queued.

2021-11-01 Thread GitBox
Jorricks opened a new pull request #19353: URL: https://github.com/apache/airflow/pull/19353 When a DAG has been running for a bit, it often occurs in our workflow that a task is added. Often, people want to run these tasks for historical dates. However, when there are more

[airflow] branch main updated (e357004 -> ddcc848)

2021-11-01 Thread kamilbregula
This is an automated email from the ASF dual-hosted git repository. kamilbregula pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from e357004 Chart: Update default Airflow version to 2.2.1 (#19326) add ddcc848 Modernize dockerfiles builds

[GitHub] [airflow] mik-laj merged pull request #19327: Modernize dockerfiles builds

2021-11-01 Thread GitBox
mik-laj merged pull request #19327: URL: https://github.com/apache/airflow/pull/19327 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] eskarimov edited a comment on issue #18999: Update databricks provider to use TriggerOperator

2021-11-01 Thread GitBox
eskarimov edited a comment on issue #18999: URL: https://github.com/apache/airflow/issues/18999#issuecomment-956445982 @chinwobble you're right, I see the same behaviour... I've spotted though when I don't pass `timeout` argument to `self.defer()`, a deferred task will fail if its runtime

[GitHub] [airflow] eskarimov commented on issue #18999: Update databricks provider to use TriggerOperator

2021-11-01 Thread GitBox
eskarimov commented on issue #18999: URL: https://github.com/apache/airflow/issues/18999#issuecomment-956445982 @chinwobble you're right, I see the same behaviour... I've spotted though when I don't pass `timeout` argument to `self.defer()`, a deferred task will fail if its runtime more

[GitHub] [airflow] josh-fell commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021

2021-11-01 Thread GitBox
josh-fell commented on issue #19328: URL: https://github.com/apache/airflow/issues/19328#issuecomment-956438029 Tested and verified #19052, #19062, and #19323. Thanks for organizing this release Jarek! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] anaynayak commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021

2021-11-01 Thread GitBox
anaynayak commented on issue #19328: URL: https://github.com/apache/airflow/issues/19328#issuecomment-956413495 #18807 tested and verified both single + multiple s3 prefix matches. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] kaxil commented on pull request #18718: Add hook_params in BaseSqlOperator

2021-11-01 Thread GitBox
kaxil commented on pull request #18718: URL: https://github.com/apache/airflow/pull/18718#issuecomment-956411525 Can you take a look at the failing tests please @denimalpaca - https://github.com/apache/airflow/runs/4038752898?check_suite_focus=true#step:6:6341 -- This is an

[GitHub] [airflow] kaxil commented on issue #17469: Label infront of TaskGroup breaks task dependencies

2021-11-01 Thread GitBox
kaxil commented on issue #17469: URL: https://github.com/apache/airflow/issues/17469#issuecomment-956407457 @bbovenzi Do we have a fix for this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] Brooke-white commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021

2021-11-01 Thread GitBox
Brooke-white commented on issue #19328: URL: https://github.com/apache/airflow/issues/19328#issuecomment-956404082 #18447 tested and working -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] dstandish commented on a change in pull request #19339: Touch up k8s executor doc

2021-11-01 Thread GitBox
dstandish commented on a change in pull request #19339: URL: https://github.com/apache/airflow/pull/19339#discussion_r740367760 ## File path: docs/apache-airflow/executor/kubernetes.rst ## @@ -21,22 +21,22 @@ Kubernetes Executor === -The kubernetes executor

[GitHub] [airflow] jedcunningham commented on a change in pull request #19339: Touch up k8s executor doc

2021-11-01 Thread GitBox
jedcunningham commented on a change in pull request #19339: URL: https://github.com/apache/airflow/pull/19339#discussion_r740367484 ## File path: docs/apache-airflow/executor/kubernetes.rst ## @@ -46,26 +46,26 @@ This command generates the pods as they will be launched in

[GitHub] [airflow] dstandish commented on a change in pull request #19339: Touch up k8s executor doc

2021-11-01 Thread GitBox
dstandish commented on a change in pull request #19339: URL: https://github.com/apache/airflow/pull/19339#discussion_r740365570 ## File path: docs/apache-airflow/executor/kubernetes.rst ## @@ -46,26 +46,26 @@ This command generates the pods as they will be launched in

[GitHub] [airflow] GuidoTournois commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021

2021-11-01 Thread GitBox
GuidoTournois commented on issue #19328: URL: https://github.com/apache/airflow/issues/19328#issuecomment-956390518 I have validated that both changes for pagerduty work as intended! - Add standard hook fields to pagerdutyHook to make hook show up in UI (#18763) - Make a separate

[airflow] branch main updated (9828773 -> e357004)

2021-11-01 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 9828773 Dags-in-image pod template example should not have dag mounts (#19337) add e357004 Chart:

[GitHub] [airflow] jedcunningham merged pull request #19326: Chart: Update default Airflow version to 2.2.1

2021-11-01 Thread GitBox
jedcunningham merged pull request #19326: URL: https://github.com/apache/airflow/pull/19326 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated (0be26b4 -> 9828773)

2021-11-01 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 0be26b4 Clarify dag-not-found error message (#19338) add 9828773 Dags-in-image pod template example

[GitHub] [airflow] jedcunningham merged pull request #19337: Dags-in-image pod template example should not have dag mounts

2021-11-01 Thread GitBox
jedcunningham merged pull request #19337: URL: https://github.com/apache/airflow/pull/19337 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] Melodie97 opened a new pull request #19350: Make scripts/in_container/check_environment.sh Google Shell Guide Com…

2021-11-01 Thread GitBox
Melodie97 opened a new pull request #19350: URL: https://github.com/apache/airflow/pull/19350 …pliant Used Google Shell Style convention to adapt better variable naming for scripts/in_container/check_environment.sh --- **^ Add meaningful description above** Read the

[GitHub] [airflow] github-actions[bot] commented on pull request #19337: Dags-in-image pod template example should not have dag mounts

2021-11-01 Thread GitBox
github-actions[bot] commented on pull request #19337: URL: https://github.com/apache/airflow/pull/19337#issuecomment-956380901 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[airflow] branch main updated (d810eaf -> 0be26b4)

2021-11-01 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from d810eaf Docs: Fix typo in ``dag-run.rst`` (#19340) add 0be26b4 Clarify dag-not-found error message

[GitHub] [airflow] jedcunningham merged pull request #19338: Clarify dag-not-found error message

2021-11-01 Thread GitBox
jedcunningham merged pull request #19338: URL: https://github.com/apache/airflow/pull/19338 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] github-actions[bot] commented on pull request #19338: Clarify dag-not-found error message

2021-11-01 Thread GitBox
github-actions[bot] commented on pull request #19338: URL: https://github.com/apache/airflow/pull/19338#issuecomment-956376148 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] kaxil commented on issue #11393: Optimize subclasses of DummyOperator be set straight to success instead of being run

2021-11-01 Thread GitBox
kaxil commented on issue #11393: URL: https://github.com/apache/airflow/issues/11393#issuecomment-956357863 > This optimization currently does not function correctly with the `pre_execute` and `post_execute` parameters introduced (on an experimental basis) in #17576. There is no

[GitHub] [airflow] kaxil opened a new pull request #18120: Handle DAGs with Parsing Errors

2021-11-01 Thread GitBox
kaxil opened a new pull request #18120: URL: https://github.com/apache/airflow/pull/18120 Currently if there are parsing errors on an existing DAG, the DAG still remains in serialized DAG table so shows up in the Webserver and user can trigger it, leading to failures and confusion.

[GitHub] [airflow] kaxil commented on issue #19346: Sensors no longer respecting `retries` with timeouts.

2021-11-01 Thread GitBox
kaxil commented on issue #19346: URL: https://github.com/apache/airflow/issues/19346#issuecomment-956342382 Thoughts @yuqian90 ?? ^^ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] axxe commented on pull request #19340: Update dag-run.rst

2021-11-01 Thread GitBox
axxe commented on pull request #19340: URL: https://github.com/apache/airflow/pull/19340#issuecomment-956341736 :-D — Axel Essbaum ***@***.*** > On 1 Nov 2021, at 16:38, boring-cyborg[bot] ***@***.***> wrote: > > > Awesome work, congrats on your first

[airflow] branch main updated (861b17d -> d810eaf)

2021-11-01 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 861b17d Doc: Small clarification of base executor docstring (#19336) add d810eaf Docs: Fix typo in

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #19340: Update dag-run.rst

2021-11-01 Thread GitBox
boring-cyborg[bot] commented on pull request #19340: URL: https://github.com/apache/airflow/pull/19340#issuecomment-956341161 Awesome work, congrats on your first merged pull request! -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] kaxil merged pull request #19340: Update dag-run.rst

2021-11-01 Thread GitBox
kaxil merged pull request #19340: URL: https://github.com/apache/airflow/pull/19340 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] kaxil commented on pull request #19340: Update dag-run.rst

2021-11-01 Thread GitBox
kaxil commented on pull request #19340: URL: https://github.com/apache/airflow/pull/19340#issuecomment-956340935 The CI failure is unrelated -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] github-actions[bot] commented on pull request #19340: Update dag-run.rst

2021-11-01 Thread GitBox
github-actions[bot] commented on pull request #19340: URL: https://github.com/apache/airflow/pull/19340#issuecomment-956340818 The PR is likely ready to be merged. No tests are needed as no important environment files, nor python files were modified by it. However, committers might decide

[airflow] branch main updated (d5d4b11 -> 861b17d)

2021-11-01 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from d5d4b11 Chore: Use enum for "__var" and "__type" members (#19303) add 861b17d Doc: Small clarification of

[GitHub] [airflow] kaxil merged pull request #19336: Tiny clarification of base executor docstring

2021-11-01 Thread GitBox
kaxil merged pull request #19336: URL: https://github.com/apache/airflow/pull/19336 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] github-actions[bot] commented on pull request #19336: Tiny clarification of base executor docstring

2021-11-01 Thread GitBox
github-actions[bot] commented on pull request #19336: URL: https://github.com/apache/airflow/pull/19336#issuecomment-956337082 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] krisuj edited a comment on issue #19343: Airflow 2.2.1 : airflow scheduler is not able to start: AttributeError: 'NoneType' object has no attribute 'utcoffset'

2021-11-01 Thread GitBox
krisuj edited a comment on issue #19343: URL: https://github.com/apache/airflow/issues/19343#issuecomment-956278498 Yeah @andydennehy, I see that as well. The DAG that the scheduler is trying to update is a SubDAG in my case; and it fails to update correctly (once completed) and causes

[GitHub] [airflow] jedcunningham commented on a change in pull request #19339: Touch up k8s executor doc

2021-11-01 Thread GitBox
jedcunningham commented on a change in pull request #19339: URL: https://github.com/apache/airflow/pull/19339#discussion_r740292916 ## File path: docs/apache-airflow/executor/kubernetes.rst ## @@ -46,26 +46,26 @@ This command generates the pods as they will be launched in

[GitHub] [airflow] krisuj edited a comment on issue #19343: Airflow 2.2.1 : airflow scheduler is not able to start: AttributeError: 'NoneType' object has no attribute 'utcoffset'

2021-11-01 Thread GitBox
krisuj edited a comment on issue #19343: URL: https://github.com/apache/airflow/issues/19343#issuecomment-956291401 I think there is a 'catchup_by_default' flag you can set to False on the DAG arguments to avoid automated backfills. But i think this error might re-occur going forward...

[GitHub] [airflow] krisuj edited a comment on issue #19343: Airflow 2.2.1 : airflow scheduler is not able to start: AttributeError: 'NoneType' object has no attribute 'utcoffset'

2021-11-01 Thread GitBox
krisuj edited a comment on issue #19343: URL: https://github.com/apache/airflow/issues/19343#issuecomment-956278498 Yeah @andydennehy, I see that as well. The DAG that the scheduler is trying to update is a SubDAG in my case; and it fails to update correctly (once completed) and causes

[GitHub] [airflow] krisuj edited a comment on issue #19343: Airflow 2.2.1 : airflow scheduler is not able to start: AttributeError: 'NoneType' object has no attribute 'utcoffset'

2021-11-01 Thread GitBox
krisuj edited a comment on issue #19343: URL: https://github.com/apache/airflow/issues/19343#issuecomment-956278498 Yeah @andydennehy, I see that as well. The DAG that the scheduler is trying to update is a SubDAG in my case; and it fails to update correctly (once completed) and causes

[GitHub] [airflow] krisuj edited a comment on issue #19343: Airflow 2.2.1 : airflow scheduler is not able to start: AttributeError: 'NoneType' object has no attribute 'utcoffset'

2021-11-01 Thread GitBox
krisuj edited a comment on issue #19343: URL: https://github.com/apache/airflow/issues/19343#issuecomment-956278498 Yeah @andydennehy, I see that as well. The DAG that the scheduler is trying to update is a SubDAG in my case; and it fails to update correctly (once completed) and causes

[GitHub] [airflow] krisuj edited a comment on issue #19343: Airflow 2.2.1 : airflow scheduler is not able to start: AttributeError: 'NoneType' object has no attribute 'utcoffset'

2021-11-01 Thread GitBox
krisuj edited a comment on issue #19343: URL: https://github.com/apache/airflow/issues/19343#issuecomment-956278498 Yeah @andydennehy, I see that as well. The DAG that the scheduler is trying to update is a SubDAG in my case; and it seems to fail to update correctly (once completed) do so

[GitHub] [airflow] krisuj edited a comment on issue #19343: Airflow 2.2.1 : airflow scheduler is not able to start: AttributeError: 'NoneType' object has no attribute 'utcoffset'

2021-11-01 Thread GitBox
krisuj edited a comment on issue #19343: URL: https://github.com/apache/airflow/issues/19343#issuecomment-955946153 I am also seeing the same error, also running airflow 2.2.1. In fact the error occurs when a SubDAG (perhaps a DAG as well) completes successfully; and seems to be

[GitHub] [airflow] malthe commented on issue #11393: Optimize subclasses of DummyOperator be set straight to success instead of being run

2021-11-01 Thread GitBox
malthe commented on issue #11393: URL: https://github.com/apache/airflow/issues/11393#issuecomment-956326552 This optimization currently does not function correctly with the `pre_execute` and `post_execute` parameters introduced (on an experimental basis) in #17576. -- This is an

[GitHub] [airflow] john-jac commented on pull request #19324: Catch AccessDeniedException in AWS Secrets Manager Backend

2021-11-01 Thread GitBox
john-jac commented on pull request #19324: URL: https://github.com/apache/airflow/pull/19324#issuecomment-956325118 > > Today, this causes a failure with the Scheduler as an uncaught exception > > What do you mean with the scheduler? Perhaps most commonly one retrieves a connection

[GitHub] [airflow] nathadfield edited a comment on issue #19346: Sensors no longer respecting `retries` with timeouts.

2021-11-01 Thread GitBox
nathadfield edited a comment on issue #19346: URL: https://github.com/apache/airflow/issues/19346#issuecomment-956298775 What I will say is that the change does create some scenarios that you might not want, e.g. if you have a long timeout setting but the task retries for some other

[GitHub] [airflow] Melodie97 commented on pull request #19257: fix: dag_id and task_id non ascii char

2021-11-01 Thread GitBox
Melodie97 commented on pull request #19257: URL: https://github.com/apache/airflow/pull/19257#issuecomment-956314197 @potiuk, should I push the branch with the 'text-unicode.decode' despite that error? -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] kaxil commented on issue #19343: Airflow 2.2.1 : airflow scheduler is not able to start: AttributeError: 'NoneType' object has no attribute 'utcoffset'

2021-11-01 Thread GitBox
kaxil commented on issue #19343: URL: https://github.com/apache/airflow/issues/19343#issuecomment-956303269 https://github.com/apache/airflow/pull/19307 should fix this issue, correct @uranusjr ? -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] fredthomsen commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021

2021-11-01 Thread GitBox
fredthomsen commented on issue #19328: URL: https://github.com/apache/airflow/issues/19328#issuecomment-956302369 [#18847](https://github.com/apache/airflow/pull/18847) and [#18752](https://github.com/apache/airflow/pull/18752) for [samba:

[GitHub] [airflow] nathadfield edited a comment on issue #19346: Sensors no longer respecting `retries` with timeouts.

2021-11-01 Thread GitBox
nathadfield edited a comment on issue #19346: URL: https://github.com/apache/airflow/issues/19346#issuecomment-956298775 What I will say is that the change does create some scenarios that you might not want, e.g. if you have a long timeout setting but the task fails for some other reason,

  1   2   >