[GitHub] [airflow] shuhoy commented on pull request #22252: Refactor BigQuery to GCS Operator

2022-03-16 Thread GitBox
shuhoy commented on pull request #22252: URL: https://github.com/apache/airflow/pull/22252#issuecomment-1070349062 All checks passed!!:rocket: -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] dstandish commented on a change in pull request #22184: Add run_id and map_index to SlaMiss

2022-03-16 Thread GitBox
dstandish commented on a change in pull request #22184: URL: https://github.com/apache/airflow/pull/22184#discussion_r828760938 ## File path: airflow/dag_processing/processor.py ## @@ -412,20 +410,20 @@ def manage_slas(self, dag: DAG, session: Session = None) -> None:

[GitHub] [airflow] dstandish commented on a change in pull request #22184: Add run_id and map_index to SlaMiss

2022-03-16 Thread GitBox
dstandish commented on a change in pull request #22184: URL: https://github.com/apache/airflow/pull/22184#discussion_r828760938 ## File path: airflow/dag_processing/processor.py ## @@ -412,20 +410,20 @@ def manage_slas(self, dag: DAG, session: Session = None) -> None:

[GitHub] [airflow] uranusjr commented on a change in pull request #22272: Add map_index support to al task instance-related views

2022-03-16 Thread GitBox
uranusjr commented on a change in pull request #22272: URL: https://github.com/apache/airflow/pull/22272#discussion_r828749020 ## File path: airflow/www/static/js/tree/StatusBox.jsx ## @@ -36,9 +36,9 @@ const StatusBox = ({ group, instance, containerRef, extraLinks = [],

[GitHub] [airflow] uranusjr commented on a change in pull request #22272: Add map_index support to al task instance-related views

2022-03-16 Thread GitBox
uranusjr commented on a change in pull request #22272: URL: https://github.com/apache/airflow/pull/22272#discussion_r828748779 ## File path: airflow/www/static/js/graph.js ## @@ -172,8 +172,15 @@ function draw() { const task = tasks[nodeId]; const tryNumber =

[GitHub] [airflow] uranusjr commented on a change in pull request #22272: Add map_index support to al task instance-related views

2022-03-16 Thread GitBox
uranusjr commented on a change in pull request #22272: URL: https://github.com/apache/airflow/pull/22272#discussion_r828748779 ## File path: airflow/www/static/js/graph.js ## @@ -172,8 +172,15 @@ function draw() { const task = tasks[nodeId]; const tryNumber =

[GitHub] [airflow] collinmcnulty opened a new pull request #22332: Events Timetable

2022-03-16 Thread GitBox
collinmcnulty opened a new pull request #22332: URL: https://github.com/apache/airflow/pull/22332 I've added a new Timetable that I believe will be widely useful for timing based on sporting events, planned communication campaigns, and other schedules that are arbitrary and irregular but

[GitHub] [airflow] pohek321 commented on issue #22330: Add functionality to DatabricksHook to create notebooks

2022-03-16 Thread GitBox
pohek321 commented on issue #22330: URL: https://github.com/apache/airflow/issues/22330#issuecomment-1070306241 Created pull request #22331 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] bbovenzi commented on issue #21201: Add Trigger Rule Display to Graph View

2022-03-16 Thread GitBox
bbovenzi commented on issue #21201: URL: https://github.com/apache/airflow/issues/21201#issuecomment-1070306044 I agree we can do it in a new graph view, but I don't think this would be too complicated to do for the current one either. -- This is an automated message from the Apache Git

[GitHub] [airflow] bbovenzi commented on issue #22325: ReST API : get_dag should return more than a simplified view of the dag

2022-03-16 Thread GitBox
bbovenzi commented on issue #22325: URL: https://github.com/apache/airflow/issues/22325#issuecomment-1070305496 Good idea! I wonder if it should be on get dag or get dag details. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #22331: Add import_notebook method to databricks hook

2022-03-16 Thread GitBox
boring-cyborg[bot] commented on pull request #22331: URL: https://github.com/apache/airflow/pull/22331#issuecomment-1070305458 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[GitHub] [airflow] pohek321 opened a new pull request #22331: Add import_notebook method to databricks hook

2022-03-16 Thread GitBox
pohek321 opened a new pull request #22331: URL: https://github.com/apache/airflow/pull/22331 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)** for more

[GitHub] [airflow] bbovenzi commented on issue #22325: ReST API : get_dag should return more than a simplified view of the dag

2022-03-16 Thread GitBox
bbovenzi commented on issue #22325: URL: https://github.com/apache/airflow/issues/22325#issuecomment-1070304848 Good idea! I wonder if it should be on get dag or get dag details. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[airflow] branch main updated: Add recipe for BeamRunGoPipelineOperator (#22296)

2022-03-16 Thread kamilbregula
This is an automated email from the ASF dual-hosted git repository. kamilbregula pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 4a1503b Add recipe for

[GitHub] [airflow] mik-laj merged pull request #22296: Add recipe for BeamRunGoPipelineOperator

2022-03-16 Thread GitBox
mik-laj merged pull request #22296: URL: https://github.com/apache/airflow/pull/22296 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] mik-laj closed issue #21545: Add Go to docker images

2022-03-16 Thread GitBox
mik-laj closed issue #21545: URL: https://github.com/apache/airflow/issues/21545 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] github-actions[bot] commented on pull request #22296: Add recipe for BeamRunGoPipelineOperator

2022-03-16 Thread GitBox
github-actions[bot] commented on pull request #22296: URL: https://github.com/apache/airflow/pull/22296#issuecomment-1070279820 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not

[GitHub] [airflow] pohek321 opened a new issue #22330: Add functionality to DatabricksHook to create notebooks

2022-03-16 Thread GitBox
pohek321 opened a new issue #22330: URL: https://github.com/apache/airflow/issues/22330 ### Description Currently, there is no way to programmatically create a notebook in Databricks using the core provider components

[GitHub] [airflow] Madaditya commented on issue #20110: CORS access_control_allow_origin header never returned

2022-03-16 Thread GitBox
Madaditya commented on issue #20110: URL: https://github.com/apache/airflow/issues/20110#issuecomment-1070231488 Was anybody able to fix a fix to the CORS issue for airflow API? We are facing a similar issue and wondered if its was a v2.2..2 specific. -- This is an automated message

[GitHub] [airflow] bskim45 commented on issue #21072: manage_sla firing notifications for the same sla miss instances repeatedly

2022-03-16 Thread GitBox
bskim45 commented on issue #21072: URL: https://github.com/apache/airflow/issues/21072#issuecomment-1070181632 I'm experiencing a similar issue somewhat related to this. When the `sla` argument is provided but an SLA miss email is not sent nor `sla_miss_callback` is not specified, SlaMiss

[jira] [Commented] (AIRFLOW-5071) Thousand os Executor reports task instance X finished (success) although the task says its queued. Was the task killed externally?

2022-03-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17507936#comment-17507936 ] ASF GitHub Bot commented on AIRFLOW-5071: - kenny813x201 commented on issue #10790: URL:

[GitHub] [airflow] kenny813x201 commented on issue #10790: Copy of [AIRFLOW-5071] JIRA: Thousands of Executor reports task instance X finished (success) although the task says its queued. Was the task

2022-03-16 Thread GitBox
kenny813x201 commented on issue #10790: URL: https://github.com/apache/airflow/issues/10790#issuecomment-1069820469 We also got the same error message. In our case, it turns out that we are using the same name for different dags. Changing different dags from `as dag` to like `as dags1`

[GitHub] [airflow] EricGao888 commented on pull request #21961: Add support for Alibaba-Cloud EMR cluster template (#21957)

2022-03-16 Thread GitBox
EricGao888 commented on pull request #21961: URL: https://github.com/apache/airflow/pull/21961#issuecomment-1069771576 > @EricGao888 I marked the PR as draft. When finished please convert to ready so we can review. Sure, thanks! -- This is an automated message from the Apache Git

[GitHub] [airflow] boring-cyborg[bot] commented on issue #22328: bigquery provider's - BigQueryCursor missing implementation for description prooerty.

2022-03-16 Thread GitBox
boring-cyborg[bot] commented on issue #22328: URL: https://github.com/apache/airflow/issues/22328#issuecomment-1069764906 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] utkarsharma2 opened a new issue #22328: bigquery provider's - BigQueryCursor missing implementation for description prooerty.

2022-03-16 Thread GitBox
utkarsharma2 opened a new issue #22328: URL: https://github.com/apache/airflow/issues/22328 ### Apache Airflow version 2.2.4 (latest released) ### What happened When trying to run following code: ``` import pandas as pd from

[GitHub] [airflow] github-actions[bot] closed pull request #18759: Movin trigger dag to operations folder

2022-03-16 Thread GitBox
github-actions[bot] closed pull request #18759: URL: https://github.com/apache/airflow/pull/18759 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] github-actions[bot] commented on issue #8687: Airflow webserver should handle signals immediately when starting

2022-03-16 Thread GitBox
github-actions[bot] commented on issue #8687: URL: https://github.com/apache/airflow/issues/8687#issuecomment-1069763273 This issue has been closed because it has not received response from the issue author. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] github-actions[bot] commented on issue #19158: Macros time operations not working

2022-03-16 Thread GitBox
github-actions[bot] commented on issue #19158: URL: https://github.com/apache/airflow/issues/19158#issuecomment-1069763182 This issue has been closed because it has not received response from the issue author. -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [airflow] github-actions[bot] closed issue #8687: Airflow webserver should handle signals immediately when starting

2022-03-16 Thread GitBox
github-actions[bot] closed issue #8687: URL: https://github.com/apache/airflow/issues/8687 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] github-actions[bot] closed pull request #21080: Fix wrong use of $ref and nullable

2022-03-16 Thread GitBox
github-actions[bot] closed pull request #21080: URL: https://github.com/apache/airflow/pull/21080 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] github-actions[bot] closed issue #19158: Macros time operations not working

2022-03-16 Thread GitBox
github-actions[bot] closed issue #19158: URL: https://github.com/apache/airflow/issues/19158 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] alexbegg commented on issue #22320: Copying DAG ID from UI and pasting in Slack includes schedule

2022-03-16 Thread GitBox
alexbegg commented on issue #22320: URL: https://github.com/apache/airflow/issues/22320#issuecomment-1069750132 > I can confirm this indeed happens with paste ( CMD + V) > > However if you will paste with CMD + SHIFT + V - it will behave as you expect > > Good catch

[GitHub] [airflow] dstandish commented on a change in pull request #22184: Add run_id and map_index to SlaMiss

2022-03-16 Thread GitBox
dstandish commented on a change in pull request #22184: URL: https://github.com/apache/airflow/pull/22184#discussion_r828511240 ## File path: airflow/dag_processing/processor.py ## @@ -412,20 +410,20 @@ def manage_slas(self, dag: DAG, session: Session = None) -> None:

[GitHub] [airflow] dstandish commented on a change in pull request #22184: Add run_id and map_index to SlaMiss

2022-03-16 Thread GitBox
dstandish commented on a change in pull request #22184: URL: https://github.com/apache/airflow/pull/22184#discussion_r828511240 ## File path: airflow/dag_processing/processor.py ## @@ -412,20 +410,20 @@ def manage_slas(self, dag: DAG, session: Session = None) -> None:

[GitHub] [airflow] ashb commented on a change in pull request #22184: Add run_id and map_index to SlaMiss

2022-03-16 Thread GitBox
ashb commented on a change in pull request #22184: URL: https://github.com/apache/airflow/pull/22184#discussion_r828502785 ## File path: airflow/dag_processing/processor.py ## @@ -412,20 +410,20 @@ def manage_slas(self, dag: DAG, session: Session = None) -> None:

[GitHub] [airflow] ashb commented on a change in pull request #22184: Add run_id and map_index to SlaMiss

2022-03-16 Thread GitBox
ashb commented on a change in pull request #22184: URL: https://github.com/apache/airflow/pull/22184#discussion_r828502055 ## File path: airflow/dag_processing/processor.py ## @@ -412,20 +410,20 @@ def manage_slas(self, dag: DAG, session: Session = None) -> None:

[GitHub] [airflow] github-actions[bot] commented on pull request #22272: Add map_index support to al task instance-related views

2022-03-16 Thread GitBox
github-actions[bot] commented on pull request #22272: URL: https://github.com/apache/airflow/pull/22272#issuecomment-1069693314 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not

[GitHub] [airflow] ashb commented on a change in pull request #22272: Add map_index support to al task instance-related views

2022-03-16 Thread GitBox
ashb commented on a change in pull request #22272: URL: https://github.com/apache/airflow/pull/22272#discussion_r828494223 ## File path: airflow/www/static/js/dag.js ## @@ -151,46 +163,41 @@ export function callModal(t, d, extraLinks, tryNumbers, sd, drID) { $('#try_index

[GitHub] [airflow] edithturn opened a new pull request #22327: Rewrite Selective Check in Python

2022-03-16 Thread GitBox
edithturn opened a new pull request #22327: URL: https://github.com/apache/airflow/pull/22327 closes #19971 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [airflow] dstandish opened a new pull request #22326: Remove incorrect deprecation warning in secrets backend

2022-03-16 Thread GitBox
dstandish opened a new pull request #22326: URL: https://github.com/apache/airflow/pull/22326 When the no value is found with `get_conn_value`, the warning was being triggered, even though `get_conn_value` was implemented and just returned no value (cus there wasn't one). Now we

[GitHub] [airflow] ashb commented on a change in pull request #22272: Add map_index support to al task instance-related views

2022-03-16 Thread GitBox
ashb commented on a change in pull request #22272: URL: https://github.com/apache/airflow/pull/22272#discussion_r828471044 ## File path: airflow/www/static/js/dag.js ## @@ -53,6 +53,7 @@ let taskId = ''; let executionDate = ''; let subdagId = ''; let dagRunId = ''; +let

[GitHub] [airflow] pierrejeambrun commented on pull request #22296: Add recipe for BeamRunGoPipelineOperator

2022-03-16 Thread GitBox
pierrejeambrun commented on pull request #22296: URL: https://github.com/apache/airflow/pull/22296#issuecomment-1069657325 @mik-laj Thank you for your comments. I just updated the PR, let me know what you think. -- This is an automated message from the Apache Git Service. To

[GitHub] [airflow] pierrejeambrun commented on a change in pull request #22296: Add recipe for BeamRunGoPipelineOperator

2022-03-16 Thread GitBox
pierrejeambrun commented on a change in pull request #22296: URL: https://github.com/apache/airflow/pull/22296#discussion_r828468900 ## File path: docs/docker-stack/docker-images-recipes/go-beam.Dockerfile ## @@ -0,0 +1,35 @@ +# Licensed to the Apache Software Foundation (ASF)

[GitHub] [airflow] pierrejeambrun commented on a change in pull request #22296: Add recipe for BeamRunGoPipelineOperator

2022-03-16 Thread GitBox
pierrejeambrun commented on a change in pull request #22296: URL: https://github.com/apache/airflow/pull/22296#discussion_r828468492 ## File path: docs/docker-stack/docker-images-recipes/go-beam.Dockerfile ## @@ -0,0 +1,35 @@ +# Licensed to the Apache Software Foundation (ASF)

[GitHub] [airflow] pierrejeambrun commented on a change in pull request #22296: Add recipe for BeamRunGoPipelineOperator

2022-03-16 Thread GitBox
pierrejeambrun commented on a change in pull request #22296: URL: https://github.com/apache/airflow/pull/22296#discussion_r828467003 ## File path: docs/docker-stack/docker-images-recipes/go-beam.Dockerfile ## @@ -0,0 +1,35 @@ +# Licensed to the Apache Software Foundation (ASF)

[GitHub] [airflow] mik-laj edited a comment on issue #22306: DataflowStartFlexTemplateOperator is missing the impersonation_chain argument

2022-03-16 Thread GitBox
mik-laj edited a comment on issue #22306: URL: https://github.com/apache/airflow/issues/22306#issuecomment-1069648241 We should make similar change to: https://github.com/apache/airflow/pull/19518#discussion_r748632907 (CC: @lwyszomi ) -- This is an automated message from the

[GitHub] [airflow] mik-laj commented on issue #22306: DataflowStartFlexTemplateOperator is missing the impersonation_chain argument

2022-03-16 Thread GitBox
mik-laj commented on issue #22306: URL: https://github.com/apache/airflow/issues/22306#issuecomment-1069648241 This problem has been documented here: https://airflow.apache.org/docs/apache-airflow-providers-google/stable/connections/gcp.html#direct-impersonation-of-a-service-account

[GitHub] [airflow] ianbuss commented on a change in pull request #22051: Support glob syntax in .airflowignore files (#21392)

2022-03-16 Thread GitBox
ianbuss commented on a change in pull request #22051: URL: https://github.com/apache/airflow/pull/22051#discussion_r828447783 ## File path: airflow/config_templates/config.yml ## @@ -347,6 +347,14 @@ type: string example: ~ default: "True" +- name:

[GitHub] [airflow] josh-fell commented on a change in pull request #22280: Add links for BigQuery Data Transfer

2022-03-16 Thread GitBox
josh-fell commented on a change in pull request #22280: URL: https://github.com/apache/airflow/pull/22280#discussion_r827246403 ## File path: airflow/providers/google/cloud/links/bigquery_dts.py ## @@ -0,0 +1,49 @@ +# +# Licensed to the Apache Software Foundation (ASF) under

[GitHub] [airflow] edithturn edited a comment on issue #19971: CI: Rewrite selective check script in Python

2022-03-16 Thread GitBox
edithturn edited a comment on issue #19971: URL: https://github.com/apache/airflow/issues/19971#issuecomment-1004284910 > It's used in two places: ci.yml and build.yml: The right file should be build-images.yml :) Close: #19971 -- This is an automated message from the

[GitHub] [airflow] carmoreno1 commented on issue #8468: DbApiHook: add chunksize to get_pandas_df parameters

2022-03-16 Thread GitBox
carmoreno1 commented on issue #8468: URL: https://github.com/apache/airflow/issues/8468#issuecomment-1069620108 > There are a problem with the chunksize, because the get_pandas_df close the connection in the first call of the iterator[DataFrame] returned Hi @imorales-mosaico is

[GitHub] [airflow] dylanbstorey opened a new issue #22325: ReST API : get_dag should return more than a simplified view of the dag

2022-03-16 Thread GitBox
dylanbstorey opened a new issue #22325: URL: https://github.com/apache/airflow/issues/22325 ### Description The current response payload from https://airflow.apache.org/docs/apache-airflow/stable/stable-rest-api-ref.html#operation/get_dag is a useful but simple view of the state

[GitHub] [airflow] boring-cyborg[bot] commented on issue #22325: ReST API : get_dag should return more than a simplified view of the dag

2022-03-16 Thread GitBox
boring-cyborg[bot] commented on issue #22325: URL: https://github.com/apache/airflow/issues/22325#issuecomment-1069618240 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #22324: Update ssh.py

2022-03-16 Thread GitBox
boring-cyborg[bot] commented on pull request #22324: URL: https://github.com/apache/airflow/pull/22324#issuecomment-1069612287 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[GitHub] [airflow] a246530 opened a new pull request #22324: Update ssh.py

2022-03-16 Thread GitBox
a246530 opened a new pull request #22324: URL: https://github.com/apache/airflow/pull/22324 Incorrect logic for self.allow_host_key_change warning regarding "Remote Identification Change is not verified". This was identified in https://github.com/apache/airflow/issues/9510 -- This

[GitHub] [airflow] ajbosco opened a new pull request #22323: enable optional subPath for dags volume mount

2022-03-16 Thread GitBox
ajbosco opened a new pull request #22323: URL: https://github.com/apache/airflow/pull/22323 Users may have their DAGs on a volume that includes other things and as such want to use a `subPath` on the Volume Mount. This is similar to how the `gitSync` Volume Mount is setup. ---

[airflow] branch constraints-main updated: Updating constraints. Build id:1994689956

2022-03-16 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 1ea6f9b Updating

[GitHub] [airflow] eladkal commented on pull request #21961: Add support for Alibaba-Cloud EMR cluster template (#21957)

2022-03-16 Thread GitBox
eladkal commented on pull request #21961: URL: https://github.com/apache/airflow/pull/21961#issuecomment-1069590428 @EricGao888 I marked the PR as draft. When finished please convert to ready so we can review. -- This is an automated message from the Apache Git Service. To respond to

[airflow] branch mapped-task-drawer updated (9b246fb -> 2566a74)

2022-03-16 Thread bbovenzi
This is an automated email from the ASF dual-hosted git repository. bbovenzi pushed a change to branch mapped-task-drawer in repository https://gitbox.apache.org/repos/asf/airflow.git. from 9b246fb fix extra links, hide local TZ if UTC, add 2566a74 confirm mark task failed/success

[GitHub] [airflow] kaxil commented on issue #19049: Migrate execution_date database columns to logical_date

2022-03-16 Thread GitBox
kaxil commented on issue #19049: URL: https://github.com/apache/airflow/issues/19049#issuecomment-1069569440 Is this still pending @uranusjr ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] dstandish commented on pull request #19857: Enable json serialization for secrets backend

2022-03-16 Thread GitBox
dstandish commented on pull request #19857: URL: https://github.com/apache/airflow/pull/19857#issuecomment-1069542431 got it @eladkal i think i see the issue, and i'll work on a fix today -- This is an automated message from the Apache Git Service. To respond to the message, please

[airflow] branch main updated: Remove RefreshConfiguration workaround for K8s token refreshing (#20759)

2022-03-16 Thread dstandish
This is an automated email from the ASF dual-hosted git repository. dstandish pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 7bd165f Remove RefreshConfiguration workaround

[GitHub] [airflow] dstandish merged pull request #20759: Remove RefreshConfiguration workaround for K8s token refreshing

2022-03-16 Thread GitBox
dstandish merged pull request #20759: URL: https://github.com/apache/airflow/pull/20759 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] eladkal commented on pull request #19857: Enable json serialization for secrets backend

2022-03-16 Thread GitBox
eladkal commented on pull request #19857: URL: https://github.com/apache/airflow/pull/19857#issuecomment-1069533737 @dstandish example: ``` from datetime import datetime from airflow import DAG from airflow.operators.python import PythonOperator from

[GitHub] [airflow] dstandish commented on pull request #19857: Enable json serialization for secrets backend

2022-03-16 Thread GitBox
dstandish commented on pull request #19857: URL: https://github.com/apache/airflow/pull/19857#issuecomment-1069480919 ok thanks @eladkal -- i can take a look at this. can you give me any examples of where you are seeing this? -- This is an automated message from the Apache Git

[GitHub] [airflow] eladkal commented on issue #22320: Copying DAG ID from UI and pasting in Slack includes schedule

2022-03-16 Thread GitBox
eladkal commented on issue #22320: URL: https://github.com/apache/airflow/issues/22320#issuecomment-1069467356 I can confirm this indeed happens with paste ( CMD + V) However if you will paste with CMD + SHIFT + V - it will behave as you expect -- This is an automated message

[GitHub] [airflow] alexbegg opened a new issue #22320: Copying DAG ID from UI and pasting in Slack includes schedule

2022-03-16 Thread GitBox
alexbegg opened a new issue #22320: URL: https://github.com/apache/airflow/issues/22320 ### Apache Airflow version 2.2.3 ### What happened (Yes, I know the title says Slack and it might not seem like an Airflow issue, but so far this is the only application I noticed

[GitHub] [airflow] boring-cyborg[bot] commented on issue #22317: Make pause DAG it's own role separate from edit DAG

2022-03-16 Thread GitBox
boring-cyborg[bot] commented on issue #22317: URL: https://github.com/apache/airflow/issues/22317#issuecomment-1069421624 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] boring-cyborg[bot] commented on issue #22318: KubernetesPodOperator xcom sidecar stuck in running

2022-03-16 Thread GitBox
boring-cyborg[bot] commented on issue #22318: URL: https://github.com/apache/airflow/issues/22318#issuecomment-1069412224 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] eladkal commented on pull request #19857: Enable json serialization for secrets backend

2022-03-16 Thread GitBox
eladkal commented on pull request #19857: URL: https://github.com/apache/airflow/pull/19857#issuecomment-1069406427 I'm starting to see warnings raised about `get_conn_uri`: `[2022-03-16, 18:06:38 UTC] {logging_mixin.py:115} WARNING - /opt/***/***/models/connection.py:420

[GitHub] [airflow] pingzh commented on pull request #21877: AIP-45 Remove dag parsing in airflow run local

2022-03-16 Thread GitBox
pingzh commented on pull request #21877: URL: https://github.com/apache/airflow/pull/21877#issuecomment-1069398672 hi @potiuk , the AIP-45 is ready to review. could you please take a look? -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] eladkal commented on issue #16249: Fully functional DAG Dependencies Graph view

2022-03-16 Thread GitBox
eladkal commented on issue #16249: URL: https://github.com/apache/airflow/issues/16249#issuecomment-1069385083 @ManiBharataraju do you have plans to add the functionality of your add-on to Airflow? -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] o-nikolas commented on a change in pull request #22295: Add docs and example dag for AWS Glue

2022-03-16 Thread GitBox
o-nikolas commented on a change in pull request #22295: URL: https://github.com/apache/airflow/pull/22295#discussion_r828284103 ## File path: airflow/providers/amazon/aws/example_dags/example_glue.py ## @@ -0,0 +1,139 @@ +# Licensed to the Apache Software Foundation (ASF)

[GitHub] [airflow] brettplarson opened a new issue #22317: Make pause DAG it's own role separate from edit DAG

2022-03-16 Thread GitBox
brettplarson opened a new issue #22317: URL: https://github.com/apache/airflow/issues/22317 ### Description As an Airflow administrator I would like to be be able to configure a user account with permissions be able to "clear" and re-run a DAG run but also _not_ be able to pause a

[GitHub] [airflow] eladkal commented on issue #18323: Detect and fail any command when db is not migrated

2022-03-16 Thread GitBox
eladkal commented on issue #18323: URL: https://github.com/apache/airflow/issues/18323#issuecomment-1069383143 fixed in https://github.com/apache/airflow/pull/18439 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [airflow] eladkal closed issue #18323: Detect and fail any command when db is not migrated

2022-03-16 Thread GitBox
eladkal closed issue #18323: URL: https://github.com/apache/airflow/issues/18323 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on pull request #22310: Add generic connection type

2022-03-16 Thread GitBox
potiuk commented on pull request #22310: URL: https://github.com/apache/airflow/pull/22310#issuecomment-1069365930 Yeah. I think it's good to have it to avoid confusion from the users. We had the same problem with email connection. This is really to give the right answer to the users who

[GitHub] [airflow] tnyz opened a new issue #22318: KubernetesPodOperator xcom sidecar stuck in running

2022-03-16 Thread GitBox
tnyz opened a new issue #22318: URL: https://github.com/apache/airflow/issues/22318 ### Apache Airflow version 2.2.4 (latest released) ### What happened When the main container errors and failed to write a return.json file, the xcom sidecar hangs and doesn't exit

[GitHub] [airflow] eladkal commented on issue #11294: Bugs/Improvement proposals filed to GitHub Actions

2022-03-16 Thread GitBox
eladkal commented on issue #11294: URL: https://github.com/apache/airflow/issues/11294#issuecomment-1069366984 @potiuk any further actions here? The tickets you opened to github can be viewed only by you :) -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] potiuk merged pull request #22310: Add generic connection type

2022-03-16 Thread GitBox
potiuk merged pull request #22310: URL: https://github.com/apache/airflow/pull/22310 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[airflow] branch main updated (df6058c -> 6d1d53b)

2022-03-16 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from df6058c Disable default_pool delete on web ui (#21658) add 6d1d53b Add generic connection type (#22310) No

[GitHub] [airflow] bbovenzi edited a comment on pull request #22272: Add map_index support to al task instance-related views

2022-03-16 Thread GitBox
bbovenzi edited a comment on pull request #22272: URL: https://github.com/apache/airflow/pull/22272#issuecomment-1069354329 https://user-images.githubusercontent.com/4600967/158645377-3d3502d8-8f8a-4532-b72e-240542aa1bde.png;> I think it would be useful to show the map index in the

[GitHub] [airflow] dstandish commented on a change in pull request #20759: Remove RefreshConfiguration workaround for K8s token refreshing

2022-03-16 Thread GitBox
dstandish commented on a change in pull request #20759: URL: https://github.com/apache/airflow/pull/20759#discussion_r828248873 ## File path: setup.py ## @@ -381,7 +381,7 @@ def write_version(filename: str = os.path.join(*[my_dir, "airflow", "git_version ] kubernetes = [

[GitHub] [airflow] bbovenzi commented on pull request #22272: Add map_index support to al task instance-related views

2022-03-16 Thread GitBox
bbovenzi commented on pull request #22272: URL: https://github.com/apache/airflow/pull/22272#issuecomment-1069354329 https://user-images.githubusercontent.com/4600967/158645377-3d3502d8-8f8a-4532-b72e-240542aa1bde.png;> I think it would be useful to show the map index in the header

[GitHub] [airflow] bbovenzi commented on pull request #22272: Add map_index support to al task instance-related views

2022-03-16 Thread GitBox
bbovenzi commented on pull request #22272: URL: https://github.com/apache/airflow/pull/22272#issuecomment-1069351761 > * `/success` and `/failed` set state to a task (and potentially its upstreams/downstreams). It feels a bit weird to be able to set the state to only one mapped task? Also

[GitHub] [airflow] bbovenzi commented on a change in pull request #22314: WIP summarize mapped

2022-03-16 Thread GitBox
bbovenzi commented on a change in pull request #22314: URL: https://github.com/apache/airflow/pull/22314#discussion_r828232501 ## File path: airflow/api_connexion/endpoints/task_instance_endpoint.py ## @@ -296,10 +298,49 @@ def get_task_instances_batch(session: Session =

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #22315: Airflow file sensor by prefix for azure data lake storage

2022-03-16 Thread GitBox
boring-cyborg[bot] commented on pull request #22315: URL: https://github.com/apache/airflow/pull/22315#issuecomment-1069340804 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[GitHub] [airflow] Ash-ZAMAN opened a new pull request #22315: Airflow file sensor by prefix for azure data lake storage

2022-03-16 Thread GitBox
Ash-ZAMAN opened a new pull request #22315: URL: https://github.com/apache/airflow/pull/22315 Hi, I noticed there was no airflow file sensor suitable for Azure Data Lake Storage. Hence, I created one. That could be realy useful for people who store data in Data Lake. My

[GitHub] [airflow] bbovenzi commented on a change in pull request #22272: Add map_index support to al task instance-related views

2022-03-16 Thread GitBox
bbovenzi commented on a change in pull request #22272: URL: https://github.com/apache/airflow/pull/22272#discussion_r828200131 ## File path: airflow/www/static/js/graph.js ## @@ -172,8 +172,8 @@ function draw() { const task = tasks[nodeId]; const tryNumber =

[GitHub] [airflow] bbovenzi commented on a change in pull request #22272: Add map_index support to al task instance-related views

2022-03-16 Thread GitBox
bbovenzi commented on a change in pull request #22272: URL: https://github.com/apache/airflow/pull/22272#discussion_r828198262 ## File path: airflow/www/static/js/gantt.js ## @@ -204,7 +204,7 @@ d3.gantt = () => { .on('mouseover', tip.show) .on('mouseout',

[GitHub] [airflow] bbovenzi commented on a change in pull request #22272: Add map_index support to al task instance-related views

2022-03-16 Thread GitBox
bbovenzi commented on a change in pull request #22272: URL: https://github.com/apache/airflow/pull/22272#discussion_r828194742 ## File path: airflow/www/static/js/dag.js ## @@ -53,6 +53,7 @@ let taskId = ''; let executionDate = ''; let subdagId = ''; let dagRunId = ''; +let

[GitHub] [airflow] norm opened a new pull request #22314: WIP summarize mapped

2022-03-16 Thread GitBox
norm opened a new pull request #22314: URL: https://github.com/apache/airflow/pull/22314 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)** for more

[airflow] branch mapped-task-drawer updated (c3d2d95 -> 9b246fb)

2022-03-16 Thread bbovenzi
This is an automated email from the ASF dual-hosted git repository. bbovenzi pushed a change to branch mapped-task-drawer in repository https://gitbox.apache.org/repos/asf/airflow.git. from c3d2d95 download log bug fixes add 9b246fb fix extra links, hide local TZ if UTC, No new

[GitHub] [airflow] dlesco commented on issue #22191: dag_processing code needs to handle OSError("handle is closed") in poll() and recv() calls

2022-03-16 Thread GitBox
dlesco commented on issue #22191: URL: https://github.com/apache/airflow/issues/22191#issuecomment-1069278603 I plan to submit a PR within the next two weeks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] villasv commented on issue #15340: helm install airflow in namespace get error: File "", line 32, in TimeoutError: There are still unapplied migrations after 60 sec

2022-03-16 Thread GitBox
villasv commented on issue #15340: URL: https://github.com/apache/airflow/issues/15340#issuecomment-1069268372 In my case, just removing the --wait flag was enough, I didn't have to fiddle with `airflow.dbMigrations.runAsJob` -- This is an automated message from the Apache Git Service.

[GitHub] [airflow] vincbeck opened a new pull request #22313: Update doc and sample dag for S3ToSFTPOperator and SFTPToS3Operator

2022-03-16 Thread GitBox
vincbeck opened a new pull request #22313: URL: https://github.com/apache/airflow/pull/22313 Update doc and sample dag for `S3ToSFTPOperator` and `SFTPToS3Operator` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [airflow] vincbeck opened a new pull request #22312: Update sample dag and doc for S3CreateBucketOperator, S3PutBucketTagg…

2022-03-16 Thread GitBox
vincbeck opened a new pull request #22312: URL: https://github.com/apache/airflow/pull/22312 Update sample dag and doc for `S3CreateBucketOperator`, `S3PutBucketTaggingOperator`, `S3GetBucketTaggingOperator`, `S3DeleteBucketTaggingOperator`, `S3DeleteBucketOperator` -- This is an

[GitHub] [airflow] ephraimbuddy closed issue #12418: AttributeError In scheduler when dictionary is passed to executor_config(Kubernetes Executor)

2022-03-16 Thread GitBox
ephraimbuddy closed issue #12418: URL: https://github.com/apache/airflow/issues/12418 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] eladkal commented on issue #15752: Airflow UI tree view: mark (success|failed) (past|future) only marking selected task instance

2022-03-16 Thread GitBox
eladkal commented on issue #15752: URL: https://github.com/apache/airflow/issues/15752#issuecomment-1069231162 The tree view has been refactored significantly. Actually it no longer exist. We now have Grid view Can you please check if the bug still reproducible on latest main branch?

[GitHub] [airflow] ephraimbuddy commented on issue #12418: AttributeError In scheduler when dictionary is passed to executor_config(Kubernetes Executor)

2022-03-16 Thread GitBox
ephraimbuddy commented on issue #12418: URL: https://github.com/apache/airflow/issues/12418#issuecomment-1069231777 Can't reproduce any more -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

  1   2   >