[GitHub] [airflow] kibablu opened a new pull request #19184: Add a fix on Ubuntu 20.04 for mysql_config not found error

2021-10-22 Thread GitBox
kibablu opened a new pull request #19184: URL: https://github.com/apache/airflow/pull/19184 On running this command on Ubuntu 20.04 ``` sudo apt install openssl \ sqlite default-libmysqlclient-dev libmysqlclient-dev postgresql ``` you may face an error of

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #19184: Add a fix on Ubuntu 20.04 for mysql_config not found error

2021-10-22 Thread GitBox
boring-cyborg[bot] commented on pull request #19184: URL: https://github.com/apache/airflow/pull/19184#issuecomment-950066402 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[GitHub] [airflow] uranusjr closed issue #19126: Airflow 2.2.0 - catchup=False not working

2021-10-22 Thread GitBox
uranusjr closed issue #19126: URL: https://github.com/apache/airflow/issues/19126 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] uranusjr commented on issue #19126: Airflow 2.2.0 - catchup=False not working

2021-10-22 Thread GitBox
uranusjr commented on issue #19126: URL: https://github.com/apache/airflow/issues/19126#issuecomment-950058229 Please see #19130. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] lintingbin2009 commented on issue #19126: Airflow 2.2.0 - catchup=False not working

2021-10-22 Thread GitBox
lintingbin2009 commented on issue #19126: URL: https://github.com/apache/airflow/issues/19126#issuecomment-950057539 I have the same problem. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #19183: Clearing ti.next_method and ti.next_kwargs on task finish.

2021-10-22 Thread GitBox
boring-cyborg[bot] commented on pull request #19183: URL: https://github.com/apache/airflow/pull/19183#issuecomment-950053066 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[GitHub] [airflow] ReadytoRocc opened a new pull request #19183: Clearing ti.next_method and ti.next_kwargs on task finish.

2021-10-22 Thread GitBox
ReadytoRocc opened a new pull request #19183: URL: https://github.com/apache/airflow/pull/19183 Extending the changes of https://github.com/apache/airflow/pull/18210 to all cases of a task finishing in `ti._run_raw_task()`. - closes: #19120 - related: #18146 -- This is an

[GitHub] [airflow] o-nikolas opened a new pull request #19182: Fix breeze docker version parsing

2021-10-22 Thread GitBox
o-nikolas opened a new pull request #19182: URL: https://github.com/apache/airflow/pull/19182 After this recent change: [18902](https://github.com/apache/airflow/pull/18902), docker version parsing no longer works in all cases: ``` [onikolas@dev-dsk-onikolas airflow]$ ./breeze

[GitHub] [airflow] mik-laj edited a comment on issue #19154: Add Release date for when an endpoint/field was added in the REST API

2021-10-22 Thread GitBox
mik-laj edited a comment on issue #19154: URL: https://github.com/apache/airflow/issues/19154#issuecomment-950043189 Each release has a separate tag, so when you switch to a specific tag, you can see the code from a specific version.

[GitHub] [airflow] mik-laj commented on issue #19154: Add Release date for when an endpoint/field was added in the REST API

2021-10-22 Thread GitBox
mik-laj commented on issue #19154: URL: https://github.com/apache/airflow/issues/19154#issuecomment-950043189 Each release has a separate tag, so when you switch to a specific tag, you can see the code from a specific version.

[GitHub] [airflow] mik-laj commented on issue #19171: EMRContainerOperator with timeout after 1 hour

2021-10-22 Thread GitBox
mik-laj commented on issue #19171: URL: https://github.com/apache/airflow/issues/19171#issuecomment-950042475 Ahh. Too fast. This issue was fixed in the EKS and not the EMR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [airflow] mik-laj closed issue #19171: EMRContainerOperator with timeout after 1 hour

2021-10-22 Thread GitBox
mik-laj closed issue #19171: URL: https://github.com/apache/airflow/issues/19171 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] mik-laj commented on issue #19171: EMRContainerOperator with timeout after 1 hour

2021-10-22 Thread GitBox
mik-laj commented on issue #19171: URL: https://github.com/apache/airflow/issues/19171#issuecomment-950042300 Fixed in apache-airflow-providers-amazon==2.3.0 http://airflow.apache.org/docs/apache-airflow-providers-amazon/stable/index.html#id1 > Refresh credentials for

[GitHub] [airflow] Bowrna commented on pull request #19100: pyenv related docs added, warning message in breeze initialize-local-virtualenv command

2021-10-22 Thread GitBox
Bowrna commented on pull request #19100: URL: https://github.com/apache/airflow/pull/19100#issuecomment-950037782 Got it. let me fix it and raise a different PR. Do I need to make any changes to this PR further? If yes, please let me know. Thanks for all the clarification @ephraimbuddy

[GitHub] [airflow] zachliu commented on pull request #19176: fix invalid syntax

2021-10-22 Thread GitBox
zachliu commented on pull request #19176: URL: https://github.com/apache/airflow/pull/19176#issuecomment-950034935 > Hmm, IIRC recall there's another PR for this...? forgot to use keyword "type" to search... https://github.com/apache/airflow/pull/19065 -- This is an automated

[GitHub] [airflow] zachliu closed pull request #19176: fix invalid syntax

2021-10-22 Thread GitBox
zachliu closed pull request #19176: URL: https://github.com/apache/airflow/pull/19176 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] mik-laj opened a new pull request #19181: More strict schema for values.yaml

2021-10-22 Thread GitBox
mik-laj opened a new pull request #19181: URL: https://github.com/apache/airflow/pull/19181 Some fields in values.yml accept value that complies with the Kubernetes API, so we can verify that too. --- **^ Add meaningful description above** Read the **[Pull Request

[GitHub] [airflow] ephraimbuddy commented on issue #19172: Tasks scheduled with `airflow tasks run` fails on a query to the meta db

2021-10-22 Thread GitBox
ephraimbuddy commented on issue #19172: URL: https://github.com/apache/airflow/issues/19172#issuecomment-950030530 Cool. Closing for now, if you encounter the issue after upgrade, I’ll reopen it -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] ephraimbuddy closed issue #19172: Tasks scheduled with `airflow tasks run` fails on a query to the meta db

2021-10-22 Thread GitBox
ephraimbuddy closed issue #19172: URL: https://github.com/apache/airflow/issues/19172 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] jsnb-devoted edited a comment on issue #19172: Tasks scheduled with `airflow tasks run` fails on a query to the meta db

2021-10-22 Thread GitBox
jsnb-devoted edited a comment on issue #19172: URL: https://github.com/apache/airflow/issues/19172#issuecomment-950029144 Ah - I misunderstood your message. Thanks for the link to the PR. At first glance it looks like the changes to `cli/task_command.py`

[GitHub] [airflow] jsnb-devoted commented on issue #19172: Tasks scheduled with `airflow tasks run` fails on a query to the meta db

2021-10-22 Thread GitBox
jsnb-devoted commented on issue #19172: URL: https://github.com/apache/airflow/issues/19172#issuecomment-950029144 Ah - I misunderstood your message. Thanks for the link to the PR. At first glance it looks like the changes to `cli/task_command.py` creates the DAG run in the db if it

[airflow] branch main updated: Allow specifying extras when using breeze initialize_local_virtualenv (#19178)

2021-10-22 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new f47d7b9 Allow specifying extras when using breeze

[GitHub] [airflow] potiuk merged pull request #19178: Allow specifying extras when using breeze initialize_local_virtualenv

2021-10-22 Thread GitBox
potiuk merged pull request #19178: URL: https://github.com/apache/airflow/pull/19178 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] ephraimbuddy commented on issue #19172: Tasks scheduled with `airflow tasks run` fails on a query to the meta db

2021-10-22 Thread GitBox
ephraimbuddy commented on issue #19172: URL: https://github.com/apache/airflow/issues/19172#issuecomment-950024662 I mean that since task instance can no longer exist without a corresponding dagrun, the above query will not fail, or do you think it'd fail? I'm thinking it will not.

[GitHub] [airflow] jsnb-devoted commented on issue #19172: Tasks scheduled with `airflow tasks run` fails on a query to the meta db

2021-10-22 Thread GitBox
jsnb-devoted commented on issue #19172: URL: https://github.com/apache/airflow/issues/19172#issuecomment-950023210 Thanks @ephraimbuddy -- I scanned the closed issues and did a once over of the `local_task_job.py` on the `v2-2-stable` branch to see how much it had changed but I didn't see

[GitHub] [airflow] ephraimbuddy commented on pull request #19100: pyenv related docs added, warning message in breeze initialize-local-virtualenv command

2021-10-22 Thread GitBox
ephraimbuddy commented on pull request #19100: URL: https://github.com/apache/airflow/pull/19100#issuecomment-950022723 > While i am usually tempted to do the same 'yeah small change let's do it together' - learned by experience it might bite back and when i feel i need to add ' ... and

[GitHub] [airflow] github-actions[bot] commented on issue #12291: Trigger Dag from Airflow Web GUI sets origin with wrong HTTP scheme

2021-10-22 Thread GitBox
github-actions[bot] commented on issue #12291: URL: https://github.com/apache/airflow/issues/12291#issuecomment-950021558 This issue has been automatically marked as stale because it has been open for 30 days with no response from the author. It will be closed in next 7 days if no further

[GitHub] [airflow] github-actions[bot] commented on pull request #17933: enable setting of pod specific annotations

2021-10-22 Thread GitBox
github-actions[bot] commented on pull request #17933: URL: https://github.com/apache/airflow/pull/17933#issuecomment-950021523 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank

[GitHub] [airflow] github-actions[bot] commented on issue #18091: Possible PyJWT dependency upgrade?

2021-10-22 Thread GitBox
github-actions[bot] commented on issue #18091: URL: https://github.com/apache/airflow/issues/18091#issuecomment-950021518 This issue has been automatically marked as stale because it has been open for 30 days with no response from the author. It will be closed in next 7 days if no further

[airflow] 05/06: Hide tooltip when next run is none (#19112)

2021-10-22 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a commit to branch v2-2-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit fb4deb74997c791a35c4ebd521f9c1c2868bf90d Author: Brent Bovenzi AuthorDate: Wed Oct 20 15:38:49 2021 -0500

[airflow] 02/06: Fix queued dag runs changes catchup=False behaviour (#19130)

2021-10-22 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a commit to branch v2-2-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit cd87e5802af08fff0481929db2594955d8a21874 Author: Robin Edwards AuthorDate: Fri Oct 22 02:03:59 2021 +0100

[airflow] 06/06: Add TriggererJob to jobs check command (#19179)

2021-10-22 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a commit to branch v2-2-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 6ef71d55f2ce510cabed4fcc3701e924aec2164a Author: Kamil Breguła AuthorDate: Sat Oct 23 01:32:00 2021 +0200

[airflow] 03/06: Add test for interval timetable catchup=False (#19145)

2021-10-22 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a commit to branch v2-2-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit a99d54d27e256c0488d604d312f4a0cab320e09a Author: Tzu-ping Chung AuthorDate: Fri Oct 22 15:38:57 2021 +0800

[airflow] 04/06: Crerate TI context with data interval compat layer (#19148)

2021-10-22 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a commit to branch v2-2-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit be29f5de828580e955cdd87225b1cd8d636ce767 Author: Tzu-ping Chung AuthorDate: Fri Oct 22 14:50:22 2021 +0800

[airflow] branch v2-2-test updated (5b1c76a -> 6ef71d5)

2021-10-22 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a change to branch v2-2-test in repository https://gitbox.apache.org/repos/asf/airflow.git. from 5b1c76a Add changelog for 2.2.1 new 28f56a0 add detailed information to logging when a dag or a

[airflow] 01/06: add detailed information to logging when a dag or a task finishes. (#19097)

2021-10-22 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a commit to branch v2-2-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 28f56a007e106d1373c6c231a67b87c45b63697c Author: Steve Zhang

[GitHub] [airflow] uranusjr commented on pull request #19176: fix invalid syntax

2021-10-22 Thread GitBox
uranusjr commented on pull request #19176: URL: https://github.com/apache/airflow/pull/19176#issuecomment-950017778 Hmm, IIRC recall there's another PR for this...? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [airflow] mik-laj commented on a change in pull request #19175: Add migration job resources

2021-10-22 Thread GitBox
mik-laj commented on a change in pull request #19175: URL: https://github.com/apache/airflow/pull/19175#discussion_r734891083 ## File path: chart/values.schema.json ## @@ -1737,6 +1737,23 @@ } } }, +

[airflow] branch main updated (10e2a88 -> d3ac010)

2021-10-22 Thread kamilbregula
This is an automated email from the ASF dual-hosted git repository. kamilbregula pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 10e2a88 Adds Sprylab as user "in the wild" (#19159) add d3ac010 Add TriggererJob to jobs check command

[GitHub] [airflow] mik-laj merged pull request #19179: Add TriggererJob to jobs check command

2021-10-22 Thread GitBox
mik-laj merged pull request #19179: URL: https://github.com/apache/airflow/pull/19179 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] mik-laj closed issue #19161: airflow-triggerer service healthcheck broken

2021-10-22 Thread GitBox
mik-laj closed issue #19161: URL: https://github.com/apache/airflow/issues/19161 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] SamWheating edited a comment on issue #19171: EMRContainerOperator with timeout after 1 hour

2021-10-22 Thread GitBox
SamWheating edited a comment on issue #19171: URL: https://github.com/apache/airflow/issues/19171#issuecomment-950008224 Hi there - the `AirflowTaskTimeout` is typically raised when a task's execution exceeds its `execution_timeout` which causes it to be stopped by Airflow. This

[GitHub] [airflow] SamWheating commented on issue #19171: EMRContainerOperator with timeout after 1 hour

2021-10-22 Thread GitBox
SamWheating commented on issue #19171: URL: https://github.com/apache/airflow/issues/19171#issuecomment-950008224 Hi there - the `AirflowTaskTimeout` is typically raised when a task's execution exceeds its `execution_timeout` which causes it to be stopped by Airflow.

[GitHub] [airflow] joeknize-bc opened a new pull request #19180: Improving snowflake operator example docs

2021-10-22 Thread GitBox
joeknize-bc opened a new pull request #19180: URL: https://github.com/apache/airflow/pull/19180 …specify the snowflake_conn_id The current [snowflake operator example page](https://airflow.apache.org/docs/apache-airflow-providers-snowflake/stable/operators/snowflake.html) omits the

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #19180: Improving snowflake operator example docs

2021-10-22 Thread GitBox
boring-cyborg[bot] commented on pull request #19180: URL: https://github.com/apache/airflow/pull/19180#issuecomment-950004648 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[GitHub] [airflow] github-actions[bot] commented on pull request #19179: Add TriggererJob to jobs check command

2021-10-22 Thread GitBox
github-actions[bot] commented on pull request #19179: URL: https://github.com/apache/airflow/pull/19179#issuecomment-950003661 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not

[GitHub] [airflow] mik-laj opened a new pull request #19179: Add TriggererJob to jobs check command

2021-10-22 Thread GitBox
mik-laj opened a new pull request #19179: URL: https://github.com/apache/airflow/pull/19179 Close: https://github.com/apache/airflow/issues/19161 --- **^ Add meaningful description above** Read the **[Pull Request

[GitHub] [airflow] 30blay commented on pull request #18988: SFTP hook to prefer the SSH paramiko key over the key file path

2021-10-22 Thread GitBox
30blay commented on pull request #18988: URL: https://github.com/apache/airflow/pull/18988#issuecomment-950001213 > Could you address the review comment in the original PR? Namely https://github.com/apache/airflow/pull/16338/files#r649058789 Done! -- This is an automated message

[GitHub] [airflow] 30blay commented on a change in pull request #16338: SFTP hook to prefer the SSH paramiko key over the key file path

2021-10-22 Thread GitBox
30blay commented on a change in pull request #16338: URL: https://github.com/apache/airflow/pull/16338#discussion_r734879490 ## File path: airflow/providers/sftp/hooks/sftp.py ## @@ -135,8 +135,13 @@ def get_conn(self) -> pysftp.Connection: } if

[GitHub] [airflow] o-nikolas opened a new pull request #19178: Allow specifying extras when using breeze initialize_local_virtualenv

2021-10-22 Thread GitBox
o-nikolas opened a new pull request #19178: URL: https://github.com/apache/airflow/pull/19178 In [this Slack thread](https://apache-airflow.slack.com/archives/CQ9QHSFQX/p1634668910074400), a user was attempting to setup a virtual env to do some testing of code changes. The user reported:

[GitHub] [airflow] fjmacagno commented on issue #13391: MySqlToHiveOperator , ”invalid path“ while loding the extracted csv to hive

2021-10-22 Thread GitBox
fjmacagno commented on issue #13391: URL: https://github.com/apache/airflow/issues/13391#issuecomment-94148 I am seeing the same issue using `HiveCliHook.load_df()`: ``` for design in designs: for platformSegment in design["platformSegments"]:

[GitHub] [airflow] potiuk closed issue #19170: Breeze build system does not recognize docker-compose version 2.X

2021-10-22 Thread GitBox
potiuk closed issue #19170: URL: https://github.com/apache/airflow/issues/19170 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on issue #19170: Breeze build system does not recognize docker-compose version 2.X

2021-10-22 Thread GitBox
potiuk commented on issue #19170: URL: https://github.com/apache/airflow/issues/19170#issuecomment-949983576 Are you sure you use the latest version of breeze ? Docker compose 2 support was added few weeks ago and I was using it for quite some time - on Mint not Ubuntu, so i am pretty

[GitHub] [airflow] zachliu opened a new pull request #19176: fix invalid syntax

2021-10-22 Thread GitBox
zachliu opened a new pull request #19176: URL: https://github.com/apache/airflow/pull/19176 closes: https://github.com/apache/airflow/discussions/19006 my comments: https://github.com/apache/airflow/discussions/19006#discussioncomment-1523475 --- **^ Add

[GitHub] [airflow] edithturn commented on pull request #19124: Modify doc contributing

2021-10-22 Thread GitBox
edithturn commented on pull request #19124: URL: https://github.com/apache/airflow/pull/19124#issuecomment-949977226 > You need to run webserver to serve the files (docs/start_docs_server.sh ?). But this won't help as CONTRIBUTING.rst is not part of the docs we build. It is supposed to

[GitHub] [airflow] github-actions[bot] commented on pull request #19166: Faster db migration to Airflow 2.2

2021-10-22 Thread GitBox
github-actions[bot] commented on pull request #19166: URL: https://github.com/apache/airflow/pull/19166#issuecomment-949976855 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] potiuk commented on pull request #19124: Modify doc contributing

2021-10-22 Thread GitBox
potiuk commented on pull request #19124: URL: https://github.com/apache/airflow/pull/19124#issuecomment-949976665 > One thing I was thinking is, all links on this page are embedded Good point. I am not too much in favour of 'reference' links. I would also love to hear what is better

[GitHub] [airflow] john-jac commented on pull request #19137: Add RedshiftDataHook

2021-10-22 Thread GitBox
john-jac commented on pull request #19137: URL: https://github.com/apache/airflow/pull/19137#issuecomment-949976235 > In that case, to avoid confusion, we should separate this to a different file e.g `redshift_data.py` just like we have `glue.py`, `glue_crawler.py` and `glue_catalog.py`.

[GitHub] [airflow] potiuk commented on pull request #19124: Modify doc contributing

2021-10-22 Thread GitBox
potiuk commented on pull request #19124: URL: https://github.com/apache/airflow/pull/19124#issuecomment-949974986 You need to run webserver to serve the files (docs/start_docs_server.sh ?). But this won't help as CONTRIBUTING.rst is not part of the docs we build. It is supposed to only be

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #19175: Add migration job resources

2021-10-22 Thread GitBox
boring-cyborg[bot] commented on pull request #19175: URL: https://github.com/apache/airflow/pull/19175#issuecomment-949972723 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[GitHub] [airflow] simplylizz opened a new pull request #19175: Add migration job resources

2021-10-22 Thread GitBox
simplylizz opened a new pull request #19175: URL: https://github.com/apache/airflow/pull/19175 Add possibility to set resource limits and requests for airflow-migration-job. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [airflow] mrbazzan commented on issue #19154: Add Release date for when an endpoint/field was added in the REST API

2021-10-22 Thread GitBox
mrbazzan commented on issue #19154: URL: https://github.com/apache/airflow/issues/19154#issuecomment-949969326 > Here all spec: > > ``` > https://raw.githubusercontent.com/apache/airflow/2.0.0/airflow/api_connexion/openapi/v1.yaml >

[GitHub] [airflow] ephraimbuddy commented on issue #19172: Tasks scheduled with `airflow tasks run` fails on a query to the meta db

2021-10-22 Thread GitBox
ephraimbuddy commented on issue #19172: URL: https://github.com/apache/airflow/issues/19172#issuecomment-949968523 This has been fixed in 2.2 where you can't have a task instance without a corresponding dagrun -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [airflow] potiuk commented on pull request #19139: Changing password as it gets masked across logs and causes issues

2021-10-22 Thread GitBox
potiuk commented on pull request #19139: URL: https://github.com/apache/airflow/pull/19139#issuecomment-949966656 I see. Makes sense. I think it makes sense to change the password if it is in unit tests -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] 30blay commented on a change in pull request #16338: SFTP hook to prefer the SSH paramiko key over the key file path

2021-10-22 Thread GitBox
30blay commented on a change in pull request #16338: URL: https://github.com/apache/airflow/pull/16338#discussion_r734846701 ## File path: airflow/providers/sftp/hooks/sftp.py ## @@ -135,8 +135,13 @@ def get_conn(self) -> pysftp.Connection: } if

[GitHub] [airflow] john-jac commented on a change in pull request #19173: Add Note to SLA regarding schedule_interval

2021-10-22 Thread GitBox
john-jac commented on a change in pull request #19173: URL: https://github.com/apache/airflow/pull/19173#discussion_r734846593 ## File path: docs/apache-airflow/concepts/tasks.rst ## @@ -163,6 +163,10 @@ If you want to disable SLA checking entirely, you can set ``check_slas =

[GitHub] [airflow] john-jac commented on pull request #19173: Add Note to SLA regarding schedule_interval

2021-10-22 Thread GitBox
john-jac commented on pull request #19173: URL: https://github.com/apache/airflow/pull/19173#issuecomment-949962844 > We should probably change the code to prevent that exception as well something like > > ```python > if dttm is None: > # Emit a log here saying SLA will

[GitHub] [airflow] ephraimbuddy commented on pull request #19137: Add RedshiftDataHook

2021-10-22 Thread GitBox
ephraimbuddy commented on pull request #19137: URL: https://github.com/apache/airflow/pull/19137#issuecomment-949961745 In that case, to avoid confusion, we should separate this to a different file e.g `redshift_data.py` just like we have `glue.py`, `glue_crawler.py` and

[airflow] branch main updated (90b15e9 -> 10e2a88)

2021-10-22 Thread uranusjr
This is an automated email from the ASF dual-hosted git repository. uranusjr pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 90b15e9 Added Wayfair to the list of companies using Apache Airflow (#19162) add 10e2a88 Adds Sprylab as

[GitHub] [airflow] uranusjr merged pull request #19159: Adds Sprylab as user "in the wild"

2021-10-22 Thread GitBox
uranusjr merged pull request #19159: URL: https://github.com/apache/airflow/pull/19159 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #19159: Adds Sprylab as user "in the wild"

2021-10-22 Thread GitBox
boring-cyborg[bot] commented on pull request #19159: URL: https://github.com/apache/airflow/pull/19159#issuecomment-949961234 Awesome work, congrats on your first merged pull request! -- This is an automated message from the Apache Git Service. To respond to the message, please log

[airflow] branch main updated (be2e109 -> 90b15e9)

2021-10-22 Thread uranusjr
This is an automated email from the ASF dual-hosted git repository. uranusjr pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from be2e109 Update INTWILD.md to add Retailink (#19115) add 90b15e9 Added Wayfair to the list of companies using

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #19162: Added Wayfair to the list of companies using Apache Airflow

2021-10-22 Thread GitBox
boring-cyborg[bot] commented on pull request #19162: URL: https://github.com/apache/airflow/pull/19162#issuecomment-949960793 Awesome work, congrats on your first merged pull request! -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] uranusjr merged pull request #19162: Added Wayfair to the list of companies using Apache Airflow

2021-10-22 Thread GitBox
uranusjr merged pull request #19162: URL: https://github.com/apache/airflow/pull/19162 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] uranusjr commented on a change in pull request #19173: Add Note to SLA regarding schedule_interval

2021-10-22 Thread GitBox
uranusjr commented on a change in pull request #19173: URL: https://github.com/apache/airflow/pull/19173#discussion_r734844348 ## File path: docs/apache-airflow/concepts/tasks.rst ## @@ -163,6 +163,10 @@ If you want to disable SLA checking entirely, you can set ``check_slas =

[GitHub] [airflow] uranusjr commented on pull request #19173: Add Note to SLA regarding schedule_interval

2021-10-22 Thread GitBox
uranusjr commented on pull request #19173: URL: https://github.com/apache/airflow/pull/19173#issuecomment-949959265 We should probably change the code to prevent that exception as well something like ```python if dttm is None: # Emit a log here saying SLA will not be

[GitHub] [airflow] github-actions[bot] commented on pull request #19162: Added Wayfair to the list of companies using Apache Airflow

2021-10-22 Thread GitBox
github-actions[bot] commented on pull request #19162: URL: https://github.com/apache/airflow/pull/19162#issuecomment-949957934 The PR is likely ready to be merged. No tests are needed as no important environment files, nor python files were modified by it. However, committers might decide

[GitHub] [airflow] john-jac opened a new pull request #19173: Add Note to SLA regarding schedule_interval

2021-10-22 Thread GitBox
john-jac opened a new pull request #19173: URL: https://github.com/apache/airflow/pull/19173 This document entry is intended to make explicit the requirement that SLAs will only be triggered for tasks in that are part of a scheduled DAG run. Manually triggering DAGs with

[GitHub] [airflow] khalidmammadov commented on pull request #19139: Changing password as it gets masked across logs and causes issues

2021-10-22 Thread GitBox
khalidmammadov commented on pull request #19139: URL: https://github.com/apache/airflow/pull/19139#issuecomment-949955438 @potiuk This PR tries to fix only 1 of 5 failing test cases within the suite and whole suite is marked as @pytest.mark.quarantined. I didnt have chance to take a

[GitHub] [airflow] mrbazzan commented on issue #19154: Add Release date for when an endpoint/field was added in the REST API

2021-10-22 Thread GitBox
mrbazzan commented on issue #19154: URL: https://github.com/apache/airflow/issues/19154#issuecomment-949944078 > To start, I think you can manually check back when all existing fields in `airflow/api_connexion/openapi/v1.yaml` were added to Airflow. Let's start with classes defined in

[GitHub] [airflow] boring-cyborg[bot] commented on issue #19172: Tasks scheduled with `airflow tasks run` fails on a query to the meta db

2021-10-22 Thread GitBox
boring-cyborg[bot] commented on issue #19172: URL: https://github.com/apache/airflow/issues/19172#issuecomment-949935621 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] jsnb-devoted opened a new issue #19172: Tasks scheduled with `airflow tasks run` fails on a query to the meta db

2021-10-22 Thread GitBox
jsnb-devoted opened a new issue #19172: URL: https://github.com/apache/airflow/issues/19172 ### Apache Airflow version 2.1.3 ### Operating System Debian GNU/Linux ### Versions of Apache Airflow Providers ``` apache-airflow-providers-amazon==2.2.0

[GitHub] [airflow] boring-cyborg[bot] commented on issue #19171: EMRContainerOperator with timeout after 1 hour

2021-10-22 Thread GitBox
boring-cyborg[bot] commented on issue #19171: URL: https://github.com/apache/airflow/issues/19171#issuecomment-949932949 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] luissantanacontato opened a new issue #19171: EMRContainerOperator with timeout after 1 hour

2021-10-22 Thread GitBox
luissantanacontato opened a new issue #19171: URL: https://github.com/apache/airflow/issues/19171 ### Apache Airflow Provider(s) amazon ### Versions of Apache Airflow Providers apache-airflow-providers-amazon==2.2.0 ### Apache Airflow version 2.1.0

[airflow] branch main updated: Update INTWILD.md to add Retailink (#19115)

2021-10-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new be2e109 Update INTWILD.md to add

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #19115: Update INTWILD.md to add Retailink

2021-10-22 Thread GitBox
boring-cyborg[bot] commented on pull request #19115: URL: https://github.com/apache/airflow/pull/19115#issuecomment-949924724 Awesome work, congrats on your first merged pull request! -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] ephraimbuddy merged pull request #19115: Update INTWILD.md to add Retailink

2021-10-22 Thread GitBox
ephraimbuddy merged pull request #19115: URL: https://github.com/apache/airflow/pull/19115 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] ephraimbuddy commented on pull request #19100: pyenv related docs added, warning message in breeze initialize-local-virtualenv command

2021-10-22 Thread GitBox
ephraimbuddy commented on pull request #19100: URL: https://github.com/apache/airflow/pull/19100#issuecomment-949923778 Result: ``` Run codespell to check for common misspellings in files..Failed - hook id: codespell - exit code: 65 If

[GitHub] [airflow] ephraimbuddy commented on pull request #19100: pyenv related docs added, warning message in breeze initialize-local-virtualenv command

2021-10-22 Thread GitBox
ephraimbuddy commented on pull request #19100: URL: https://github.com/apache/airflow/pull/19100#issuecomment-949922236 > I think (not sure - on my phone now) this is either a codespell flag to add custom error message or pre-commit message. I t should end up with moditlfying the

[GitHub] [airflow] carlsonp opened a new issue #19170: Breeze build system does not recognize docker-compose version 2.X

2021-10-22 Thread GitBox
carlsonp opened a new issue #19170: URL: https://github.com/apache/airflow/issues/19170 ### Apache Airflow version main (development) ### Operating System Ubuntu 20.04 ### Versions of Apache Airflow Providers _No response_ ### Deployment

[GitHub] [airflow] josh-fell commented on issue #19158: Macros time operations not working

2021-10-22 Thread GitBox
josh-fell commented on issue #19158: URL: https://github.com/apache/airflow/issues/19158#issuecomment-949901330 @pdavis156879 I'm unable to reproduce this with the code provided as well as different flavors of calling `macros.ds_add()`. Is there another example you have that raises the

[GitHub] [airflow] carlsonp commented on issue #19161: airflow-triggerer service healthcheck broken

2021-10-22 Thread GitBox
carlsonp commented on issue #19161: URL: https://github.com/apache/airflow/issues/19161#issuecomment-949901188 Sorry I gave it my best shot reading up and deploying via [Breeze](https://github.com/apache/airflow/blob/main/BREEZE.rst) but I don't have 40 GB of space on my laptop to

[GitHub] [airflow-client-python] mik-laj commented on pull request #34: bug fix ApiValueError when calling get_variables()

2021-10-22 Thread GitBox
mik-laj commented on pull request #34: URL: https://github.com/apache/airflow-client-python/pull/34#issuecomment-949895751 You have to start with generating the client, and then you can start to find out why he is generating the code this way. This generator is also Open Source, so you

[GitHub] [airflow] jedcunningham closed pull request #19166: Faster db migration to Airflow 2.2

2021-10-22 Thread GitBox
jedcunningham closed pull request #19166: URL: https://github.com/apache/airflow/pull/19166 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] mik-laj commented on issue #19154: Add Release date for when an endpoint/field was added in the REST API

2021-10-22 Thread GitBox
mik-laj commented on issue #19154: URL: https://github.com/apache/airflow/issues/19154#issuecomment-949887443 Here all spec: ``` https://raw.githubusercontent.com/apache/airflow/2.0.0/airflow/api_connexion/openapi/v1.yaml

[GitHub] [airflow] github-actions[bot] commented on pull request #19169: Updating Apache HDFS title in index doc to match convention

2021-10-22 Thread GitBox
github-actions[bot] commented on pull request #19169: URL: https://github.com/apache/airflow/pull/19169#issuecomment-949882682 The PR is likely ready to be merged. No tests are needed as no important environment files, nor python files were modified by it. However, committers might decide

[GitHub] [airflow] potiuk commented on pull request #19100: pyenv related docs added, warning message in breeze initialize-local-virtualenv command

2021-10-22 Thread GitBox
potiuk commented on pull request #19100: URL: https://github.com/apache/airflow/pull/19100#issuecomment-949874128 I think (not sure - on my phone now) this is either a codespell flag to add custom error message or pre-commit message. I t should end up with moditlfying the precommit

[GitHub] [airflow] josh-fell opened a new pull request #19169: Updating Apache HDFS title in index doc to match convention

2021-10-22 Thread GitBox
josh-fell opened a new pull request #19169: URL: https://github.com/apache/airflow/pull/19169 The current title in the Apache HDFS index doc is "apache-airflow-providers-hdfs". This PR updates the title of the index doc to "apache-airflow-providers-apache-hdfs" which follow the same

[GitHub] [airflow] wpromatt commented on issue #14352: Airflow2.0 cannot read remote log from GCP GCS

2021-10-22 Thread GitBox
wpromatt commented on issue #14352: URL: https://github.com/apache/airflow/issues/14352#issuecomment-949873147 Any updates on this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [airflow] uranusjr commented on issue #19154: Add Release date for when an endpoint/field was added in the REST API

2021-10-22 Thread GitBox
uranusjr commented on issue #19154: URL: https://github.com/apache/airflow/issues/19154#issuecomment-949872687 To start, I think you can manually check back when all existing fields in `airflow/api_connexion/openapi/v1.yaml` were added to Airflow. Let's start with classes defined in

  1   2   3   >