[GitHub] [airflow] lgov opened a new issue #17129: All tasks fail on logging to a Windows drive (Kubernetes-Multipass-Microk8s on Windows host)

2021-07-21 Thread GitBox
lgov opened a new issue #17129: URL: https://github.com/apache/airflow/issues/17129 **Apache Airflow version**: 2.1.0 **Kubernetes version (if you are using kubernetes)** (use `kubectl version`): v1.19.7 **Environment**: - **Cloud provider or hardware

[GitHub] [airflow] chenjiahui closed pull request #17128: Update graph.css

2021-07-21 Thread GitBox
chenjiahui closed pull request #17128: URL: https://github.com/apache/airflow/pull/17128 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] ephraimbuddy commented on issue #17054: Unable to trigger a DAG run via stable rest api

2021-07-21 Thread GitBox
ephraimbuddy commented on issue #17054: URL: https://github.com/apache/airflow/issues/17054#issuecomment-883987047 > hmm, I tried with 2.1.0 too couldn't reproduce. > > cc @ephraimbuddy can you reproduce with 2.1.0? I was not able to reproduce in 2.1.0 as well. @AvniM ,

[GitHub] [airflow] uranusjr commented on pull request #17125: Fix bool conversion Verify parameter in Tableau Hook

2021-07-21 Thread GitBox
uranusjr commented on pull request #17125: URL: https://github.com/apache/airflow/pull/17125#issuecomment-884011294 Not directly related to the issue, but `distutils.util.strtobool` is going to be deprecated in Python 3.10, so this is probably a good time as any to remove that function

[GitHub] [airflow] ciancolo commented on pull request #17125: Fix bool conversion Verify parameter in Tableau Hook

2021-07-21 Thread GitBox
ciancolo commented on pull request #17125: URL: https://github.com/apache/airflow/pull/17125#issuecomment-884023597 Oh really?! I didn't know. Thank you for the hint. I was thinking, what if we removed completely the conversion? I mean the admissible value for that `Verify` field

[GitHub] [airflow] ciancolo commented on issue #17037: Status of testing Providers that were prepared on July 15, 2021

2021-07-21 Thread GitBox
ciancolo commented on issue #17037: URL: https://github.com/apache/airflow/issues/17037#issuecomment-883961376 there is a problem with #16365. In the case of `Extra` parameter in format `{'verify': true}` the conversion str to bool is not necessary. With `Extra` parameters as

[GitHub] [airflow] ciancolo opened a new pull request #17125: Fix bool conversion Verify parameter in Tableau Hook

2021-07-21 Thread GitBox
ciancolo opened a new pull request #17125: URL: https://github.com/apache/airflow/pull/17125 Hello all, During the RC tests, I founded this bug (generated from my PR #16365). The bug is present when the user set in `Extra` parameter field in a `Tableau Connection` the parameter

[GitHub] [airflow] uranusjr commented on issue #17124: AwsBatchOperator on v2.1.x exits with return code 1

2021-07-21 Thread GitBox
uranusjr commented on issue #17124: URL: https://github.com/apache/airflow/issues/17124#issuecomment-884005562 The task still seems to work though? It’s marked as success and that’s what’s important to Airflow. -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [airflow] ciancolo edited a comment on issue #17037: Status of testing Providers that were prepared on July 15, 2021

2021-07-21 Thread GitBox
ciancolo edited a comment on issue #17037: URL: https://github.com/apache/airflow/issues/17037#issuecomment-883961376 there is a problem with #16365. In the case of `Extra` parameter in format `{'verify': true}` the conversion str to bool is not necessary. With `Extra` parameters

[GitHub] [airflow] boring-cyborg[bot] commented on issue #17127: Airflow 2.1.0 with Schedulers HA Failing

2021-07-21 Thread GitBox
boring-cyborg[bot] commented on issue #17127: URL: https://github.com/apache/airflow/issues/17127#issuecomment-884008943 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] sorabhgit opened a new issue #17127: Airflow 2.1.0 with Schedulers HA Failing

2021-07-21 Thread GitBox
sorabhgit opened a new issue #17127: URL: https://github.com/apache/airflow/issues/17127 ### Discussed in https://github.com/apache/airflow/discussions/17126 Originally posted by **sorabhgit** July 21, 2021 Hello Guys , I am also struggling with issue while setting up

[GitHub] [airflow] oyarushe commented on pull request #17117: Made S3ToRedshiftOperator transaction safe

2021-07-21 Thread GitBox
oyarushe commented on pull request #17117: URL: https://github.com/apache/airflow/pull/17117#issuecomment-884016463 > Could you also rename the variable since it’s no longer a truncate statement? thanks, I did it. -- This is an automated message from the Apache Git Service. To

[GitHub] [airflow] uranusjr edited a comment on issue #17124: AwsBatchOperator on v2.1.x exits with return code 1

2021-07-21 Thread GitBox
uranusjr edited a comment on issue #17124: URL: https://github.com/apache/airflow/issues/17124#issuecomment-884005562 The task still seems to work though? It’s marked as success and that’s what’s important to Airflow. The `on_success_callback()` does not check the return code, only the

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #17128: Update graph.css

2021-07-21 Thread GitBox
boring-cyborg[bot] commented on pull request #17128: URL: https://github.com/apache/airflow/pull/17128#issuecomment-884017325 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[GitHub] [airflow] chenjiahui opened a new pull request #17128: Update graph.css

2021-07-21 Thread GitBox
chenjiahui opened a new pull request #17128: URL: https://github.com/apache/airflow/pull/17128 In some cases, the task_instancetask_instance gets a state of scheduled, so we need to provide a style for this state. Otherwise, we can't to know which node is currently in progress.

[GitHub] [airflow] uranusjr commented on issue #17123: sqlalchemy.exc.OperationalError: (psycopg2.errors.UndefinedFile) could not open file

2021-07-21 Thread GitBox
uranusjr commented on issue #17123: URL: https://github.com/apache/airflow/issues/17123#issuecomment-883938505 Hi, you did not provide any information about your error! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [airflow] potiuk closed issue #17123: sqlalchemy.exc.OperationalError: (psycopg2.errors.UndefinedFile) could not open file

2021-07-21 Thread GitBox
potiuk closed issue #17123: URL: https://github.com/apache/airflow/issues/17123 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] boring-cyborg[bot] commented on issue #17124: AwsBatchOperator on v2.1.x exits with return code 1

2021-07-21 Thread GitBox
boring-cyborg[bot] commented on issue #17124: URL: https://github.com/apache/airflow/issues/17124#issuecomment-883972671 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] kushagra391 opened a new issue #17124: AwsBatchOperator on v2.1.x exits with return code 1

2021-07-21 Thread GitBox
kushagra391 opened a new issue #17124: URL: https://github.com/apache/airflow/issues/17124 **Apache Airflow version**: 2.1.1 **Kubernetes version (if you are using kubernetes)** (use `kubectl version`): 1.19 **Environment**: - **Cloud provider or hardware

[GitHub] [airflow] Lyalpha commented on issue #8494: TriggerDagOperator sometimes causes database to trigger UniqueViolation constraint

2021-07-21 Thread GitBox
Lyalpha commented on issue #8494: URL: https://github.com/apache/airflow/issues/8494#issuecomment-884022861 There has been no fix of this, so I expect it is the same in 2.x, although I don't have a MWE to check. * The CLI does not expose a way to trigger the same dag >1/second * Even

[GitHub] [airflow] github-actions[bot] commented on pull request #17117: Made S3ToRedshiftOperator transaction safe

2021-07-21 Thread GitBox
github-actions[bot] commented on pull request #17117: URL: https://github.com/apache/airflow/pull/17117#issuecomment-884045975 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not

[GitHub] [airflow] kushagra391 commented on issue #17124: AwsBatchOperator on v2.1.x exits with return code 1

2021-07-21 Thread GitBox
kushagra391 commented on issue #17124: URL: https://github.com/apache/airflow/issues/17124#issuecomment-884052102 thanks @uranusjr ! yea, the job does get marked success. And i just tested callbacks on a test dag. It seems to be working fine. Closing the issue, I'll debug my

[GitHub] [airflow] kushagra391 closed issue #17124: AwsBatchOperator on v2.1.x exits with return code 1

2021-07-21 Thread GitBox
kushagra391 closed issue #17124: URL: https://github.com/apache/airflow/issues/17124 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] github-actions[bot] commented on pull request #17125: Fix bool conversion Verify parameter in Tableau Hook

2021-07-21 Thread GitBox
github-actions[bot] commented on pull request #17125: URL: https://github.com/apache/airflow/pull/17125#issuecomment-884094993 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not

[GitHub] [airflow] kaxil commented on a change in pull request #17121: [WIP] Deactivating DAGs which have been removed from files

2021-07-21 Thread GitBox
kaxil commented on a change in pull request #17121: URL: https://github.com/apache/airflow/pull/17121#discussion_r673891843 ## File path: airflow/dag_processing/processor.py ## @@ -618,6 +619,8 @@ def process_file( Stats.incr('dag_file_refresh_error', 1, 1)

[GitHub] [airflow] potiuk closed issue #17037: Status of testing Providers that were prepared on July 15, 2021

2021-07-21 Thread GitBox
potiuk closed issue #17037: URL: https://github.com/apache/airflow/issues/17037 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on issue #17037: Status of testing Providers that were prepared on July 15, 2021

2021-07-21 Thread GitBox
potiuk commented on issue #17037: URL: https://github.com/apache/airflow/issues/17037#issuecomment-884119589 There were quite a bit too many problems with this wave, I am going to release a second rc2 wave with all the providers with fixes soon (plus few more changes). Closing this one

[GitHub] [airflow] kaxil merged pull request #17041: Chart: Update ``postgres`` subchart to ``10.5.3``

2021-07-21 Thread GitBox
kaxil merged pull request #17041: URL: https://github.com/apache/airflow/pull/17041 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] kaxil commented on pull request #17125: Fix bool conversion Verify parameter in Tableau Hook

2021-07-21 Thread GitBox
kaxil commented on pull request #17125: URL: https://github.com/apache/airflow/pull/17125#issuecomment-884095718 I am ok we do this in follow up PR too but we should definitely do it i.e replace strtobool -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] ephraimbuddy commented on a change in pull request #17122: AIP-39: Add schedule_date to OpenAPI DAGRun schema

2021-07-21 Thread GitBox
ephraimbuddy commented on a change in pull request #17122: URL: https://github.com/apache/airflow/pull/17122#discussion_r673885918 ## File path: airflow/api_connexion/endpoints/dag_run_endpoint.py ## @@ -242,24 +242,34 @@ def post_dag_run(dag_id, session): except

[GitHub] [airflow] ciancolo commented on issue #17037: Status of testing Providers that were prepared on July 15, 2021

2021-07-21 Thread GitBox
ciancolo commented on issue #17037: URL: https://github.com/apache/airflow/issues/17037#issuecomment-884037636 Tested #16350 on my local Sqoop env and it works as expected -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [airflow] fjetter commented on a change in pull request #16829: Queue support for DaskExecutor using Dask Worker Resources

2021-07-21 Thread GitBox
fjetter commented on a change in pull request #16829: URL: https://github.com/apache/airflow/pull/16829#discussion_r673811608 ## File path: airflow/executors/dask_executor.py ## @@ -81,7 +81,22 @@ def airflow_run(): if not self.client: raise

[GitHub] [airflow] uranusjr commented on issue #17129: All tasks fail on logging to a Windows drive (Kubernetes-Multipass-Microk8s on Windows host)

2021-07-21 Thread GitBox
uranusjr commented on issue #17129: URL: https://github.com/apache/airflow/issues/17129#issuecomment-884044784 I mentioned in https://github.com/apache/airflow/pull/16110#discussion_r640487904 we should just replace the `:` with `_`. Would you be interested in creating a pull request for

[GitHub] [airflow] aa1371 commented on a change in pull request #16829: Queue support for DaskExecutor using Dask Worker Resources

2021-07-21 Thread GitBox
aa1371 commented on a change in pull request #16829: URL: https://github.com/apache/airflow/pull/16829#discussion_r673831944 ## File path: airflow/executors/dask_executor.py ## @@ -81,7 +81,22 @@ def airflow_run(): if not self.client: raise

[GitHub] [airflow] kushagra391 commented on issue #17124: AwsBatchOperator on v2.1.x exits with return code 1

2021-07-21 Thread GitBox
kushagra391 commented on issue #17124: URL: https://github.com/apache/airflow/issues/17124#issuecomment-884070878 found the issue, for some reason, this does not call callbacks on v2.x (but worked fine v1.x) ``` class RWBatchOperator(AwsBatchOperator, AATBaseOperator):

[airflow] branch main updated (eb3d685 -> 96fd413)

2021-07-21 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from eb3d685 Correct the :mod: documentation for s3_to_redshift_operator (#17115) add 96fd413 Chart: Update

[airflow] branch main updated: Fix bool conversion Verify parameter in Tableau Hook (#17125)

2021-07-21 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new ef3c75d Fix bool conversion Verify parameter in

[GitHub] [airflow] potiuk merged pull request #17125: Fix bool conversion Verify parameter in Tableau Hook

2021-07-21 Thread GitBox
potiuk merged pull request #17125: URL: https://github.com/apache/airflow/pull/17125 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] potiuk commented on pull request #17125: Fix bool conversion Verify parameter in Tableau Hook

2021-07-21 Thread GitBox
potiuk commented on pull request #17125: URL: https://github.com/apache/airflow/pull/17125#issuecomment-884121330 Random failures. Merging. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] uranusjr commented on pull request #17125: Fix bool conversion Verify parameter in Tableau Hook

2021-07-21 Thread GitBox
uranusjr commented on pull request #17125: URL: https://github.com/apache/airflow/pull/17125#issuecomment-884042661 We can’t just remove functionality due to backward compatibility policy—we could deprecate it, but still need to keep the logic. So something like this is probably good

[GitHub] [airflow] eladkal commented on pull request #17125: Fix bool conversion Verify parameter in Tableau Hook

2021-07-21 Thread GitBox
eladkal commented on pull request #17125: URL: https://github.com/apache/airflow/pull/17125#issuecomment-884107478 > We can’t just remove functionality due to backward compatibility policy—we could deprecate it, but still need to keep the logic Do we need deprecation? it was added

[GitHub] [airflow] ephraimbuddy commented on a change in pull request #17118: Use `dag_maker` fixture in test_backfill_job.py

2021-07-21 Thread GitBox
ephraimbuddy commented on a change in pull request #17118: URL: https://github.com/apache/airflow/pull/17118#discussion_r673890194 ## File path: tests/jobs/test_backfill_job.py ## @@ -290,13 +306,13 @@ def test_backfill_conf(self): dr =

[GitHub] [airflow] potiuk commented on issue #8494: TriggerDagOperator sometimes causes database to trigger UniqueViolation constraint

2021-07-21 Thread GitBox
potiuk commented on issue #8494: URL: https://github.com/apache/airflow/issues/8494#issuecomment-884118023 There has been a bit overhaul of DAG triggering in Airflow 2 and there is a different primary index on DagRun and we are also preparing for making "out-of-band" triggering a DagRun

[GitHub] [airflow] potiuk commented on issue #17037: Status of testing Providers that were prepared on July 15, 2021

2021-07-21 Thread GitBox
potiuk commented on issue #17037: URL: https://github.com/apache/airflow/issues/17037#issuecomment-884119793 > Check #17125 for the bug fix. Cool. Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [airflow] potiuk commented on pull request #17125: Fix bool conversion Verify parameter in Tableau Hook

2021-07-21 Thread GitBox
potiuk commented on pull request #17125: URL: https://github.com/apache/airflow/pull/17125#issuecomment-884120669 > > We can’t just remove functionality due to backward compatibility policy—we could deprecate it, but still need to keep the logic > > Do we need deprecation? it was

[GitHub] [airflow] potiuk commented on pull request #17125: Fix bool conversion Verify parameter in Tableau Hook

2021-07-21 Thread GitBox
potiuk commented on pull request #17125: URL: https://github.com/apache/airflow/pull/17125#issuecomment-884120867 I am going to release an rc2 wave of July Providers shortly. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [airflow] Lyalpha commented on issue #8494: TriggerDagOperator sometimes causes database to trigger UniqueViolation constraint

2021-07-21 Thread GitBox
Lyalpha commented on issue #8494: URL: https://github.com/apache/airflow/issues/8494#issuecomment-884126197 OK thanks, I am already on 2.x but indeed I don't know if any DB changes may have alleviated this as the fix I posted has meant I never saw it again for the remainder of 1.x (or

[GitHub] [airflow] uranusjr commented on a change in pull request #17121: [WIP] Deactivating DAGs which have been removed from files

2021-07-21 Thread GitBox
uranusjr commented on a change in pull request #17121: URL: https://github.com/apache/airflow/pull/17121#discussion_r673904932 ## File path: airflow/dag_processing/processor.py ## @@ -647,3 +650,17 @@ def process_file( self.log.exception("Error logging import

[GitHub] [airflow] GBAAM opened a new issue #17132: 2.1.2 (py 3.6 and 3.7) Docker Image broken

2021-07-21 Thread GitBox
GBAAM opened a new issue #17132: URL: https://github.com/apache/airflow/issues/17132 The Docker Image for 2.1.2 (default Python 3.6 https://airflow.apache.org/docs/apache-airflow/2.1.2/docker-compose.yaml) is missing a few python packages: - `celery` - `redis` -

[GitHub] [airflow] boring-cyborg[bot] commented on issue #17132: 2.1.2 (py 3.6 and 3.7) Docker Image broken

2021-07-21 Thread GitBox
boring-cyborg[bot] commented on issue #17132: URL: https://github.com/apache/airflow/issues/17132#issuecomment-884131226 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] pmalafosse commented on issue #17037: Status of testing Providers that were prepared on July 15, 2021

2021-07-21 Thread GitBox
pmalafosse commented on issue #17037: URL: https://github.com/apache/airflow/issues/17037#issuecomment-884130862 There is a bug with https://github.com/apache/airflow/pull/16685 I will create a fix by tomorrow -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [airflow] uranusjr commented on a change in pull request #17121: [WIP] Deactivating DAGs which have been removed from files

2021-07-21 Thread GitBox
uranusjr commented on a change in pull request #17121: URL: https://github.com/apache/airflow/pull/17121#discussion_r673904932 ## File path: airflow/dag_processing/processor.py ## @@ -647,3 +650,17 @@ def process_file( self.log.exception("Error logging import

[GitHub] [airflow] uranusjr commented on a change in pull request #17121: [WIP] Deactivating DAGs which have been removed from files

2021-07-21 Thread GitBox
uranusjr commented on a change in pull request #17121: URL: https://github.com/apache/airflow/pull/17121#discussion_r673904932 ## File path: airflow/dag_processing/processor.py ## @@ -647,3 +650,17 @@ def process_file( self.log.exception("Error logging import

[GitHub] [airflow] uranusjr commented on a change in pull request #17122: AIP-39: Add schedule_date to OpenAPI DAGRun schema

2021-07-21 Thread GitBox
uranusjr commented on a change in pull request #17122: URL: https://github.com/apache/airflow/pull/17122#discussion_r673915763 ## File path: airflow/api_connexion/endpoints/dag_run_endpoint.py ## @@ -242,24 +242,34 @@ def post_dag_run(dag_id, session): except

[GitHub] [airflow] fjetter commented on a change in pull request #16829: Queue support for DaskExecutor using Dask Worker Resources

2021-07-21 Thread GitBox
fjetter commented on a change in pull request #16829: URL: https://github.com/apache/airflow/pull/16829#discussion_r673923845 ## File path: airflow/executors/dask_executor.py ## @@ -81,7 +81,22 @@ def airflow_run(): if not self.client: raise

[GitHub] [airflow] wavewater opened a new issue #17135: ExasolHook get_pandas_df does not return pandas dataframe but None

2021-07-21 Thread GitBox
wavewater opened a new issue #17135: URL: https://github.com/apache/airflow/issues/17135 When calling the exasol hooks get_pandas_df function (https://github.com/apache/airflow/blob/main/airflow/providers/exasol/hooks/exasol.py) I noticed that it does not return a pandas dataframe. It

[GitHub] [airflow] kaxil commented on pull request #17133: Warn on Webserver when using ``SQLite`` or ``SequentialExecutor``

2021-07-21 Thread GitBox
kaxil commented on pull request #17133: URL: https://github.com/apache/airflow/pull/17133#issuecomment-884175587 > Is there a way to disable these and maybe set it in breeze? It’d be a bit annoying to see it show up when I’m absolutely just testing things… I can make it so that you

[GitHub] [airflow] boring-cyborg[bot] commented on issue #17135: ExasolHook get_pandas_df does not return pandas dataframe but None

2021-07-21 Thread GitBox
boring-cyborg[bot] commented on issue #17135: URL: https://github.com/apache/airflow/issues/17135#issuecomment-884175515 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] ryanahamilton commented on a change in pull request #17128: Update graph.css

2021-07-21 Thread GitBox
ryanahamilton commented on a change in pull request #17128: URL: https://github.com/apache/airflow/pull/17128#discussion_r673961455 ## File path: airflow/www/static/css/graph.css ## @@ -136,6 +136,10 @@ g.node.queued rect { stroke: grey; } +g.node.scheduled rect{ +

[GitHub] [airflow] GBAAM commented on issue #17132: 2.1.2 (py 3.6 and 3.8) Docker Image broken

2021-07-21 Thread GitBox
GBAAM commented on issue #17132: URL: https://github.com/apache/airflow/issues/17132#issuecomment-884188597 Addition: in the 3.8 image, the dependency `libpq-dev` is also missing -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] kaxil commented on a change in pull request #17121: [WIP] Deactivating DAGs which have been removed from files

2021-07-21 Thread GitBox
kaxil commented on a change in pull request #17121: URL: https://github.com/apache/airflow/pull/17121#discussion_r673974267 ## File path: airflow/dag_processing/processor.py ## @@ -647,3 +650,17 @@ def process_file( self.log.exception("Error logging import

[GitHub] [airflow] kaxil opened a new pull request #17136: Add missing changelog entry for 2.1.2

2021-07-21 Thread GitBox
kaxil opened a new pull request #17136: URL: https://github.com/apache/airflow/pull/17136 This change was missing from changelog, potentially because of bad commit message "yarn audit" (https://github.com/apache/airflow/commit/9b0b0c68f6db940b16037be8dd7c1884ce6f1a87) ---

[GitHub] [airflow] kaxil edited a comment on issue #15364: There is a vulnerability in jquery 3.4.1 ,upgrade recommended

2021-07-21 Thread GitBox
kaxil edited a comment on issue #15364: URL: https://github.com/apache/airflow/issues/15364#issuecomment-884197549 @HardikVijayPatel This is available in 2.1.2 -- looks like because of the bad commit message it wasn't captured in Changelog --

[GitHub] [airflow] wavewater commented on issue #17135: ExasolHook get_pandas_df does not return pandas dataframe but None

2021-07-21 Thread GitBox
wavewater commented on issue #17135: URL: https://github.com/apache/airflow/issues/17135#issuecomment-884200313 sure - it will be my first pull request. Can you guide me? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [airflow] github-actions[bot] commented on pull request #17034: Refactored waiting function for Tableau Jobs

2021-07-21 Thread GitBox
github-actions[bot] commented on pull request #17034: URL: https://github.com/apache/airflow/pull/17034#issuecomment-884139528 The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not

[GitHub] [airflow] github-actions[bot] commented on pull request #17118: Use `dag_maker` fixture in test_backfill_job.py

2021-07-21 Thread GitBox
github-actions[bot] commented on pull request #17118: URL: https://github.com/apache/airflow/pull/17118#issuecomment-884140176 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and

[GitHub] [airflow] hx-markterry commented on a change in pull request #16338: SFTP hook to prefer the SSH paramiko key over the key file path

2021-07-21 Thread GitBox
hx-markterry commented on a change in pull request #16338: URL: https://github.com/apache/airflow/pull/16338#discussion_r673915248 ## File path: airflow/providers/sftp/hooks/sftp.py ## @@ -135,8 +135,13 @@ def get_conn(self) -> pysftp.Connection: } if

[airflow] branch main updated (ef3c75d -> 29b6be8)

2021-07-21 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from ef3c75d Fix bool conversion Verify parameter in Tableau Hook (#17125) add 29b6be8 Refactored waiting function

[GitHub] [airflow] eladkal merged pull request #17034: Refactored waiting function for Tableau Jobs

2021-07-21 Thread GitBox
eladkal merged pull request #17034: URL: https://github.com/apache/airflow/pull/17034 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] namjals commented on issue #17127: Airflow 2.1.0 with Schedulers HA Failing

2021-07-21 Thread GitBox
namjals commented on issue #17127: URL: https://github.com/apache/airflow/issues/17127#issuecomment-884149426 It looks like you are not getting the lock. How about accessing the installed mysql server by referring to the site below and checking if queries such as select and insert are

[GitHub] [airflow] kaxil opened a new pull request #17133: Warn on Webserver when using ``SQLite`` or ``SequentialExecutor``

2021-07-21 Thread GitBox
kaxil opened a new pull request #17133: URL: https://github.com/apache/airflow/pull/17133 ![image](https://user-images.githubusercontent.com/8811558/126488077-dcdb4964-3df3-4795-9c94-f6a29709e66c.png) --- **^ Add meaningful description above** Read the

[GitHub] [airflow] uranusjr commented on pull request #17133: Warn on Webserver when using ``SQLite`` or ``SequentialExecutor``

2021-07-21 Thread GitBox
uranusjr commented on pull request #17133: URL: https://github.com/apache/airflow/pull/17133#issuecomment-884159915 Is there a way to disable these and maybe set it in breeze? It’d be a bit annoying to see it show up when I’m absolutely just testing things… -- This is an automated

[GitHub] [airflow] uranusjr commented on issue #17124: AwsBatchOperator on v2.1.x exits with return code 1

2021-07-21 Thread GitBox
uranusjr commented on issue #17124: URL: https://github.com/apache/airflow/issues/17124#issuecomment-884164870 Oh that makes sense, this is related to how multi-inheritance works in Python (method resolution order, aka MRO). Airflow 2 uses a different kind of inheritance magic (metaclass)

[GitHub] [airflow] rv-irosario commented on issue #17111: apache-airflow-providers-google: google-ads-12.0.0

2021-07-21 Thread GitBox
rv-irosario commented on issue #17111: URL: https://github.com/apache/airflow/issues/17111#issuecomment-884177034 looks like the tag of 12.0.0 is the last compatible tag for 3.6 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] uranusjr commented on pull request #17133: Warn on Webserver when using ``SQLite`` or ``SequentialExecutor``

2021-07-21 Thread GitBox
uranusjr commented on pull request #17133: URL: https://github.com/apache/airflow/pull/17133#issuecomment-884178339 Sounds good to me -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] kaxil commented on a change in pull request #17121: [WIP] Deactivating DAGs which have been removed from files

2021-07-21 Thread GitBox
kaxil commented on a change in pull request #17121: URL: https://github.com/apache/airflow/pull/17121#discussion_r673959161 ## File path: airflow/dag_processing/processor.py ## @@ -647,3 +650,17 @@ def process_file( self.log.exception("Error logging import

[GitHub] [airflow] kaxil edited a comment on issue #15364: There is a vulnerability in jquery 3.4.1 ,upgrade recommended

2021-07-21 Thread GitBox
kaxil edited a comment on issue #15364: URL: https://github.com/apache/airflow/issues/15364#issuecomment-884197549 @HardikVijayPatel This is available in 2.1.2 -- looks like because of the bad commit message it wasn't captured in Changelog --

[GitHub] [airflow] kaxil commented on issue #15364: There is a vulnerability in jquery 3.4.1 ,upgrade recommended

2021-07-21 Thread GitBox
kaxil commented on issue #15364: URL: https://github.com/apache/airflow/issues/15364#issuecomment-884197549 @HardikVijayPatel This is available in 2.1.2 -- looks like because of the bad commit message it wasn't captured in Changelog --

[GitHub] [airflow] Lyalpha edited a comment on issue #8494: TriggerDagOperator sometimes causes database to trigger UniqueViolation constraint

2021-07-21 Thread GitBox
Lyalpha edited a comment on issue #8494: URL: https://github.com/apache/airflow/issues/8494#issuecomment-884126197 OK thanks, I am already on 2.x but indeed I don't know if any DB changes may have alleviated this as the ~~fix~~ workaround I posted has meant I never saw it again for the

[GitHub] [airflow] uranusjr commented on issue #8494: TriggerDagOperator sometimes causes database to trigger UniqueViolation constraint

2021-07-21 Thread GitBox
uranusjr commented on issue #8494: URL: https://github.com/apache/airflow/issues/8494#issuecomment-884129669 Also iirc the metadatabase is currently running on sub-millisecond precision, so even if this is still an issue (and I am not sure about that), it’s probably significantly more

[GitHub] [airflow] uranusjr commented on a change in pull request #17118: Use `dag_maker` fixture in test_backfill_job.py

2021-07-21 Thread GitBox
uranusjr commented on a change in pull request #17118: URL: https://github.com/apache/airflow/pull/17118#discussion_r673911401 ## File path: tests/jobs/test_backfill_job.py ## @@ -290,13 +306,13 @@ def test_backfill_conf(self): dr =

[GitHub] [airflow] uranusjr commented on a change in pull request #17118: Use `dag_maker` fixture in test_backfill_job.py

2021-07-21 Thread GitBox
uranusjr commented on a change in pull request #17118: URL: https://github.com/apache/airflow/pull/17118#discussion_r673914099 ## File path: tests/jobs/test_backfill_job.py ## @@ -919,9 +895,9 @@ def test_backfill_max_limit_check_within_limit(self): assert 2 ==

[GitHub] [airflow] pateash commented on pull request #16931: #16692 show cron description in UI

2021-07-21 Thread GitBox
pateash commented on pull request #16931: URL: https://github.com/apache/airflow/pull/16931#issuecomment-884180567 > The problem is we can’t store the timetable object in db (at least not easily; it’s technically doable but should be avoided). Maybe we can pre-render the description and

[GitHub] [airflow] uranusjr commented on issue #17135: ExasolHook get_pandas_df does not return pandas dataframe but None

2021-07-21 Thread GitBox
uranusjr commented on issue #17135: URL: https://github.com/apache/airflow/issues/17135#issuecomment-884180729 Hi, would you be interested in putting together a pull request for this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] lwyszomi opened a new pull request #17137: [Airflow 13779] use provided parameters in the wait_for_pipeline_state hook

2021-07-21 Thread GitBox
lwyszomi opened a new pull request #17137: URL: https://github.com/apache/airflow/pull/17137 Related: https://github.com/apache/airflow/issues/13779 Give a possibility to run `wait_for_pipeline_state` with default or provided parameters, remove unnecessary call inside

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #17137: [Airflow 13779] use provided parameters in the wait_for_pipeline_state hook

2021-07-21 Thread GitBox
boring-cyborg[bot] commented on pull request #17137: URL: https://github.com/apache/airflow/pull/17137#issuecomment-884206185 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[GitHub] [airflow] m1racoli edited a comment on issue #16243: When triggering a job via airfow UI, job fails abruptly with Negsignal.SIGSEGV

2021-07-21 Thread GitBox
m1racoli edited a comment on issue #16243: URL: https://github.com/apache/airflow/issues/16243#issuecomment-884202100 @iostreamdoth @potiuk Using `grpcio<=1.30` certainly helps, but I am not sure if the topic can be considered closed. Version 1.30.0 of grpc is over a year old and

[GitHub] [airflow] m1racoli edited a comment on issue #16243: When triggering a job via airfow UI, job fails abruptly with Negsignal.SIGSEGV

2021-07-21 Thread GitBox
m1racoli edited a comment on issue #16243: URL: https://github.com/apache/airflow/issues/16243#issuecomment-884202100 @iostreamdoth @potiuk Using `grpcio<=1.30` certainly helps, but I am not sure if the topic can be considered closed. Version 1.30.0 of grpc is over a year old and

[GitHub] [airflow] kaxil commented on pull request #16915: New generic tableau operator: TableauOperator

2021-07-21 Thread GitBox
kaxil commented on pull request #16915: URL: https://github.com/apache/airflow/pull/16915#issuecomment-884212370 There are some conflicts, can you please resolve that -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[airflow] branch main updated (29b6be8 -> 038b87e)

2021-07-21 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git. from 29b6be8 Refactored waiting function for Tableau Jobs (#17034) add 038b87e Add missing changelog entry for

[GitHub] [airflow] AvniM commented on issue #17054: Unable to trigger a DAG run via stable rest api

2021-07-21 Thread GitBox
AvniM commented on issue #17054: URL: https://github.com/apache/airflow/issues/17054#issuecomment-884234504 @ephraimbuddy: The output is `airflow@airflow-webserver-78dd8ff445-zdm62:/$ echo $AIRFLOW_HOME` `/opt/airflow` -- This is an automated message from the Apache Git Service.

[GitHub] [airflow] m1racoli commented on issue #16243: When triggering a job via airfow UI, job fails abruptly with Negsignal.SIGSEGV

2021-07-21 Thread GitBox
m1racoli commented on issue #16243: URL: https://github.com/apache/airflow/issues/16243#issuecomment-884202100 @potiuk Using `grpcio<=1.30` certainly helps, but I am not sure if the topic can be considered closed. Version 1.30.0 of grpc is over a year old and currently there's no

[GitHub] [airflow] github-actions[bot] commented on pull request #17136: Add missing changelog entry for 2.1.2

2021-07-21 Thread GitBox
github-actions[bot] commented on pull request #17136: URL: https://github.com/apache/airflow/pull/17136#issuecomment-884202974 The PR is likely ready to be merged. No tests are needed as no important environment files, nor python files were modified by it. However, committers might decide

[GitHub] [airflow] m1racoli edited a comment on issue #16243: When triggering a job via airfow UI, job fails abruptly with Negsignal.SIGSEGV

2021-07-21 Thread GitBox
m1racoli edited a comment on issue #16243: URL: https://github.com/apache/airflow/issues/16243#issuecomment-884202100 @iostreamdoth @potiuk Using `grpcio<=1.30` certainly helps, but I am not sure if the topic can be considered closed. Version 1.30.0 of grpc is over a year old and

[GitHub] [airflow] kaxil merged pull request #17136: Add missing changelog entry for 2.1.2

2021-07-21 Thread GitBox
kaxil merged pull request #17136: URL: https://github.com/apache/airflow/pull/17136 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [airflow] kaxil commented on pull request #16754: Only allow webserver to request from the worker log server

2021-07-21 Thread GitBox
kaxil commented on pull request #16754: URL: https://github.com/apache/airflow/pull/16754#issuecomment-884217602 > I also faced the same issue and was not able to solve it, I downgraded to 2.1.1 in the chart for now. > Can we create a Issue and track it for 2.1.3 Yup, we will

[GitHub] [airflow] SamWheating commented on a change in pull request #17121: [WIP] Deactivating DAGs which have been removed from files

2021-07-21 Thread GitBox
SamWheating commented on a change in pull request #17121: URL: https://github.com/apache/airflow/pull/17121#discussion_r674009622 ## File path: airflow/dag_processing/processor.py ## @@ -618,6 +619,8 @@ def process_file( Stats.incr('dag_file_refresh_error', 1, 1)

[GitHub] [airflow] uranusjr commented on issue #17135: ExasolHook get_pandas_df does not return pandas dataframe but None

2021-07-21 Thread GitBox
uranusjr commented on issue #17135: URL: https://github.com/apache/airflow/issues/17135#issuecomment-884260770 Sure, let's see what we can do. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] boring-cyborg[bot] commented on issue #17138: NON_FAILED trigger rule does not work as expected.

2021-07-21 Thread GitBox
boring-cyborg[bot] commented on issue #17138: URL: https://github.com/apache/airflow/issues/17138#issuecomment-884261651 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] scrawfor opened a new issue #17138: NON_FAILED trigger rule does not work as expected.

2021-07-21 Thread GitBox
scrawfor opened a new issue #17138: URL: https://github.com/apache/airflow/issues/17138 **Apache Airflow version**: 2.1.2 **Environment**: - **Cloud provider or hardware configuration**: Docker Image: apache/airflow:2.1.2-python3.8 - **OS** (e.g. from /etc/os-release):

  1   2   3   >