[GitHub] [airflow] github-actions[bot] commented on pull request #10917: WIP: Fix race conditions in task callback invocations

2020-10-24 Thread GitBox
github-actions[bot] commented on pull request #10917: URL: https://github.com/apache/airflow/pull/10917#issuecomment-716092955 [The Workflow run](https://github.com/apache/airflow/actions/runs/326856968) is cancelling this PR. It has some failed jobs matching ^Pylint$,^Static

[GitHub] [airflow] jmelot commented on issue #11040: Create ChainBetwenDAGAndOperatorNotAllowedRule to ease upgrade to Airflow 2.0

2020-10-24 Thread GitBox
jmelot commented on issue #11040: URL: https://github.com/apache/airflow/issues/11040#issuecomment-716090764 Thanks, and sorry for taking so long to follow up. I [implemented a rule](https://github.com/jmelot/airflow/commit/d9a109952d9bec5b7dc6e7db10001dd69a7e796d) for this that parses

[GitHub] [airflow] mik-laj commented on a change in pull request #11693: Add Python Helm testing framework

2020-10-24 Thread GitBox
mik-laj commented on a change in pull request #11693: URL: https://github.com/apache/airflow/pull/11693#discussion_r511528599 ## File path: .github/workflows/ci.yml ## @@ -424,6 +428,52 @@ jobs: name: airflow-provider-readmes path:

[GitHub] [airflow] mik-laj commented on issue #8088: Auto-generate installation.rst

2020-10-24 Thread GitBox
mik-laj commented on issue #8088: URL: https://github.com/apache/airflow/issues/8088#issuecomment-716066856 > 'async': async_packages, async is a restricted keyword in python. You cannot create a variable with this name, but it can be the name of a key in the dictionary.

[GitHub] [airflow] mik-laj edited a comment on issue #8088: Auto-generate installation.rst

2020-10-24 Thread GitBox
mik-laj edited a comment on issue #8088: URL: https://github.com/apache/airflow/issues/8088#issuecomment-716066856 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [airflow] mik-laj edited a comment on pull request #11793: [AIRFLOW-8664] Postgres to GCS operator - use named cursor

2020-10-24 Thread GitBox
mik-laj edited a comment on pull request #11793: URL: https://github.com/apache/airflow/pull/11793#issuecomment-716057427 I like this change very much, but I would like to test it before merging. Can you add system tests to make this easier?

[GitHub] [airflow] mik-laj commented on pull request #11793: [AIRFLOW-8664] Postgres to GCS operator - use named cursor

2020-10-24 Thread GitBox
mik-laj commented on pull request #11793: URL: https://github.com/apache/airflow/pull/11793#issuecomment-716057427 I like this change very much, but I would like to test it before merging. Can you add system tests to make this easier?

[GitHub] [airflow] mik-laj commented on pull request #11693: Add Python Helm testing framework

2020-10-24 Thread GitBox
mik-laj commented on pull request #11693: URL: https://github.com/apache/airflow/pull/11693#issuecomment-716051619 Can you also add docs about running these tests? This is an automated message from the Apache Git Service. To

[GitHub] [airflow] github-actions[bot] commented on pull request #11748: Checks if all the libraries in setup.py are listed in installation.rst file

2020-10-24 Thread GitBox
github-actions[bot] commented on pull request #11748: URL: https://github.com/apache/airflow/pull/11748#issuecomment-716049929 [The Workflow run](https://github.com/apache/airflow/actions/runs/326379487) is cancelling this PR. It has some failed jobs matching ^Pylint$,^Static

[GitHub] [airflow] potiuk commented on a change in pull request #11467: Add docs about Scheduler HA, how to use it and DB requirements

2020-10-24 Thread GitBox
potiuk commented on a change in pull request #11467: URL: https://github.com/apache/airflow/pull/11467#discussion_r511504146 ## File path: docs/scheduler.rst ## @@ -65,3 +65,72 @@ If you want to use 'external trigger' to run future-dated execution dates, set ` This only has

[GitHub] [airflow] richard-williamson commented on a change in pull request #11467: Add docs about Scheduler HA, how to use it and DB requirements

2020-10-24 Thread GitBox
richard-williamson commented on a change in pull request #11467: URL: https://github.com/apache/airflow/pull/11467#discussion_r511502978 ## File path: docs/scheduler.rst ## @@ -65,3 +65,72 @@ If you want to use 'external trigger' to run future-dated execution dates, set `

[GitHub] [airflow] dimberman commented on a change in pull request #11693: Add Python Helm testing framework

2020-10-24 Thread GitBox
dimberman commented on a change in pull request #11693: URL: https://github.com/apache/airflow/pull/11693#discussion_r511500739 ## File path: scripts/ci/kubernetes/ci_run_helm_testing.sh ## @@ -18,7 +18,28 @@ echo "Running helm tests" +. "$( dirname "${BASH_SOURCE[0]}"

[GitHub] [airflow] potiuk commented on issue #8088: Auto-generate installation.rst

2020-10-24 Thread GitBox
potiuk commented on issue #8088: URL: https://github.com/apache/airflow/issues/8088#issuecomment-716035803 Great questions BTW! This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] potiuk edited a comment on issue #8088: Auto-generate installation.rst

2020-10-24 Thread GitBox
potiuk edited a comment on issue #8088: URL: https://github.com/apache/airflow/issues/8088#issuecomment-716035701 Q3: The "apache.atlas" is the new "official" name in 2.0. As all other apache external projects - they are all grouped in the "apache" subdirectory in providers and ultimate

[GitHub] [airflow] potiuk commented on issue #8088: Auto-generate installation.rst

2020-10-24 Thread GitBox
potiuk commented on issue #8088: URL: https://github.com/apache/airflow/issues/8088#issuecomment-716035701 Q3: The "apache.atlas" is the new "official" name in 2.0 (as all apache external projects - they are all grouped in the "apache" subdirectory in providers and ultimate goal when

[GitHub] [airflow] potiuk commented on pull request #11820: Retrieve PR labels from the associated PR

2020-10-24 Thread GitBox
potiuk commented on pull request #11820: URL: https://github.com/apache/airflow/pull/11820#issuecomment-716034430 In order to fully test #11828 I need to merge this one first - to start retrieving labels from PR in master "wokflow_runs". I tested it already in the "limited" version and

[GitHub] [airflow] szn commented on issue #8088: Auto-generate installation.rst

2020-10-24 Thread GitBox
szn commented on issue #8088: URL: https://github.com/apache/airflow/issues/8088#issuecomment-716031818 Next question: Some extras are defined in a `name: name` style (see `cloudant` below). Others define it's name and alias (see `atlas` below). And there is `async` extras which

[GitHub] [airflow] github-actions[bot] commented on pull request #11829: Add providers, operators, and hooks readmes

2020-10-24 Thread GitBox
github-actions[bot] commented on pull request #11829: URL: https://github.com/apache/airflow/pull/11829#issuecomment-716028444 [The Workflow run](https://github.com/apache/airflow/actions/runs/326215228) is cancelling this PR. It has some failed jobs matching ^Pylint$,^Static

[GitHub] [airflow] potiuk opened a new pull request #11831: Removes duplicates from DISABLED_INTEGRATIONS variable

2020-10-24 Thread GitBox
potiuk opened a new pull request #11831: URL: https://github.com/apache/airflow/pull/11831 Presto DB is checked several times but it also means that it is added several times to DISABLED_INTEGRATIONS in case it is not enabled. This commit fixes it. --- **^ Add

[GitHub] [airflow] potiuk commented on pull request #11826: Generated backport providers readmes/setup for 2020.10.29

2020-10-24 Thread GitBox
potiuk commented on pull request #11826: URL: https://github.com/apache/airflow/pull/11826#issuecomment-716021712 Hey @kaxil -> I think that one will be good. I need it to release the providers :) This is an automated

[GitHub] [airflow] pprzetacznik commented on issue #11654: Add `session_lifetime_hours`/`session_lifetime_minutes` to the configuration

2020-10-24 Thread GitBox
pprzetacznik commented on issue #11654: URL: https://github.com/apache/airflow/issues/11654#issuecomment-716019390 Just for the record, I believe that creating `webserver_config.py` file in the airflow home directory file with the following content may work. ```

[GitHub] [airflow] potiuk opened a new pull request #11830: Adds newly added fast CI jobs to "fail-fast" cancelling

2020-10-24 Thread GitBox
potiuk opened a new pull request #11830: URL: https://github.com/apache/airflow/pull/11830 We "fail-fast" the whole workflow run if we the queue is busy and we notice that there is a failing "fast" job - i.e. job that probably failed rather fast, and you will have to rerun the build

[GitHub] [airflow] github-actions[bot] commented on pull request #11829: Add providers, operators, and hooks readmes

2020-10-24 Thread GitBox
github-actions[bot] commented on pull request #11829: URL: https://github.com/apache/airflow/pull/11829#issuecomment-716004004 [The Workflow run](https://github.com/apache/airflow/actions/runs/326187966) is cancelling this PR. It has some failed jobs matching ^Pylint$,^Static

[GitHub] [airflow] github-actions[bot] commented on pull request #11815: Render k8s yaml for tasks via the Airflow UI

2020-10-24 Thread GitBox
github-actions[bot] commented on pull request #11815: URL: https://github.com/apache/airflow/pull/11815#issuecomment-716003988 [The Workflow run](https://github.com/apache/airflow/actions/runs/326187966) is cancelling this PR. It has some failed jobs matching ^Pylint$,^Static

[GitHub] [airflow] petedejoy commented on pull request #11829: Add providers, operators, and hooks readmes

2020-10-24 Thread GitBox
petedejoy commented on pull request #11829: URL: https://github.com/apache/airflow/pull/11829#issuecomment-716000932 Thanks @potiuk! Is that failing because I need to add a new line at the end of these files? This is an

[GitHub] [airflow] potiuk commented on pull request #11829: Add providers, operators, and hooks readmes

2020-10-24 Thread GitBox
potiuk commented on pull request #11829: URL: https://github.com/apache/airflow/pull/11829#issuecomment-71661 Just one EOF static check failiing :) This is an automated message from the Apache Git Service. To respond to

[GitHub] [airflow] potiuk commented on issue #8088: Auto-generate installation.rst

2020-10-24 Thread GitBox
potiuk commented on issue #8088: URL: https://github.com/apache/airflow/issues/8088#issuecomment-715997510 But it's up to you :) This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] potiuk edited a comment on issue #8088: Auto-generate installation.rst

2020-10-24 Thread GitBox
potiuk edited a comment on issue #8088: URL: https://github.com/apache/airflow/issues/8088#issuecomment-715995681 For the Q2 case. It might actually be easier if we separate out all the deprecated extras to a separate constant `DEPRECATED_EXTRAS_REQUIREMENTS`. We just need to make sure to

[GitHub] [airflow] potiuk commented on issue #8088: Auto-generate installation.rst

2020-10-24 Thread GitBox
potiuk commented on issue #8088: URL: https://github.com/apache/airflow/issues/8088#issuecomment-715995681 For the Q2 case. It might actually be easier if we separate out all the deprecated extras to a separate constant? `DEPRECATED_EXTRAS`. We just need to make sure to add those two

[GitHub] [airflow] potiuk commented on issue #8088: Auto-generate installation.rst

2020-10-24 Thread GitBox
potiuk commented on issue #8088: URL: https://github.com/apache/airflow/issues/8088#issuecomment-715994636 Good questions :) Q1: right Q2: remove is remove alias - should be indeed doubled in `installation.rst`

[GitHub] [airflow] petedejoy opened a new pull request #11829: Add providers, operators, and hooks readmes

2020-10-24 Thread GitBox
petedejoy opened a new pull request #11829: URL: https://github.com/apache/airflow/pull/11829 It took me quite a while to piece together how exactly operators, hooks, and providers would be released and distributed in Airflow 2.0 and beyond from various mailing list threads, AIPs, and

[GitHub] [airflow] kaxil commented on a change in pull request #11627: Add D205 pydocstyle check

2020-10-24 Thread GitBox
kaxil commented on a change in pull request #11627: URL: https://github.com/apache/airflow/pull/11627#discussion_r511490113 ## File path: airflow/providers/slack/operators/slack.py ## @@ -89,9 +92,9 @@ def execute(self, **kwargs): # noqa: D403 class

[GitHub] [airflow] potiuk commented on pull request #11828: Run only subset of tests for non approved prs

2020-10-24 Thread GitBox
potiuk commented on pull request #11828: URL: https://github.com/apache/airflow/pull/11828#issuecomment-715971599 @dimberman @ashb @kaxil @turbaszek -> once we have the labeling in place, this one limits not only the actual tests run but also the number of images prepared. We only need

[GitHub] [airflow] potiuk commented on pull request #11828: Run only subset of tests for non approved prs

2020-10-24 Thread GitBox
potiuk commented on pull request #11828: URL: https://github.com/apache/airflow/pull/11828#issuecomment-715970658 cc: @TobKed - > once we have the auto-labeling and re-triggering the workflow, this one implements only running one default combo of all tests.

[GitHub] [airflow] github-actions[bot] commented on pull request #11827: Migrate from helm-unittest to python unittest

2020-10-24 Thread GitBox
github-actions[bot] commented on pull request #11827: URL: https://github.com/apache/airflow/pull/11827#issuecomment-715970203 [The Workflow run](https://github.com/apache/airflow/actions/runs/326140717) is cancelling this PR. It has some failed jobs matching ^Pylint$,^Static

[GitHub] [airflow] potiuk opened a new pull request #11828: Run only subset of tests for non approved prs

2020-10-24 Thread GitBox
potiuk opened a new pull request #11828: URL: https://github.com/apache/airflow/pull/11828 This PR is an implementation of optimisation - to only run default values for build matrix in case PR does not have "Ready to Merge" label. Shortly this label will be automatically set when

[GitHub] [airflow] szn edited a comment on issue #8088: Auto-generate installation.rst

2020-10-24 Thread GitBox
szn edited a comment on issue #8088: URL: https://github.com/apache/airflow/issues/8088#issuecomment-715959080 I have a case needed to be clarified @mik-laj @potiuk: `setup.py:` ```python ... EXTRAS_REQUIREMENTS = { 'amazon': amazon, 'aws': amazon, # TODO:

[GitHub] [airflow] szn commented on issue #8088: Auto-generate installation.rst

2020-10-24 Thread GitBox
szn commented on issue #8088: URL: https://github.com/apache/airflow/issues/8088#issuecomment-715959080 I have a case needed to be clarified: `setup.py:` ```python ... EXTRAS_REQUIREMENTS = { 'amazon': amazon, 'aws': amazon, # TODO: remove this in Airflow 2.1

[GitHub] [airflow] ktrueda commented on a change in pull request #11627: Add D205 pydocstyle check

2020-10-24 Thread GitBox
ktrueda commented on a change in pull request #11627: URL: https://github.com/apache/airflow/pull/11627#discussion_r511485962 ## File path: airflow/providers/slack/operators/slack.py ## @@ -89,9 +92,9 @@ def execute(self, **kwargs): # noqa: D403 class

[GitHub] [airflow] github-actions[bot] commented on pull request #11826: Generated backport providers readmes/setup for 2020.10.29

2020-10-24 Thread GitBox
github-actions[bot] commented on pull request #11826: URL: https://github.com/apache/airflow/pull/11826#issuecomment-715938902 [The Workflow run](https://github.com/apache/airflow/actions/runs/326088693) is cancelling this PR. It has some failed jobs matching ^Pylint$,^Static

[GitHub] [airflow] mik-laj opened a new pull request #11827: Migrate from helm-unittest to python unittest

2020-10-24 Thread GitBox
mik-laj opened a new pull request #11827: URL: https://github.com/apache/airflow/pull/11827 I am waiting for the @dimberman 's change to be merged, but in the meantime I have converted all tests with an automated script. Part of: https://github.com/apache/airflow/issues/11657

[GitHub] [airflow] ktrueda commented on a change in pull request #11627: Add D205 pydocstyle check

2020-10-24 Thread GitBox
ktrueda commented on a change in pull request #11627: URL: https://github.com/apache/airflow/pull/11627#discussion_r511483765 ## File path: airflow/providers/slack/operators/slack.py ## @@ -89,9 +92,9 @@ def execute(self, **kwargs): # noqa: D403 class

[GitHub] [airflow] potiuk commented on pull request #11826: Generated backport providers readmes/setup for 2020.10.29

2020-10-24 Thread GitBox
potiuk commented on pull request #11826: URL: https://github.com/apache/airflow/pull/11826#issuecomment-715928427 BTW. I am releasing all of them due to the .tar.gz installability fix This is an automated message from the

[GitHub] [airflow] potiuk commented on pull request #11826: Generated backport providers readmes/setup for 2020.10.29

2020-10-24 Thread GitBox
potiuk commented on pull request #11826: URL: https://github.com/apache/airflow/pull/11826#issuecomment-715928281 Updaed with the archive URL fix This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] ktrueda commented on pull request #11627: Add D205 pydocstyle check

2020-10-24 Thread GitBox
ktrueda commented on pull request #11627: URL: https://github.com/apache/airflow/pull/11627#issuecomment-715927679 @kaxil Thank you for your suggestion very much!!  This is an automated message from the Apache

[airflow] branch master updated: Fix bug when marking tasks when DAG Serialization is enabled (#11803)

2020-10-24 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new 330cd42 Fix bug when marking tasks when

[GitHub] [airflow] kaxil merged pull request #11803: Fix bug when marking tasks when DAG Serialization is enabled

2020-10-24 Thread GitBox
kaxil merged pull request #11803: URL: https://github.com/apache/airflow/pull/11803 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] kaxil commented on pull request #11803: Fix bug when marking tasks when DAG Serialization is enabled

2020-10-24 Thread GitBox
kaxil commented on pull request #11803: URL: https://github.com/apache/airflow/pull/11803#issuecomment-715927237 > Shoudl we add some tests @kaxil ? Check the PR description  tests would be covered in #11335 where we update all the tests to enable DAG Serialization.

[airflow] branch master updated: Update download url for Airflow Providers Version (#11823)

2020-10-24 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new 97da08c Update download url for Airflow

[GitHub] [airflow] potiuk merged pull request #11823: Update download url for Airflow Providers Version

2020-10-24 Thread GitBox
potiuk merged pull request #11823: URL: https://github.com/apache/airflow/pull/11823 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[airflow] branch master updated (8d94214 -> f93175d)

2020-10-24 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 8d94214 Switch postgres from 10 to 13 (#11785) add f93175d Fix typo in scripts/in_container/entrypoint_ci.sh

[GitHub] [airflow] potiuk commented on pull request #11803: Fix bug when marking tasks when DAG Serialization is enabled

2020-10-24 Thread GitBox
potiuk commented on pull request #11803: URL: https://github.com/apache/airflow/pull/11803#issuecomment-715926874 Shoudl we add some tests @kaxil ? This is an automated message from the Apache Git Service. To respond to the

[airflow] branch master updated (8d94214 -> f93175d)

2020-10-24 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 8d94214 Switch postgres from 10 to 13 (#11785) add f93175d Fix typo in scripts/in_container/entrypoint_ci.sh

[GitHub] [airflow] potiuk merged pull request #11824: Fix typo in scripts/in_container/entrypoint_ci.sh

2020-10-24 Thread GitBox
potiuk merged pull request #11824: URL: https://github.com/apache/airflow/pull/11824 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] potiuk commented on pull request #11826: Generated backport providers readmes/setup for 2020.10.29

2020-10-24 Thread GitBox
potiuk commented on pull request #11826: URL: https://github.com/apache/airflow/pull/11826#issuecomment-715926604 I also standardised the names and capitalisation of the generated README/.py/config files. This is an

[GitHub] [airflow] potiuk opened a new pull request #11826: Generated backport providers readmes/setup for 2020.10.29

2020-10-24 Thread GitBox
potiuk opened a new pull request #11826: URL: https://github.com/apache/airflow/pull/11826 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#pull-request-guidelines)** for more

[GitHub] [airflow] kaxil commented on a change in pull request #11825: Fix spelling

2020-10-24 Thread GitBox
kaxil commented on a change in pull request #11825: URL: https://github.com/apache/airflow/pull/11825#discussion_r511462582 ## File path: airflow/providers/amazon/aws/operators/datasync.py ## @@ -199,7 +199,7 @@ def execute(self, context): if self.candidate_task_arns:

[jira] [Commented] (AIRFLOW-5071) Thousand os Executor reports task instance X finished (success) although the task says its queued. Was the task killed externally?

2020-10-24 Thread Richard Williamson (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17220106#comment-17220106 ] Richard Williamson commented on AIRFLOW-5071: - We were seeing this issue sporadically the

[GitHub] [airflow] github-actions[bot] removed a comment on pull request #11447: Use PyUpgrade to use Python 3.6 features

2020-10-24 Thread GitBox
github-actions[bot] removed a comment on pull request #11447: URL: https://github.com/apache/airflow/pull/11447#issuecomment-706778594 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] kaxil commented on a change in pull request #11627: Add D205 pydocstyle check

2020-10-24 Thread GitBox
kaxil commented on a change in pull request #11627: URL: https://github.com/apache/airflow/pull/11627#discussion_r511461221 ## File path: airflow/providers/slack/operators/slack.py ## @@ -159,8 +162,8 @@ def construct_api_call_params(self) -> Any: class

[GitHub] [airflow] kaxil commented on a change in pull request #11627: Add D205 pydocstyle check

2020-10-24 Thread GitBox
kaxil commented on a change in pull request #11627: URL: https://github.com/apache/airflow/pull/11627#discussion_r511460824 ## File path: airflow/providers/slack/operators/slack.py ## @@ -89,9 +92,9 @@ def execute(self, **kwargs): # noqa: D403 class

[GitHub] [airflow] kaxil commented on a change in pull request #11627: Add D205 pydocstyle check

2020-10-24 Thread GitBox
kaxil commented on a change in pull request #11627: URL: https://github.com/apache/airflow/pull/11627#discussion_r511460824 ## File path: airflow/providers/slack/operators/slack.py ## @@ -89,9 +92,9 @@ def execute(self, **kwargs): # noqa: D403 class

[GitHub] [airflow] pkonarzewski commented on issue #9957: dbapi_hook get_records doesn't accept list.

2020-10-24 Thread GitBox
pkonarzewski commented on issue #9957: URL: https://github.com/apache/airflow/issues/9957#issuecomment-715917177 So I've wrote some code to fix this issue, but now i have some doubts. It's a simple fix, but there is few corner cases, that make it a little bit messy for me. My

[GitHub] [airflow] kaxil commented on a change in pull request #11335: Make Dag Serialization a hard requirement

2020-10-24 Thread GitBox
kaxil commented on a change in pull request #11335: URL: https://github.com/apache/airflow/pull/11335#discussion_r511457675 ## File path: tests/jobs/test_scheduler_job.py ## @@ -1407,7 +1414,9 @@ def test_find_executable_task_instances_task_concurrency(self): # pylint: disab

[GitHub] [airflow] github-actions[bot] commented on pull request #11447: Use PyUpgrade to use Python 3.6 features

2020-10-24 Thread GitBox
github-actions[bot] commented on pull request #11447: URL: https://github.com/apache/airflow/pull/11447#issuecomment-715916889 [The Workflow run](https://github.com/apache/airflow/actions/runs/325975561) is cancelling this PR. It has some failed jobs matching ^Pylint$,^Static

[GitHub] [airflow] kaxil commented on a change in pull request #11335: Make Dag Serialization a hard requirement

2020-10-24 Thread GitBox
kaxil commented on a change in pull request #11335: URL: https://github.com/apache/airflow/pull/11335#discussion_r511457675 ## File path: tests/jobs/test_scheduler_job.py ## @@ -1407,7 +1414,9 @@ def test_find_executable_task_instances_task_concurrency(self): # pylint: disab

[GitHub] [airflow] mik-laj commented on a change in pull request #11802: Add Kubernetes cleanup-pods CLI command for Helm Chart

2020-10-24 Thread GitBox
mik-laj commented on a change in pull request #11802: URL: https://github.com/apache/airflow/pull/11802#discussion_r511456059 ## File path: airflow/cli/commands/kubernetes_command.py ## @@ -61,3 +63,64 @@ def generate_pod_yaml(args): sanitized_pod =

[GitHub] [airflow] mik-laj commented on a change in pull request #11802: Add Kubernetes cleanup-pods CLI command for Helm Chart

2020-10-24 Thread GitBox
mik-laj commented on a change in pull request #11802: URL: https://github.com/apache/airflow/pull/11802#discussion_r511453580 ## File path: airflow/cli/commands/kubernetes_command.py ## @@ -61,3 +63,64 @@ def generate_pod_yaml(args): sanitized_pod =

[GitHub] [airflow] jbampton opened a new pull request #11825: Fix spelling

2020-10-24 Thread GitBox
jbampton opened a new pull request #11825: URL: https://github.com/apache/airflow/pull/11825 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#pull-request-guidelines)** for more

[GitHub] [airflow] ashb commented on a change in pull request #11802: Add Kubernetes cleanup-pods CLI command for Helm Chart

2020-10-24 Thread GitBox
ashb commented on a change in pull request #11802: URL: https://github.com/apache/airflow/pull/11802#discussion_r511451685 ## File path: airflow/cli/commands/kubernetes_command.py ## @@ -61,3 +63,64 @@ def generate_pod_yaml(args): sanitized_pod =

[GitHub] [airflow] ashb commented on a change in pull request #11802: Add Kubernetes cleanup-pods CLI command for Helm Chart

2020-10-24 Thread GitBox
ashb commented on a change in pull request #11802: URL: https://github.com/apache/airflow/pull/11802#discussion_r511451313 ## File path: airflow/cli/commands/kubernetes_command.py ## @@ -61,3 +63,64 @@ def generate_pod_yaml(args): sanitized_pod =

[GitHub] [airflow] ashb commented on a change in pull request #11335: Make Dag Serialization a hard requirement

2020-10-24 Thread GitBox
ashb commented on a change in pull request #11335: URL: https://github.com/apache/airflow/pull/11335#discussion_r511450726 ## File path: tests/jobs/test_scheduler_job.py ## @@ -1407,7 +1414,9 @@ def test_find_executable_task_instances_task_concurrency(self): # pylint: disab

[GitHub] [airflow] kaxil opened a new pull request #11824: Fix typo in scripts/in_container/entrypoint_ci.sh

2020-10-24 Thread GitBox
kaxil opened a new pull request #11824: URL: https://github.com/apache/airflow/pull/11824 `xpessed` -> `xpassed` --- **^ Add meaningful description above** Read the **[Pull Request

[GitHub] [airflow] kaxil opened a new pull request #11823: Update download url for Airflow Providers Version

2020-10-24 Thread GitBox
kaxil opened a new pull request #11823: URL: https://github.com/apache/airflow/pull/11823 All the versions are available at https://archive.apache.org/dist/airflow/ and this link appears in https://pypi.org/project/apache-airflow/ --- **^ Add meaningful description

[GitHub] [airflow] mik-laj commented on pull request #11767: Fix: Removed password if HiveServer2Hook in LDAP or CUSTOM mode

2020-10-24 Thread GitBox
mik-laj commented on pull request #11767: URL: https://github.com/apache/airflow/pull/11767#issuecomment-715911628 Should we add test to avoid regression? This is an automated message from the Apache Git Service. To respond

[GitHub] [airflow] BhuviTheDataGuy commented on issue #11822: Python Operator - Get xcom_pull from a different task

2020-10-24 Thread GitBox
BhuviTheDataGuy commented on issue #11822: URL: https://github.com/apache/airflow/issues/11822#issuecomment-715910204 Hey @mik-laj Sure, Seems it's not resolving the template instead its passing the string as it is. ```sql select * from public.m1 where timestamp> {

[airflow] branch master updated (dff9c9a -> 8d94214)

2020-10-24 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from dff9c9a Fixes flaky test test_should_response_200_with_reset_dag_run (#11817) add 8d94214 Switch postgres

[airflow] branch master updated (dff9c9a -> 8d94214)

2020-10-24 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from dff9c9a Fixes flaky test test_should_response_200_with_reset_dag_run (#11817) add 8d94214 Switch postgres

[airflow] branch master updated (6ce855a -> dff9c9a)

2020-10-24 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 6ce855a Fix spelling (#11821) add dff9c9a Fixes flaky test test_should_response_200_with_reset_dag_run

[GitHub] [airflow] potiuk merged pull request #11785: Switch postgres from 10 to 13

2020-10-24 Thread GitBox
potiuk merged pull request #11785: URL: https://github.com/apache/airflow/pull/11785 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[airflow] branch master updated (6ce855a -> dff9c9a)

2020-10-24 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 6ce855a Fix spelling (#11821) add dff9c9a Fixes flaky test test_should_response_200_with_reset_dag_run

[airflow] branch master updated (aacf602 -> 6ce855a)

2020-10-24 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from aacf602 Fix spelling (#11457) add 6ce855a Fix spelling (#11821) No new revisions were added by this update.

[GitHub] [airflow] potiuk commented on pull request #11785: Switch postgres from 10 to 13

2020-10-24 Thread GitBox
potiuk commented on pull request #11785: URL: https://github.com/apache/airflow/pull/11785#issuecomment-715909129 Just random integration error failing . I will take a look at stability of the Open LDAP next. Seems that once it fails, it fails

[airflow] branch master updated: Fix spelling (#11821)

2020-10-24 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new 6ce855a Fix spelling (#11821) 6ce855a is

[jira] [Commented] (AIRFLOW-2075) Extract and create a data access layer

2020-10-24 Thread Richard Williamson (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17220079#comment-17220079 ] Richard Williamson commented on AIRFLOW-2075: - Can we re-open the more general version of

[GitHub] [airflow] potiuk merged pull request #11817: Fixes flaky test test_should_response_200_with_reset_dag_run

2020-10-24 Thread GitBox
potiuk merged pull request #11817: URL: https://github.com/apache/airflow/pull/11817 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] potiuk closed issue #11816: [QUARANTINE] Flaky test TestPostClearTaskInstances.test_should_response_200_with_reset_dag_run

2020-10-24 Thread GitBox
potiuk closed issue #11816: URL: https://github.com/apache/airflow/issues/11816 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] potiuk merged pull request #11821: Fix spelling

2020-10-24 Thread GitBox
potiuk merged pull request #11821: URL: https://github.com/apache/airflow/pull/11821 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [airflow] mik-laj commented on issue #11822: Python Operator - Get xcom_pull from a different task

2020-10-24 Thread GitBox
mik-laj commented on issue #11822: URL: https://github.com/apache/airflow/issues/11822#issuecomment-715908327 ```diff - params = {'table_name': table_name, 'maxdt': "{{ti.xcom_pull(task_ids='push_result_{}')}}.format(table_name)}", + params = {'table_name': table_name,

[GitHub] [airflow] BhuviTheDataGuy opened a new issue #11822: Python Operator - Get xcom_pull from a different task

2020-10-24 Thread GitBox
BhuviTheDataGuy opened a new issue #11822: URL: https://github.com/apache/airflow/issues/11822 I have a SQL file like below. ```sql select * from {{params.table_name }} where data > {{ params.maxdt }} ``` And Im calling a function from python operator. So I need to pass maxdt

[GitHub] [airflow] jbampton opened a new pull request #11821: Fix spelling

2020-10-24 Thread GitBox
jbampton opened a new pull request #11821: URL: https://github.com/apache/airflow/pull/11821 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#pull-request-guidelines)** for more

[GitHub] [airflow] potiuk commented on pull request #11820: Retrieve PR labels from the associated PR

2020-10-24 Thread GitBox
potiuk commented on pull request #11820: URL: https://github.com/apache/airflow/pull/11820#issuecomment-715895118 Works nicely here: In CI: https://github.com/potiuk/airflow/pull/134/checks?check_run_id=1301856214#step:2:595 In CI Build:

[GitHub] [airflow] potiuk commented on pull request #11820: Retrieve PR labels from the associated PR

2020-10-24 Thread GitBox
potiuk commented on pull request #11820: URL: https://github.com/apache/airflow/pull/11820#issuecomment-715895135 cc: @TobKed This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] potiuk opened a new pull request #11820: Retrieve PR labels from the associated PR

2020-10-24 Thread GitBox
potiuk opened a new pull request #11820: URL: https://github.com/apache/airflow/pull/11820 This change is needed to implement optimisation of running only limited version of the matrix tests for PRs that are not yet approved by committers. --- **^ Add meaningful

[airflow] branch master updated (e4adfd7 -> aacf602)

2020-10-24 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from e4adfd7 Add links to PyPI packages. (#11818) add aacf602 Fix spelling (#11457) No new revisions were added

[airflow] branch master updated (3934ef2 -> e4adfd7)

2020-10-24 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from 3934ef2 Remove redundant builtins imports (#11809) add e4adfd7 Add links to PyPI packages. (#11818) No new

[airflow] branch master updated (e4adfd7 -> aacf602)

2020-10-24 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git. from e4adfd7 Add links to PyPI packages. (#11818) add aacf602 Fix spelling (#11457) No new revisions were added

[airflow] branch master updated: Add links to PyPI packages. (#11818)

2020-10-24 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/master by this push: new e4adfd7 Add links to PyPI packages. (#11818)

[GitHub] [airflow] potiuk commented on pull request #11817: Fixes flaky test test_should_response_200_with_reset_dag_run

2020-10-24 Thread GitBox
potiuk commented on pull request #11817: URL: https://github.com/apache/airflow/pull/11817#issuecomment-715894285 @mik-laj - one flaky test less. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] potiuk merged pull request #11457: Fix spelling

2020-10-24 Thread GitBox
potiuk merged pull request #11457: URL: https://github.com/apache/airflow/pull/11457 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

  1   2   >