This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-4-test in repository https://gitbox.apache.org/repos/asf/airflow.git
commit 330f18d1bf922f3bcb102b340b4911afbadfa1b3 Author: Ephraim Anierobi <[email protected]> AuthorDate: Tue Sep 13 17:46:25 2022 +0100 Update Release Note --- RELEASE_NOTES.rst | 494 ++++++++++++++++++++- .../ci/pre_commit/pre_commit_version_heads_map.py | 2 +- 2 files changed, 489 insertions(+), 7 deletions(-) diff --git a/RELEASE_NOTES.rst b/RELEASE_NOTES.rst index 8663f278fb..0e0db5e7dc 100644 --- a/RELEASE_NOTES.rst +++ b/RELEASE_NOTES.rst @@ -141,22 +141,504 @@ The new logic generally orders by data interval, but a custom ordering can be applied by setting the DAG to use a custom timetable. -Features -^^^^^^^^ +New Features +^^^^^^^^^^^^ -- DbApiHook accepts log_sql to turn off logging SQL queries. (#24570) +- Add ``@task.short_circuit`` TaskFlow decorator (#25752) +- Make ``execution_date_or_run_id`` optional in ``tasks test`` command (#26114) +- Automatically register DAGs that are used in a context manager (#23592) +- Add option of sending DAG parser logs to stdout. (#25754) +- Support multiple DagProcessors parsing files from different locations. (#25935) +- Implement ExternalPythonOperator (#25780) +- Make execution_date optional for command ``dags test`` (#26111) +- Implement ``expand_kwargs()`` against a literal list (#25925) +- Add trigger rule tooltip (#26043) +- Add conf parameter to CLI for airflow dags test (#25900) +- Include scheduled slots in pools view (#26006) +- Add ``output`` property to MappedOperator (#25604) +- Add roles delete command to cli (#25854) +- Add Airflow specific warning classes (#25799) +- Add support for TaskGroup in ExternalTaskSensor (#24902) +- Add ``@task.kubernetes`` taskflow decorator (#25663) +- Add a way to import Airflow without side-effects (#25832) +- Let timetables control generated run_ids. (#25795) +- Allow per-timetable ordering override in grid view (#25633) +- Grid logs for mapped instances (#25610) +- Consolidate to one ``schedule`` param (#25410) +- DAG regex flag in backfill command (#23870) +- Adding support for owner links in the Dags view UI (#25280) +- clear specific dag run TI (#23516) +- Possibility to document DAG with a separated markdown file (#25509) +- Add parsing context to DAG Parsing (#25161) +- Implement ``CronTriggerTimetable`` (#23662) +- Add option to mask sensitive data in UI configuration page (#25346) +- Create new databases from the ORM (#24156) +- Implement ``XComArg.zip(*xcom_args)`` (#25176) +- Introduce ``sla_miss`` metric (#23402) +- Migrate files to ts (#25267) +- Implement ``map()`` semantic (#25085) +- Add override method to ``TaskGroupDecorator`` (#25160) +- Add ``revisionHistoryLimit`` to all deployments (#25059) +- Implement ``expand_kwargs()`` (#24989) +- Adding ``podAnnotations`` to Redis ``statefulset`` (#23708) +- Chart: Provision Standalone Dag Processor (#23711) +- Add parameter to turn off SQL query logging (#24570) +- Add support for KEDA HPA config to Helm Chart (#24220) +- Add ``DagWarning`` model, and a check for missing pools (#23317) +- Add Task Logs to Grid details panel (#24249) +- Added small health check server and endpoint in scheduler and updated… (#23905) +- Add built-in External Link for ``ExternalTaskMarker`` operator (#23964) +- Add default task retry delay config (#23861) +- Add clear DagRun endpoint. (#23451) +- Add support for timezone as string in cron interval timetable (#23279) +- Support annotations on ``volumeClaimTemplates`` (#23433) +- Add support for ``topologySpreadConstraints`` to Helm Chart (#22712) +- add auto refresh to dags home page (#22900) Improvements ^^^^^^^^^^^^ -- Default value for [core] hostname_callable is ``airflow.utils.net.getfqdn`` which should provide more stable canonical host name. You can still use ``socket.getfqdn``or any other ``hostname_callable`` you had configured.. (#24981) - +- Add more weekday operator and sensor examples #26071 (#26098) +- D400 first line should end with period ``batch02`` (#25268) +- Add subdir parameter to dags reserialize command (#26170) +- Update zombie message to be more descriptive (#26141) +- Only send an ``SlaCallbackRequest`` if the DAG is scheduled (#26089) +- Promote ``Operator.output`` more (#25617) +- Upgrade API files to typescript (#25098) +- Less hacky double-rendering prevention in mapped task (#25924) +- [improvement] Audit log (#25856) +- Remove mapped operator validation code (#25870) +- More DAG(schedule=...) improvements (#25648) +- Reduce ``operator_name`` dupe in serialised JSON (#25819) +- make grid view group/mapped summary UI more consistent (#25723) +- Use ParamSpec to replace ... in Callable (#25658) +- Remove useless statement in ``task_group_to_grid`` (#25654) +- Add auto refresh to grid logs (#25621) +- Grid Logs, add visual indicator of selected attempt (#25611) +- Add optional data interval to CronTriggerTimetable (#25503) +- Simply json responses (#25518) +- Remove unused code in /grid endpoint (#25481) +- Add and document description fields (#25370) +- Improve Airflow logging for operator Jinja template processing (#25452) +- Update core example DAGs to use ``@task.branch`` decorator (#25242) +- Fix DAG audit_log route (#25415) +- Add missing import in best-practices code example (#25391) +- Change stdout and stderr access mode to append in commands (#25253) +- Remove getTasks from Grid view (#25359) +- Improve taskflow type hints with ParamSpec (#25173) +- Use tables in grid details panes (#25258) +- Disallow any dag tags longer than 100 char (#25196) +- Explicitly list ``@dag`` arguments (#25044) +- Only refresh active dags on dags page (#24770) +- More typing in ``SchedulerJob`` and ``TaskInstance`` (#24912) +- D400 first line should end with period two files batch 01 (#24955) +- Patch getfqdn with more resilient version (#24981) +- Replace all NBSP characters by whitespaces (#24797) +- Have consistent types between the ORM and the migration files (#24044) +- Re-serialize all DAGs on 'airflow db upgrade' (#24518) +- Rework contract of ``try_adopt_task_instances`` method (#23188) +- Make expand() error vague so it's not misleading (#24018) +- Add enum validation for ``[webserver]analytics_tool`` (#24032) +- Split contributor's quick start into separate guides. (#23762) +- Add ``dttm`` searchable field in audit log (#23794) +- Allow more parameters to be piped through via ``execute_in_subprocess`` (#23286) +- Use func.count to count rows (#23657) +- remove stale serialized dags (#22917) +- AIP45 Remove dag parsing in airflow run local (#21877) +- Add support for queued state in DagRun update endpoint. (#23481) +- Add fields to dagrun endpoint (#23440) Bug Fixes ^^^^^^^^^ -- ``ExternalTaskSensor`` now supports the ``soft_fail`` flag to skip if external task or DAG enters a failed state. (#23647) +- Add the dag_id to ``AirflowDagCycleException`` message (#26204) +- Properly build URL to retrieve logs independently from system (#26337) +- Fix 'from airflow import version' lazy import (#26239) +- For worker log servers only bind to IPV6 when dual stack is available (#26222) +- Fix TaskInstance.task not defined before handle_failure (#26040) +- Undo secrets backend config caching (#26223) +- Fix faulty executor config serialization logic (#26191) +- Show DAGs and Datasets menu links based on role permission (#26183) +- Allow setting TaskGroup tooltip via function docstring (#26028) +- Rewrite recursion into iteration (#26175) +- Fix backfill occasional deadlocking (#26161) +- Fix DagRun.start_date not set during backfill with --reset-dagruns True (#26135) +- use label instead of id for dynamic task labels in graph (#26108) +- Don't fail DagRun when leaf mapped_task is SKIPPED (#25995) +- Add group prefix to decorated mapped task (#26081) +- Fix UI flash when triggering with dup logical date (#26094) +- FIX Make items nullable for TaskInstance related endpoints to avoid API errors (#26076) +- Fix BranchDateTimeOperator to be timezone-awreness-insensitive (#25944) +- Fix legacy timetable schedule interval params (#25999) +- Fix response schema for list-mapped-task-instance (#25965) +- Properly check the existence of missing mapped TIs (#25788) +- fix broken auto-refresh (#25950) +- Use per-timetable ordering in grid UI (#25880) +- Rewrite recursion when parsing DAG into iteration (#25898) +- Find cross-group tasks in iter_mapped_dependants (#25793) +- Fail task if mapping upstream fails (#25757) +- Rotate session id during login (#25771) +- Support ``/`` in variable get endpoint (#25774) +- Use cfg default_wrap value for grid logs (#25731) +- Add origin request args when triggering a run (#25729) +- Operator name separate from class (#22834) +- Fix incorrect data interval alignment due to assumption on input time alignment (#22658) +- Return None if an XComArg fails to resolve (#25661) +- Correct ``json`` arg help in ``airflow variables set`` command (#25726) +- Added MySQL index hint to use ti_state on find_zombies query (#25725) +- Only excluded actually expanded fields from render (#25599) +- Grid, fix toast for axios errors (#25703) +- Check for queued states for dags autorefresh (#25695) +- Two typing fixes (#25690) +- Adding mysql index hint to use index on task_instance.state in critical section query (#25673) +- Configurable umask to all daemonized processes. (#25664) +- Fix mapped sensor with reschedule mode (#25594) +- Don't mistakenly take a lock on DagRun via ti.refresh_from_fb (#25312) +- Fix the errors raised when None is passed to template filters (#25593) +- Fix upgrade code for the dag_owner_attributes table (#25579) +- Add map index to task logs api (#25568) +- Cache the custom secrets backend so the same instance gets re-used (#25556) +- Allow wildcarded CORS origins (#25553) +- Ensure that zombie tasks for dags with errors get cleaned up (#25550) +- Add right padding (#25554) +- Fix "This Session's transaction has been rolled back" (#25532) +- set default task group in dag.add_task method (#25000) +- Fix reducing mapped length of a mapped task at runtime after a clear (#25531) +- Make extra link work in UI (#25500) +- Sync up plugin API schema and definition (#25524) +- Only load distribution of a name once (#25296) +- Fix Serialization error in TaskCallbackRequest (#25471) +- First/last names can be empty (#25476) +- Removed interfering force of index. (#25404) +- Fix ``airflow db reset`` when dangling tables exist (#25441) +- Refactor DAG pages to be consistent (#25402) +- Check expand_kwargs() input type before unmapping (#25355) +- fix: change disable_verify_ssl behaviour (#25023) +- fix - resolve bash by absolute path (#25331) +- Remove useless logging line (#25347) +- Filter XCOM by key when calculating map lengths (#24530) +- Add ``__repr__`` to ParamsDict class (#25305) +- Fix ExternalTaskSensor not working with dynamic task (#25215) +- convert TimeSensorAsync target_time to utc on call time (#25221) +- Stop SLA callbacks gazumping other callbacks and DOS'ing the DagProcessorManager queue (#25147) +- call updateNodeLabels after expandGroup (#25217) +- No grid auto-refresh for backfill dag runs (#25042) +- Added exception catching to send default email if template file raises any exception (#24943) +- Fix invalidateQueries call (#25097) +- airflow/www/package.json: Add name, version fields. (#25065) +- Add %z for %(asctime)s to fix timezone for logs on UI (#24811) +- Fix pid check (#24636) +- Fix zombie task handling with multiple schedulers (#24906) +- Fix tag link on dag detail page (#24918) +- Bind log server on worker to IPv6 address (#24755) (#24846) +- Fix exception in mini task scheduler. (#24865) +- Send DAG timeout callbacks to processor outside of prohibit_commit (#24366) +- improve grid date tick spacing (#24849) +- Fix cycle bug with attaching label to task group (#24847) +- Add cache_ok flag to sqlalchemy TypeDecorators. (#24499) +- Disable attrs state management on MappedOperator (#24772) +- Serialize pod_override to JSON before pickling executor_config (#24356) +- Move fallible ti.task.dag assignment back inside try/except block (#24533) (#24592) +- Fix grid date ticks (#24738) +- Fix migration ``0080_2_0_2`` - Replace null values before setting column not null (#24585) +- Do not fail requeued TIs (#23846) +- Debounce status highlighting in Grid view (#24710) +- Fix Grid vertical scrolling (#24684) +- don't try to render child rows for closed groups (#24637) +- Clear next method when clearing TIs (#23929) +- ``TriggerDagRunOperator.operator_extra_links`` is attr (#24676) +- Pass worker annotations to generated pod_template_file (#24647) +- Fix timestamp defaults for sensorinstance (#24638) +- ExternalTaskSensor respects soft_fail if the external task enters a failed_state (#23647) +- Use sql_alchemy_conn for celery result backend when result_backend is not set (#24496) +- Migrate jsx files that affect run/task selection to tsx (#24509) +- Patch sql_alchemy_conn if old Postgres schemes used (#24569) +- Remove special serde logic for mapped op_kwargs (#23860) +- Add missing types to FSHook (#24470) +- Fix bugs in URI constructor for MySQL connection (#24320) +- Fix mapped task immutability after clear (#23667) +- Don't rely on current ORM structure for db clean command (#23574) +- Do not calculate grid root instances (#24528) +- Seed log_template table (#24511) +- Fix deprecated log_id_template value (#24506) +- Fix toast messages (#24505) +- Add indexes for CASCADE deletes for task_instance (#24488) +- Return empty dict if Pod JSON encoding fails (#24478) +- Use ``get_hostname`` instead of ``socket.getfqdn`` (#24260) +- Fix semver compare number for ``jobs check`` command (#24480) +- Remove framer-motion from custom tooltip (#24449) +- Speed up grid_data endpoint by 10x (#24284) +- Don't crash scheduler if exec config has old k8s objects (#24117) +- ``TI.log_url`` fix for ``map_index`` (#24335) +- Improve grid rendering performance with a custom tooltip (#24417) +- Fix links to sources for examples (#24386) +- Fix flaky order of returned dag runs (#24405) +- ``DebugExecutor`` use ``ti.run()`` instead of ``ti._run_raw_task`` (#24357) +- Mask secrets in stdout for 'airflow tasks test' (#24362) +- Add tests for the grid_data endpoint (#24375) +- Optimize calendar view for cron scheduled DAGs (#24262) +- Check for run_id for grid group summaries (#24327) +- Check bag DAG schedule_interval match tiemtable (#23113) +- Fix permission issue for dag that has dot in name (#23510) +- Check that edge nodes actually exist (#24166) +- scheduleinterval nullable true added in openapi (#24253) +- Apply per-run log templates to log handlers (#24153) +- Fix useTasks crash on error (#24152) +- Unify return_code interface for task runner (#24093) +- Parse error for task added to multiple groups (#23071) +- Rename Permissions to Permission Pairs. (#24065) +- Reduce grid view API calls (#24083) +- Bring MappedOperator members in sync with BaseOperator (#24034) +- Handle occasional deadlocks in trigger with retries (#24071) +- Run the ``check_migration`` loop at least once (#24068) +- Fix StatD timing metric units (#21106) +- Fix grid view for mapped tasks (#24059) +- Fix closing connection dbapi.get_pandas_df (#23452) +- Replace ``use_task_execution_date`` with ``use_task_logical_date`` (#23983) +- Add TaskInstance State 'REMOVED' to finished states and success states (#23797) +- [23945] Icons in grid view for different dag types (#23970) +- DagFileProcessorManager: Start a new process group only if current process not a session leader (#23872) +- Add cascade to ``dag_tag`` to ``dag`` foreignkey (#23444) +- Disallow calling expand with no arguments (#23463) +- Faster grid view (#23951) +- Use '--subdir' argument value for standalong dag processor. (#23864) +- Fix and speed up grid view (#23947) +- Grid fix details button truncated and small UI tweaks (#23934) +- Prevent UI from crashing if grid task instances are null (#23939) +- Remove redundant register exit signals in ``dag-processor`` command (#23886) +- Enable clicking on DAG owner in autocomplete dropdown (#23804) +- Highlight task states by hovering on legend row (#23678) +- Add ``__wrapped__`` property to _TaskDecorator (#23830) +- Fix UnboundLocalError when sql is empty list in DbApiHook (#23816) +- Mask sensitive values for not-yet-running TIs (#23807) +- Exclude missing tasks from the gantt view (#23627) +- Automatically reschedule stalled queued tasks in CeleryExecutor (v2) (#23690) +- Fix retrieval of deprecated non-config values (#23723) +- Fix secrets rendered in UI when task is not executed. (#22754) +- Fix provider import error matching (#23825) +- Fix regression in ignoring symlinks (#23535) +- Modify db clean to also catch the ProgrammingError exception (#23699) +- Maintain grid view selection on filtering upstream (#23779) +- Fix auto upstream dep when expanding non-templated field (#23771) +- Fix task log is not captured (#23684) +- Add 'reschedule' to the serialized fields for the BaseSensorOperator (#23674) +- Remove titles from link buttons (#23736) +- Fix grid details header text overlap (#23728) +- Handle invalid date parsing in webserver views. (#23161) +- Ensure execution_timeout as timedelta (#23655) +- Fix expand/collapse all buttons (#23590) +- Move around overflow, position and padding (#23044) +- Don't run pre-migration checks for downgrade (#23634) +- Add index for event column in log table (#23625) +- Simplify flash message for _airflow_moved tables (#23635) +- Prevent KubernetesJobWatcher getting stuck on resource too old (#23521) +- Fix: Exception when parsing log #20966 (#23301) +- Implement send_callback method for CeleryKubernetesExecutor and LocalKubernetesExecutor (#23617) +- 19943 Grid view status filters (#23392) +- Apply specific ID collation to root_dag_id too (#23536) +- Fix broken dagrun links when many runs start at the same time (#23462) +- Fix ``PythonVirtualenvOperator`` templated_fields (#23559) +- Pools with negative open slots should not block other pools (#23143) +- Fix scheduler crash when expanding with mapped task that returned none (#23486) +- Fix dag-processor fetch metabase config (#23575) +- Change approach to finding bad rows to LEFT OUTER JOIN. (#23528) +- Only count bad refs when ``moved`` table exists (#23491) +- Expand/collapse all groups (#23487) +- Use kubernetes queue in kubernetes hybrid executors (#23048) +- Fix literal cross product expansion (#23434) +- Visually distinguish task group summarys (#23488) +- Remove color change for highly nested groups (#23482) +- Show warning if '/' is used in a DAG run ID (#23106) +- Optimize 2.3.0 pre-upgrade check queries (#23458) +- Add backward compatibility for core__sql_alchemy_conn__cmd (#23441) +- Override pool for TaskInstance when pool is passed from cli. (#23258) +- Fix duplicated Kubernetes DeprecationWarnings (#23302) +- fix cli ``airflow dags show`` for mapped operator (#23339) +- Fix broken task instance link in xcom list (#23367) +- Allow for ``LOGGING_LEVEL=DEBUG`` (#23360) +- Store grid view selection in url params (#23290) +- Fix connection test button (#23345) +- Hide some task instance attributes (#23338) +- Fix update user auth stats (#23314) +- Use run_id for ti.mark_success_url (#23330) +- Don't show grid actions if server would reject with permission denied (#23332) +- Add tags inside try block. (#21784) +- Add is_mapped field to Task response. (#23319) +- Use <Time /> in Mapped Instance table (#23313) +- Remove custom signal handling in Triggerer (#23274) + +Misc/Internal +^^^^^^^^^^^^^ + +- Add automatically generated ERD schema for the MetaData DB (#26217) +- Mark serialization functions as internal (#26193) +- Remove remaining deprecated classes and replace them with PEP562 (#26167) +- Move dag_edges and task_group_to_dict to corresponding util modules (#26212) +- Lazily import many modules to improve import speed (#24486) +- FIX Incorrect typing information (#26077) +- Add missing contrib classes to deprecated dictionaries (#26179) +- Re-configure/connect the ORM after forking to run a DAG processor (#26216) +- Remove cattrs from lineage processing. (#26134) +- Removed deprecated contrib files and replace them with PEP-562 getattr (#26153) +- Make ``BaseSerialization.serialize`` "public" to other classes. (#26142) +- feat: kubernetes 1.25 support (#26139) +- Change the template to use human readable task_instance description (#25960) +- Bump moment-timezone from 0.5.34 to 0.5.35 in /airflow/www (#26080) +- Fix Flask deprecation warning (#25753) +- Add CamelCase to generated operations types (#25887) +- Fix migration issues and tighten the CI upgrade/downgrade test (#25869) +- Bump ws from 6.2.1 to 6.2.2 in /airflow/ui (#25804) +- Bump path-parse from 1.0.6 to 1.0.7 in /airflow/ui (#25803) +- Bump tmpl from 1.0.4 to 1.0.5 in /airflow/ui (#25809) +- Bump browserslist from 4.16.3 to 4.21.3 in /airflow/ui (#25807) +- Bump hosted-git-info from 2.8.8 to 2.8.9 in /airflow/ui (#25820) +- Bump dns-packet from 1.3.1 to 1.3.4 in /airflow/ui (#25806) +- Fix type annotations in SkipMixin (#25864) +- Separate instruction to install OS dependencies in images (#25565) +- Workaround setuptools editable packages path issue (#25848) +- Bump undici from 5.8.0 to 5.9.1 in /airflow/www (#25801) +- Remove depreciation warning when use default remote tasks logging handlers (#25764) +- Remove skipping tests of Mssql for Python 3.8 (#25800) +- Add custom_operator_name attr to ``_BranchPythonDecoratedOperator`` (#25783) +- Clarify filename_template deprecation message (#25749) +- Bump cattrs version (#25689) +- Remove deprecated modules from Amazon provider package (#25609) +- Move the old ./breeze script to scripts/tools/setup_breeze (#25584) +- Remove deprecated modules (#25543) +- Documentation on task mapping additions (#24489) +- Align Common SQL provider logo location (#25538) +- Remove Smart Sensors (#25507) +- Fix elasticsearch test config to avoid warning on deprecated template (#25520) +- Limit Flask to <2.3 in the wake of 2.2 breaking our tests (#25511) +- Bump terser from 4.8.0 to 4.8.1 in /airflow/ui (#25178) +- Move all "old" SQL operators to common.sql providers (#25350) +- Refactor test DAGs to unclutter example DAGs (#25327) +- Include missing mention of ``external_executor_id`` in ``sql_engine_collation_for_ids`` docs (#25197) +- Add ts types generation to static checks (#25167) +- Move javascript compilation to host (#25169) +- Generate typescript types from rest API docs (#25123) +- Bump typing-extensions and mypy for ParamSpec (#25088) +- Upgrade utils files to typescript (#25089) +- Upgrade ramaining context file to typescript. (#25096) +- Upgrade grid Table component to ts. (#25074) +- Skip mapping against mapped ti if it returns None (#25047) +- Refactor js file structure (#25003) +- Add absolute paths for typescript files (#24978) +- Sort operator extra links (#24992) +- Move mapped kwargs introspection to separate type (#24971) +- Limit astroid version to < 2.12 (#24982) +- Only assert stuff for mypy when type checking (#24937) +- Extends resolve_xcom_backend function level documentation (#24965) +- Bump moment from 2.29.3 to 2.29.4 in /airflow/www (#24885) +- Upgrade FAB to 4.1.3 (#24884) +- Move all SQL classes to common-sql provider (#24836) +- Remove "bad characters" from our codebase (#24841) +- Remove upper-binding for SQLAlchemy (#24819) +- Remove ``xcom_push`` flag from ``BashOperator`` (#24824) +- Refactor DR.task_instance_scheduling_decisions (#24774) +- Move Flask hook registration to end of file (#24776) +- Remove defaults from Airflow test config (#24263) +- More typing and minor refactor for kubernetes (#24719) +- Move provider dependencies to inside provider folders (#24672) +- Upgrade more javascript files to typescript (#24715) +- Address all yarn test warnings (#24722) +- Clean up task decorator type hints and docstrings (#24667) +- We now need at least Flask-WTF 0.15 (#24621) +- Upgrade FAB to 4.1.2 (#24619) +- Upgrade FAB to 4.1.1 (#24399) +- Switch Markdown engine to markdown-it-py (#19702) +- Update flask-appbuilder authlib/oauth dependency (#24516) +- Preserve original order of providers' connection extra fields in UI (#24425) +- Get rid of TimedJSONWebSignatureSerializer (#24519) +- Rename charts.css to chart.css (#24531) +- Rename grid.css to chart.css (#24529) +- Upgrade to webpack 5 (#24485) +- Remove internet explorer support (#24495) +- Vendor in the bitnami chart (#24395) +- Upgrade to react 18 and chakra 2 (#24430) +- Add salesforce_default to List Connection (#24347) +- misc: create new process group by ``set_new_process_group`` utility (#24371) +- Refactor ``DagRun.verify_integrity`` (#24114) +- Add typescript (#24337) +- Fix D202 issue (#24322) +- Remove limit of presto-python-client version (#24305) +- Airflow UI fix vulnerabilities - Prototype Pollution (#24201) +- pydocstyle D202 added (#24221) +- Bump moto version (#24222) +- Update 'rich' to latest version across the board. (#24186) +- Do not support MSSQL less than v2017 in code (#24095) +- Removing magic status code numbers from api_connecxion (#24050) +- Remove hack from BigQuery DTS hook (#23887) +- Drop Python 3.6 compatibility objects/modules (#24048) +- Remove unused [github_enterprise] from ref docs (#24033) +- Remove pinning for xmltodict (#23992) +- Clean up f-strings in logging calls (#23597) +- Add limit for JPype1 (#23847) +- cleanup usage of ``get_connections()`` from test suite (#23757) +- clearer method name in scheduler_job.py (#23702) +- Add typing for airflow/configuration.py (#23716) +- Disable Flower by default from docker-compose (#23685) +- Added postgres 14 to support versions(including breeze) (#23506) +- [FEATURE] add K8S 1.24 support (#23637) +- [FEATURE] update K8S-KIND to 0.13.0 (#23636) +- [FIX] remove python 3.6 (#23409) +- Refactor code references from tree to grid (#23254) +- Fix empty image preparation (#23304) + +Doc only changes +^^^^^^^^^^^^^^^^ +- Add url prefix setting for Celery Flower (#25986) +- Updating deprecated configuration in examples (#26037) +- Fix wrong link for taskflow tutorial (#26007) +- Reorganize tutorials into a section (#25890) +- Fix concept doc for dynamic task map (#26002) +- Update code examples from "classic" operators to taskflow (#25845) +- Add instructions on manually fixing MySQL Charset problems (#25938) +- Prefer the local Quick Start in docs (#25888) +- Fix broken link to Trigger Rules (#25840) +- Update code examples from "classic" operators to taskflow (#25657) +- Improve docker documentation (#25735) +- Correctly link to Dag parsing context in docs (#25722) +- Add note on task_instance_mutation_hook usage (#25607) +- Documentation update. Actualizing passing data options (#25577) +- Update AIP confluence link (#25571) +- Note how DAG policy works with default_args (#24804) +- [docs] Update DAG run to clarify when a DAG actually runs (#25290) +- Update tutorial docs to include a definition of operators (#25012) +- Update set-up-database.rst (#24983) +- Rewrite the Airflow documentation home page (#24795) +- Fix syntax in mysql setup documentation (#24893 (#24939) +- Chart: minor clarifications to docs (#24929) +- Update PythonVirtualenvOperator Howto (#24782) +- Fix docs build errors for Sphinx 5 (#24870) +- Update templates doc to mention ``extras`` and format Airflow Vars / Conns (#24735) +- Document built in Timetables (#23099) +- update ``task-generated mapping`` example (#23424) +- Add note about image regeneration in June 2022 (#24524) +- Clarify that users should not use Maria DB (#24556) +- Update description of installing providers separately from core (#24454) +- Doc: Add hyperlinks to Github PRs for Release Notes (#24532) +- Add imports to deferring code samples (#24544) +- Small cleanup of ``get_current_context()`` chapter (#24482) +- Docs: Fix default 2.2.5 log_id_template (#24455) +- Add Flux to chart gitops docs (#24288) +- Add note on subtle logical date change in 2.2.0 (#24413) +- Mention context variables and logging (#24304) +- Alphabetizes two tables (#23923) +- Doc: Add column names for DB Migration Reference (#23853) +- Update Production Guide for Helm Chart docs (#23836) +- Document fix for broken elasticsearch logs with 2.3.0+ upgrade (#23821) +- Fix doc description of [core] parallelism config setting (#23768) +- Clarify that bundle extras should not be used for PyPi installs (#23697) +- Synchronize support for Postgres and K8S in docs (#23673) +- Add slim images to docker-stack docs index (#23601) +- Update dags.rst (#23579) +- Move dag_processing.processor_timeouts to counters section (#23393) +- Replace DummyOperator references in docs (#23502) +- Clarify ``reattach_on_restart`` behavior (#23377) +- Add doc notes for keyword-only args for ``expand()`` and ``partial()`` (#23373) + Airflow 2.3.4 (2022-08-23) diff --git a/scripts/ci/pre_commit/pre_commit_version_heads_map.py b/scripts/ci/pre_commit/pre_commit_version_heads_map.py index 5d03f0f055..a37b862b4d 100755 --- a/scripts/ci/pre_commit/pre_commit_version_heads_map.py +++ b/scripts/ci/pre_commit/pre_commit_version_heads_map.py @@ -59,7 +59,7 @@ if __name__ == '__main__': if airflow_version.is_devrelease or 'b' in (airflow_version.pre or ()): exit(0) versions = read_revision_heads_map() - if airflow_version not in versions: + if airflow_version.base_version not in versions: print("Current airflow version is not in the REVISION_HEADS_MAP") print("Current airflow version:", airflow_version) print("Please add the version to the REVISION_HEADS_MAP at:", DB_FILE)
