This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch v1-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git
commit 3e080c240e9968c4086c32943a22b3c4010453df Author: Kaxil Naik <kaxiln...@gmail.com> AuthorDate: Wed Jul 1 19:40:29 2020 +0100 Add Changelog for 1.10.11 --- .pre-commit-config.yaml | 3 +- CHANGELOG.txt | 194 ++++++++++++++++++++++++++++++++++++++++++++++++ 2 files changed, 196 insertions(+), 1 deletion(-) diff --git a/.pre-commit-config.yaml b/.pre-commit-config.yaml index e7b90db..a017dad 100644 --- a/.pre-commit-config.yaml +++ b/.pre-commit-config.yaml @@ -245,7 +245,8 @@ repos: (?x) ^airflow/contrib/hooks/cassandra_hook.py$| ^airflow/operators/hive_stats_operator.py$| - ^tests/contrib/hooks/test_cassandra_hook.py + ^tests/contrib/hooks/test_cassandra_hook.py| + ^CHANGELOG.txt - id: dont-use-safe-filter language: pygrep name: Don't use safe in templates diff --git a/CHANGELOG.txt b/CHANGELOG.txt index a8aa353..0313e7b 100644 --- a/CHANGELOG.txt +++ b/CHANGELOG.txt @@ -1,3 +1,196 @@ +Airflow 1.10.11, 2020-07-05 +----------------------------- + +New Features +"""""""""""" + +- Add task instance mutation hook (#8852) +- Allow changing Task States Colors (#9520) +- Add support for AWS Secrets Manager as Secrets Backend (#8186) +- Add airflow info command to the CLI (#8704) +- Add Local Filesystem Secret Backend (#8596) +- Add Airflow config CLI command (#8694) +- Add Support for Python 3.8 (#8836)(#8823) +- Allow K8S worker pod to be configured from JSON/YAML file (#6230) +- Add quarterly to crontab presets (#6873) +- Add support for ephemeral storage on KubernetesPodOperator (#6337) +- Add AirflowFailException to fail without any retry (#7133) +- Add SQL Branch Operator (#8942) + +Bug Fixes +""""""""" + +- Use NULL as dag.description default value (#7593) +- BugFix: DAG trigger via UI error in RBAC UI (#8411) +- Fix logging issue when running tasks (#9363) +- Fix JSON encoding error in DockerOperator (#8287) +- Fix alembic crash due to typing import (#6547) +- Correctly restore upstream_task_ids when deserializing Operators (#8775) +- Correctly store non-default Nones in serialized tasks/dags (#8772) +- Correctly deserialize dagrun_timeout field on DAGs (#8735) +- Fix tree view if config contains " (#9250) +- Fix Dag Run UI execution date with timezone cannot be saved issue (#8902) +- Fix Migration for MSSQL (#8385) +- RBAC ui: Fix missing Y-axis labels with units in plots (#8252) +- RBAC ui: Fix missing task runs being rendered as circles instead (#8253) +- Fix: DagRuns page renders the state column with artifacts in old UI (#9612) +- Fix task and dag stats on home page (#8865) +- Fix the trigger_dag api in the case of nested subdags (#8081) +- UX Fix: Prevent undesired text selection with DAG title selection in Chrome (#8912) +- Fix connection add/edit for spark (#8685) +- Fix retries causing constraint violation on MySQL with DAG Serialization (#9336) +- [AIRFLOW-4472] Use json.dumps/loads for templating lineage data (#5253) +- Restrict google-cloud-texttospeach to <v2 (#9137) +- Fix pickling failure when spawning processes (#8671) +- Pin Version of Azure Cosmos to <4 (#8956) +- Azure storage 0.37.0 is not installable any more (#8833) +- Fix modal_backdrop z-index in the UI (#7313) +- Fix Extra Links in Gannt View (#8308) +- Bug fix for EmrAddStepOperator init with cluster_name error (#9235) +- Fix KubernetesPodOperator pod name length validation (#8829) +- Fix non updating DAG code by checking against last modification time (#8266) +- BugFix: Unpausing a DAG with catchup=False creates an extra DAG run (#8776) + + +Improvements +"""""""""""" + +- Improve add_dag_code_table migration (#8176) +- Persistent display/filtering of DAG status (#8106) +- Set unique logger names (#7330) +- Update the version of cattrs from 0.9 to 1.0 to support Python 3.8 (#7100) +- Reduce response payload size of /dag_stats and /task_stats (#8655) +- Add authenticator parameter to snowflake_hook (#8642) +- Show "Task Reschedule" table in Airflow Webserver (#9521) +- Change worker_refresh_interval fallback to default of 30 (#9588) +- Use pfromat instead of str to render arguments in WebUI (#9587) +- Simplify DagFileProcessorManager (#7521) +- Reload gunicorn when plugins has beeen changed (#8997) +- Fix the default value for store_dag_code (#9554) +- Add support for fetching logs from running pods (#8626) +- Persist start/end date and duration for DummyOperator Task Instance (#8663) +- Ensure "started"/"ended" in tooltips are not shown if job not started (#8667) +- Add context to execution_date_fn in ExternalTaskSensor (#8702) +- Avoid color info in response of ``/dag_stats`` & ``/task_stats`` (#8742) +- Make loading plugins from entrypoint fault-tolerant (#8732) +- Refactor Kubernetes worker config (#7114) +- Add default ``conf`` parameter to Spark JDBC Hook (#8787) +- Allow passing backend_kwargs to AWS SSM client (#8802) +- Filter dags by clicking on tag (#8897) +- Support k8s auth method in Vault Secrets provider (#8640) +- Monitor pods by labels instead of names (#6377) +- Optimize count query on /home (#8729) +- Fix json string escape in tree view (#8551) +- Add TaskInstance state to TI Tooltip to be colour-blind friendlier (#8910) +- Add a tip to trigger DAG screen (#9049) +- Use Markup for htmlcontent for landing_times (#9242) +- Pinning max pandas version to 2.0 (lesser than) to allow pandas 1.0 (#7954) +- Update example webserver_config.py to show correct CSRF config (#8944) +- Fix displaying Executor Class Name in "Base Job" table (#8679) +- Use existing DagBag for 'dag_details' & 'trigger' Endpoints (#8501) +- Flush pending Sentry exceptions before exiting (#7232) +- Display DAG run conf in the list view (#6794) +- Fix performance degradation when updating dagrun state (#8435) +- Don't use the ``|safe`` filter in code, it's risky (#9180) +- Validate only task commands are run by executors (#9178) +- Show Deprecation warning on duplicate Task ids (#8728) +- Move DAG._schedule_interval logic out of ``DAG.__init__`` (#8225) +- Make retrieving Paused Dag ids a separate method (#7587) +- Bulk fetch paused_dag_ids (#7476) +- Add a configurable DAGs volume mount path for Kubernetes (#8147) +- Add schedulername option for KubernetesPodOperator (#6088) +- Support running git sync container as root (#6312) +- Add extra options for Slack Webhook operator and Slack hook (#9409) +- Monkey patch greenlet celery pools (#8559) +- Decrypt secrets from SystemsManagerParameterStoreBackend (#9214) +- Prevent clickable sorting on non sortable columns in TI view (#8681) +- Make hive macros py3 compatible (#8598) +- Fix SVG tooltip positioning with custom scripting (#8269) +- Avoid unnecessary sleep to maintain local task job heart rate (#6553) +- Include some missing RBAC roles on User and Viewer roles (#9133) +- Show Dag's Markdown docs on Tree View (#9448) +- Improved compatibility with Python 3.5+ - Convert signal.SIGTERM to int (#9207) +- Add 'main' param to template_fields in DataprocSubmitPySparkJobOperator (#9154) +- Make it possible to silence warnings from Airflow (#9208) +- Remove redundant count query in BaseOperator.clear() (#9362) +- Fix DB migration message (#8988) +- Fix awkward log info in dbapi_hook (#8482) +- Fix Celery default to no longer allow pickle (#7205) +- Further validation that only task commands are run by executors (#9240) +- Remove vendored nvd3 and slugify libraries (#9136) +- Enable configurable git sync depth (#9094) +- Reduce the required resources for the Kubernetes's sidecar (#6062) +- Refactor K8S codebase with k8s API models (#5481) +- Move k8sexecutor out of contrib to closer match master (#8904) +- Allow filtering using "event" and "owner" in "Log" view (#4881) +- Add Yandex.Cloud custom connection to 1.10 (#8791) +- Add table-hover css class to DAGs table (#5033) +- Show un/pause errors in dags view. (#7669) +- Restructure database queries on /home (#4872) +- Add Cross Site Scripting defence (#6913) +- Make Gantt tooltip the same as Tree and Graph view (#8220) +- Add config to only delete worker pod on task failure (#7507)(#8312) +- Remove duplicate error message on chart connection failure (#8476) +- Remove default value spark_binary (#8508) +- Expose Airflow Webserver Port in Production Docker Image (#8228) +- Commit after each alembic migration (#4797) +- KubernetesPodOperator fixes and test (#6524) +- Docker Image: Add ADDITIONAL_AIRFLOW_EXTRAS (#9032) +- Docker Image: Add ADDITIONAL_PYTHON_DEPS (#9031) +- Remove httplib2 from Google requirements (#9194) +- Merging multiple sql operators (#9124) +- Adds hive as extra in pyhive dependency (#9075) +- Change default auth for experimental backend to deny_all (#9611) +- Restrict changing XCom values from the Webserver (#9614) +- Add __repr__ for DagTag so tags display properly in /dagmodel/show (#8719) + +Doc only changes +"""""""""""""""" + +- Add docs on using DAGRun.conf (#9578) +- Enforce code-block directives in doc (#9443) +- Carefully parse warning messages when building documentation (#8693) +- Make KubernetesPodOperator clear in docs (#8444) +- Improve language in Pod Mutation Hook docs (#8445) +- Fix formatting of Pool docs in concepts.rst (#8443) +- Make doc clearer about Airflow Variables using Environment Variables (#8427) +- Fix pools doc for LocalExecutor (#7643) +- Add Local and Sequential Executors to Doc (#8084) +- Add documentation for CLI command airflow dags test (#8251) +- Fix typo in DAG Serialization documentation (#8317) +- Add scheduler in production section (#7351) +- Add a structural dag validation example (#6727) +- Adding Task re-run documentation (#6295) +- Fix outdated doc on settings.policy (#7532) +- Add docs about reload_on_plugin_change opiton (#9575) +- Add copy button to Code Blocks in Airflow Docs (#9450) +- Update commands in docs for v1.10+ (#9585) +- Add more info on dry-run CLI option (#9582) +- Document default timeout value for SSHOperator (#8744) +- Fix docs on creating CustomOperator (#8678) +- Enhanced documentation around Cluster Policy (#8661) +- Use sphinx syntax in concepts.rst (#7729) +- Update README to remove Py 3.8 limitation for Master (#9451) +- Add note about using dag_run.conf in BashOperator (#9143) +- Improve tutorial - Include all imports statements (#8670) +- Added more precise Python requirements to README.md (#8455) +- Fix Airflow Stable version in README.md (#9360) +- Update AWS connection example to show how to set from env var (#9191) +- Fix list formatting of plugins doc. (#8873) +- Add 'Version Added' on Secrets Backend docs (#8264) +- Simplify language re roll-your-own secrets backend (#8257) +- Add installation description for repeatable PyPi installation (#8513) +- Add note extra links only render on when using RBAC webserver (#8788) +- Remove unused airflow import from docs (#9274) +- Add PR/issue note in Contribution Workflow Example (#9177) +- Don't use the term "whitelist" - language matters (#9174) +- Add docs to change Colors on the Webserver (#9607) +- Change 'initiate' to 'initialize' in installation.rst (#9619) +- Replace old Variables View Screenshot with new (#9620) +- Replace old SubDag zoom screenshot with new (#9621) +- Update docs about the change to default auth for experimental API (#9617) + + Airflow 1.10.10, 2020-04-09 --------------------------- @@ -193,6 +386,7 @@ Doc only changes - [AIRFLOW-XXXX] Fix typo commiter => committer (#7392) - [AIRFLOW-XXXX] Remove duplicated paragraph in docs (#7662) - Fix reference to KubernetesPodOperator (#8100) +- Update the tree view of dag on Concepts Last Run Only (#8268) Airflow 1.10.9, 2020-02-07