zentol commented on code in PR #20859: URL: https://github.com/apache/flink/pull/20859#discussion_r983597745
########## docs/content.zh/release-notes/flink-1.16.md: ########## @@ -0,0 +1,206 @@ +--- +title: "Release Notes - Flink 1.16" +--- +<!-- +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. +--> + +# Release notes - Flink 1.16 + +These release notes discuss important aspects, such as configuration, behavior, or dependencies, +that changed between Flink 1.15 and Flink 1.16. Please read these notes carefully if you are +planning to upgrade your Flink version to 1.16. + +### Table API & SQL + +#### Remove string expression DSL + +##### [FLINK-26704](https://issues.apache.org/jira/browse/FLINK-26704) + +The deprecated String expression DSL has been removed from Java/Scala/Python Table API. + +#### Support Retryable Lookup Join To Solve Delayed Updates Issue In External Systems + +##### [FLINK-28779](https://issues.apache.org/jira/browse/FLINK-28779) + +Adds retryable lookup join to support both async and sync lookups in order to solve the delayed updates issue in external systems. + +#### Make `AsyncDataStream.OutputMode` configurable for table module + +##### [FLINK-27622](https://issues.apache.org/jira/browse/FLINK-27622) + +It is recommend to set the new option 'table.exec.async-lookup.output-mode' to 'ALLOW_UNORDERED' when +no stritctly output order is needed, this will yield significant performance gains on append-only streams + +#### Harden correctness for non-deterministic updates present in the changelog pipeline + +##### [FLINK-27849](https://issues.apache.org/jira/browse/FLINK-27849) + +For complex streaming jobs, now it's possible to detect and resolve potential correctness issues before running. + +### Connectors + +#### Move Elasticsearch connector to external connector repository + +##### [FLINK-26884](https://issues.apache.org/jira/browse/FLINK-26884) + +The Elasticsearch connector has been copied from the Flink repository to its own individual repository +at https://github.com/apache/flink-connector-elasticsearch. For this release, identical Elasticsearch +connector artifacts will be available from both repositories but with different versions. For example, +the first releases will be `1.16.0` and the externally versioned and maintained artifact `3.0.0`. +Developers are encouraged to move to the latter during this release cycle. + +#### Drop support for Hive versions 1.\*, 2.1.\* and 2.2.\* + +##### [FLINK-27044](https://issues.apache.org/jira/browse/FLINK-27044) + +Support for Hive 1.\*, 2.1.\* and 2.2.\* has been dropped from Flink. These Hive versions are no longer +supported by the Hive community and therefore are also no longer supported by Flink. + +#### Hive sink report statistics to Hive metastore + +##### [FLINK-28883](https://issues.apache.org/jira/browse/FLINK-28883) + +In batch mode, Hive sink now will report statistics to Hive metastore by default for writting tables and partitions. Review Comment: ```suggestion In batch mode, Hive sink now will report statistics to Hive metastore by default for written tables and partitions. ``` ########## docs/content.zh/release-notes/flink-1.16.md: ########## @@ -0,0 +1,206 @@ +--- +title: "Release Notes - Flink 1.16" +--- +<!-- +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. +--> + +# Release notes - Flink 1.16 + +These release notes discuss important aspects, such as configuration, behavior, or dependencies, +that changed between Flink 1.15 and Flink 1.16. Please read these notes carefully if you are +planning to upgrade your Flink version to 1.16. + +### Table API & SQL + +#### Remove string expression DSL + +##### [FLINK-26704](https://issues.apache.org/jira/browse/FLINK-26704) + +The deprecated String expression DSL has been removed from Java/Scala/Python Table API. + +#### Support Retryable Lookup Join To Solve Delayed Updates Issue In External Systems + +##### [FLINK-28779](https://issues.apache.org/jira/browse/FLINK-28779) + +Adds retryable lookup join to support both async and sync lookups in order to solve the delayed updates issue in external systems. + +#### Make `AsyncDataStream.OutputMode` configurable for table module + +##### [FLINK-27622](https://issues.apache.org/jira/browse/FLINK-27622) + +It is recommend to set the new option 'table.exec.async-lookup.output-mode' to 'ALLOW_UNORDERED' when +no stritctly output order is needed, this will yield significant performance gains on append-only streams + +#### Harden correctness for non-deterministic updates present in the changelog pipeline + +##### [FLINK-27849](https://issues.apache.org/jira/browse/FLINK-27849) + +For complex streaming jobs, now it's possible to detect and resolve potential correctness issues before running. + +### Connectors + +#### Move Elasticsearch connector to external connector repository + +##### [FLINK-26884](https://issues.apache.org/jira/browse/FLINK-26884) + +The Elasticsearch connector has been copied from the Flink repository to its own individual repository +at https://github.com/apache/flink-connector-elasticsearch. For this release, identical Elasticsearch +connector artifacts will be available from both repositories but with different versions. For example, +the first releases will be `1.16.0` and the externally versioned and maintained artifact `3.0.0`. +Developers are encouraged to move to the latter during this release cycle. + +#### Drop support for Hive versions 1.\*, 2.1.\* and 2.2.\* + +##### [FLINK-27044](https://issues.apache.org/jira/browse/FLINK-27044) + +Support for Hive 1.\*, 2.1.\* and 2.2.\* has been dropped from Flink. These Hive versions are no longer +supported by the Hive community and therefore are also no longer supported by Flink. + +#### Hive sink report statistics to Hive metastore + +##### [FLINK-28883](https://issues.apache.org/jira/browse/FLINK-28883) + +In batch mode, Hive sink now will report statistics to Hive metastore by default for writting tables and partitions. +This might be time-consuming when there are many written files. You can disable this feature by +setting `table.exec.hive.sink.statistic-auto-gather.enable` to `false`. + +#### Remove a number of Pulsar cursor APIs + +##### [FLINK-27399](https://issues.apache.org/jira/browse/FLINK-27399) + +A number of breaking changes were made to the Pulsar Connector cursor APIs: + +- `CursorPosition#seekPosition()` has been removed. +- `StartCursor#seekPosition()` has been removed. +- `StopCursor#shouldStop` now returns a `StopCondition` instead of a boolean. + +#### Mark StreamingFileSink as deprecated + +##### [FLINK-27188](https://issues.apache.org/jira/browse/FLINK-27188) + +The StreamingFileSink has been deprecated in favor of the unified FileSink since Flink 1.12. +This changed is reflected in the docs, but not yet in the codebase. Review Comment: ```suggestion ``` @MartijnVisser This is properly deprecated in the code in https://github.com/apache/flink/commit/61a9d83abfe257892f961c6e2983a54b4e910622, correct? ########## docs/content.zh/release-notes/flink-1.16.md: ########## @@ -0,0 +1,206 @@ +--- +title: "Release Notes - Flink 1.16" +--- +<!-- +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. +--> + +# Release notes - Flink 1.16 + +These release notes discuss important aspects, such as configuration, behavior, or dependencies, +that changed between Flink 1.15 and Flink 1.16. Please read these notes carefully if you are +planning to upgrade your Flink version to 1.16. + +### Table API & SQL + +#### Remove string expression DSL + +##### [FLINK-26704](https://issues.apache.org/jira/browse/FLINK-26704) + +The deprecated String expression DSL has been removed from Java/Scala/Python Table API. + +#### Support Retryable Lookup Join To Solve Delayed Updates Issue In External Systems + +##### [FLINK-28779](https://issues.apache.org/jira/browse/FLINK-28779) + +Adds retryable lookup join to support both async and sync lookups in order to solve the delayed updates issue in external systems. + +#### Make `AsyncDataStream.OutputMode` configurable for table module + +##### [FLINK-27622](https://issues.apache.org/jira/browse/FLINK-27622) + +It is recommend to set the new option 'table.exec.async-lookup.output-mode' to 'ALLOW_UNORDERED' when +no stritctly output order is needed, this will yield significant performance gains on append-only streams + +#### Harden correctness for non-deterministic updates present in the changelog pipeline + +##### [FLINK-27849](https://issues.apache.org/jira/browse/FLINK-27849) + +For complex streaming jobs, now it's possible to detect and resolve potential correctness issues before running. + +### Connectors + +#### Move Elasticsearch connector to external connector repository + +##### [FLINK-26884](https://issues.apache.org/jira/browse/FLINK-26884) + +The Elasticsearch connector has been copied from the Flink repository to its own individual repository +at https://github.com/apache/flink-connector-elasticsearch. For this release, identical Elasticsearch +connector artifacts will be available from both repositories but with different versions. For example, +the first releases will be `1.16.0` and the externally versioned and maintained artifact `3.0.0`. +Developers are encouraged to move to the latter during this release cycle. + +#### Drop support for Hive versions 1.\*, 2.1.\* and 2.2.\* + +##### [FLINK-27044](https://issues.apache.org/jira/browse/FLINK-27044) + +Support for Hive 1.\*, 2.1.\* and 2.2.\* has been dropped from Flink. These Hive versions are no longer +supported by the Hive community and therefore are also no longer supported by Flink. + +#### Hive sink report statistics to Hive metastore + +##### [FLINK-28883](https://issues.apache.org/jira/browse/FLINK-28883) + +In batch mode, Hive sink now will report statistics to Hive metastore by default for writting tables and partitions. +This might be time-consuming when there are many written files. You can disable this feature by +setting `table.exec.hive.sink.statistic-auto-gather.enable` to `false`. + +#### Remove a number of Pulsar cursor APIs + +##### [FLINK-27399](https://issues.apache.org/jira/browse/FLINK-27399) + +A number of breaking changes were made to the Pulsar Connector cursor APIs: + +- `CursorPosition#seekPosition()` has been removed. +- `StartCursor#seekPosition()` has been removed. +- `StopCursor#shouldStop` now returns a `StopCondition` instead of a boolean. + +#### Mark StreamingFileSink as deprecated + +##### [FLINK-27188](https://issues.apache.org/jira/browse/FLINK-27188) + +The StreamingFileSink has been deprecated in favor of the unified FileSink since Flink 1.12. +This changed is reflected in the docs, but not yet in the codebase. + +#### Flink generated Avro schemas can't be parsed using Python + +##### [FLINK-2596](https://issues.apache.org/jira/browse/FLINK-25962) + +Avro schemas generated by Flink now use the "org.apache.flink.avro.generated" namespace for compatibility with the Avro Python SDK. + +#### Introduce Protobuf format + +##### [FLINK-18202](https://issues.apache.org/jira/browse/FLINK-18202) + +Apache Flink now support the Protocol Buffers (Protobuf) format. This allows you to use this format +directly in your Table API or SQL applications. Review Comment: ```suggestion ``` feature -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
