zabetak commented on code in PR #4238: URL: https://github.com/apache/calcite/pull/4238#discussion_r1993039655
########## site/_docs/history.md: ########## @@ -84,21 +164,220 @@ The methods used before (`Schema:getTable(String name)`, `Schema:getTableNames() `Schema.getSubSchema(String name)` and `Schema.getSubSchemaNames(String name)`) have been marked as deprecated. +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6766";>CALCITE-6766</a>] Move `DATEADD` and `DATEDIFF` from PostgreSQL to Redshift library +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6664";>CALCITE-6664</a>] Replace `GREATEST`, `LEAST` functions in Spark library with the implementation of PostgreSQL Library + #### New features {: #new-features-1-39-0} +* [<a href="https://issues.apache.org/jira/browse/CALCITE-4918";>CALCITE-4918</a>] Support VARIANT data type +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6685";>CALCITE-6685</a>] Support checked arithmetic +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6846";>CALCITE-6846</a>] Support basic DPhyp join reorder algorithm +* [<a href="https://issues.apache.org/jira/browse/CALCITE-5409";>CALCITE-5409</a>] Implement `BatchNestedLoopJoin` for JDBC +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6738";>CALCITE-6738</a>] Support a `UUID` type natively +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6668";>CALCITE-6668</a>] Support `IS TRUE`/`IS FALSE` operator in Arrow adapter +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6760";>CALCITE-6760</a>] Support `TIME` data type in Arrow adapter +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6690";>CALCITE-6690</a>] Support `DECIMAL` with precision and scale in Arrow adapter +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6730";>CALCITE-6730</a>] Add `CONVERT` function (enabled in Oracle library) +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6666";>CALCITE-6666</a>] Support Oracle `SYSDATE` and `SYSTIMESTAMP` functions +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6821";>CALCITE-6821</a>] Support crc32 function for Hive and Spark library +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6844";>CALCITE-6844</a>] Enable various existing `ARRAY` functions in Hive +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6800";>CALCITE-6800</a>] Enable a few existing functions to Hive library +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6831";>CALCITE-6831</a>] Add `ARRAY_SLICE` function（enabled in Hive Library) +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6689";>CALCITE-6689</a>] Add `INSTR` function in Hive library +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6815";>CALCITE-6815</a>] Support `BIN` function for Spark and Hive Library +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6812";>CALCITE-6812</a>] Support `BASE64` and `UNBASE64` functions for Hive +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6805";>CALCITE-6805</a>] Support `HEX` function for Hive and Spark Library +* [<a href="https://issues.apache.org/jira/browse/CALCITE-4860";>CALCITE-4860</a>] Support `NULLS FIRST` and `NULLS LAST` query in Elasticsearch adapter +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6726";>CALCITE-6726</a>] Support `%` (modulo) operator in MSSQL +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6678";>CALCITE-6678</a>] Support `DUAL` table query when db provides this feature +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6645";>CALCITE-6645</a>] Support user-defined function without parentheses when db dialect's `allowNiladicParentheses` property is false +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6663";>CALCITE-6663</a>] Support `SPLIT_PART` function for PostgreSQL +* [<a href="https://issues.apache.org/jira/browse/CALCITE-5612";>CALCITE-5612</a>] Support PostgreSQL's `SET TRANSACTION` command in Babel parser +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6643";>CALCITE-6643</a>] Enable `LENGTH`/`CHAR_LENGTH` function in `PrestoSqlDialect` +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6633";>CALCITE-6633</a>] Add `CEILING` to MSSQL dialect +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6612";>CALCITE-6612</a>] Add `DATE_SUB` function(enabled in Spark library) +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6618";>CALCITE-6618</a>] Support NOT EQUALS operator in Arrow adapter + #### Dependency version upgrade {: #dependency-1-39-0} +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6871";>CALCITE-6871</a>] Upgrade avatica from 1.25.0 to 1.26.0 +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6794";>CALCITE-6794</a>] Site Gemfile contains vulnerable ruby libraries +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6782";>CALCITE-6782</a>] Upgrade Cassandra to 4.1.6 and Cassandra driver to 4.18.1 + #### Bug-fixes, API changes and minor enhancements {: #fixes-1-39-0} +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6650";>CALCITE-6650</a>] Optimize the `IN`/`SOME` sub-query using metadata row count +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6877";>CALCITE-6877</a>] Generate `LogicalProject` in `RelRoot.project()` when mapping is not name trivial +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6879";>CALCITE-6879</a>] Support `APPROX_DISTINCT_COUNT` for more dialects +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6876";>CALCITE-6876</a>] Druid Adapter support more functions +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6788";>CALCITE-6788</a>] `LoptOptimizeJoinRule` should be able to delegate costs to the planner +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6870";>CALCITE-6870</a>] `FilterToCalcRule`/`ProjectToCalcRule` should not convert a `Filter`/`Project` to `Calc` when it contains sub-query +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6874";>CALCITE-6874</a>] `FilterCalcMergeRule`/`ProjectCalcMergeRule` should not merge a `Filter`/`Project` to `Calc` when it contains sub-query +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6873";>CALCITE-6873</a>] `FilterProjectTransposeRule` should not push the `Filter` past the `Project` when the `Filter` contains a sub-query with correlation +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6867";>CALCITE-6867</a>] Druid Adapter transforms an SQL `NOT IN` filter to a Druid `IN` filter +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6850";>CALCITE-6850</a>] `ProjectRemoveRule` with two projects does not keep field names from the top one +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6864";>CALCITE-6864</a>] `ProjectAggregateMergeRule` loses the project's field names +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6652";>CALCITE-6652</a>] `RelDecorrelator` can't decorrelate query with `LIMIT` 1 +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6837";>CALCITE-6837</a>] Invalid code generated for `ROW_NUMBER` function in `Enumerable` convention +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6274";>CALCITE-6274</a>] Join between Elasticsearch indexes returns empty result +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6853";>CALCITE-6853</a>] Nested window aggregate throws `UnsupportedOperationException` with the default `ValidatorConfig` +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6847";>CALCITE-6847</a>] ClickHouse doesn't support `TRUE`/`FALSE` keywords in join predicate +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6819";>CALCITE-6819</a>] MSSQL doesn't support `TRUE`/`FALSE` keywords in join predicate +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6832";>CALCITE-6832</a>] Redundant `fields`/`nullable` entries in `STRUCT` serialization to JSON +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6839";>CALCITE-6839</a>] SUM function throws overflow exceptions due to incorrect return types +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6833";>CALCITE-6833</a>] JDBC adapter generates invalid table alias for semi-join in `UNION` +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6824";>CALCITE-6824</a>] Sub-query in join conditions rewrite fails if referencing a column from the right-hand side table +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6838";>CALCITE-6838</a>] `RelToSqlConverter` should generate double parentheses when the input to `UNNEST` is a query statement +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6785";>CALCITE-6785</a>] `RelToSqlConverter` generate wrong sql when `UNNEST` has a correlate variable +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6804";>CALCITE-6804</a>] Anti-join with `WHERE NOT EXISTS` syntax has corrupted condition +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6817";>CALCITE-6817</a>] Add string representation of default nulls direction for `RelNode` +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6818";>CALCITE-6818</a>] Write `LIMIT` for fetch operations in Snowflake +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6790";>CALCITE-6790</a>] Write `LIMIT` for fetch operations in Vertica +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6813";>CALCITE-6813</a>] `UNNEST` infers incorrect nullability for the result when applied to an array that contains nullable `ROW` values +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6796";>CALCITE-6796</a>] Convert Type from `BINARY` to `VARBINARY` in PrestoDialect +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6771";>CALCITE-6771</a>] Convert Type from `FLOAT` to `DOUBLE` in PrestoDialect +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6503";>CALCITE-6503</a>] `JdbcAdapter` cannot push down `NOT IN` sub-queries +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6303";>CALCITE-6303</a>] UNION with CTE(s) results in exception during query validation +* [<a href="https://issues.apache.org/jira/browse/CALCITE-4561";>CALCITE-4561</a>] Wrong results for plan with `EnumerableHashJoin` (semi) on nullable colunms +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6791";>CALCITE-6791</a>] Search pattern during matching in `REPLACE` function should be case insensitive in MSSQL +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6786";>CALCITE-6786</a>] `ANY`/`SOME` operator yields multiple rows in correlated queries +* [<a href="https://issues.apache.org/jira/browse/CALCITE-2295";>CALCITE-2295</a>] Correlated sub-query with project generates wrong plan +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6756";>CALCITE-6756</a>] Preserve `CAST` of `STRING` operand in binary comparison for PostgreSQL +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6778";>CALCITE-6778</a>] `SOME` rewrite for correlated queries does not handle null values correctly +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6764";>CALCITE-6764</a>] Field access from a nullable `ROW` should be nullable +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6744";>CALCITE-6744</a>] `RelMetadataQuery.getColumnOrigins` should return null when column origin includes correlation variables +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6754";>CALCITE-6754</a>] Remove deprecated method calling in `Driver` +* [<a href="https://issues.apache.org/jira/browse/CALCITE-5626";>CALCITE-5626</a>] Sub-query with fully-qualified table name throws 'table not found' during validation +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6301";>CALCITE-6301</a>] Following "must-filter" columns, add "bypass" columns +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6776";>CALCITE-6776</a>] Multiple expanded `IS NOT DISTINCT FROM` cannot be collapsed back +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6779";>CALCITE-6779</a>] Casts from `UUID` to `DATE` should be invalid +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6777";>CALCITE-6777</a>] Conversion between `UUID` and `BINARY` produces wrong results +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6774";>CALCITE-6774</a>] `REPLACE` function returns wrong result when search pattern is an empty string +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6413";>CALCITE-6413</a>] `SqlValidator` does not invoke `TypeCoercionImpl::binaryComparisonCoercion` for both `NATURAL` and `USING` join conditions +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6775";>CALCITE-6775</a>] `ToChar` and `ToTimestamp` PG implementors should use translator's root instead of creating a new root expression +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6770";>CALCITE-6770</a>] Preserve column names when casts are inserted in projects +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6745";>CALCITE-6745</a>] UDF without parameters cannot be validated when use default conformance +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6762";>CALCITE-6762</a>] Preserving the `CAST` conversion for operands in Presto +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6749";>CALCITE-6749</a>] `RelMdUtil#setAggChildKeys` may return an incorrect result +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6699";>CALCITE-6699</a>] Invalid unparse for `VARCHAR` in StarRocksDialect +* [<a href="https://issues.apache.org/jira/browse/CALCITE-3772";>CALCITE-3772</a>] `RelFieldTrimmer` incorrectly trims fields when the query includes correlated sub-query +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6751";>CALCITE-6751</a>] Reduction of `CAST` from string to interval is incorrect +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6759";>CALCITE-6759</a>] `RelToSqlConverter` returns the wrong result when `Aggregate` is on `Sort` +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6759";>CALCITE-6759</a>] `SqlToRelConverter` should not remove `ORDER BY` in sub-query if it has an `OFFSET` +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6761";>CALCITE-6761</a>] StarRocks generates incorrect SQL for certain units in the `EXTRACT` function +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6746";>CALCITE-6746</a>] `ProjectWindowTranspose` rule is unsound +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6727";>CALCITE-6727</a>] Column uniqueness constrain should only apply to inner join +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6649";>CALCITE-6649</a>] Enhance `RelMdPredicates` pull up predicate from project +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6740";>CALCITE-6740</a>] `RexToLixTranslator` generates code with many redundant structures +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6742";>CALCITE-6742</a>] `StandardConvertletTable.convertCall` loses casts from `ROW` comparisons +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6741";>CALCITE-6741</a>] The type of a comparison is nullable when either operand is nullable +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6665";>CALCITE-6665</a>] Add `isEmpty` metadata to check if a relational expression returns no rows +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6691";>CALCITE-6691</a>] `QUALIFY` on project references wrong columns +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6735";>CALCITE-6735</a>] Type coercion for comparisons does not coerce `ROW` types +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6734";>CALCITE-6734</a>] `RelFieldTrimmer` should trim `Aggregate`'s input fields which are arguments of unused aggregate functions +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6736";>CALCITE-6736</a>] Validator accepts comparisons between arrays, multisets, maps without regard to element types +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6737";>CALCITE-6737</a>] `LoptOptimizeJoinRule` can not identify selfjoin on unique join keys +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6725";>CALCITE-6725</a>] The caching mechanism key in `ElasticsearchSchemaFactory` is affected by the order of hosts +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6733";>CALCITE-6733</a>] Type inferred by coercion for comparisons with decimal is too narrow +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6700";>CALCITE-6700</a>] MySQL `BIT_COUNT` function should return result when parameter is `BOOLEAN`, `STRING`, `DATE`, `TIME` and `TIMESTAMP` type +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6566";>CALCITE-6566</a>] JDBC adapter should generate PI function with parentheses in most dialects +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6221";>CALCITE-6221</a>] JDBC adapter generates invalid query when the same table is joined multiple times +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6714";>CALCITE-6714</a>] Cast literal to interval gives the wrong result if literal is casted +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6715";>CALCITE-6715</a>] Enhance `RelFieldTrimmer` to trim `LogicalCorrelate` nodes +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6146";>CALCITE-6146</a>] Target charset should be used when comparing two strings through `CONVERT`/`TRANSLATE` function during validation +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6723";>CALCITE-6723</a>] Type inference for `ARRAY_INSERT` function is incorrect +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6721";>CALCITE-6721</a>] Incorrect implementation of `SqlFunction.checkedDivide` +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6711";>CALCITE-6711</a>] Functions whose output value can be null should return a nullable type +* [<a href="https://issues.apache.org/jira/browse/CALCITE-6720";>CALCITE-6720</a>] Refactor cross product logic in `RelMdUniqueKeys#getPassedThroughCols` using `Linq4j#product` +* [<a href="https://issues.apache.org/jira/browse/CALCITE-4758";>CALCITE-4758</a>] Wrong result when `SOME` sub-query in `SqlNodeList` is converted to `VALUES` Review Comment: Moved to breaking change section. ########## site/_docs/history.md: ########## @@ -46,11 +46,92 @@ using JDK/OpenJDK versions 8 to 23; Guava versions 21.0 to 33.3.0-jre; other software versions as specified in gradle.properties. +#### Breaking Changes +{: #breaking-1-40-0} + +#### New features +{: #new-features-1-40-0} + +#### Dependency version upgrade +{: #dependency-1-40-0} + +#### Bug-fixes, API changes and minor enhancements +{: #fixes-1-40-0} + +#### Build and test suite +{: #build-1-40-0} + +#### Web site and documentation +{: #site-1-40-0} +--> +## <a href="https://github.com/apache/calcite/releases/tag/calcite-1.39.0";>1.39.0</a> / 2025-03-13 +{: #v1-39-0} + +This release comes 5 months after [1.38.0](#v1-38-0), +contains contributions from 45 contributors, and resolves 209 issues. +Highlights include +the support of the VARIANT and UUID data types, Review Comment: Fixed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
