Changeset: 6344fd39f04d for MonetDB URL: https://dev.monetdb.org/hg/MonetDB/rev/6344fd39f04d Removed Files: sql/test/analytics/Tests/analytics20.stable.out sql/test/miscellaneous/Tests/deallocate.stable.out sql/test/miscellaneous/Tests/groupby_prepare.stable.out sql/test/miscellaneous/Tests/select_groupby.stable.out sql/test/prepare/Tests/bind_with_cast.SF-1720934.stable.out sql/test/prepare/Tests/limit_in_prepare.Bug-2552.stable.out sql/test/prepare/Tests/prepare-complex.stable.out sql/test/prepare/Tests/prepare-mergetable.stable.out sql/test/prepare/Tests/prepare-utf8.Bug-3930.stable.out sql/test/prepare/Tests/prepare-view.stable.out sql/test/prepare/Tests/prepare_doesnot_like_LIKE.SF-1234205.stable.out sql/test/prepare/Tests/prepare_on_boolean_bug.Bug-2581.stable.out sql/test/prepare/Tests/prepare_statements_crash_server.Bug-2599.stable.out sql/test/prepare/Tests/prepare_statements_crash_server.Bug-2599.stable.out.int128 sql/test/prepare/Tests/prepared-merge-statement.Bug-6706.stable.out sql/test/prepare/Tests/prepared-select-with-error-causes-hang.Bug-6761.stable.out sql/test/prepare/Tests/prepared-statement-with-udf.Bug-6650.stable.out sql/test/prepare/Tests/sqlancer_prepare.stable.out sql/test/prepare/Tests/sqlancer_prepare.stable.out.int128 Modified Files: clients/Tests/exports.stable.out monetdb5/modules/atoms/CMakeLists.txt sql/backends/monet5/CMakeLists.txt sql/backends/monet5/sql.c sql/backends/monet5/sql_result.c sql/backends/monet5/vaults/odbc/odbc_loader.c sql/server/CMakeLists.txt sql/server/rel_dump.c sql/server/rel_select.c sql/storage/bat/bat_storage.c sql/test/miscellaneous/Tests/groupby_prepare.test sql/test/miscellaneous/Tests/select_groupby.test sql/test/prepare/Tests/bind_with_cast.SF-1720934.test sql/test/prepare/Tests/limit_in_prepare.Bug-2552.test sql/test/prepare/Tests/prepare-complex.test sql/test/prepare/Tests/prepare-utf8.Bug-3930.test sql/test/prepare/Tests/prepare_doesnot_like_LIKE.SF-1234205.test sql/test/prepare/Tests/prepare_on_boolean_bug.Bug-2581.test sql/test/prepare/Tests/prepare_statements_crash_server.Bug-2599.test sql/test/prepare/Tests/prepared-merge-statement.Bug-6706.test sql/test/prepare/Tests/prepared-select-with-error-causes-hang.Bug-6761.test sql/test/prepare/Tests/sqlancer_prepare.test testing/sqllogictest.py tools/mserver/mserver5.c Branch: nested Log Message:
merged with default diffs (truncated from 16878 to 300 lines): diff --git a/.hgtags b/.hgtags --- a/.hgtags +++ b/.hgtags @@ -838,3 +838,4 @@ ab5d60be21cd1c65e9de476d71a86c2995f70785 30e6380820842b9e0325536eb22d7cb3843ab095 Aug2024_7 30e6380820842b9e0325536eb22d7cb3843ab095 Aug2024_SP2_release fd30df6fc710aa7615a995dd826389a67cddd47f Mar2025_root +11a26808ab1bc96546077899924e5c31d7f2553c Mar2025_1 diff --git a/ChangeLog-Archive b/ChangeLog-Archive --- a/ChangeLog-Archive +++ b/ChangeLog-Archive @@ -1,6 +1,16 @@ # DO NOT EDIT THIS FILE -- MAINTAINED AUTOMATICALLY # This file contains past ChangeLog entries +* Tue Mar 11 2025 Sjoerd Mullender <[email protected]> - 11.53.1-20250317 +- There is a new shared library called libmutils that contains some + utility functions that are used by several programs. + +* Mon Sep 16 2024 Joeri van Ruth <[email protected]> - 11.53.1-20250317 +- Hot snapshot: allow member files larger than 64 GiB. By member files we mean + the files inside the resulting .tar file, not the tar file itself. Huge member + files are written using a GNU tar extension to the original tar format, which + doesn't support more than 8 GiB. + * Tue Aug 6 2024 Sjoerd Mullender <[email protected]> - 11.51.1-20240812 - The CMake configuration files for building extensions have now been included in the various MonetDB development RPMs and debs. diff --git a/ChangeLog.Aug2024 b/ChangeLog.Aug2024 deleted file mode 100644 --- a/ChangeLog.Aug2024 +++ /dev/null @@ -1,3 +0,0 @@ -# ChangeLog file for devel -# This file is updated with Maddlog - diff --git a/ChangeLog.Mar2025 b/ChangeLog.Mar2025 --- a/ChangeLog.Mar2025 +++ b/ChangeLog.Mar2025 @@ -1,9 +1,3 @@ # ChangeLog file for devel # This file is updated with Maddlog -* Mon Sep 16 2024 Joeri van Ruth <[email protected]> -- Hot snapshot: allow member files larger than 64 GiB. By member files we mean - the files inside the resulting .tar file, not the tar file itself. Huge member - files are written using a GNU tar extension to the original tar format, which - doesn't support more than 8 GiB. - diff --git a/MonetDB.spec b/MonetDB.spec --- a/MonetDB.spec +++ b/MonetDB.spec @@ -95,7 +95,7 @@ Group: Applications/Databases License: MPL-2.0 URL: https://www.monetdb.org/ BugURL: https://github.com/MonetDB/MonetDB/issues -Source: https://www.monetdb.org/downloads/sources/Aug2024-SP2/MonetDB-%{version}.tar.bz2 +Source: https://www.monetdb.org/downloads/sources/Mar2025/MonetDB-%{version}.tar.bz2 # The Fedora packaging document says we need systemd-rpm-macros for # the _unitdir and _tmpfilesdir macros to exist; however on RHEL 7 @@ -219,6 +219,49 @@ functionality of MonetDB. %{_datadir}/monetdb/cmake/monetdb_config_headerTargets.cmake %endif +%package mutils +Summary: MonetDB mutils library +Group: Applications/Databases + +%description mutils +MonetDB is a database management system that is developed from a +main-memory perspective with use of a fully decomposed storage model, +automatic index management, extensibility of data types and search +accelerators. It also has an SQL front end. + +This package contains a shared library (libmutils) which is needed by +various other components. + +%ldconfig_scriptlets mutils + +%files mutils +%license COPYING +%defattr(-,root,root) +%{_libdir}/libmutils*.so.* + +%if %{without compat} +%package mutils-devel +Summary: MonetDB mutils library +Group: Applications/Databases +Requires: %{name}-mutils%{?_isa} = %{version}-%{release} + +%description mutils-devel +MonetDB is a database management system that is developed from a +main-memory perspective with use of a fully decomposed storage model, +automatic index management, extensibility of data types and search +accelerators. It also has an SQL front end. + +This package contains the files to develop with the %{name}-mutils +library. + +%files mutils-devel +%defattr(-,root,root) +%dir %{_includedir}/monetdb +%{_libdir}/libmutils*.so +%{_libdir}/pkgconfig/monetdb-mutils.pc +%{_datadir}/monetdb/cmake/mutilsTargets*.cmake +%endif + %package stream Summary: MonetDB stream library Group: Applications/Databases @@ -244,6 +287,7 @@ various other components. Summary: MonetDB stream library Group: Applications/Databases Requires: %{name}-stream%{?_isa} = %{version}-%{release} +Requires: %{name}-mutils-devel%{?_isa} = %{version}-%{release} Requires: bzip2-devel Requires: libcurl-devel Requires: zlib-devel @@ -1012,6 +1056,142 @@ rm "${RPM_BUILD_ROOT}"%{_unitdir}/monetd %endif %changelog +* Mon Mar 17 2025 Sjoerd Mullender <[email protected]> - 11.53.1-20250317 +- Rebuilt. +- GH#7101: Feature request: nextafter() in SQL +- GH#7159: CREATE LOCAL TEMPORARY VIEW +- GH#7331: Support RETURNING clause +- GH#7578: explain result in Mal is truncated in large UDFs and their + input bats is not shown +- GH#7609: Upgrade 11.49.11 to 11.51.7 issues +- GH#7611: Not possible to create table with multiple composite UNIQUE + NULLS NOT DISTINCT constraints +- GH#7614: Filter function creates a cartesian product when used with a + view +- GH#7615: Filter function creates a cartesian product when used with a + view (2) +- GH#7616: Filter function disappears +- GH#7618: Tables loose their columns +- GH#7619: Resource leak in prepared statements +- GH#7621: crash on aggregate with case statement + +* Tue Mar 11 2025 Niels Nes <[email protected]> - 11.53.1-20250317 +- sql: ranking window functions are now optimized into topn's + For the grouped case we added the missing grouped/heap based topn + implementation. + +* Tue Mar 11 2025 Sjoerd Mullender <[email protected]> - 11.53.1-20250317 +- MonetDB: There is a new shared library called libmutils that contains some + utility functions that are used by several programs. + +* Wed Mar 5 2025 Martin van Dinther <[email protected]> - 11.53.1-20250317 +- sql: Added support for reading external data in a generic way via table + returning function: proto_loader(string uri). The uri string value + must start with the scheme name, ending with : character. + Supported schemes are: monetdb: and odbc:. + The monetdb scheme allows you to connect to a remote MonetDB server + and retrieve the data of a specific table or view in a specific schema. + The uri syntax: monetdb://[<host>[:<port>]]/<database>/<schema>/<table> + Example: SELECT * FROM proto_loader('monetdb://127.0.0.1:50000/demo_db/sys/tables'); + The odbc scheme allows you to connect to any ODBC data source via + an ODBC driver and retrieve the data of a supplied query. + The uri syntax: + odbc:{{DSN|FILEDSN}=<data source name>|DRIVER=<path_to_driver>}; + [<ODBC connection parameters>;]QUERY=<SQL query> + For ODBC you normally configure a data source first. This + is done using the ODBC administrator (on windows: odbcad32.exe, + on linux: odbcinst). Once a data source for a specific ODBC + driver has been setup using a unique name, you can reference it as: + DSN=my_bigdata; or FILE_DSN=/home/usernm/dsns/my_bigdata.dsn; + If you do not want to setup a data source, you can use DRIVER=...; + to specify the ODBC driver program to use. However this also means + you have to specify all the required connection parameters yourself, + such as UID=...;PWD=...;DATABASE=...; etc. + The QUERY=<SQL query> part is mandatory and must be specified at the + end of the uri string, after the optional ODBC connection parameters. + Examples: SELECT * FROM proto_loader( + 'odbc:DSN=Postgres;UID=claude;PWD=monet;QUERY=SELECT * FROM customers'); + SELECT * FROM proto_loader('odbc:DRIVER=/usr/lib64/libsqlite3odbc.so; + Database=/home/martin/sqlite3/chinook.db;QUERY=SELECT * FROM customers'); + Note that the 'odbc:' scheme is experimental and not enabled by default. + To enable it, the MonetDB server has to be started with argument: + --loadmodule odbc_loader + +* Tue Feb 18 2025 Sjoerd Mullender <[email protected]> - 11.53.1-20250317 +- clients: Support for dumping databases from servers from before Jul2021 (11.41.X) + has been removed. + +* Mon Feb 10 2025 stefanos mavros <[email protected]> - 11.53.1-20250317 +- sql: Extended the constant aggregate optimizer in order to eliminate + aggregates with constant arguments whenever possible. + +* Wed Jan 29 2025 Joeri van Ruth <[email protected]> - 11.53.1-20250317 +- sql: REMOTE TABLES and REPLICA TABLES now fully support the monetdb:// + and monetdbs:// URL's introduced in Aug2024. + Any mapi:monetdb:// URL's are normalized to the new style. +- sql: Add function sa_msettings_create() to allocate an msettings object + using the arena allocator. +- sql: Unused helper function mapiuri_database() has been removed from + rel_remote.h. + +* Mon Jan 13 2025 Sjoerd Mullender <[email protected]> - 11.53.1-20250317 +- monetdb5: Removed function bat.attach since it wasn't used. + +* Fri Dec 20 2024 Niels Nes <[email protected]> - 11.53.1-20250317 +- sql: Added support for aggregates which order within the group such + as quantile and which potentially order within the group such as + group_concat. The ordering for such operators in now handled once in + the relational plan. For this the create function statements can now + have an optional order specification, using the keywords 'ORDERED' + and 'WITH ORDER'. + +* Fri Dec 20 2024 Sjoerd Mullender <[email protected]> - 11.53.1-20250317 +- sql: Added support for recursive CTE's. +- sql: The SQL parser was cleaned up. This resulted in some keywords being + used more strictly. If any of these keywords are to be used as column + names, they have to be quoted using double quotes: AS, TABLE, COLUMN, + DISTINCT, EXEC, EXECUTE. + +* Mon Dec 16 2024 Sjoerd Mullender <[email protected]> - 11.53.1-20250317 +- geom: Removed type geometryA (geometry array). It was deprecated in the + Jun2023 release (11.47.X) because there was no use for the type. + +* Mon Dec 16 2024 Sjoerd Mullender <[email protected]> - 11.53.1-20250317 +- monetdb5: Removed the MAL type "identifier" and supporting functions. There has + never been an SQL interface to this type. +- monetdb5: Removed the MAL type "color" and supporting functions. There has + never been an SQL interface to this type. + +* Mon Dec 16 2024 Yunus Koning <[email protected]> - 11.53.1-20250317 +- sql: Introduce the RETURNING clause for INSERT, UPDATE and DELETE statements. + Specifying a RETURNING clause causes the SQL statement to return the + modified records which can be queried using SELECT like expressions + in the RETURNING clause. Aggregate functions are allowed. + This is a common non-standard SQL extension. + Examples: + INSERT INTO foo values (1,10), (-1,-10) RETURNING i+2*j AS bar + ---- + 21 + -21 + UPDATE foo SET i = -i WHERE i >0 RETURNING sum(j), count(j) + ---- + -60|3 + +* Mon Dec 16 2024 Joeri van Ruth <[email protected]> - 11.53.1-20250317 +- MonetDB: Hot snapshot: allow member files larger than 64 GiB. By member files we mean + the files inside the resulting .tar file, not the tar file itself. Huge member + files are written using a GNU tar extension to the original tar format, which + doesn't support more than 8 GiB. + +* Mon Dec 16 2024 Sjoerd Mullender <[email protected]> - 11.53.1-20250317 +- gdk: The implementation for the imprints index on numeric columns has + been removed. It hasn't been used in years, and when it is enabled, + it doesn't really make queries go faster. + +* Mon Dec 16 2024 Lucas Pereira <[email protected]> - 11.53.1-20250317 +- sql: Introduce division_min_scale SQL environment variable for specifying + minimum scale of the division result. The default value is 3. + * Mon Dec 16 2024 Sjoerd Mullender <[email protected]> - 11.51.7-20241216 - Rebuilt. - GH#7112: Need keyboard shortcut to interrupt query execution rather than @@ -1344,316 +1524,3 @@ rm "${RPM_BUILD_ROOT}"%{_unitdir}/monetd - sql: Add a DECIMAL AS clause to COPY INTO that configures the decimal separator and thousands separator for decimals, temporal types and floats. -* Sat Jun 29 2024 Sjoerd Mullender <[email protected]> - 11.49.11-20240629 -- Rebuilt. -- GH#7509: MonetDB Dec2023-SP2 crashes at `sql_init_subtype` -- GH#7511: MonetDB Dec2023-SP2 crashes with the `PASSWORD_HASH` function -- GH#7512: MonetDB Dec2023-SP2 crashes with the - `GET_MERGE_TABLE_PARTITION_EXPRESSIONS` function -- GH#7513: MonetDB Dec2023-SP2 crashes with the `GETHOST` function -- GH#7518: mserver reports errors when starting if geom module is enabled - but database was created without -- GH#7526: deadlock, causing new connections to hang indefinitely -- GH#7531: loading more than 2147483647 rows gives issue. -- GH#7536: Truncated file when dumping a table from mclient into a gzipped - file -- GH#7537: MonetDB crashes with a SIGSEGV due to a null pointer - dereference when using prepared statements -- GH#7541: Unexpected result when using `LEVENSHTEIN` -- GH#7546: monetdbd leaks file descriptors when starting mserver5. - -* Sat Jun 29 2024 Sjoerd Mullender <[email protected]> - 11.49.11-20240629 -- monetdb5: The mserver5 program has a new option: --without-geom. If the server - was compiled with geom support (or the geom module was installed in a - binary distribution), this option allows the server to start without - the geom module, so that it can proceed with a database that was - created without geom. - -* Wed May 15 2024 Sjoerd Mullender <[email protected]> - 11.49.11-20240629 -- sql: When sys.persist_unlogged is called for a table, it may return that - zero rows were persisted. If this is because the call was done too - early, i.e. the table was recently created and the write-ahead log - where this was logged has not been processed yet, the call will - request an immediate write-ahead log rotation. This means that the - WAL will be processed as soon as possible and a new call to - sys.persist_unlogged soon after will likely return a positive result. - _______________________________________________ checkin-list mailing list -- [email protected] To unsubscribe send an email to [email protected]
