https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=23073
--- Comment #15 from Thomas Dukleth <[email protected]> --- As is well known, databases such as MySQL and Postgres do not have any magical diff friendly dump which would have appropriate granularity to use in an automated comparison to find any actual problem without being overwhelmed with noise from necessary differences between databases where the essential data is the same for relevant columns but where there are necessary database specific differences such as an extra indexing column, etc. Similar to what I had done for some part of debugging the Python script for the database migration, I am working on API based automated select of for every column and every row to write out each row equivalent of data between the two databases so that actual data is compared with appropriate granularity and not whole rows. Such an approach should be helpful to automatically check that the migrated data is complete and spot any unlikely but possible issues, such as with encoding of names from CJK languages which some users have, which would never be a problem for true UTF8 in Postgres but for which the MediaWiki solution to historic MySQL 3 byte limit for MySQL uft8 character set encoding is using binary data type for MySQL columns. [Encoding differences have been well addressed by insertion to MediaWiki supported binary data type columns for use in MySQL some time ago as will be explained retrospectively in a more detailed comment complete with references to an old version Debian time machine allowing the MySQL database to be created correctly for where we landed with MediaWiki when apprehending the database choice mistake.] The issue here is about an automated test for data comparison in which data has been read from both the originating Postgres database and the migrated MySQL database, then granularly saved in full UTF8 for diff comparison. -- You are receiving this mail because: You are watching all bug changes. _______________________________________________ Koha-bugs mailing list [email protected] https://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
