[Bug 166121] "Remove Duplicate" needs to be improved to handle cases with many duplicates
https://bugs.documentfoundation.org/show_bug.cgi?id=166121 Johannes changed: What|Removed |Added Attachment #200477|0 |1 is obsolete|| --- Comment #14 from Johannes --- Created attachment 206076 --> https://bugs.documentfoundation.org/attachment.cgi?id=206076&action=edit example file comment #13 -- You are receiving this mail because: You are the assignee for the bug.
[Bug 166121] "Remove Duplicate" needs to be improved to handle cases with many duplicates
https://bugs.documentfoundation.org/show_bug.cgi?id=166121 Johannes changed: What|Removed |Added Status|RESOLVED|REOPENED Resolution|FIXED |--- --- Comment #13 from Johannes --- Yes, thanks for the improvements! Nevertheless, not all has been fixed in my opinion. Open attached file, and try to remove duplicates (data > duplicates). This takes a very long time! Compare this behaviour with the standard filter: data > more filters > standard filter > options > no duplications: this takes around 1 second. Why can the standard filter do the job in 1 second, and duplicates needs some minutes? -- You are receiving this mail because: You are the assignee for the bug.
[Bug 166121] "Remove Duplicate" needs to be improved to handle cases with many duplicates
https://bugs.documentfoundation.org/show_bug.cgi?id=166121 --- Comment #12 from nobu --- I was disappointed with the first commit, but recent commits are wonderful improvements. Thank you, Noel Grandin. -- You are receiving this mail because: You are the assignee for the bug.
[Bug 166121] "Remove Duplicate" needs to be improved to handle cases with many duplicates
https://bugs.documentfoundation.org/show_bug.cgi?id=166121 --- Comment #11 from Commit Notification --- Noel Grandin committed a patch related to this issue. It has been pushed to "master": https://git.libreoffice.org/core/commit/0c22a0dd8d2c747a476137ecf2f7cc83e68eb680 tdf#166121 speed up de-duplication by merge deletes It will be available in 26.8.0. The patch should be included in the daily builds available at https://dev-builds.libreoffice.org/daily/ in the next 24-48 hours. More information about daily builds can be found at: https://wiki.documentfoundation.org/Testing_Daily_Builds Affected users are encouraged to test the fix and report feedback. -- You are receiving this mail because: You are the assignee for the bug.
[Bug 166121] "Remove Duplicate" needs to be improved to handle cases with many duplicates
https://bugs.documentfoundation.org/show_bug.cgi?id=166121 Noel Grandin changed: What|Removed |Added Status|NEW |RESOLVED Resolution|--- |FIXED -- You are receiving this mail because: You are the assignee for the bug.
[Bug 166121] "Remove Duplicate" needs to be improved to handle cases with many duplicates
https://bugs.documentfoundation.org/show_bug.cgi?id=166121 --- Comment #10 from Commit Notification --- Noel Grandin committed a patch related to this issue. It has been pushed to "master": https://git.libreoffice.org/core/commit/1b5b22902e22a24f2782057ec2598b0370aeccad tdf#166121 speed up de-duplication by merge deletes It will be available in 26.8.0. The patch should be included in the daily builds available at https://dev-builds.libreoffice.org/daily/ in the next 24-48 hours. More information about daily builds can be found at: https://wiki.documentfoundation.org/Testing_Daily_Builds Affected users are encouraged to test the fix and report feedback. -- You are receiving this mail because: You are the assignee for the bug.
[Bug 166121] "Remove Duplicate" needs to be improved to handle cases with many duplicates
https://bugs.documentfoundation.org/show_bug.cgi?id=166121 --- Comment #9 from Commit Notification --- Noel Grandin committed a patch related to this issue. It has been pushed to "master": https://git.libreoffice.org/core/commit/eef514e5c375b50883189fc9383f2394e00f1bc2 tdf#166121 split lcl_CheckInArray function It will be available in 26.8.0. The patch should be included in the daily builds available at https://dev-builds.libreoffice.org/daily/ in the next 24-48 hours. More information about daily builds can be found at: https://wiki.documentfoundation.org/Testing_Daily_Builds Affected users are encouraged to test the fix and report feedback. -- You are receiving this mail because: You are the assignee for the bug.
[Bug 166121] "Remove Duplicate" needs to be improved to handle cases with many duplicates
https://bugs.documentfoundation.org/show_bug.cgi?id=166121 --- Comment #8 from Commit Notification --- Noel Grandin committed a patch related to this issue. It has been pushed to "master": https://git.libreoffice.org/core/commit/8b2a0bbd246f685f5fe85c7add736f60a110188d tdf#166121 inline lcl_RemoveCells It will be available in 26.8.0. The patch should be included in the daily builds available at https://dev-builds.libreoffice.org/daily/ in the next 24-48 hours. More information about daily builds can be found at: https://wiki.documentfoundation.org/Testing_Daily_Builds Affected users are encouraged to test the fix and report feedback. -- You are receiving this mail because: You are the assignee for the bug.
[Bug 166121] "Remove Duplicate" needs to be improved to handle cases with many duplicates
https://bugs.documentfoundation.org/show_bug.cgi?id=166121 Commit Notification changed: What|Removed |Added Whiteboard|target:26.2.0 |target:26.2.0 |inReleaseNotes:26.2 |inReleaseNotes:26.2 ||target:26.8.0 -- You are receiving this mail because: You are the assignee for the bug.
[Bug 166121] "Remove Duplicate" needs to be improved to handle cases with many duplicates
https://bugs.documentfoundation.org/show_bug.cgi?id=166121 Buovjaga changed: What|Removed |Added CC||ilmari.lauhakangas@libreoff ||ice.org --- Comment #6 from Buovjaga --- (In reply to Johannes from comment #2) > Created attachment 200477 [details] > Example file With master, removing takes ~5.5 secs while with 25.8.1 it takes ~16.5 secs. Arch Linux 64-bit Version: 26.2.0.0.alpha0+ (X86_64) / LibreOffice Community Build ID: 3c29e1277bda566b4455123a7a53c8f0fc6eda98 CPU threads: 8; OS: Linux 6.16; UI render: default; VCL: gtk3 Locale: fi-FI (fi_FI.UTF-8); UI: en-US Calc: CL threaded Built on 3 October 2025 -- You are receiving this mail because: You are the assignee for the bug.
[Bug 166121] "Remove Duplicate" needs to be improved to handle cases with many duplicates
https://bugs.documentfoundation.org/show_bug.cgi?id=166121 Buovjaga changed: What|Removed |Added Whiteboard|target:26.2.0 |target:26.2.0 ||inReleaseNotes:26.2 -- You are receiving this mail because: You are the assignee for the bug.
[Bug 166121] "Remove Duplicate" needs to be improved to handle cases with many duplicates
https://bugs.documentfoundation.org/show_bug.cgi?id=166121 --- Comment #4 from Commit Notification --- Noel Grandin committed a patch related to this issue. It has been pushed to "master": https://git.libreoffice.org/core/commit/29425a537bc182b38efcb1120e9f430b28d503a4 tdf#166121 supress row height calc during "Remove Duplicate" It will be available in 26.2.0. The patch should be included in the daily builds available at https://dev-builds.libreoffice.org/daily/ in the next 24-48 hours. More information about daily builds can be found at: https://wiki.documentfoundation.org/Testing_Daily_Builds Affected users are encouraged to test the fix and report feedback. -- You are receiving this mail because: You are the assignee for the bug.
[Bug 166121] "Remove Duplicate" needs to be improved to handle cases with many duplicates
https://bugs.documentfoundation.org/show_bug.cgi?id=166121 --- Comment #5 from Commit Notification --- Noel Grandin committed a patch related to this issue. It has been pushed to "master": https://git.libreoffice.org/core/commit/56fde5e66f22d68237150c501583fdf734c69c96 tdf#166121 reduce cost of clipboard during Remove Duplicates It will be available in 26.2.0. The patch should be included in the daily builds available at https://dev-builds.libreoffice.org/daily/ in the next 24-48 hours. More information about daily builds can be found at: https://wiki.documentfoundation.org/Testing_Daily_Builds Affected users are encouraged to test the fix and report feedback. -- You are receiving this mail because: You are the assignee for the bug.
[Bug 166121] "Remove Duplicate" needs to be improved to handle cases with many duplicates
https://bugs.documentfoundation.org/show_bug.cgi?id=166121 Commit Notification changed: What|Removed |Added Whiteboard||target:26.2.0 -- You are receiving this mail because: You are the assignee for the bug.
[Bug 166121] "Remove Duplicate" needs to be improved to handle cases with many duplicates
https://bugs.documentfoundation.org/show_bug.cgi?id=166121 BogdanB changed: What|Removed |Added Blocks||107977, 136524 CC||[email protected] ||g Referenced Bugs: https://bugs.documentfoundation.org/show_bug.cgi?id=107977 [Bug 107977] [META] Calc feature enhancements https://bugs.documentfoundation.org/show_bug.cgi?id=136524 [Bug 136524] [META] Performance/hang/lag/high CPU issues -- You are receiving this mail because: You are the assignee for the bug.
[Bug 166121] "Remove Duplicate" needs to be improved to handle cases with many duplicates
https://bugs.documentfoundation.org/show_bug.cgi?id=166121 Johannes changed: What|Removed |Added See Also||https://bugs.documentfounda ||tion.org/show_bug.cgi?id=16 ||5566 -- You are receiving this mail because: You are the assignee for the bug.
[Bug 166121] "Remove Duplicate" needs to be improved to handle cases with many duplicates
https://bugs.documentfoundation.org/show_bug.cgi?id=166121 --- Comment #3 from nobu --- https://www.reddit.com/r/libreoffice/comments/1m7a6zq/comment/n4qqu7l/ -- You are receiving this mail because: You are the assignee for the bug.
[Bug 166121] "Remove Duplicate" needs to be improved to handle cases with many duplicates
https://bugs.documentfoundation.org/show_bug.cgi?id=166121 Johannes changed: What|Removed |Added CC||[email protected] --- Comment #2 from Johannes --- Created attachment 200477 --> https://bugs.documentfoundation.org/attachment.cgi?id=200477&action=edit Example file Example file added. -- You are receiving this mail because: You are the assignee for the bug.
[Bug 166121] "Remove Duplicate" needs to be improved to handle cases with many duplicates
https://bugs.documentfoundation.org/show_bug.cgi?id=166121 Johannes changed: What|Removed |Added Version|25.8.0.0 alpha0+|25.2.2.2 release -- You are receiving this mail because: You are the assignee for the bug.
[Bug 166121] "Remove Duplicate" needs to be improved to handle cases with many duplicates
https://bugs.documentfoundation.org/show_bug.cgi?id=166121 Johannes changed: What|Removed |Added OS|Windows (All) |All Status|UNCONFIRMED |NEW Ever confirmed|0 |1 --- Comment #1 from Johannes --- I can confirm that the functionality for removing duplicates is very slow with a lot of data - even with examples that are not extreme. Reproducible with Version: 25.8.0.0.alpha0+ (X86_64) / LibreOffice Community Build ID: ea4921a3e31cf87c60e2eceeec46cccdc6a79b23 CPU threads: 4; OS: Linux 6.14; UI render: default; VCL: kf5 (cairo+wayland) Locale: nl-NL (nl_NL.UTF-8); UI: en-US Calc: threaded -- You are receiving this mail because: You are the assignee for the bug.
[Bug 166121] "Remove Duplicate" needs to be improved to handle cases with many duplicates
https://bugs.documentfoundation.org/show_bug.cgi?id=166121 Roman Kuznetsov <[email protected]> changed: What|Removed |Added Keywords||perf -- You are receiving this mail because: You are the assignee for the bug.
