[Bug 258361] An account with many mails cannot be synced (performance problem)
https://bugs.kde.org/show_bug.cgi?id=258361 --- Comment #13 from Tobias Koenig tokoe kde org 2011-01-20 18:52:35 --- Ludwig, can you restest please with new packages if the changes to the sqlite backend improved performance? -- Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. ___ Kdepim-bugs mailing list Kdepim-bugs@kde.org https://mail.kde.org/mailman/listinfo/kdepim-bugs
[Bug 258361] An account with many mails cannot be synced (performance problem)
https://bugs.kde.org/show_bug.cgi?id=258361 --- Comment #12 from Andre Heinecke aheinecke intevation de 2011-01-14 19:01:04 --- A server/src/storage/akonadidb_mobile.qrc [License: Trivialfile.] A server/src/storage/akonadidb-mobile.xml [License: Trivialfile.] commit 8a2400f131cba56c6c8ce37e27073c23210d7fb2 Author: Andre Heinecke aheine...@intevation.de Date: Fri Jan 14 17:56:56 2011 + Optimize WinCE db performance by removing indices. SQLite benchmarks on Windows CE have shown that creation and maintenance of indices are expensive. It has to be evaluated if they are used by SQLites query planner with the statements by Akonadi anyhow. Tests have shown an improvement for initial sync on WinCE of ~40% which is also the difference we saw benchmarking many insert statements. CCBUG: 258361 diff --git a/server/CMakeLists.txt b/server/CMakeLists.txt index da8e912..036e803 100644 --- a/server/CMakeLists.txt +++ b/server/CMakeLists.txt @@ -32,21 +32,27 @@ endif ( MYSQLD_EXECUTABLE ) ### next target ### +if(NOT WINCE) + set (AKONADI_DB_SCHEME ${CMAKE_CURRENT_SOURCE_DIR}/src/storage/akonadidb.xml) +else(NOT WINCE) + set (AKONADI_DB_SCHEME ${CMAKE_CURRENT_SOURCE_DIR}/src/storage/akonadidb-mobile.xml) +endif(NOT WINCE) + add_custom_command( OUTPUT ${CMAKE_CURRENT_BINARY_DIR}/entities.h ${CMAKE_CURRENT_BINARY_DIR}/entities.cpp COMMAND ${XSLTPROC_EXECUTABLE} --stringparam code header ${CMAKE_CURRENT_SOURCE_DIR}/src/storage/entities.xsl - ${CMAKE_CURRENT_SOURCE_DIR}/src/storage/akonadidb.xml + ${AKONADI_DB_SCHEME} ${CMAKE_CURRENT_BINARY_DIR}/entities.h COMMAND ${XSLTPROC_EXECUTABLE} --stringparam code source ${CMAKE_CURRENT_SOURCE_DIR}/src/storage/entities.xsl - ${CMAKE_CURRENT_SOURCE_DIR}/src/storage/akonadidb.xml + ${AKONADI_DB_SCHEME} ${CMAKE_CURRENT_BINARY_DIR}/entities.cpp DEPENDS ${CMAKE_CURRENT_SOURCE_DIR}/src/storage/entities.xsl ${CMAKE_CURRENT_SOURCE_DIR}/src/storage/entities-header.xsl ${CMAKE_CURRENT_SOURCE_DIR}/src/storage/entities-source.xsl - ${CMAKE_CURRENT_SOURCE_DIR}/src/storage/akonadidb.xml + ${AKONADI_DB_SCHEME} ) set(libakonadiprivate_SRCS @@ -168,7 +174,11 @@ set_source_files_properties(${xesam_xml} PROPERTIES INCLUDE xesamtypes.h) qt4_add_dbus_interface( libakonadiprivate_SRCS ${xesam_xml} xesaminterface ) -qt4_add_resources( libakonadiprivate_SRCS src/storage/akonadidb.qrc ) +if(NOT WINCE) + qt4_add_resources( libakonadiprivate_SRCS src/storage/akonadidb.qrc ) +else(NOT WINCE) + qt4_add_resources( libakonadiprivate_SRCS src/storage/akonadidb_mobile.qrc ) +endif(NOT WINCE) automoc4_add_library( akonadiprivate STATIC ${libakonadiprivate_SRCS} ) diff --git a/server/src/main.cpp b/server/src/main.cpp index a7637e2..8543c6b 100644 --- a/server/src/main.cpp +++ b/server/src/main.cpp @@ -53,7 +53,11 @@ void shutdownHandler( int ) int main( int argc, char ** argv ) { +#ifndef _WIN32_WCE Q_INIT_RESOURCE( akonadidb ); +#else +Q_INIT_RESOURCE( akonadidb_mobile ); +#endif AkApplication app( argc, argv ); app.setDescription( QLatin1String( Akonadi Server\nDo not run manually, use 'akonadictl' instead to start/stop Akonadi. ) ); @@ -89,6 +93,11 @@ int main( int argc, char ** argv ) Akonadi::AkonadiServer::instance()-quit(); +#ifndef _WIN32_WCE Q_CLEANUP_RESOURCE( akonadidb ); +#else +Q_CLEANUP_RESOURCE( akonadidb_mobile ); +#endif + return result; } diff --git a/server/src/storage/akonadidb-mobile.xml b/server/src/storage/akonadidb-mobile.xml new file mode 100644 index 000..b50224c --- /dev/null +++ b/server/src/storage/akonadidb-mobile.xml @@ -0,0 +1,185 @@ +?xml version=1.0 encoding=UTF-8? +!-- + +Copyright (c) 2006 Volker Krause vkra...@kde.org +Copyright (C) 2006 by Tobias Koenig to...@kde.org + +This library is free software; you can redistribute it and/or modify it +under the terms of the GNU Library General Public License as published by +the Free Software Foundation; either version 2 of the License, or (at your +option) any later version. + +This library is distributed in the hope that it will be useful, but WITHOUT +ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or +FITNESS FOR A PARTICULAR PURPOSE. See the GNU Library General Public +License for more details. + +You should have received a copy of the GNU Library General Public License +along with this library; see the file COPYING.LIB. If not, write to the +Free Software Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA +02110-1301, USA. + +-- + + +!-- + Akonadi Database Schema Definition + + This file is used to generate database access code as well as the tables itself. + + Database element (root node, can contain table
[Bug 258361] An account with many mails cannot be synced (performance problem)
https://bugs.kde.org/show_bug.cgi?id=258361 --- Comment #11 from Ludwig Reiter ludwig reiter intevation de 2011-01-12 12:23:15 --- Retested again with Windows CE. This time I looked at the CPU load while syncing large1: At the beginning of the sync: akonadi agent server ~13 dbus ~8 akonadi_imap_resource ~6-14 In the middle of the sync: kmail mobile 6-7 (sometimes) dbus ~8 So the bottleneck is not the CPU I would suppose. -- Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. ___ Kdepim-bugs mailing list Kdepim-bugs@kde.org https://mail.kde.org/mailman/listinfo/kdepim-bugs
[Bug 258361] An account with many mails cannot be synced (performance problem)
https://bugs.kde.org/show_bug.cgi?id=258361 Ludwig Reiter ludwig.rei...@intevation.de changed: What|Removed |Added Status|NEEDSINFO |REOPENED Resolution|WAITINGFORINFO | --- Comment #7 from Ludwig Reiter ludwig reiter intevation de 2011-01-10 16:36:11 --- It needs 25 mins to sync 2000 mails (large1, large2) In this time the download arrow is displayed. and the account says: [download arrow] Syncing collection 'large1' [or 'large2'] After 25 mins, I cannot scroll to every mail in large2. (Unread 997, but can only look at mail 1 to 122) and account: Ready. I think 25 mins is too long to sync 2000 small mails and then I should be able to scroll to every mail in both folders. -- Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. ___ Kdepim-bugs mailing list Kdepim-bugs@kde.org https://mail.kde.org/mailman/listinfo/kdepim-bugs
[Bug 258361] An account with many mails cannot be synced (performance problem)
https://bugs.kde.org/show_bug.cgi?id=258361 --- Comment #8 from Ludwig Reiter ludwig reiter intevation de 2011-01-10 16:41:31 --- After additional 7 min Kontact told me that he is ready and then I can scroll all mails. So the problem is the sync time (~32 minutes for 2000 mails) -- Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. ___ Kdepim-bugs mailing list Kdepim-bugs@kde.org https://mail.kde.org/mailman/listinfo/kdepim-bugs
[Bug 258361] An account with many mails cannot be synced (performance problem)
https://bugs.kde.org/show_bug.cgi?id=258361 Till Adam a...@kde.org changed: What|Removed |Added CC||a...@kde.org --- Comment #9 from Till Adam adam kde org 2011-01-10 17:07:32 --- Ludwig, please try timing the same folder on both CE and N900, to see if the sync speed is comparable. If i is, we can debug/profile on Linux, which is much easier. It doesn't matter mcuh how you measure, as long as you measure the same on both devices. The absolute numbers don't matter much, only the relative ones. -- Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. ___ Kdepim-bugs mailing list Kdepim-bugs@kde.org https://mail.kde.org/mailman/listinfo/kdepim-bugs
[Bug 258361] An account with many mails cannot be synced (performance problem)
https://bugs.kde.org/show_bug.cgi?id=258361 Tobias Koenig to...@kde.org changed: What|Removed |Added Status|REOPENED|NEEDSINFO CC||to...@kde.org Resolution||WAITINGFORINFO --- Comment #6 from Tobias Koenig tokoe kde org 2011-01-04 07:01:05 --- Ludwig, any news on this topic? -- Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. ___ Kdepim-bugs mailing list Kdepim-bugs@kde.org https://mail.kde.org/mailman/listinfo/kdepim-bugs
[Bug 258361] An account with many mails cannot be synced (performance problem)
https://bugs.kde.org/show_bug.cgi?id=258361 --- Comment #5 from Volker Krause vkrause kde org 2010-12-13 13:00:39 --- Is the akonadi_imap_resource process still running? What does the global status indicator (top left in the app) show? What does the detailed resource status show (Home - Actions - Accounts)? Any change when toggling online/offline? -- Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. ___ Kdepim-bugs mailing list Kdepim-bugs@kde.org https://mail.kde.org/mailman/listinfo/kdepim-bugs
[Bug 258361] An account with many mails cannot be synced (performance problem)
https://bugs.kde.org/show_bug.cgi?id=258361 Ludwig Reiter ludwig.rei...@intevation.de changed: What|Removed |Added Status|RESOLVED|REOPENED Resolution|FIXED | --- Comment #4 from Ludwig Reiter ludwig reiter intevation de 2010-12-10 14:38:39 --- version: 4.6. beta2 (svn-1204839) Not fixed. Setup: Inbox 10 mails |- large1 1050 mails |- large2 1050 mails |- large3 1050 mails I select the inbox and waited 10(!) minutes, but the inbox says: No mails in this folder. So not fixed. -- Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. ___ Kdepim-bugs mailing list Kdepim-bugs@kde.org https://mail.kde.org/mailman/listinfo/kdepim-bugs
[Bug 258361] An account with many mails cannot be synced (performance problem)
https://bugs.kde.org/show_bug.cgi?id=258361 Andreas Holzammer a...@kdab.com changed: What|Removed |Added Status|NEW |RESOLVED CC||a...@kdab.com Resolution||FIXED --- Comment #2 from Andreas Holzammer andy kdab com 2010-12-06 17:24:00 --- This was a memory problem, which should be fixed now. -- Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. ___ Kdepim-bugs mailing list Kdepim-bugs@kde.org https://mail.kde.org/mailman/listinfo/kdepim-bugs
[Bug 258361] An account with many mails cannot be synced (performance problem)
https://bugs.kde.org/show_bug.cgi?id=258361 --- Comment #3 from Volker Krause vkrause kde org 2010-12-06 17:25:33 --- Fixed in revision 1204255. -- Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. ___ Kdepim-bugs mailing list Kdepim-bugs@kde.org https://mail.kde.org/mailman/listinfo/kdepim-bugs
[Bug 258361] An account with many mails cannot be synced (performance problem)
https://bugs.kde.org/show_bug.cgi?id=258361 --- Comment #1 from Volker Krause vkrause kde org 2010-12-03 10:16:37 --- SVN commit 1203130 by vkrause: Disable the session timeout for now, at least with such a small value it causes more harm than good apparently. BUG: 258271 CCBUG: 258361 CCBUG: 258378 M +1 -1 imapresource.kcfg WebSVN link: http://websvn.kde.org/?view=revrevision=1203130 -- Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. ___ Kdepim-bugs mailing list Kdepim-bugs@kde.org https://mail.kde.org/mailman/listinfo/kdepim-bugs
[Bug 258361] An account with many mails cannot be synced (performance problem)
https://bugs.kde.org/show_bug.cgi?id=258361 Ludwig Reiter ludwig.rei...@intevation.de changed: What|Removed |Added Keywords||komo3 -- Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the assignee for the bug. ___ Kdepim-bugs mailing list Kdepim-bugs@kde.org https://mail.kde.org/mailman/listinfo/kdepim-bugs