[Bug 258361] An account with many mails cannot be synced (performance problem)

2011-01-20 Thread Tobias Koenig
https://bugs.kde.org/show_bug.cgi?id=258361





--- Comment #13 from Tobias Koenig tokoe kde org  2011-01-20 18:52:35 ---
Ludwig, can you restest please with new packages if the changes to the sqlite
backend improved performance?

-- 
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the assignee for the bug.
___
Kdepim-bugs mailing list
Kdepim-bugs@kde.org
https://mail.kde.org/mailman/listinfo/kdepim-bugs


[Bug 258361] An account with many mails cannot be synced (performance problem)

2011-01-14 Thread Andre Heinecke
https://bugs.kde.org/show_bug.cgi?id=258361





--- Comment #12 from Andre Heinecke aheinecke intevation de  2011-01-14 
19:01:04 ---

A server/src/storage/akonadidb_mobile.qrc [License: Trivialfile.]


A server/src/storage/akonadidb-mobile.xml [License: Trivialfile.]

commit 8a2400f131cba56c6c8ce37e27073c23210d7fb2
Author: Andre Heinecke aheine...@intevation.de
Date:   Fri Jan 14 17:56:56 2011 +

Optimize WinCE db performance by removing indices.

 SQLite benchmarks on Windows CE have shown that creation
 and maintenance of indices are expensive. It has to be
 evaluated if they are used by SQLites query planner
 with the statements by Akonadi anyhow. Tests have shown an
 improvement for initial sync on WinCE of ~40% which is
 also the difference we saw benchmarking many insert statements.

 CCBUG: 258361

diff --git a/server/CMakeLists.txt b/server/CMakeLists.txt
index da8e912..036e803 100644
--- a/server/CMakeLists.txt
+++ b/server/CMakeLists.txt
@@ -32,21 +32,27 @@ endif ( MYSQLD_EXECUTABLE )

 ### next target ###

+if(NOT WINCE)
+   set (AKONADI_DB_SCHEME
${CMAKE_CURRENT_SOURCE_DIR}/src/storage/akonadidb.xml)
+else(NOT WINCE)
+   set (AKONADI_DB_SCHEME
${CMAKE_CURRENT_SOURCE_DIR}/src/storage/akonadidb-mobile.xml)
+endif(NOT WINCE)
+
 add_custom_command(
   OUTPUT ${CMAKE_CURRENT_BINARY_DIR}/entities.h
  ${CMAKE_CURRENT_BINARY_DIR}/entities.cpp
   COMMAND ${XSLTPROC_EXECUTABLE} --stringparam code header
   ${CMAKE_CURRENT_SOURCE_DIR}/src/storage/entities.xsl
-  ${CMAKE_CURRENT_SOURCE_DIR}/src/storage/akonadidb.xml
+  ${AKONADI_DB_SCHEME}
${CMAKE_CURRENT_BINARY_DIR}/entities.h
   COMMAND ${XSLTPROC_EXECUTABLE} --stringparam code source
   ${CMAKE_CURRENT_SOURCE_DIR}/src/storage/entities.xsl
-  ${CMAKE_CURRENT_SOURCE_DIR}/src/storage/akonadidb.xml
+  ${AKONADI_DB_SCHEME}
${CMAKE_CURRENT_BINARY_DIR}/entities.cpp
   DEPENDS ${CMAKE_CURRENT_SOURCE_DIR}/src/storage/entities.xsl
   ${CMAKE_CURRENT_SOURCE_DIR}/src/storage/entities-header.xsl
   ${CMAKE_CURRENT_SOURCE_DIR}/src/storage/entities-source.xsl
-  ${CMAKE_CURRENT_SOURCE_DIR}/src/storage/akonadidb.xml
+  ${AKONADI_DB_SCHEME}
 )

 set(libakonadiprivate_SRCS
@@ -168,7 +174,11 @@ set_source_files_properties(${xesam_xml} PROPERTIES
INCLUDE xesamtypes.h)

 qt4_add_dbus_interface( libakonadiprivate_SRCS ${xesam_xml} xesaminterface )

-qt4_add_resources( libakonadiprivate_SRCS src/storage/akonadidb.qrc )
+if(NOT WINCE)
+  qt4_add_resources( libakonadiprivate_SRCS src/storage/akonadidb.qrc )
+else(NOT WINCE)
+  qt4_add_resources( libakonadiprivate_SRCS src/storage/akonadidb_mobile.qrc )
+endif(NOT WINCE)


 automoc4_add_library( akonadiprivate STATIC ${libakonadiprivate_SRCS} )
diff --git a/server/src/main.cpp b/server/src/main.cpp
index a7637e2..8543c6b 100644
--- a/server/src/main.cpp
+++ b/server/src/main.cpp
@@ -53,7 +53,11 @@ void shutdownHandler( int )

 int main( int argc, char ** argv )
 {
+#ifndef _WIN32_WCE
 Q_INIT_RESOURCE( akonadidb );
+#else
+Q_INIT_RESOURCE( akonadidb_mobile );
+#endif
 AkApplication app( argc, argv );
 app.setDescription( QLatin1String( Akonadi Server\nDo not run manually,
use 'akonadictl' instead to start/stop Akonadi. ) );

@@ -89,6 +93,11 @@ int main( int argc, char ** argv )

 Akonadi::AkonadiServer::instance()-quit();

+#ifndef _WIN32_WCE
 Q_CLEANUP_RESOURCE( akonadidb );
+#else
+Q_CLEANUP_RESOURCE( akonadidb_mobile );
+#endif
+
 return result;
 }
diff --git a/server/src/storage/akonadidb-mobile.xml
b/server/src/storage/akonadidb-mobile.xml
new file mode 100644
index 000..b50224c
--- /dev/null
+++ b/server/src/storage/akonadidb-mobile.xml
@@ -0,0 +1,185 @@
+?xml version=1.0 encoding=UTF-8?
+!--
+
+Copyright (c) 2006 Volker Krause vkra...@kde.org
+Copyright (C) 2006 by Tobias Koenig to...@kde.org
+
+This library is free software; you can redistribute it and/or modify it
+under the terms of the GNU Library General Public License as published by
+the Free Software Foundation; either version 2 of the License, or (at your
+option) any later version.
+
+This library is distributed in the hope that it will be useful, but
WITHOUT
+ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or
+FITNESS FOR A PARTICULAR PURPOSE.  See the GNU Library General Public
+License for more details.
+
+You should have received a copy of the GNU Library General Public License
+along with this library; see the file COPYING.LIB.  If not, write to the
+Free Software Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston,
MA
+02110-1301, USA.
+
+--
+
+
+!--
+  Akonadi Database Schema Definition
+
+  This file is used to generate database access code as well as the tables
itself.
+
+  Database element (root node, can contain table 

[Bug 258361] An account with many mails cannot be synced (performance problem)

2011-01-12 Thread Ludwig Reiter
https://bugs.kde.org/show_bug.cgi?id=258361





--- Comment #11 from Ludwig Reiter ludwig reiter intevation de  2011-01-12 
12:23:15 ---
Retested again with Windows CE. This time I looked at the CPU load while
syncing large1:
At the beginning of the sync:
akonadi agent server ~13 
dbus ~8
akonadi_imap_resource ~6-14

In the middle of the sync:
kmail mobile 6-7
(sometimes) dbus ~8

So the bottleneck is not the CPU I would suppose.

-- 
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the assignee for the bug.
___
Kdepim-bugs mailing list
Kdepim-bugs@kde.org
https://mail.kde.org/mailman/listinfo/kdepim-bugs


[Bug 258361] An account with many mails cannot be synced (performance problem)

2011-01-10 Thread Ludwig Reiter
https://bugs.kde.org/show_bug.cgi?id=258361


Ludwig Reiter ludwig.rei...@intevation.de changed:

   What|Removed |Added

 Status|NEEDSINFO   |REOPENED
 Resolution|WAITINGFORINFO  |




--- Comment #7 from Ludwig Reiter ludwig reiter intevation de  2011-01-10 
16:36:11 ---
It needs 25 mins to sync 2000 mails (large1, large2)
In this time the download arrow is displayed. and the account says:
[download arrow] Syncing collection 'large1' [or 'large2']
After 25 mins, I cannot scroll to every mail in large2. (Unread 997, but can
only look at mail 1 to 122) and account: Ready.

I think 25 mins is too long to sync 2000 small mails and then I should be able
to scroll to every mail in both folders.

-- 
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the assignee for the bug.
___
Kdepim-bugs mailing list
Kdepim-bugs@kde.org
https://mail.kde.org/mailman/listinfo/kdepim-bugs


[Bug 258361] An account with many mails cannot be synced (performance problem)

2011-01-10 Thread Ludwig Reiter
https://bugs.kde.org/show_bug.cgi?id=258361





--- Comment #8 from Ludwig Reiter ludwig reiter intevation de  2011-01-10 
16:41:31 ---
After additional 7 min Kontact told me that he is ready and then I can scroll
all mails.
So the problem is the sync time (~32 minutes for 2000 mails)

-- 
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the assignee for the bug.
___
Kdepim-bugs mailing list
Kdepim-bugs@kde.org
https://mail.kde.org/mailman/listinfo/kdepim-bugs


[Bug 258361] An account with many mails cannot be synced (performance problem)

2011-01-10 Thread Till Adam
https://bugs.kde.org/show_bug.cgi?id=258361


Till Adam a...@kde.org changed:

   What|Removed |Added

 CC||a...@kde.org




--- Comment #9 from Till Adam adam kde org  2011-01-10 17:07:32 ---
Ludwig, please try timing the same folder on both CE and N900, to see if the
sync speed is comparable. If i is, we can debug/profile on Linux, which is much
easier. It doesn't matter mcuh how you measure, as long as you measure the same
on both devices. The absolute numbers don't matter much, only the relative
ones.

-- 
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the assignee for the bug.
___
Kdepim-bugs mailing list
Kdepim-bugs@kde.org
https://mail.kde.org/mailman/listinfo/kdepim-bugs


[Bug 258361] An account with many mails cannot be synced (performance problem)

2011-01-03 Thread Tobias Koenig
https://bugs.kde.org/show_bug.cgi?id=258361


Tobias Koenig to...@kde.org changed:

   What|Removed |Added

 Status|REOPENED|NEEDSINFO
 CC||to...@kde.org
 Resolution||WAITINGFORINFO




--- Comment #6 from Tobias Koenig tokoe kde org  2011-01-04 07:01:05 ---
Ludwig, any news on this topic?

-- 
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the assignee for the bug.
___
Kdepim-bugs mailing list
Kdepim-bugs@kde.org
https://mail.kde.org/mailman/listinfo/kdepim-bugs


[Bug 258361] An account with many mails cannot be synced (performance problem)

2010-12-13 Thread Volker Krause
https://bugs.kde.org/show_bug.cgi?id=258361





--- Comment #5 from Volker Krause vkrause kde org  2010-12-13 13:00:39 ---
Is the akonadi_imap_resource process still running? What does the global status
indicator (top left in the app) show? What does the detailed resource status
show (Home - Actions - Accounts)? Any change when toggling online/offline?

-- 
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the assignee for the bug.
___
Kdepim-bugs mailing list
Kdepim-bugs@kde.org
https://mail.kde.org/mailman/listinfo/kdepim-bugs


[Bug 258361] An account with many mails cannot be synced (performance problem)

2010-12-10 Thread Ludwig Reiter
https://bugs.kde.org/show_bug.cgi?id=258361


Ludwig Reiter ludwig.rei...@intevation.de changed:

   What|Removed |Added

 Status|RESOLVED|REOPENED
 Resolution|FIXED   |




--- Comment #4 from Ludwig Reiter ludwig reiter intevation de  2010-12-10 
14:38:39 ---
version: 4.6. beta2 (svn-1204839)

Not fixed.

Setup:
Inbox 10 mails
|- large1 1050 mails
|- large2 1050 mails
|- large3 1050 mails

I select the inbox and waited 10(!) minutes, but the inbox says: No mails in
this folder.

So not fixed.

-- 
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the assignee for the bug.
___
Kdepim-bugs mailing list
Kdepim-bugs@kde.org
https://mail.kde.org/mailman/listinfo/kdepim-bugs


[Bug 258361] An account with many mails cannot be synced (performance problem)

2010-12-06 Thread Andreas Holzammer
https://bugs.kde.org/show_bug.cgi?id=258361


Andreas Holzammer a...@kdab.com changed:

   What|Removed |Added

 Status|NEW |RESOLVED
 CC||a...@kdab.com
 Resolution||FIXED




--- Comment #2 from Andreas Holzammer andy kdab com  2010-12-06 17:24:00 ---
This was a memory problem, which should be fixed now.

-- 
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the assignee for the bug.
___
Kdepim-bugs mailing list
Kdepim-bugs@kde.org
https://mail.kde.org/mailman/listinfo/kdepim-bugs


[Bug 258361] An account with many mails cannot be synced (performance problem)

2010-12-06 Thread Volker Krause
https://bugs.kde.org/show_bug.cgi?id=258361





--- Comment #3 from Volker Krause vkrause kde org  2010-12-06 17:25:33 ---
Fixed in revision 1204255.

-- 
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the assignee for the bug.
___
Kdepim-bugs mailing list
Kdepim-bugs@kde.org
https://mail.kde.org/mailman/listinfo/kdepim-bugs


[Bug 258361] An account with many mails cannot be synced (performance problem)

2010-12-03 Thread Volker Krause
https://bugs.kde.org/show_bug.cgi?id=258361





--- Comment #1 from Volker Krause vkrause kde org  2010-12-03 10:16:37 ---
SVN commit 1203130 by vkrause:

Disable the session timeout for now, at least with such a small value it
causes more harm than good apparently.

BUG: 258271
CCBUG: 258361
CCBUG: 258378


 M  +1 -1  imapresource.kcfg  


WebSVN link: http://websvn.kde.org/?view=revrevision=1203130

-- 
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the assignee for the bug.
___
Kdepim-bugs mailing list
Kdepim-bugs@kde.org
https://mail.kde.org/mailman/listinfo/kdepim-bugs


[Bug 258361] An account with many mails cannot be synced (performance problem)

2010-11-30 Thread Ludwig Reiter
https://bugs.kde.org/show_bug.cgi?id=258361


Ludwig Reiter ludwig.rei...@intevation.de changed:

   What|Removed |Added

   Keywords||komo3




-- 
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the assignee for the bug.
___
Kdepim-bugs mailing list
Kdepim-bugs@kde.org
https://mail.kde.org/mailman/listinfo/kdepim-bugs