[Akonadi] [Bug 363741] akonadi server 16.08.1: crashing every few seconds

[Olly Betts via KDE Bugzilla]

https://bugs.kde.org/show_bug.cgi?id=363741

--- Comment #34 from Olly Betts  ---
I've pushed a fix for this to xapian git master, which I'll backport before
1.4.1:

https://git.xapian.org/?p=xapian;a=commitdiff;h=cef6873ab3849875bf4c5d0147a4a07ba562bad9

With this patch, either the old approach or new approach can be used.

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Akonadi] [Bug 363741] akonadi server 16.08.1: crashing every few seconds

[Daniel Vrátil via KDE Bugzilla]

https://bugs.kde.org/show_bug.cgi?id=363741

--- Comment #33 from Daniel Vrátil  ---
Git commit 5aefe02b83a6d73dbd048337d2ba54fee4bbd67c by Daniel Vrátil.
Committed on 13/10/2016 at 07:49.
Pushed by dvratil into branch 'Applications/16.08'.

Fix a memory leak introduced in 1e70d63a943

M  +1-1search/email/emailsearchstore.cpp

http://commits.kde.org/akonadi-search/5aefe02b83a6d73dbd048337d2ba54fee4bbd67c

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Akonadi] [Bug 363741] akonadi server 16.08.1: crashing every few seconds

[Olly Betts via KDE Bugzilla]

https://bugs.kde.org/show_bug.cgi?id=363741

Olly Betts  changed:

   What|Removed |Added

 CC||ojwbetts+...@gmail.com

--- Comment #32 from Olly Betts  ---
> There was an undocumented behaviour change in Xapian 1.4

Otherwise known as a "bug"!  In this case the behaviour change is the bug, but
even if it was deliberate not documenting it would still be a bug.

It would be helpful to forwards reports of such things to the Xapian developers
so we can actually address them.  In this case I happened to stumble across
your report via the Debian BTS when checking for any fallout from the
transition to xapian 1.4 that Debian has just completed - clearly that's not a
reliable or timely way to find out about an issue.  If this had been forwarded
when first reported, we could have fixed it before 1.4.0.

The fix applied in 1e70d63a9439f48b5f1a70accac531a10f4e4239 leaks the
AgePostingSource object - with 1.4.0 your best option is to hand over ownership
like so:

return Xapian::Query(Xapian::Query::OP_AND_MAYBE, query, Xapian::Query((new
AgePostingSource(0))->release()));

Hopefully there's still a way we can fix this without breaking compatibility
with 1.4.0.

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Akonadi] [Bug 363741] akonadi server 16.08.1: crashing every few seconds

[Daniel Vrátil via KDE Bugzilla]

https://bugs.kde.org/show_bug.cgi?id=363741

Daniel Vrátil  changed:

   What|Removed |Added

 Resolution|--- |FIXED
 Status|CONFIRMED   |RESOLVED
  Latest Commit||http://commits.kde.org/akon
   ||adi-search/1e70d63a9439f48b
   ||5f1a70accac531a10f4e4239
   Version Fixed In||5.3.2

--- Comment #31 from Daniel Vrátil  ---
Git commit 1e70d63a9439f48b5f1a70accac531a10f4e4239 by Daniel Vrátil.
Committed on 09/10/2016 at 22:52.
Pushed by dvratil into branch 'Applications/16.08'.

Create AgePostingSource on heap

There was an undocumented behaviour change in Xapian 1.4 where
Xapian::Query() no longer internally creates a clone of the
PostingResource that we pass to it and instead takes a (shared)
ownership of the pointer that is then re-used later while
the actual query is being executed, which means that the
PostingResource must live at least until the query execution
is finished.

We were creating the AgePostingSource on stack, which lead to
use-after-free in Xapian 1.4.
FIXED-IN: 5.3.2

M  +1-2search/email/emailsearchstore.cpp

http://commits.kde.org/akonadi-search/1e70d63a9439f48b5f1a70accac531a10f4e4239

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Akonadi] [Bug 363741] akonadi server 16.08.1: crashing every few seconds

[Sandro Knauß via KDE Bugzilla]

https://bugs.kde.org/show_bug.cgi?id=363741

--- Comment #30 from Sandro Knauß  ---
I used xapian 1.2, but xapian-check emailContacts also fails with the same
error. For all other xapian collections, this don't fail (calendars/ 
collections/  contacts/  email/  notes/). But xapian also shows an warning for
this collection. And it consumes all free RAm, so it may fail, because it just
consume too much RAM? see

Cross-checking document lengths between the postlist and termlist tables would
use more than 1GB of memory, so skipping that check

% ldd /usr/bin/xapian-check
linux-vdso.so.1 (0x7ffc3ddf6000)
libxapian.so.22 => /usr/lib/libxapian.so.22 (0x7f8bac439000)
libstdc++.so.6 => /usr/lib/x86_64-linux-gnu/libstdc++.so.6
(0x7f8bac0b8000)
libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x7f8babdb4000)
libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1
(0x7f8babb9d000)
libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x7f8bab7ff000)
libz.so.1 => /lib/x86_64-linux-gnu/libz.so.1 (0x7f8bab5e2000)
libuuid.so.1 => /lib/x86_64-linux-gnu/libuuid.so.1 (0x7f8bab3dd000)
/lib64/ld-linux-x86-64.so.2 (0x55cb530fc000)

% xapian-check .local/share/baloo/emailContacts
Cross-checking document lengths between the postlist and termlist tables would
use more than 1GB of memory, so skipping that check
record:
baseA blocksize=8K items=80571 lastblock=1159 revision=7650 levels=2 root=458
B-tree checked okay
record table structure checked OK

termlist:
baseA blocksize=8K items=80571 lastblock=1345 revision=7650 levels=2 root=415
B-tree checked okay
xapian-check: Unknown exception
xapian-check .local/share/baloo/emailContacts  5,33s user 11,51s system 69% cpu
24,358 total

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Akonadi] [Bug 363741] akonadi server 16.08.1: crashing every few seconds

[Christoph Feck via KDE Bugzilla]

https://bugs.kde.org/show_bug.cgi?id=363741

Christoph Feck  changed:

   What|Removed |Added

 CC||cf...@kde.org

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Akonadi] [Bug 363741] akonadi server 16.08.1: crashing every few seconds

[Till Schäfer via KDE Bugzilla]

https://bugs.kde.org/show_bug.cgi?id=363741

--- Comment #29 from Till Schäfer  ---
Interesting detail form Bug 367846:

xapian-check .local/share/akonadi/search_db/emailContacts always crashes with
xapian 1.4.x. However, for me, this check even crashes, when akonadi runs fine
atop of Xapian 1.4.0 (an no search query folder exist)

-> As Xapian 1.2.x seem to be working with akonadi -> Can someone with Xapian
1.2.x confirm that this crash does not occur?



$ xapian-check emailContacts/
Cross-checking document lengths between the postlist and termlist tables would
use more than 1GB of memory, so skipping that check
docdata:
blocksize=8K items=16458 firstunused=277 revision=913 levels=1 root=22
B-tree checked okay
docdata table structure checked OK

termlist:
blocksize=8K items=16458 firstunused=349 revision=913 levels=1 root=194
B-tree checked okay
xapian-check: Unknown exception

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Akonadi] [Bug 363741] akonadi server 16.08.1: crashing every few seconds

[Till Schäfer via KDE Bugzilla]

https://bugs.kde.org/show_bug.cgi?id=363741

Till Schäfer  changed:

   What|Removed |Added

 CC||rodney.ba...@iinet.net.au

--- Comment #28 from Till Schäfer  ---
*** Bug 367846 has been marked as a duplicate of this bug. ***

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Akonadi] [Bug 363741] akonadi server 16.08.1: crashing every few seconds

[Sandro Knauß via KDE Bugzilla]

https://bugs.kde.org/show_bug.cgi?id=363741

Sandro Knauß  changed:

   What|Removed |Added

 CC||skna...@kde.org

--- Comment #27 from Sandro Knauß  ---
Sounds like a duplicate of #367846

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Akonadi] [Bug 363741] akonadi server 16.08.1: crashing every few seconds

[ml via KDE Bugzilla]

https://bugs.kde.org/show_bug.cgi?id=363741

ml  changed:

   What|Removed |Added

 CC||iivan...@gmail.com

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Akonadi] [Bug 363741] akonadi server 16.08.1: crashing every few seconds

[Denis Kurz via KDE Bugzilla]

https://bugs.kde.org/show_bug.cgi?id=363741

Denis Kurz  changed:

   What|Removed |Added

Version|16.08   |5.3.1
 CC||kde...@posteo.de

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Akonadi] [Bug 363741] akonadi server 16.08.1: crashing every few seconds

[via KDE Bugzilla]

https://bugs.kde.org/show_bug.cgi?id=363741

hiwatari.se...@gmail.com changed:

   What|Removed |Added

 CC||hiwatari.se...@gmail.com

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Akonadi] [Bug 363741] akonadi server 16.08.1: crashing every few seconds

[Till Schäfer via KDE Bugzilla]

https://bugs.kde.org/show_bug.cgi?id=363741

Till Schäfer  changed:

   What|Removed |Added

Version|16.04   |16.08

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Akonadi] [Bug 363741] akonadi server 16.08.1: crashing every few seconds

[Till Schäfer via KDE Bugzilla]

https://bugs.kde.org/show_bug.cgi?id=363741

--- Comment #26 from Till Schäfer  ---
i have re-triggered the bug by the following actions: 
* open Find Message
* entering a search critera and press search
* a message window popped up telling me that the folder is not completely index
* i have pressed re-index folder

after this, akonadi keeps crashing again.

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Akonadi] [Bug 363741] akonadi server 16.08.1: crashing every few seconds

[Till Schäfer via KDE Bugzilla]

https://bugs.kde.org/show_bug.cgi?id=363741

--- Comment #25 from Till Schäfer  ---
i got rid of the crashing by dumping my mysql database and let akonadi create a
new one

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Akonadi] [Bug 363741] akonadi server 16.08.1: crashing every few seconds

[Till Schäfer via KDE Bugzilla]

https://bugs.kde.org/show_bug.cgi?id=363741

Till Schäfer  changed:

   What|Removed |Added

Summary|akonadi server 16.04.2: |akonadi server 16.08.1:
   |crashing every few seconds  |crashing every few seconds

-- 
You are receiving this mail because:
You are the assignee for the bug.