[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 caulier.gil...@gmail.com changed: What|Removed |Added Severity|normal |crash -- You are receiving this

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 caulier.gil...@gmail.com changed: What|Removed |Added Component|Faces-Engine|Database-Faces -- You are receiving

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #67 from Evert Vorster --- Thanks for the updated patch. It's building now. My latest test was with all the patches installed, and it scanned all the way through my collection. There are a few smaller bugs where

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #66 from Maik Qualmann --- Created attachment 100038 --> https://bugs.kde.org/attachment.cgi?id=100038=edit currentFace31.patch New patch, face modul updated to the latest version of OpenCV3.1. Please test it with

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 Maik Qualmann changed: What|Removed |Added Attachment #2|0 |1 is obsolete|

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #65 from caulier.gil...@gmail.com --- As i said previously, i processed on my VM with my collection all faces scan with Mysql server + multicore CPU support. No crash. About TBB support in OpenCV 3.1 that i compiled, i don't set anything to

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #64 from caulier.gil...@gmail.com --- Evert, My patch use OpenCV 3.1 tarball. OpenCV-contrib come from github as well (current implementation. As i know there is no OpenCV-contrib tarball released. This is very problematic as API/ABI

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #63 from Evert Vorster --- Update on the status. I am now compiling digikam with all the patches except for Gilles' patch to use face module form opencv_contrib instead from digiKam core. That patch causes a

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #62 from Evert Vorster --- Just tested with the vanilla code, and digikam does indeed crash earlier than with the patch. I am now installing just Maik's patch, and re-running it. -- You are receiving this mail

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #61 from Evert Vorster --- Small correction, it seems my source tree was not cleaned as thoroughly as I thought it was, and so I appear to have built digikam with all the patches applied when I thought it was not.

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #60 from Evert Vorster --- Hi there.. OK, so, I recompiled digikam with no patch, and ran the face detection against my picture library. The face detect would usually fail anywhere from 1 to 4% through the

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #59 from caulier.gil...@gmail.com --- Note : with my patch, multi-coree enabled, and mysql server, no crash. All work fine. I didn't see the tbb opencv dependency. I will look if mine as this module enabled. Gilles Caulier -- You are

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #58 from Evert Vorster --- OK, so now DigiKam crashes with both internal and external SQL, at approximately 30% through my collection. I'll start a new bug for that. I get a compile error with Gilles' patch, and

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #57 from Evert Vorster --- Created attachment 12 --> https://bugs.kde.org/attachment.cgi?id=12=edit Compile error Gilles patch to use external face module -- You are receiving this mail because: You are

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #56 from Evert Vorster --- Now we are getting somewhere. I finally managed to compile a version of opencv that has tbb disabled. With Maik's patch installed I was able to scan through 25% of my library before I

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #55 from Maik Qualmann --- The cause is compiled libtbb2 support in OpenCV. Gilles, look in the crash logs from Evert, our distributions have libtbb2 disabled in OpenCV. See my Comment 52 Maik -- You are receiving

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #54 from Evert Vorster --- Gilles, I found the contrib version of OpenCV, but the network link I am behind is terribly slow, and I have been unable to download and compile it. I tried your patch anyways, but

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #53 from caulier.gil...@gmail.com --- Ever, Faces scan with Mysql dataabse server is complete without a crash. I used single core to compute face detection. I will not try to use whole cpu core. Gilles Caulier -- You are receiving this

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #52 from Maik Qualmann --- My packages for OpenCV are not using a TBB (libtbb2). Your Yes. It could be related herewith: http://code.opencv.org/issues/4489 Maik -- You are receiving this mail because: You are

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #51 from caulier.gil...@gmail.com --- Screenshot of face scan with remote mysql in action : https://www.flickr.com/photos/digikam/28121515122/in/dateposted-public/ Gilles Caulier -- You are receiving this mail because: You are watching

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #50 from caulier.gil...@gmail.com --- Evert, With my patch, and Mysql remote server, face scan is started over the same collection and no crash appear until now Wait and see... Gilles Caulier -- You are receiving this mail because:

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #49 from caulier.gil...@gmail.com --- Evert, The face scan with my patch is finished with 244 faces found and no crash Now i will test with a Mysql internal database. Gilles Caulier -- You are receiving this mail because: You are

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #48 from Maik Qualmann --- Created attachment 2 --> https://bugs.kde.org/attachment.cgi?id=2=edit face31.patch New face modul from OpenCV-3.1. But not the latest version. Maik -- You are receiving this

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #47 from Maik Qualmann --- Gilles, I have a patch created for the new face recognition already a few months ago. But I see a slight change in the ABI to the current code from github. OpenCV minimum would be version

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #46 from caulier.gil...@gmail.com --- With my patch, detection process my whole collection with 2271 images using sqlite database. Yes, it's not too huge but it's a test collection on my virtual machine. Until now, all work fine. No crash,

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #45 from caulier.gil...@gmail.com --- Created attachment 1 --> https://bugs.kde.org/attachment.cgi?id=1=edit patch to use face module from opencv_contrib instead from digiKam core Evert, New patch to drop face module in digiKam

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #44 from Evert Vorster --- Created attachment 0 --> https://bugs.kde.org/attachment.cgi?id=0=edit The list of files from OpenCV I am on Arch linux, we don't have contrib. The closest thing is self

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #43 from caulier.gil...@gmail.com --- Do you have opencv3-contrib installed. This one include face detection algorithm. Typically for 5.0.0 i included this opencv-face directly in digiKam core, as opencv 2 to 3 still a transition switch.

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #42 from caulier.gil...@gmail.com --- Here with sqlite, the crash is not reproducible. I compiled OpenCV3 myself and uninstalled openCV2 before, to prevent binaries mix of the library. Using valgrind reduce execution speed as you have seen.

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #41 from Evert Vorster --- Created attachment 99988 --> https://bugs.kde.org/attachment.cgi?id=99988=edit Segfault with facedetect patch applied, running on SQlite db Looks like it's not the database backend,

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #40 from Evert Vorster --- I was just updating some of the face tags that the recognizer got wrong, without scanning for new faces, and this rather quickly segfaults digikam. I am now starting up digikam with the

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #39 from caulier.gil...@gmail.com --- >I found that just changing the tag associated to a picture will segfault >digikam Do you mean a simple tag to image or a face tag ? Both are different in the way to process data in background. Gilles

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #38 from Evert Vorster --- Created attachment 99987 --> https://bugs.kde.org/attachment.cgi?id=99987=edit gdb crash log with facedetect patch loaded. Unfortunately, it seems that the facedetect patch did not

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #37 from caulier.gil...@gmail.com --- Maik, Your facedetector.patch must be applied to git/master in all cases... Gilles Caulier -- You are receiving this mail because: You are watching all bug changes.

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #36 from caulier.gil...@gmail.com --- >I will notify the maintainer of digikam-git that libexiv2 is no longer a >requirement for >digikam. Not libexiv2, but libkexiv2. For dependencies details, look here :

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #35 from Evert Vorster --- I am currently running digikam through valgrind. Once that crashes, I will install Maik's patch only, and see if I can reproduce the issue. I will notify the maintainer of digikam-git

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #34 from Maik Qualmann --- Created attachment 99986 --> https://bugs.kde.org/attachment.cgi?id=99986=edit facedetector.patch Please test also this patch. Maik -- You are receiving this mail because: You are

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #33 from caulier.gil...@gmail.com --- There is some test to do , if possible. 1/ using OpenCV2 instead OpenCV3. There is a flags to turn off in digiKam cmake configuration script before to compile. 2/ using sqlite database instead Mysql, to

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #32 from caulier.gil...@gmail.com --- Exiv2 is fine. We don't use libkexiv2 anymore. Implementation is not in digiKam core, to reduce the puzzle. Gilles Caulier -- You are receiving this mail because: You are watching all bug changes.

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #31 from caulier.gil...@gmail.com --- My patch must be the right direction but certainly not at the right level in source code. Look well as we touch data not initialized while OpenCV API call It sound like a non re-entrancy somewhere.

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #30 from Evert Vorster --- Gilles: extra/exiv2 0.25-3 and libkexiv2 from git, r782.6c196e4-1 -- You are receiving this mail because: You are watching all bug changes.

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #29 from Evert Vorster --- Maik, thanks again for looking into this. I am currently doing a valgrind log hoping to catch another segfault. It's just so terribly slow! On every try I get about 3 - 6% through the

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #28 from caulier.gil...@gmail.com --- Maik, even if images are broken, or if video/raw files crash Exiv2, all Exiv2 API are wrapped around exception catch which must be handle by high level implementation in digiKam. Typically if a file

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #27 from Maik Qualmann --- Can you check if these images are broken? /data/DigiKam/Photos/Home/2015/02-28 Oval Track/Evert Pictures/IMG_7377.JPG /data/DigiKam/Photos/Home/2015/02-28 Oval Track/Evert

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #26 from Evert Vorster --- Created attachment 99984 --> https://bugs.kde.org/attachment.cgi?id=99984=edit Console output of crash after removing movie files. So, I have removed all the movie files from the

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #25 from Evert Vorster --- Created attachment 99981 --> https://bugs.kde.org/attachment.cgi?id=99981=edit valgrind log OK, Thanks for looking into this. I have moved all the .mov and .mp4 from that directory.

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #24 from Maik Qualmann --- I see in the valgrind log that QuickTime video is included. I think it's possible that Exiv2 crashes here. Can you these video files for test removed in face recognition? Maik -- You are

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #23 from Evert Vorster --- Ah, Maik, the same error is repeated in the valgrind log that I just attached, and since I did not type that one, it definitely does not contain typos. Thanks for looking into this!

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #22 from Evert Vorster --- Re: Maik Qualmann, I did indeed make a typo. Thanks for pointing that out. -Evert- -- You are receiving this mail because: You are watching all bug changes.

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 Maik Qualmann changed: What|Removed |Added CC||metzping...@gmail.com

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #20 from Evert Vorster --- Created attachment 99978 --> https://bugs.kde.org/attachment.cgi?id=99978=edit valgrind with mysql gone away error There seems to be two distict modes of failure here. One is the

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #19 from Evert Vorster --- Created attachment 99977 --> https://bugs.kde.org/attachment.cgi?id=99977=edit Segfault, with the patch applied on detect faces only Once I rebuilt digikam with debugging enabled, I

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #18 from Evert Vorster --- Hey there... Unfortunately, that patch did not stop the crashing. With just scanning for faces, it got about 6% through my collection of 30,000 photos ( 160Gb ) before crashing again.

[digikam] [Bug 365202] External MySQL database faces update segfault [patch]

https://bugs.kde.org/show_bug.cgi?id=365202 caulier.gil...@gmail.com changed: What|Removed |Added Summary|External MySQL database |External MySQL database

[digikam] [Bug 365202] External MySQL database faces update segfault

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #17 from caulier.gil...@gmail.com --- Created attachment 99970 --> https://bugs.kde.org/attachment.cgi?id=99970=edit add mutex to prevent non re-entrency in OpenCV API Try with my little patch if it fix the problem. Gilles Caulier --

[digikam] [Bug 365202] External MySQL database faces update segfault

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #16 from Evert Vorster --- I'm sorry, I can't read that log as clearly as you do. I know how to produce them, and then hopefully someone smarter than me can pick at it and hopefully update the git with a fix. Can

[digikam] [Bug 365202] External MySQL database faces update segfault

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #15 from caulier.gil...@gmail.com --- Sound like the source of the problem : ==16753== Conditional jump or move depends on uninitialised value(s) ==16753==at 0x973DFAA: ??? (in /usr/lib/libopencv_objdetect.so.3.1.0) ==16753==by

[digikam] [Bug 365202] External MySQL database faces update segfault

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #14 from Evert Vorster --- Created attachment 99947 --> https://bugs.kde.org/attachment.cgi?id=99947=edit Konsole output around the error. Noticed this error about halfway down the attached file. For some reason

[digikam] [Bug 365202] External MySQL database faces update segfault

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #13 from Evert Vorster --- Created attachment 99946 --> https://bugs.kde.org/attachment.cgi?id=99946=edit Valgrind log of a segfault Finally, a Valgrind log of the error -- You are receiving this mail because:

[digikam] [Bug 365202] External MySQL database faces update segfault

https://bugs.kde.org/show_bug.cgi?id=365202 caulier.gil...@gmail.com changed: What|Removed |Added CC||swatilodh...@gmail.com --- Comment

[digikam] [Bug 365202] External MySQL database faces update segfault

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #11 from Evert Vorster --- The database is MariaDB, which is the same as MySQL, I believe. I use OpenCV 3.x -- You are receiving this mail because: You are watching all bug changes.

[digikam] [Bug 365202] External MySQL database faces update segfault

https://bugs.kde.org/show_bug.cgi?id=365202 --- Comment #10 from caulier.gil...@gmail.com --- So you use Mysql as database. Right ? and which Opencv library version you use ? 2.x or 3.x ? Gilles Caulier -- You are receiving this mail because: You are watching all bug changes.

[digikam] [Bug 365202] External MySQL database faces update segfault

https://bugs.kde.org/show_bug.cgi?id=365202 caulier.gil...@gmail.com changed: What|Removed |Added Component|Faces-Engine|Database-Mysql