Hi,

Looks similar to what I've seen on my system with a large brtfs 
filesystem, do you happen to use btrfs? I've noticed hangs when a lot of 
io is happening on the sql lite database.

These mount options seem to have reduced their frequency for me:
/home           btrfs 
noatime,nodiratime,space_cache,autodefrag,compress=lzo,subvol=@home

While it still occacionally happens, I've not had the chance to actually 
debug this in detail yet.
Let me know if you also use btrfs or not.

PS: Waiting long enough (more then a minute) sometimes actually gets DT 
moving again on my system.
My database is quite big:
Intel-DH77EB:~/.config/darktable$ ls -alh
total 568M
drwxrwxr-x 1 ochal ochal  160 mei  5 19:22 .
drwx------ 1 ochal ochal  764 mei  5 21:26 ..
-rw-rw-r-- 1 ochal ochal  16K mei  4 23:27 darktablerc
-rw-r--r-- 1 ochal ochal  78K apr 21  2014 keyboardrc
-rw-rw-r-- 1 ochal ochal  75K mei  5 19:22 keyboardrc_default
-rw-r--r-- 1 ochal ochal 568M mei  5 21:43 library.db
-rw-rw-rw- 1 ochal ochal    5 mei  5 19:20 library.db.lock
drwxr-xr-x 1 ochal ochal  862 apr 17 15:31 styles
drwxrwxr-x 1 ochal ochal  540 nov  5  2013 watermarks


On 05-05-15 21:32, Oliver Bedford wrote:
> Hi,
>
> I think, the hangs I see are not associated with opencl. I encounter
> them with opencl disabled, too.
>
> It seems, that I can provoke them by importing a directory (which was
> already processed by dt in the past) and then quickly scrolling down and
> selecting an image for editing in darkroom mode. At this stage top shows
> dt is already eating some cpu. So perhaps some sort of race condition?
> dt then becomes unresponsive, top outputs something similar to this:
>
>          
> top - 21:14:30 up 14 min,  3 users,  load average: 0.88, 0.59, 0.39
> Tasks: 236 total,   2 running, 234 sleeping,   0 stopped,   0 zombie
> Cpu(s): 12.6%us,  0.1%sy,  0.0%ni, 87.3%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
> Mem:  16375288k total,  5452888k used, 10922400k free,    89880k buffers
> Swap: 33235964k total,        0k used, 33235964k free,  3696580k cached
>
>    PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
> 14818 ojo       20   0 39.5g 1.0g  40m R  100  6.5   1:23.54 darktable
>   1574 root      20   0  162m  55m  30m S    0  0.3   0:27.53 Xorg
>   2523 ojo       20   0  368m  65m  35m S    0  0.4   0:09.31 compiz
> [rest skipped]
>
> Last output of darktable -d all:
>
> [...]
>
> [camera_control] unregistering listener 0x2a2a220
> [sql] prepare "select count(id) from images where   (flags & 256) != 256
> and ((film_id in (select id from film_rolls where folder like
> '/home/ojo/Bilder/EigenePhotos/Lissabon2015/ORGNL'))) order by filename,
> version"
> [sql] prepare "select count (distinct imgid) from selected_images"
> [sql] exec "DELETE FROM memory.collected_images"
> [sql] prepare "INSERT INTO memory.collected_images (imgid) select
> distinct id from images where   (flags & 256) != 256 and ((film_id in
> (select id from film_rolls where folder like
> '/home/ojo/Bilder/EigenePhotos/Lissabon2015/ORGNL'))) order by filename,
> version limit ?1, ?2"
> [sql] prepare "SELECT imgid FROM memory.collected_images ORDER by rowid
> LIMIT ?1, ?2"
> [add_job] 0 | lua: overlay button toggled | queue: 0 | priority: 0
> [sql] prepare "SELECT DISTINCT T.id, T.name FROM tagged_images JOIN tags
> T on T.id = tagged_images.tagid WHERE tagged_images.imgid = 7704  ORDER
> BY T.name"
> [sql] prepare "INSERT INTO memory.tagq (id) SELECT id FROM tags T WHERE
> T.name LIKE ?1"
> [sql] exec "INSERT INTO memory.taglist (id, count) SELECT
> DISTINCT(TXT.id2), TXT.count FROM tagxtag TXT WHERE TXT.count > 0  AND
> TXT.id1 IN (SELECT id FROM memory.tagq) ORDER BY TXT.count DESC"
> [sql] exec "INSERT OR REPLACE INTO memory.taglist (id, count) SELECT
> DISTINCT(TXT.id1), TXT.count FROM tagxtag TXT WHERE TXT.count > 0  AND
> TXT.id2 IN (SELECT id FROM memory.tagq) ORDER BY TXT.count DESC"
> [sql] prepare "SELECT T.name, T.id FROM tags T JOIN memory.taglist MT ON
> MT.id = T.id WHERE T.id IN (SELECT DISTINCT(MT.id) FROM memory.taglist
> MT)   AND T.name NOT LIKE 'darktable|%%' ORDER BY MT.count DESC"
> [sql] exec "DELETE from memory.taglist"
> [sql] exec "DELETE from memory.tagq"
> [run_job+] 11 140245221,498666 in darkroom mode
> [sql] prepare "select count (distinct imgid) from selected_images"
> [sql] exec "delete from selected_images"
> [sql] prepare "insert or ignore into selected_images values (?1)"
> [sql] prepare "UPDATE images SET width = ?1, height = ?2, maker = ?3,
> model = ?4, lens = ?5, exposure = ?6, aperture = ?7, iso = ?8,
> focal_length = ?9, focus_distance = ?10, film_id = ?11, datetime_taken
> = ?12, flags = ?13, crop = ?14, orientation = ?15, raw_parameters = ?16,
> group_id = ?17, longitude = ?18, latitude = ?19, color_matrix = ?20,
> colorspace = ?21, raw_black = ?22, raw_maximum = ?23 WHERE id = ?24"
> [sql] prepare "UPDATE images SET width = ?1, height = ?2, maker = ?3,
> model = ?4, lens = ?5, exposure = ?6, aperture = ?7, iso = ?8,
> focal_length = ?9, focus_distance = ?10, film_id = ?11, datetime_taken
> = ?12, flags = ?13, crop = ?14, orientation = ?15, raw_parameters = ?16,
> group_id = ?17, longitude = ?18, latitude = ?19, color_matrix = ?20,
> colorspace = ?21, raw_black = ?22, raw_maximum = ?23 WHERE id = ?24"
>
>
> Any help is greatly appreciated.
>
> Regards,
> Oliver


------------------------------------------------------------------------------
One dashboard for servers and applications across Physical-Virtual-Cloud 
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
_______________________________________________
Darktable-users mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/darktable-users

Reply via email to