hi,
does DT indexes the images after importing (you CAN switch it off in
preference dialog)? I have 40000 pictures in my library and DT is not
particularly slow. However, it took around 6h to index all the images
after import and during that time, DT was particularly slow and even
not responding.

Xavier
--

Xavier Raynaud
Maître de conférences
UPMC-Paris6
Biogéochimie et Ecologie des Milieux Continentaux
46 rue d'Ulm
F-75230 Paris CEDEX 5

Le 13 févr. 2013 à 00:09, Marcin Sikora <[email protected]> a écrit :

> No success. I really do not know where is the problem.
>
>
> My system is:
>
> Mamory: 4 GB
>
> 2 x Intel® Core™2 Duo CPU T9300 @ 2.50GHz processors
>
> Graphics GeForce 8600M GT/PCIe/SSE2
>
> OS type Debian(testing) 64bit
>
>
> Now I have used a testing pictures set:
>
> 23.000 pictures on the USB external drive approx. 250 GB data
>
>
> I tried two versions of DT with both I have the same problem:
>
> 1.0.4 – from Debian testing distribution.
>
> 1.1+1050~ge73064b – build from the sources(downloaded today)
>
>
> The cmake output:
>
>
> cmake -DCMAKE_BUILD_TYPE=Release ..
>
> -- multiarch triplet detected: x86_64-linux-gnu
>
> -- Determining version
>
> -- Found Gettext
>
> -- Found msgfmt to convert language file. Translation enabled
>
> -- Found xsltproc
>
> -- Found Glib
>
> -- Found LibXml2: /usr/lib/x86_64-linux-gnu/libxml2.so (found suitable
> version "2.8.0", required is "2.6")
>
> -- Could NOT find INOTIFY (missing: INOTIFY_INCLUDE_DIR)
>
> -- Found GIO
>
> -- Found Cairo
>
> -- Found GDK-PixBuf
>
> -- Found LibXml2: /usr/lib/x86_64-linux-gnu/libxml2.so (found version "2.8.0")
>
> -- Internationalization: Enabled
>
> -- Found JsonGlib
>
> -- OpenJPEG version 1.3.0 found. Only 1.5 and newer support reading of
> icc profiles.
>
> -- Found GraphicsMagick
>
> -- Checking for -march=native support
>
> -- checking for one of the modules 'libsoup-2.2;libsoup2'
>
> -- Map mode: enabled
>
> --
>
> -- Configuring done
>
> -- Generating done
>
> -- Build files have been written to: /home/parus/darktable/build
>
>
> There is one problem:
>
>> -- Could NOT find INOTIFY (missing: INOTIFY_INCLUDE_DIR)
>
> which still I can not figure it out which headers cmake can not find.
> Is it a problem?
>
>
> A clean DT with a few pictures works just fine but after importing
> 23.000 pictures (library.db has 292 MB) the problem of switch between
> darkroom and light table is the same – it takes very long time. Also
> starting DT on my system takes (measured with time command) from DT
> execution to unfreezing DT GUI:
>
> real 3m4.740s
>
> user 0m30.586s
>
> sys 2m32.550s
>
>
> I have tested also on more powerful computer:
>
> Memory: 6GB
>
> 8x Intel Xeon CPU E5420 @ 2.50 GHz
>
> Operating system Debian testing 64bit
>
> Pictures on NAS disk.
>
> 35.000 pictures imported into DT.
>
>
> The starting time is not much shorter :
>
> real 1m28.625s
>
> user 0m26.182s
>
> sys 1m7.588s
>
>
> Any ideas how to find a problem?
>
>
> regards
>
>
> On Tue, Feb 12, 2013 at 10:03 AM, Marcin Sikora <[email protected]> 
> wrote:
>>> Waren
>>
>> That’s good news!!! Thank you for your info. Then I'll search a
>> problem with my system settings. Can be a problem with my samba NAS
>> server? This I have forgotten to mention. I have so much pictures in
>> RAW that I cannot keep it on the local machine. I' using a wired
>> network connection to NAS. The transfer of files is several 10ths of
>> MB per sec. So the transfer speed should be not a problem. Also the DT
>> library is on the local machine. So reading a library should be not
>> affected by samba server.
>>
>>> Jose
>> Thank you for a good workflow. Simple a clear hacks to shuffle with
>> shuffling of libraries. I can see that potential possibility of
>> working with different parts of my pictures and make backups of
>> current progress. Is it possible to export presents from the old
>> library and import it to the new library? Or it is better to make an
>> empty library with presents and copy it each time to
>> ~/.config/darktable/library.db
>>
>> Alternative 3. I do not like as well. The thumbnails in Digikam do not
>> reflect settings in DT. But I like that DT supports videos. So, I have
>> overview of my videos with date and tags. I was thinking about it how
>> to deal with videos in DT. Simple solution could be to make an simple
>> script to extract an frame from a video and set the metadata according
>> to video metadata and import it to DT.
>>
>> I will try to copy 35.000 images to my local machine and import it to
>> DT and I will see if I will have working and fast DT :-)
>>
>> Regards
>>
>>
>> On Tue, Feb 12, 2013 at 9:19 AM, Jose Carlos Garcia Sogo
>> <[email protected]> wrote:
>>> Check a couple of things:
>>> 1. In preferences, disable the similarity process. Unless you are
>>> going to use it, it will take a while to process 35.000 images.
>>> 2. Even if you have imported all your images, use the collect module
>>> in left panel to just select the bunch of images in which you are
>>> working on.  That way, the thumbnails will be generated only once, and
>>> it should improve your performance. Some devs have libraries similar
>>> to yours, so it shouldn't be a problem in general. The problem may
>>> arise if you try to scroll all through the 35.000 images.
>>>
>>> Answering your workflow questions:
>>>  1. You don't need to delete the library. Just select the images you
>>> don't want to be in it (use collect module in left panel to define
>>> them, and select all in right panel + remove button - WARNING: delete
>>> button will erase them from your disk)
>>>  2. You can have different libraries. Just move the current one in
>>> ~/.config/darktable/library.db to other place and a new one will be
>>> created as soon as you open darktable again. If you want to open the
>>> moved one, just call darktable --library /path/to/library
>>> There is an issue with this approach, as presets are stored only in
>>> the library now, you will have to recreate them
>>>  3. Not recommended
>>>
>>> With your folder scheme, I recommend you the 'folders' view in the
>>> collect module.
>>>
>>> Regards
>>>
>>> On Mon, Feb 11, 2013 at 3:13 PM, Marcin Sikora <[email protected]> 
>>> wrote:
>>>> Hi,
>>>> I'm a new user of DT. Before I have used Bibble on Linux which
>>>> transformed to After Shot by Corel. I really like the speed of this
>>>> RAW management tool. But still I'm not sure about if it is the best
>>>> RAW converter for Linux. I would like to give a try to DT since its
>>>> futures seem to be very impressive. Still I'm hesitating between
>>>> RawTherapy and Darktable.
>>>>
>>>> Up to now I prefere DT with all interesting plugins but I'm struggling
>>>> with the speed of DT. Switching from Darkroom back to Light Table is
>>>> extremely slow (more then 30 seconds). Currently I have imported only
>>>> a small part of my pictures to the DT library (approx. 35.000
>>>> pictures). I would like to work with much more. But with current GUI
>>>> it is very inconvenient.
>>>>
>>>> I see that more users have similar problem:
>>>> http://www.darktable.org/redmine/issues/8981 . There is a quite
>>>> advanced discussion (_count_images staff etc.) which is beyond the DT
>>>> beginner skills.  Is ther any insiders command/debugging help for DT
>>>> users?
>>>>
>>>> Or is there a simple solution? Could you help me to establish a good
>>>> work flow? E.g.
>>>>
>>>> 1. Import only a small amount of pictures and delete library when I
>>>> would like to move to work with another part of my pictures?
>>>>
>>>> 2. manually selection of smalled sub-libraries from command line e.g.
>>>> to create library for each year separately?
>>>>
>>>> 3. use another software to manage pictures e.g. Digikam and use DT
>>>> only for converting RAWs for single pictures.
>>>>
>>>> My pictures are organised in file tree:
>>>>
>>>> <year>/<Month (max 12 sub-folders)>/<Year-Month-Day (max 31
>>>> sub-folders>/<RAW files (can be hundreds)>
>>>>
>>>> I'm using the most resent git version of DT (last time I tried it 
>>>> yesterday)
>>>>
>>>>
>>>> Best regards,
>>>> Marcin
>>>>
>>>> ------------------------------------------------------------------------------
>>>> Free Next-Gen Firewall Hardware Offer
>>>> Buy your Sophos next-gen firewall before the end March 2013
>>>> and get the hardware for free! Learn more.
>>>> http://p.sf.net/sfu/sophos-d2d-feb
>>>> _______________________________________________
>>>> Darktable-users mailing list
>>>> [email protected]
>>>> https://lists.sourceforge.net/lists/listinfo/darktable-users
>>>
>>>
>>>
>>> --
>>> José Carlos García Sogo
>>>   [email protected]
>
> ------------------------------------------------------------------------------
> Free Next-Gen Firewall Hardware Offer
> Buy your Sophos next-gen firewall before the end March 2013
> and get the hardware for free! Learn more.
> http://p.sf.net/sfu/sophos-d2d-feb
> _______________________________________________
> Darktable-users mailing list
> [email protected]
> https://lists.sourceforge.net/lists/listinfo/darktable-users

------------------------------------------------------------------------------
Free Next-Gen Firewall Hardware Offer
Buy your Sophos next-gen firewall before the end March 2013 
and get the hardware for free! Learn more.
http://p.sf.net/sfu/sophos-d2d-feb
_______________________________________________
Darktable-users mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/darktable-users

Reply via email to