On lundi 23 novembre 2020 12:16:35 CET GianLuca Sarto wrote:
> Hello All,
>
> it's not really an issue, just wondering...
>
> I load my RAWs in one folder which has now about 10K images.
>
> Each time I add a bunch of 30-50 images, it reads all folder just to add
> the new ones.
>
> Does it has to be so?
>
> I mean, rsync has the ability to filter files that are already on
> destination, could the same feature be implemented in DT?
Rsync still has to check some data for each file as well. Which means the
whole directory has to be read in (not each individual file, in first
instance). And rsync "just" compares raw directory info.
As you add the images to an existing folder, dt has to check each file against
its *database* to see if the file is present, and if there have been changes
since last startup. Database queries have more overhead than simple directory
comparisons, so will be slower.
How long does dt take to add those 30-50 files?
Another question is whether storing all the raws in one flat directory is the
fastest in normal use. Unless you always use a filter, scrolling through the
files is going to be slow. Using sub-directories probably speeds up using dt.
(and once a directory is imported, the data is retained in the database, so
e.g. searches will see all the imported images)
Remco
darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org
