Hi Pascal,
Do you have options on how you provide your SAN volume? I've found that
providing a SAN volume through ISCSI instead of NFS or CIFS gives huge
performance benefits when you are executing 1000s of very small file operations
as the ISCSI volume is treated as a local disk and gets the benefit of local
o/s cacheing without having to go across the net every time it needs to check
file statuses etc. That may possibly help your use case (or not) but I've
found it the usual explanation when individual operations have a real big
performance difference between SAN and local disk (this is assuming you don't
just have a really bad SAN and everything on it is slow).
Rgds,
Rob.
From: johannes hanika [mailto:hana...@gmail.com]
Sent: 02 September 2013 11:08
To: Pascal Obry
Cc: darktable-devel
Subject: Re: [darktable-devel] writing xmp as background job
On Mon, Sep 2, 2013 at 12:02 PM, Pascal Obry
<pas...@obry.net<mailto:pas...@obry.net>> wrote:
2013/9/2 johannes hanika <hana...@gmail.com<mailto:hana...@gmail.com>>:
> no, that's exactly the race condition horror scenario i described earlier..
> if we write to that file we want to be sure we do that now and only in one
> thread at a time. if you just put it in a job you'll need to provide
> wrappers which force it to happen now and put a mutex around it etc.
Ok, looks like it was a bad idea to use a background job for this. The
safety is indeed a very strong point.
Let's drop this then except if you have a better idea to avoid this
long delay and freeze of the UI.
how did you trigger the xmp writing? mark 2k images and tag them at the same
time? that should indeed go into a bg job, where the bg job executes the
tagging and will lock the image only for a short time while it writes the xmp?
we'll need to make sure we write the xmp as part of dropping the write lock
though.
j.
Thanks,
Pascal.
--
Pascal Obry / Magny Les Hameaux (78)
The best way to travel is by means of imagination
http://v2p.fr.eu.org
http://www.obry.net
gpg --keyserver keys.gnupg.net<http://keys.gnupg.net> --recv-key F949BD3B
This email is confidential and is intended for the addressee only. If you are
not the addressee, please delete the email and do not use it in any way. Please
note that any views or opinions presented in this email are solely those of the
author and do not necessarily represent those of the company. NHBC reserves the
right to monitor all email communications. The recipient should check this
email and any attachments for the presence of viruses. The company accepts no
liability for any damage caused by any virus transmitted by this email. NHBC,
the National House-Building Council, is limited by guarantee in England, No
320784. Registered address: NHBC House, Davy Avenue, Knowlhill, Milton Keynes
MK5 8FP. NHBC is authorised by the Prudential Regulation Authority and
regulated by the Financial Conduct Authority and Prudential Regulation
Authority. NHBC Building Control Services Ltd, registered by guarantee in
England with Company No. 01952969. Registered address: NHBC House, Davy Avenue,
Knowlhill, Milton Keynes MK5 8FP. NHBC Services Ltd registered by guarantee in
England, No 03067703. Registered address: NHBC House, Davy Avenue, Knowlhill,
Milton Keynes MK5 8FP. If you make a claim under a Buildmark policy your
personal details will be stored and processed in accordance with the Data
Protection Act. Your personal details may be passed to others involved with
your claim such as the original builder, or a consultant or remedial works
contractor that we may employ in connection with your claim(s) and matter
ancillary to your claim(s). Other than disclosure provided for in this
statement, we will not pass any data about you to any other party without your
permission unless we are required to do so by law.
------------------------------------------------------------------------------
Learn the latest--Visual Studio 2012, SharePoint 2013, SQL 2012, more!
Discover the easy way to master current and previous Microsoft technologies
and advance your career. Get an incredible 1,500+ hours of step-by-step
tutorial videos with LearnDevNow. Subscribe today and save!
http://pubads.g.doubleclick.net/gampad/clk?id=58040911&iu=/4140/ostg.clktrk
_______________________________________________
darktable-devel mailing list
darktable-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/darktable-devel
