[darktable-user] Import older xmp files

[Sakke K]

I have new install and i try edit my pics from 2016.
I lost all my xmp files data - DarkTable overwrite my
old xmp file in folder. I use now Ubuntu 16 lts and
Darktable 2.2.4. Import only one folder with 300 pics.
I do not want to edit photos again. I have backup xmp
files. I have not old Darktable database. I have only raw
and xmp files.


Sorry for my poor language skills.


darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] gen-profile -d

[Romano Giannetti]

I recently did the profiling for a TZ-100 camera. I shot down a couple 
of notes while doing it; I share them here hoping they can be of help...



I started with the information in the following sites:

- http://www.darktable.org/2012/12/profiling-sensor-and-photon-noise/
- https://landscrapes.wordpress.com/2016/05/10/darktable/

and tried to simplify the thing as much as possible.

First of all, you need the tools directory of the source version of your 
darktable. I decided to clone the git repository and then checkout the 
same stable version I have from the darktable PPA [link]. Basically, I 
did the following (suppose you're in your home directory):


git clone https://github.com/darktable-org/darktable.git
cd darktable
git checkout release-2.2.4
git reset --hard

...and now the tools for noise profiling are in 
`~/darktable/tools/noise`; let's calle this directory `NP`.


NP=~/darktable/tools/noise

Now it's time to take your photos. You need a series of photos, at all 
ISO you want to have the profile, that must be


- unfocused
- have both overexposed and underexposed areas
- assigned the "raw linear" profile

...where the second one is the most difficult thing to achieve. 
Especially for low ISO values.


Once you have the shots that have a lot of histogram data (see example 
here) you can go applying the raw linear profile to them. You have to 
use the right hand "styles" module of the lighttable and "import" the 
file "raw linear.dtsyle" you will find in $NP; after that select all of 
your raw files and apply iy. They will turn greenish - it's ok.


Now you go in the directory in which you have the photos and do the 
following:


$NP/gen-profile -d .

If all is well, at the end you will have a `preset.json` file with your 
noiseprofiles. You can test it by calling darktable with:


darktable --noiseprofiles presets.json

and trying to apply it to your photos.

Errors are quite common at this point. I had a couple of them:

1. `gen-profile` bails out saying that the image is not underexposed. I 
have to re-shot it, with less exposure.
2. `gen-profile` bails out saying that some channel (I had just green) 
is wrong. This normally means that the picture has no sufficient 
overexposure.




On 05/07/17 13:29, Аl Воgnеr wrote:

I have uploaded new and hopefully better noise images from a Pentax KP
to
https://drive.google.com/drive/folders/0Bx7crlmGDudaaG11OURYN184ZzQ?usp=sharing
and now I want to follow
http://www.darktable.org/2012/12/profiling-sensor-and-photon-noise/
where I read, I should execute

~/darktable/tools/noise/gen-profile -d .

But my Ubuntu-system doesn't contain a file gen-profile, so I searched
for it and found
https://github.com/darktable-org/darktable/blob/master/tools/noise/gen-profile

Is it enough to download this script or do I need more?

Al

darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org



--
--
Romano Giannetti
http://www.rgtti.com/


darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] Import older xmp files

[Tobias Ellinghaus]

Am Mittwoch, 5. Juli 2017, 14:02:40 CEST schrieb Sakke K:
> I have new install and i try edit my pics from 2016.
> I lost all my xmp files data - DarkTable overwrite my
> old xmp file in folder. I use now Ubuntu 16 lts and
> Darktable 2.2.4. Import only one folder with 300 pics.
> I do not want to edit photos again. I have backup xmp
> files. I have not old Darktable database. I have only raw
> and xmp files.

What is your question? Did you try to import the old images and darktable 
ignored the edits stored in the XMP files? Could you send me one of the 
original XMPs from your backup?

> Sorry for my poor language skills.

Tobias

signature.asc
Description: This is a digitally signed message part.

[darktable-user] gen-profile -d

[Аl Воgnеr]

I have uploaded new and hopefully better noise images from a Pentax KP
to
https://drive.google.com/drive/folders/0Bx7crlmGDudaaG11OURYN184ZzQ?usp=sharing
and now I want to follow
http://www.darktable.org/2012/12/profiling-sensor-and-photon-noise/
where I read, I should execute

~/darktable/tools/noise/gen-profile -d .

But my Ubuntu-system doesn't contain a file gen-profile, so I searched
for it and found
https://github.com/darktable-org/darktable/blob/master/tools/noise/gen-profile

Is it enough to download this script or do I need more?

Al

darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] Darktable on HiDPI screens

[parafin]

Which display do you have? Exact model.


On Wed, 5 Jul 2017 15:25:59 +0200
Аl Воgnеr  wrote:

> Am Wed, 5 Jul 2017 08:17:41 -0400
> schrieb Šarūnas :
> 
> > On 2017-07-04 08:21, Аl Воgnеr wrote:
> > > I found 
> > > https://www.reddit.com/r/DarkTable/comments/4wm39l/darktable_on_hidpi_screens/
> > >
> > >   
> > which recommends to change the value of screen_dpi_overwrite in
> > > ~/.config/darktable/darktablerc
> > > 
> > > The default value is -1.0 and it was recommended to set it to
> > > 140-150. But this doesn't work for me. If I change to 140 I get some
> > > letters in yellow in the menu.
> > > 
> > > What do you do with a 4k-display?  
> > 
> > Current Ubuntu/KDE with 27" 3840×2160:
> > 
> > System Settings → Fonts → Force fonts DPI:144.
> > 
> > This fixes fonts for all the applications (save for a few very
> > “stubborn” ones). No need to adjust DPI for darktable individually,
> > all looks good.
> 
> I did this already before and it was set to 144, but nothing happened
> with dt, but with other programs. Now I modified darktablerc to 288 and
> I saw a change, but 288 is too large, so I have to try what would be a
> good value.
> 
> Al
> 
> darktable user mailing list
> to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org
> 
> 
> 

darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] Darktable on HiDPI screens

[Romano Giannetti]

On 05/07/17 14:28, Tobias Ellinghaus wrote:

Am Mittwoch, 5. Juli 2017, 13:51:47 CEST schrieb Аl Воgnеr:


Here is a screenshot, where you see that 144 did not change the size,
but the colors of the letters, especially in yellow and blue:
https://drive.google.com/drive/folders/0Bx7crlmGDudaQVB3Qy11SVdLYlE

I don't see any yellow text in that screenshot. Or otherwise colored one.
Maybe try setting the DPI to something even bigger, say, 300. Does that change
anything?


Neither do I, --- at 100% it is ok on my screen. Could be an aliasing 
artifact? I mean, are you sure that your screen panel has the resolution 
(physical) that the software is thinking it has?


Romano

--
--
Romano Giannetti
http://www.rgtti.com/


darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] gen-profile -d

[Аl Воgnеr]

Am Wed, 5 Jul 2017 13:34:35 +0200
schrieb Romano Giannetti :

Thank you Romano,

I use darktable 1:2.2.5-0pmjdebruijn1~xenial with (X)Ubuntu.

Don't know if the following is important to me:

$ git checkout release-2.2.5
Note: checking out 'release-2.2.5'.

You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in
this
state without impacting any branches by performing another checkout.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -b with the checkout command again.
Example:

  git checkout -b 

HEAD ist jetzt bei 1916f51... Reword a line in release notes


$ git reset --hard
HEAD ist jetzt bei 1916f51 Reword a line in release notes


> Now it's time to take your photos. You need a series of photos, at
> all ISO you want to have the profile, that must be
> 
> - unfocused
> - have both overexposed and underexposed areas
> - assigned the "raw linear" profile
> 
> ...where the second one is the most difficult thing to achieve. 
> Especially for low ISO values.

My samples are here:
https://drive.google.com/drive/folders/0Bx7crlmGDudaaG11OURYN184ZzQ

No idea, if they can be used.

> Once you have the shots that have a lot of histogram data

Low ISO doesn't have a lot of histogram data, high ISO does.

> you can go applying the raw linear profile to them

No idea how to do this, I am not familiar with profiles and styles.

> have to use the right hand "styles" module of the lighttable and
> "import" the file "raw linear.dtsyle" you will find in $NP; after
> that select all of your raw files and apply iy. They will turn
> greenish - it's ok.

No idea again, sorry!

>  $NP/gen-profile -d .

It is running as a trial at the moment **without** these mentioned
styles, using the dng-files without any changes and saw no important
errors until now.

I couldn't find errors in the output.

$ darktable --noiseprofiles ./presets.json

Nothing happened re noise, maybe because the Pentax KP is not supported
too or I am doing something wrong. I activated noise reduction by
profile only.

Al


darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] gen-profile -d

[Roman Lebedev]

On Wed, Jul 5, 2017 at 5:48 PM, Romano Giannetti  wrote:
> On 05/07/17 15:17, Аl Воgnеr wrote:

> You have to apply the raw linear profile to all of them. It's explained in
>
> https://landscrapes.wordpress.com/portfolio/sensor_profile_1/
Never trust anything (be it either a person, or an article) which says
"DarkTable".
And, both these articles seem rather outdated.

> Romano
>
> --
> --
> Romano Giannetti
> http://www.rgtti.com/
>
> 
> darktable user mailing list
> to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org
>

Roman.

darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] gen-profile -d

[Romano Giannetti]

On 05/07/17 16:52, Roman Lebedev wrote:



You have to apply the raw linear profile to all of them. It's explained in

https://landscrapes.wordpress.com/portfolio/sensor_profile_1/

Never trust anything (be it either a person, or an article) which says
"DarkTable".
And, both these articles seem rather outdated.

Yes, I know --- but form both article I was able to dig information to 
obtain a working noise profiling for the TZ-100. And the second article 
is on the official darktable site ;-)...


Romano

--
--
Romano Giannetti
http://www.rgtti.com/


darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] Darktable on HiDPI screens

[Tobias Ellinghaus]

Am Mittwoch, 5. Juli 2017, 13:51:47 CEST schrieb Аl Воgnеr:
> Am Tue, 04 Jul 2017 16:52:57 +0200
> schrieb Tobias Ellinghaus :
> 
> I changed:
> 
> run_crawler_on_start=FALSE
> screen_dpi_overwrite=-1.0
> screen_ppd_overwrite=-1.0
> 
> to
> 
> run_crawler_on_start=FALSE
> screen_dpi_overwrite=144
> screen_ppd_overwrite=-1.0
> 
> Here is a screenshot, where you see that 144 did not change the size,
> but the colors of the letters, especially in yellow and blue:
> https://drive.google.com/drive/folders/0Bx7crlmGDudaQVB3Qy11SVdLYlE

I don't see any yellow text in that screenshot. Or otherwise colored one.
Maybe try setting the DPI to something even bigger, say, 300. Does that change 
anything?

> The strange thing is now, that the colors in the letters remain after
> changing back to -1.00
> 
> Al
> 
> > Am Dienstag, 4. Juli 2017, 14:21:44 CEST schrieb Аl Воgnеr:
> > > I found
> > > https://www.reddit.com/r/DarkTable/comments/4wm39l/darktable_on_hidpi_sc
> > > reen s/ which recommends to change the value of screen_dpi_overwrite in
> > > ~/.config/darktable/darktablerc
> > 
> > Yes, that's how it should work – when your system is misconfigured
> > and reports the wrong resolution in the first place, or when you have
> > a multi monitor setup with differing DPI. Are you maybe using
> > Wayland? I am not sure how well that works.
> > 
> > > The default value is -1.0 and it was recommended to set it to
> > > 140-150. But this doesn't work for me. If I change to 140 I get
> > > some letters in yellow in the menu.
> > 
> > I have never heard of that. Could you share a screen shot please?
> > 
> > > What do you do with a 4k-display?
> > > 
> > > Al
> > 
> > Tobias
> 
> 
> darktable user mailing list
> to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org



signature.asc
Description: This is a digitally signed message part.

Re: [darktable-user] Darktable on HiDPI screens

[Аl Воgnеr]

Am Wed, 05 Jul 2017 14:28:04 +0200
schrieb Tobias Ellinghaus :

> Am Mittwoch, 5. Juli 2017, 13:51:47 CEST schrieb Аl Воgnеr:
> > Am Tue, 04 Jul 2017 16:52:57 +0200
> > schrieb Tobias Ellinghaus :
> > 
> > I changed:
> > 
> > run_crawler_on_start=FALSE
> > screen_dpi_overwrite=-1.0
> > screen_ppd_overwrite=-1.0
> > 
> > to
> > 
> > run_crawler_on_start=FALSE
> > screen_dpi_overwrite=144
> > screen_ppd_overwrite=-1.0
> > 
> > Here is a screenshot, where you see that 144 did not change the
> > size, but the colors of the letters, especially in yellow and blue:
> > https://drive.google.com/drive/folders/0Bx7crlmGDudaQVB3Qy11SVdLYlE  
> 
> I don't see any yellow text in that screenshot. Or otherwise colored
> one.

Did you enlarge it? Directly from gdrive I can see it, but it is not so
extreme as with dt. Maybe it depends on the graphics driver. I use 
nvidia-381 381.22-0ubuntu0~gpu16.04.2
 
> Maybe try setting the DPI to something even bigger, say, 300.
> Does that change anything?

I tried 288, looks a lot better with colors in the letter, nearly
nothing, but it is too large now.

Al

darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] gen-profile -d

[Romano Giannetti]

On 05/07/17 15:17, Аl Воgnеr wrote:

Am Wed, 5 Jul 2017 13:34:35 +0200
schrieb Romano Giannetti :

Thank you Romano,

I use darktable 1:2.2.5-0pmjdebruijn1~xenial with (X)Ubuntu.

Don't know if the following is important to me:

$ git checkout release-2.2.5
Note: checking out 'release-2.2.5'.

You are in 'detached HEAD'


This is normal, forget it.

Now it's time to take your photos. You need a series of photos, at
all ISO you want to have the profile, that must be

- unfocused
- have both overexposed and underexposed areas
- assigned the "raw linear" profile

...where the second one is the most difficult thing to achieve.
Especially for low ISO values.


You have to apply the raw linear profile to all of them. It's explained in

https://landscrapes.wordpress.com/portfolio/sensor_profile_1/

and following pages. You should also read throughout

http://www.darktable.org/2012/12/profiling-sensor-and-photon-noise/

(no, it's not straightforward; it is a bit of work. I would like to find 
the time to publish a step-by-step instructions).



I couldn't find errors in the output.

$ darktable --noiseprofiles ./presets.json

Nothing happened re noise, maybe because the Pentax KP is not supported
too or I am doing something wrong. I activated noise reduction by
profile only.



You should activate "profiled denoise" and check that darktable is 
saying something on the style of "profile for Pentax KP at XXX ISO 
found" in the module. I do not think you can have something really 
usable if you have not used the raw linear profile on the RAW.


Romano

--
--
Romano Giannetti
http://www.rgtti.com/


darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] Darktable on HiDPI screens

[parafin]

Google didn't find the information I wanted to check, so I suggest you
check yourself:
http://www.lagom.nl/lcd-test/subpixel.php

If your monitor has non-standard (not RGB) subpixel pattern letters on
your screen may seem colored.


On Wed, 5 Jul 2017 22:30:33 +0200
Аl Воgnеr  wrote:

> Am Wed, 5 Jul 2017 16:31:48 +0300
> schrieb parafin :
> 
> > Which display do you have? Exact model.
> 
> Asus PA328Q.
> 
> I am guessing, if I set the system fontsize to 144dpi and darktablerc is
> 144 too, nothing changes, if it is greater than 144dpi fontsize changes.
> 
> At moment I am testing 180dpi. A little bit too much, but on the other
> side with 600px border it is more or less ok. The goal is to get a 3:2
> relation for the picture part of the screen.
> 
> Al
> 
>  
> > On Wed, 5 Jul 2017 15:25:59 +0200
> > Аl Воgnеr  wrote:
> > 
> > > Am Wed, 5 Jul 2017 08:17:41 -0400
> > > schrieb Šarūnas :
> > >   
> > > > On 2017-07-04 08:21, Аl Воgnеr wrote:  
> > > > > I found 
> > > > > https://www.reddit.com/r/DarkTable/comments/4wm39l/darktable_on_hidpi_screens/
> > > > >
> > > > > 
> > > > which recommends to change the value of screen_dpi_overwrite in  
> > > > > ~/.config/darktable/darktablerc
> > > > > 
> > > > > The default value is -1.0 and it was recommended to set it to
> > > > > 140-150. But this doesn't work for me. If I change to 140 I get
> > > > > some letters in yellow in the menu.
> > > > > 
> > > > > What do you do with a 4k-display?
> > > > 
> > > > Current Ubuntu/KDE with 27" 3840×2160:
> > > > 
> > > > System Settings → Fonts → Force fonts DPI:144.
> > > > 
> > > > This fixes fonts for all the applications (save for a few very
> > > > “stubborn” ones). No need to adjust DPI for darktable
> > > > individually, all looks good.  
> > > 
> > > I did this already before and it was set to 144, but nothing
> > > happened with dt, but with other programs. Now I modified
> > > darktablerc to 288 and I saw a change, but 288 is too large, so I
> > > have to try what would be a good value.
> > > 
> > > Al
> > > 
> > > darktable user mailing list
> > > to unsubscribe send a mail to
> > > darktable-user+unsubscr...@lists.darktable.org
> > > 
> > > 
> > >   
> > 
> > darktable user mailing list
> > to unsubscribe send a mail to
> > darktable-user+unsubscr...@lists.darktable.org
> > 
> 
> 

darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] Darktable on HiDPI screens

[Аl Воgnеr]

Am Wed, 5 Jul 2017 16:59:31 +0200
schrieb Romano Giannetti :

> On 05/07/17 14:28, Tobias Ellinghaus wrote:
> > Am Mittwoch, 5. Juli 2017, 13:51:47 CEST schrieb Аl Воgnеr:  
> >>
> >> Here is a screenshot, where you see that 144 did not change the
> >> size, but the colors of the letters, especially in yellow and blue:
> >> https://drive.google.com/drive/folders/0Bx7crlmGDudaQVB3Qy11SVdLYlE  
> > I don't see any yellow text in that screenshot. Or otherwise
> > colored one. Maybe try setting the DPI to something even bigger,
> > say, 300. Does that change anything?  
> 
> Neither do I, --- at 100% it is ok on my screen. Could be an aliasing 
> artifact? I mean, are you sure that your screen panel has the
> resolution (physical) that the software is thinking it has?

Well, it was *very* colored, a few letters in yellow, then in blue,
then white or black, a.s.o. I saw this e.g. in the left and right panel,
and when I selected a filmroll.

At the moment everything looks nearly perfect, a little bit too large
fonts, but white letters on dark background in the panels. I have set
180dpi in darktablerc und 144dpi for the system. Because of the
troubles I think I will keep this setting for a while.

In theory I have a little bit less than 140dpi. The monitor reports
itself the resolution is 3840x2160@60Hz (708.48 x 398.52 mm from the
PA328Q manual).

Al



darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] gen-profile -d

[Аl Воgnеr]

Am Wed, 5 Jul 2017 16:48:12 +0200
schrieb Romano Giannetti :

> You should activate "profiled denoise" and check that darktable is 
> saying something on the style of "profile for Pentax KP at XXX ISO 
> found" in the module. I do not think you can have something really 
> usable if you have not used the raw linear profile on the RAW.

Romano, I thought the same, that I didn't create something useful. I
was interested if the script runs without errors. I will go on if I
have more time, maybe in 2-3 weeks.

Al


darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] Darktable on HiDPI screens

[Аl Воgnеr]

Am Wed, 5 Jul 2017 16:31:48 +0300
schrieb parafin :

> Which display do you have? Exact model.

Asus PA328Q.

I am guessing, if I set the system fontsize to 144dpi and darktablerc is
144 too, nothing changes, if it is greater than 144dpi fontsize changes.

At moment I am testing 180dpi. A little bit too much, but on the other
side with 600px border it is more or less ok. The goal is to get a 3:2
relation for the picture part of the screen.

Al

 
> On Wed, 5 Jul 2017 15:25:59 +0200
> Аl Воgnеr  wrote:
> 
> > Am Wed, 5 Jul 2017 08:17:41 -0400
> > schrieb Šarūnas :
> >   
> > > On 2017-07-04 08:21, Аl Воgnеr wrote:  
> > > > I found 
> > > > https://www.reddit.com/r/DarkTable/comments/4wm39l/darktable_on_hidpi_screens/
> > > >
> > > > 
> > > which recommends to change the value of screen_dpi_overwrite in  
> > > > ~/.config/darktable/darktablerc
> > > > 
> > > > The default value is -1.0 and it was recommended to set it to
> > > > 140-150. But this doesn't work for me. If I change to 140 I get
> > > > some letters in yellow in the menu.
> > > > 
> > > > What do you do with a 4k-display?
> > > 
> > > Current Ubuntu/KDE with 27" 3840×2160:
> > > 
> > > System Settings → Fonts → Force fonts DPI:144.
> > > 
> > > This fixes fonts for all the applications (save for a few very
> > > “stubborn” ones). No need to adjust DPI for darktable
> > > individually, all looks good.  
> > 
> > I did this already before and it was set to 144, but nothing
> > happened with dt, but with other programs. Now I modified
> > darktablerc to 288 and I saw a change, but 288 is too large, so I
> > have to try what would be a good value.
> > 
> > Al
> > 
> > darktable user mailing list
> > to unsubscribe send a mail to
> > darktable-user+unsubscr...@lists.darktable.org
> > 
> > 
> >   
> 
> darktable user mailing list
> to unsubscribe send a mail to
> darktable-user+unsubscr...@lists.darktable.org
> 


darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org