Re: [darktable-user] CPU Recommendations

2018-03-25 Thread Patrik Marschalik 
Thanks!

After removing my old configuration file the result was:

dev_process_export] pixel pipeline processing took 15,410 secs (219,753 CPU)

That is much better. :-)

Patrik

On Sun, Mar 25, 2018 at 01:37:07PM -0400, Šarūnas wrote:
> On 03/25/2018 12:58 PM, Patrik Marschalik wrote:
> > When I am running
> >
> > darktable-cli bench.SRW bench.SRW.xmp test.jpg --core --disable-opencl
> > -d perf
> >
> > on my new Ryzen 7 1700 processor it takes around 33s, that is about
> > twice
> > the results from
> >
> > https://math.dartmouth.edu/~sarunas/darktable_bench.html
> >
> > $ grep "model name" /proc/cpuinfo && free -h && lspci | grep "VGA" &&
> > uname -a
> > model name  : AMD Ryzen 7 1700 Eight-Core Processor
> > model name  : AMD Ryzen 7 1700 Eight-Core Processor
> > model name  : AMD Ryzen 7 1700 Eight-Core Processor
> > model name  : AMD Ryzen 7 1700 Eight-Core Processor
> > model name  : AMD Ryzen 7 1700 Eight-Core Processor
> > model name  : AMD Ryzen 7 1700 Eight-Core Processor
> > model name  : AMD Ryzen 7 1700 Eight-Core Processor
> > model name  : AMD Ryzen 7 1700 Eight-Core Processor
> > model name  : AMD Ryzen 7 1700 Eight-Core Processor
> > model name  : AMD Ryzen 7 1700 Eight-Core Processor
> > model name  : AMD Ryzen 7 1700 Eight-Core Processor
> > model name  : AMD Ryzen 7 1700 Eight-Core Processor
> > model name  : AMD Ryzen 7 1700 Eight-Core Processor
> > model name  : AMD Ryzen 7 1700 Eight-Core Processor
> > model name  : AMD Ryzen 7 1700 Eight-Core Processor
> > model name  : AMD Ryzen 7 1700 Eight-Core Processor
> >   totalusedfree  shared  buff/cache 
> > available
> > Mem:15G2,6G 11G 37M 1,8G 12G
> > Swap:   63G  0B 63G
> > 26:00.0 VGA compatible controller: NVIDIA Corporation GP106 [GeForce GTX 
> > 1060 6GB] (rev a1)
> > Linux 4.14.0-0.bpo.3-amd64 #1 SMP Debian 4.14.13-1~bpo9+1 (2018-01-14) 
> > x86_64 GNU/Linux
> >
> > What could be the problem?
> 
> Perhaps you'd like to compare what takes how long. Here it is run on
> Ryzen 5 1600 3.6GHz:
> 
> $ darktable-cli bench.SRW bench.SRW.xmp test.jpg --core --disable-opencl
> -d perf
> output file already exists, it will get renamed
> 0.419067 [dev] took 0.192 secs (0.222 CPU) to load the image.
> 0.499966 [export] creating pixelpipe took 0.080 secs (0.115 CPU)
> 0.513925 [dev_pixelpipe] took 0.013 secs (0.066 CPU) initing base buffer
> [export]
> 0.528093 [dev_pixelpipe] took 0.014 secs (0.089 CPU) processed `raw
> black/white point' on CPU, blended on CPU [export]
> 0.535352 [dev_pixelpipe] took 0.007 secs (0.046 CPU) processed `white
> balance' on CPU, blended on CPU [export]
> 0.617931 [dev_pixelpipe] took 0.082 secs (0.974 CPU) processed
> `highlight reconstruction' on CPU, blended on CPU [export]
> 0.763135 [dev_pixelpipe] took 0.145 secs (1.681 CPU) processed
> `demosaic' on CPU, blended on CPU [export]
> 1.343859 [dev_pixelpipe] took 0.581 secs (4.136 CPU) processed `tone
> mapping' on CPU, blended on CPU [export]
> 2.011026 [dev_pixelpipe] took 0.667 secs (6.976 CPU) processed `lens
> correction' on CPU, blended on CPU [export]
> 2.044709 [dev_pixelpipe] took 0.034 secs (0.370 CPU) processed `base
> curve' on CPU, blended on CPU [export]
> 2.069955 [dev_pixelpipe] took 0.025 secs (0.265 CPU) processed `input
> color profile' on CPU, blended on CPU [export]
> 2.191421 [dev_pixelpipe] took 0.121 secs (1.371 CPU) processed `color
> reconstruction' on CPU, blended on CPU [export]
> 10.639141 [dev_pixelpipe] took 8.448 secs (100.013 CPU) processed
> `denoise (non-local means)' on CPU, blended on CPU [export]
> 11.032732 [dev_pixelpipe] took 0.393 secs (3.990 CPU) processed `global
> tonemap' on CPU, blended on CPU [export]
> 11.369133 [dev_pixelpipe] took 0.336 secs (3.962 CPU) processed `shadows
> and highlights' on CPU, blended on CPU [export]
> 13.517173 [dev_pixelpipe] took 2.148 secs (23.705 CPU) processed
> `equalizer' on CPU, blended on CPU [export]
> 13.696848 [dev_pixelpipe] took 0.180 secs (2.083 CPU) processed `local
> contrast' on CPU, blended on CPU [export]
> 13.838740 [dev_pixelpipe] took 0.142 secs (1.618 CPU) processed `color
> zones' on CPU, blended on CPU [export]
> 13.872655 [dev_pixelpipe] took 0.034 secs (0.385 CPU) processed `levels'
> on CPU, blended on CPU [export]
> 13.952512 [dev_pixelpipe] took 0.080 secs (0.856 CPU) processed
> `sharpen' on CPU, blended on CPU [export]
> 13.975510 [dev_pixelpipe] took 0.023 secs (0.242 CPU) processed `color
> contrast' on CPU, blended on CPU [export]
> 14.040952 [dev_pixelpipe] took 0.065 secs (0.692 CPU) processed `output
> color profile' on CPU, blended on CPU [export]
> 14.058418 [dev_pixelpipe] took 0.017 secs (0.184 CPU) processed `gamma'
> on CPU, blended on CPU [export]
> 14.058586 [dev_process_export] pixel pipeline processing took 13.559
> secs (153.764 CPU)
> [export_job] exported to `test_03.jpg'
>

Re: [darktable-user] CPU Recommendations

2018-03-25 Thread Šarūnas 
On 03/25/2018 12:58 PM, Patrik Marschalik wrote:
> When I am running
>
> darktable-cli bench.SRW bench.SRW.xmp test.jpg --core --disable-opencl
> -d perf
>
> on my new Ryzen 7 1700 processor it takes around 33s, that is about
> twice
> the results from
>
> https://math.dartmouth.edu/~sarunas/darktable_bench.html
>
> $ grep "model name" /proc/cpuinfo && free -h && lspci | grep "VGA" &&
> uname -a
> model name  : AMD Ryzen 7 1700 Eight-Core Processor
> model name  : AMD Ryzen 7 1700 Eight-Core Processor
> model name  : AMD Ryzen 7 1700 Eight-Core Processor
> model name  : AMD Ryzen 7 1700 Eight-Core Processor
> model name  : AMD Ryzen 7 1700 Eight-Core Processor
> model name  : AMD Ryzen 7 1700 Eight-Core Processor
> model name  : AMD Ryzen 7 1700 Eight-Core Processor
> model name  : AMD Ryzen 7 1700 Eight-Core Processor
> model name  : AMD Ryzen 7 1700 Eight-Core Processor
> model name  : AMD Ryzen 7 1700 Eight-Core Processor
> model name  : AMD Ryzen 7 1700 Eight-Core Processor
> model name  : AMD Ryzen 7 1700 Eight-Core Processor
> model name  : AMD Ryzen 7 1700 Eight-Core Processor
> model name  : AMD Ryzen 7 1700 Eight-Core Processor
> model name  : AMD Ryzen 7 1700 Eight-Core Processor
> model name  : AMD Ryzen 7 1700 Eight-Core Processor
>   totalusedfree  shared  buff/cache available
> Mem:15G2,6G 11G 37M 1,8G 12G
> Swap:   63G  0B 63G
> 26:00.0 VGA compatible controller: NVIDIA Corporation GP106 [GeForce GTX 1060 
> 6GB] (rev a1)
> Linux 4.14.0-0.bpo.3-amd64 #1 SMP Debian 4.14.13-1~bpo9+1 (2018-01-14) x86_64 
> GNU/Linux
>
> What could be the problem?

Perhaps you'd like to compare what takes how long. Here it is run on
Ryzen 5 1600 3.6GHz:

$ darktable-cli bench.SRW bench.SRW.xmp test.jpg --core --disable-opencl
-d perf
output file already exists, it will get renamed
0.419067 [dev] took 0.192 secs (0.222 CPU) to load the image.
0.499966 [export] creating pixelpipe took 0.080 secs (0.115 CPU)
0.513925 [dev_pixelpipe] took 0.013 secs (0.066 CPU) initing base buffer
[export]
0.528093 [dev_pixelpipe] took 0.014 secs (0.089 CPU) processed `raw
black/white point' on CPU, blended on CPU [export]
0.535352 [dev_pixelpipe] took 0.007 secs (0.046 CPU) processed `white
balance' on CPU, blended on CPU [export]
0.617931 [dev_pixelpipe] took 0.082 secs (0.974 CPU) processed
`highlight reconstruction' on CPU, blended on CPU [export]
0.763135 [dev_pixelpipe] took 0.145 secs (1.681 CPU) processed
`demosaic' on CPU, blended on CPU [export]
1.343859 [dev_pixelpipe] took 0.581 secs (4.136 CPU) processed `tone
mapping' on CPU, blended on CPU [export]
2.011026 [dev_pixelpipe] took 0.667 secs (6.976 CPU) processed `lens
correction' on CPU, blended on CPU [export]
2.044709 [dev_pixelpipe] took 0.034 secs (0.370 CPU) processed `base
curve' on CPU, blended on CPU [export]
2.069955 [dev_pixelpipe] took 0.025 secs (0.265 CPU) processed `input
color profile' on CPU, blended on CPU [export]
2.191421 [dev_pixelpipe] took 0.121 secs (1.371 CPU) processed `color
reconstruction' on CPU, blended on CPU [export]
10.639141 [dev_pixelpipe] took 8.448 secs (100.013 CPU) processed
`denoise (non-local means)' on CPU, blended on CPU [export]
11.032732 [dev_pixelpipe] took 0.393 secs (3.990 CPU) processed `global
tonemap' on CPU, blended on CPU [export]
11.369133 [dev_pixelpipe] took 0.336 secs (3.962 CPU) processed `shadows
and highlights' on CPU, blended on CPU [export]
13.517173 [dev_pixelpipe] took 2.148 secs (23.705 CPU) processed
`equalizer' on CPU, blended on CPU [export]
13.696848 [dev_pixelpipe] took 0.180 secs (2.083 CPU) processed `local
contrast' on CPU, blended on CPU [export]
13.838740 [dev_pixelpipe] took 0.142 secs (1.618 CPU) processed `color
zones' on CPU, blended on CPU [export]
13.872655 [dev_pixelpipe] took 0.034 secs (0.385 CPU) processed `levels'
on CPU, blended on CPU [export]
13.952512 [dev_pixelpipe] took 0.080 secs (0.856 CPU) processed
`sharpen' on CPU, blended on CPU [export]
13.975510 [dev_pixelpipe] took 0.023 secs (0.242 CPU) processed `color
contrast' on CPU, blended on CPU [export]
14.040952 [dev_pixelpipe] took 0.065 secs (0.692 CPU) processed `output
color profile' on CPU, blended on CPU [export]
14.058418 [dev_pixelpipe] took 0.017 secs (0.184 CPU) processed `gamma'
on CPU, blended on CPU [export]
14.058586 [dev_process_export] pixel pipeline processing took 13.559
secs (153.764 CPU)
[export_job] exported to `test_03.jpg'

The system according to your command:
$ grep "model name" /proc/cpuinfo && free -h && lspci | grep "VGA" &&
> uname -a
model name  : AMD Ryzen 5 1600 Six-Core Processor
model name  : AMD Ryzen 5 1600 Six-Core Processor
model name  : AMD Ryzen 5 1600 Six-Core Processor
model name  : AMD Ryzen 5 1600 Six-Core Processor
model name  : AMD Ryzen 5 1600 Six-Core Processor
model name  : AMD Ryzen 5 1600

Re: [darktable-user] CPU Recommendations

2018-03-25 Thread Patrik Marschalik 
When I am running

darktable-cli bench.SRW bench.SRW.xmp test.jpg --core --disable-opencl
-d perf

on my new Ryzen 7 1700 processor it takes around 33s, that is about
twice
the results from

https://math.dartmouth.edu/~sarunas/darktable_bench.html

$ grep "model name" /proc/cpuinfo && free -h && lspci | grep "VGA" &&
uname -a
model name  : AMD Ryzen 7 1700 Eight-Core Processor
model name  : AMD Ryzen 7 1700 Eight-Core Processor
model name  : AMD Ryzen 7 1700 Eight-Core Processor
model name  : AMD Ryzen 7 1700 Eight-Core Processor
model name  : AMD Ryzen 7 1700 Eight-Core Processor
model name  : AMD Ryzen 7 1700 Eight-Core Processor
model name  : AMD Ryzen 7 1700 Eight-Core Processor
model name  : AMD Ryzen 7 1700 Eight-Core Processor
model name  : AMD Ryzen 7 1700 Eight-Core Processor
model name  : AMD Ryzen 7 1700 Eight-Core Processor
model name  : AMD Ryzen 7 1700 Eight-Core Processor
model name  : AMD Ryzen 7 1700 Eight-Core Processor
model name  : AMD Ryzen 7 1700 Eight-Core Processor
model name  : AMD Ryzen 7 1700 Eight-Core Processor
model name  : AMD Ryzen 7 1700 Eight-Core Processor
model name  : AMD Ryzen 7 1700 Eight-Core Processor
  totalusedfree  shared  buff/cache available
Mem:15G2,6G 11G 37M 1,8G 12G
Swap:   63G  0B 63G
26:00.0 VGA compatible controller: NVIDIA Corporation GP106 [GeForce GTX 1060 
6GB] (rev a1)
Linux 4.14.0-0.bpo.3-amd64 #1 SMP Debian 4.14.13-1~bpo9+1 (2018-01-14) x86_64 
GNU/Linux

What could be the problem?

Thanks,
Patrik

On Sun, Feb 04, 2018 at 08:35:14PM -0500, Šarūnas wrote:
> On 02/04/2018 05:38 PM, Robert Bieber wrote:
> > Oh yeah, I'm just talking about the price of the CPU, not the whole PC.
> > I'm planning on doing all out on RAM and solid state drives as well. I
> > guess GPU might be of some concern as well, how has GPU processing in
> > dark table on Linux been going lately? I know it exists, but I'm always
> > scared of anything to do with graphics drivers on Linux
> 
> GPU might just be the upgrade with the biggest impact for RAW
> processing. To have that impact it will need not only the drivers to
> work, but also the corresponding OpenCL part...
> 
> This topic comes up from time to time here, so, as already mentioned, it
> may make sense to search the archives.
> 
> With Nvidia things may seem more stable, but it's not that one just
> installs proprietary drivers + OpenCL from the distribution's
> repositories and it "just works". You need proprietary Nvidia drivers
> for OpenCL to work.
> 
> With AMD it is already possible to have a completely open source setup.
> amdgpu is in the kernel, and the OpenCL part can come from the open
> source ROCm. It will limit you to certain AMD GPUs and Linux kernel/X
> versions. To have a wider range, the open source kernel amdgpu can be
> combined with the OpenCL part from AMD's proprietary amdgpu-pro — that
> works well too.
> 
> I have some random tests listed here:
> math.dartmouth.edu/~sarunas/darktable_bench.html
> 
> 
> -- 
> Šarūnas Burdulis
> math.dartmouth.edu/~sarunas
> 




darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] CPU Recommendations

2018-02-06 Thread Michael Rasmussen 
On Tue, 6 Feb 2018 17:52:48 -0800
Scott  wrote:

> [default_process_tiling_opencl_ptp] couldn't run process_cl() for
> module 'atrous' in tiling mode: 0
> [opencl_pixelpipe] could not run module 'atrous' on gpu. falling back
> to cpu path
I sometimes sees this error as well if I have Google Chrome open.
Closing Google Chrome and running 'atrous' on gpu succeeds.

I have not been able yet to test whether enabled hardware optimization
in Google Chrome or not have any influence on this.

-- 
Hilsen/Regards
Michael Rasmussen

Get my public GnuPG keys:
michael  rasmussen  cc
http://pgp.mit.edu:11371/pks/lookup?op=get=0xD3C9A00E
mir  datanom  net
http://pgp.mit.edu:11371/pks/lookup?op=get=0xE501F51C
mir  miras  org
http://pgp.mit.edu:11371/pks/lookup?op=get=0xE3E80917
--
/usr/games/fortune -es says:
Sigh.  I like to think it's just the Linux people who want to be on
the "leading edge" so bad they walk right off the precipice.
(Craig E. Groeschel)


pgp_fLyVzuILB.pgp
Description: OpenPGP digital signature

Re: [darktable-user] CPU Recommendations

2018-02-06 Thread Scott 
Just to add one more data point, another older system:

Darktable 2.4.1 on Ubuntu 17.10
Intel Core i5-3570K @ 3.40GHz (4 cores)
GeForce GTX 650 Ti BOOST
16 GB RAM

$ darktable-cli bench.SRW test.jpg --core --disable-opencl -d perf
[dev_process_export] pixel pipeline processing took 29.503 secs (101.837 CPU)

$ darktable-cli bench.SRW test.jpg --core -d perf -d opencl
[dev_process_export] pixel pipeline processing took 17.418 secs (36.790 CPU)
[opencl_summary_statistics] device 'GeForce GTX 650 Ti BOOST' (0): 545
out of 546 events were successful and 1 events lost

A couple of notes:
With no opencl, over half of the time was spent on the non-local means
denoise (15.28 seconds).  The equalizer was 6.8 seconds.
With opencl, the non-local means reduced to 6.56 seconds.  The
equalizer actually took longer at 7.6 seconds because this is the
opencl event that was lost on my machine:

[default_process_tiling_cl_ptp] use tiling on module 'atrous' for
image with full size 5490 x 3660
[default_process_tiling_cl_ptp] (3 x 1) tiles with max dimensions 2756
x 3660 and overlap 256
[default_process_tiling_cl_ptp] tile (0, 0) with 2756 x 3660 at origin [0, 0]
[opencl_atrous] couldn't enqueue kernel! -4
[default_process_tiling_opencl_ptp] couldn't run process_cl() for
module 'atrous' in tiling mode: 0
[opencl_pixelpipe] could not run module 'atrous' on gpu. falling back
to cpu path
[dev_pixelpipe] took 7.646 secs (25.516 CPU) processed `equalizer' on
CPU with tiling, blended on CPU [export]


On Tue, Feb 6, 2018 at 2:25 PM, Tobias Ellinghaus  wrote:
> Am Dienstag, 6. Februar 2018, 14:32:28 CET schrieb Guillermo Rozas:
>> But the manual explicitly says that "there can be multiple parallel
>> pixelpipes doing file exports and there can be multiple parallel
>> pixelpipes generating thumbnails". How are them allocated? With
>> "multiple" it refers to different queues from consecutive runs of the
>> export panel or thumbnails generator, or files from a single queue can
>> run in parallel if more than one device is available?
>
> Neither nor. Only one export job is run at a time, and for the running job
> only one image is processed at a time. Even when there are several GPUs that
> could do the computations you would still need huge amounts of memory.
>
>> Best regards,
>> Guillermo
>
> Tobias
>
>> On Tue, Feb 6, 2018 at 10:23 AM, Roman Lebedev  wrote:
>> > More like not really, that is *only* about darkroom editing (it will
>> > do main and preview pipes in parallel)
>> > It won't make any difference whatsoever for export.
>>
>> 
>> darktable user mailing list
>> to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org
>

darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] CPU Recommendations

2018-02-06 Thread Tobias Ellinghaus 
Am Dienstag, 6. Februar 2018, 14:32:28 CET schrieb Guillermo Rozas:
> But the manual explicitly says that "there can be multiple parallel
> pixelpipes doing file exports and there can be multiple parallel
> pixelpipes generating thumbnails". How are them allocated? With
> "multiple" it refers to different queues from consecutive runs of the
> export panel or thumbnails generator, or files from a single queue can
> run in parallel if more than one device is available?

Neither nor. Only one export job is run at a time, and for the running job 
only one image is processed at a time. Even when there are several GPUs that 
could do the computations you would still need huge amounts of memory.

> Best regards,
> Guillermo

Tobias

> On Tue, Feb 6, 2018 at 10:23 AM, Roman Lebedev  wrote:
> > More like not really, that is *only* about darkroom editing (it will
> > do main and preview pipes in parallel)
> > It won't make any difference whatsoever for export.
> 
> 
> darktable user mailing list
> to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org



signature.asc
Description: This is a digitally signed message part.

Re: [darktable-user] CPU Recommendations

2018-02-06 Thread Guillermo Rozas 
But the manual explicitly says that "there can be multiple parallel
pixelpipes doing file exports and there can be multiple parallel
pixelpipes generating thumbnails". How are them allocated? With
"multiple" it refers to different queues from consecutive runs of the
export panel or thumbnails generator, or files from a single queue can
run in parallel if more than one device is available?

Best regards,
Guillermo

On Tue, Feb 6, 2018 at 10:23 AM, Roman Lebedev  wrote:
> More like not really, that is *only* about darkroom editing (it will
> do main and preview pipes in parallel)
> It won't make any difference whatsoever for export.
>

darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] CPU Recommendations

2018-02-06 Thread Roman Lebedev 
On Tue, Feb 6, 2018 at 4:18 PM, KOVÁCS István  wrote:
>
>
> On 6 Feb 2018 09:18, "Jean-Luc Lacroix"  wrote:
>
> Just out of curiosity: if I add another GPU card, would DT be able to use
> that additional GPU power?
>
> Cheers.
>
> Jean-Luc
>
>
> Yes.
More like not really, that is *only* about darkroom editing (it will
do main and preview pipes in parallel)
It won't make any difference whatsoever for export.

> https://www.darktable.org/usermanual/en/darktable_and_opencl_multiple_devices.html
>
> Kofa
Roman.

> 
> darktable user mailing list to unsubscribe send a mail to
> darktable-user+unsubscr...@lists.darktable.org

darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] CPU Recommendations

2018-02-06 Thread KOVÁCS István 
On 6 Feb 2018 09:18, "Jean-Luc Lacroix"  wrote:

Just out of curiosity: if I add another GPU card, would DT be able to use
that additional GPU power?

Cheers.

Jean-Luc


Yes.
https://www.darktable.org/usermanual/en/darktable_and_opencl_multiple_devices.html

Kofa


darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] CPU Recommendations

2018-02-06 Thread Jean-Luc Lacroix 
I currently have a Nvidia GTX 970 that works flawlessly with its 
proprietary driver and OpenCL on a i7 Debian box.


Just out of curiosity: if I add another GPU card, would DT be able to 
use that additional GPU power?


Cheers.

Jean-Luc


On 05/02/18 17:50, Peter Mc Donough wrote:

Am 05.02.2018 um 02:35 schrieb Šarūnas:

On 02/04/2018 05:38 PM, Robert Bieber wrote:

Oh yeah, I'm just talking about the price of the CPU, not the whole PC.
I'm planning on doing all out on RAM and solid state drives as well. I
guess GPU might be of some concern as well, how has GPU processing in
dark table on Linux been going lately? I know it exists, but I'm always
scared of anything to do with graphics drivers on Linux


GPU might just be the upgrade with the biggest impact for RAW
processing. To have that impact it will need not only the drivers to
work, but also the corresponding OpenCL part...
...


This is exactly what you should keep in mind. As much RAM as you can 
afford, and an openCL capable graphics card. 16GB RAM and a 1TB SSD work 
nicely in my computer.


I run darktable with an 4-core AMD processor and an AMD-RX 460 graphics 
card in Ubuntu 16.04.3 with the amdgpu-pro driver (just the openCL part)


I copied some time ago a sort of test-suite, which shows that photo 
export is more than four times faster on my PC with openCL enabled.


1.899 secs without openCL
0.442 secs with openCL

You usually do not export just one photo, and openCL should also 
accelerate other processing tasks.


If you wish I can send you the zipped test per mail.

cu
Peter
 


darktable user mailing list
to unsubscribe send a mail to 
darktable-user+unsubscr...@lists.darktable.org




darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] CPU Recommendations

2018-02-05 Thread Peter Mc Donough 

Am 05.02.2018 um 02:35 schrieb Šarūnas:

On 02/04/2018 05:38 PM, Robert Bieber wrote:

Oh yeah, I'm just talking about the price of the CPU, not the whole PC.
I'm planning on doing all out on RAM and solid state drives as well. I
guess GPU might be of some concern as well, how has GPU processing in
dark table on Linux been going lately? I know it exists, but I'm always
scared of anything to do with graphics drivers on Linux


GPU might just be the upgrade with the biggest impact for RAW
processing. To have that impact it will need not only the drivers to
work, but also the corresponding OpenCL part...
...


This is exactly what you should keep in mind. As much RAM as you can 
afford, and an openCL capable graphics card. 16GB RAM and a 1TB SSD work 
nicely in my computer.


I run darktable with an 4-core AMD processor and an AMD-RX 460 graphics 
card in Ubuntu 16.04.3 with the amdgpu-pro driver (just the openCL part)


I copied some time ago a sort of test-suite, which shows that photo 
export is more than four times faster on my PC with openCL enabled.


1.899 secs without openCL
0.442 secs with openCL

You usually do not export just one photo, and openCL should also 
accelerate other processing tasks.


If you wish I can send you the zipped test per mail.

cu
Peter

darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] CPU Recommendations

2018-02-05 Thread Guillermo Rozas 
...now I just have to go see if I can get my hands on a decent Nvidia card
> without the bitcoin miners snapping them all up :p
>

Note that if you plan to keep the pc for some years, nvidia will stop
developing the proprietary driver, and maybe you have to moreless trash the
pc since newer kernel and so on won't work with old gpu drivers...


Except that NVidia has a clear support commitment and a public timeline for
end of support, which for example currently guarantees support for some
legacy cards (circa 10 years old) until 2019 (
http://nvidia.custhelp.com/app/answers/detail/a_id/3142). Add to that their
current push to use CUDA (only available on the proprietary driver) for
anything from HP computing to machine learning, and I would bet that any
current NVidia card will still be supported long after it has become
obsolete.

Regards,
Guillermo


darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] CPU Recommendations

2018-02-05 Thread Patrick Shanahan 
* Giulio  [02-05-18 10:53]:
> Il 05/02/2018 01:01, Robert Bieber ha scritto:
> >Interesting, thanks for the rundown.  I don't really like the idea of
> >proprietary graphics drivers, but it seems like Nvidia is still my best
> >bet.  Hopefully someday the free AMD drivers will be up to par and I can
> >switch back to them.
> >
> >...now I just have to go see if I can get my hands on a decent Nvidia card
> >without the bitcoin miners snapping them all up :p
> 
> Note that if you plan to keep the pc for some years, nvidia will stop
> developing the proprietary driver, and maybe you have to moreless trash the
> pc since newer kernel and so on won't work with old gpu drivers...

yes, could happen, but am presently using nv gts450 which came out in
2009, and *most* people do not keep a computer that long.  and amd has a
much poorer record of supporting older gpu's.

my i7 was issued about the same time but it is very sufficient for working
my d850 raw photos.


-- 
(paka)Patrick Shanahan   Plainfield, Indiana, USA  @ptilopteri
http://en.opensuse.orgopenSUSE Community Memberfacebook/ptilopteri
Registered Linux User #207535@ http://linuxcounter.net
Photos: http://wahoo.no-ip.org/piwigo   paka @ IRCnet freenode

darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] CPU Recommendations

2018-02-05 Thread Jean-Luc Coulon (f5ibh) 
Hi

2018-02-05 16:50 GMT+01:00 Giulio :

> Note that if you plan to keep the pc for some years, nvidia will stop
> developing the proprietary driver, and maybe you have to moreless trash the
> pc since newer kernel and so on won't work with old gpu drivers...
>
> *if* the problem is with the driver, the whole PC will not have to be
trashed. Maybe the graphic cards. But there are several other components in
a PC...

BTW, I've an Intel Core i7-6700K CPU @ 4.00GHz. I've no GPU, only the
integrated attachment. And it works quite well.


darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] CPU Recommendations

2018-02-05 Thread Giulio 

Il 05/02/2018 01:01, Robert Bieber ha scritto:
Interesting, thanks for the rundown.  I don't really like the idea of 
proprietary graphics drivers, but it seems like Nvidia is still my best 
bet.  Hopefully someday the free AMD drivers will be up to par and I can 
switch back to them.


...now I just have to go see if I can get my hands on a decent Nvidia 
card without the bitcoin miners snapping them all up :p


Note that if you plan to keep the pc for some years, nvidia will stop 
developing the proprietary driver, and maybe you have to moreless trash 
the pc since newer kernel and so on won't work with old gpu drivers...




darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] CPU Recommendations

2018-02-05 Thread Guillermo Rozas 
>> If you use KDE, you'd better avoid Nvidia. See
>> http://kde-bugs-dist.kde.narkive.com/RYzm58yW/plasmashell-bug-347772-new-kscreenlocker-greet-using-100-cpu-on-plasma-5
>>
>> It's been open for years. There are a few suggested workarounds, none of
>> which really worked for me.
>
> I use KDE with an nVIDIA Quadro M4000M on openSUSE 42.3 and have yet
> to observe this.

I see the same, no problems in a 960M on Kubuntu 17.10 (but my
installation is a mess from a Gnome to KDE upgrade, so I can't say
anything about a clean install).
Regards,
Guillermo

darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] CPU Recommendations

2018-02-05 Thread Robert Krawitz 
On Mon, 5 Feb 2018 08:07:27 +0100, =?UTF-8?B?S09Ww4FDUyBJc3R2w6Fu?= wrote:
> If you use KDE, you'd better avoid Nvidia. See
> http://kde-bugs-dist.kde.narkive.com/RYzm58yW/plasmashell-bug-347772-new-kscreenlocker-greet-using-100-cpu-on-plasma-5
>
> It's been open for years. There are a few suggested workarounds, none of
> which really worked for me.

I use KDE with an nVIDIA Quadro M4000M on openSUSE 42.3 and have yet
to observe this.

It's plausible that this depends upon your screenlocker configuration
and that there's an OpenGL issue.  I use a minimal configuration
(black background, no widgets).
-- 
Robert Krawitz 

***  MIT Engineers   A Proud Tradition   http://mitathletics.com  ***
Member of the League for Programming Freedom  --  http://ProgFree.org
Project lead for Gutenprint   --http://gimp-print.sourceforge.net

"Linux doesn't dictate how I work, I dictate how Linux works."
--Eric Crampton

darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] CPU Recommendations

2018-02-04 Thread KOVÁCS István 
If you use KDE, you'd better avoid Nvidia. See
http://kde-bugs-dist.kde.narkive.com/RYzm58yW/plasmashell-bug-347772-new-kscreenlocker-greet-using-100-cpu-on-plasma-5

It's been open for years. There are a few suggested workarounds, none of
which really worked for me.

Kofa

On 5 Feb 2018 01:02, "Robert Bieber"  wrote:

Interesting, thanks for the rundown.  I don't really like the idea of
proprietary graphics drivers, but it seems like Nvidia is still my best
bet.


darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] CPU Recommendations

2018-02-04 Thread Šarūnas 
On 02/04/2018 05:38 PM, Robert Bieber wrote:
> Oh yeah, I'm just talking about the price of the CPU, not the whole PC.
> I'm planning on doing all out on RAM and solid state drives as well. I
> guess GPU might be of some concern as well, how has GPU processing in
> dark table on Linux been going lately? I know it exists, but I'm always
> scared of anything to do with graphics drivers on Linux

GPU might just be the upgrade with the biggest impact for RAW
processing. To have that impact it will need not only the drivers to
work, but also the corresponding OpenCL part...

This topic comes up from time to time here, so, as already mentioned, it
may make sense to search the archives.

With Nvidia things may seem more stable, but it's not that one just
installs proprietary drivers + OpenCL from the distribution's
repositories and it "just works". You need proprietary Nvidia drivers
for OpenCL to work.

With AMD it is already possible to have a completely open source setup.
amdgpu is in the kernel, and the OpenCL part can come from the open
source ROCm. It will limit you to certain AMD GPUs and Linux kernel/X
versions. To have a wider range, the open source kernel amdgpu can be
combined with the OpenCL part from AMD's proprietary amdgpu-pro — that
works well too.

I have some random tests listed here:
math.dartmouth.edu/~sarunas/darktable_bench.html


-- 
Šarūnas Burdulis
math.dartmouth.edu/~sarunas



signature.asc
Description: OpenPGP digital signature

Re: [darktable-user] CPU Recommendations

2018-02-04 Thread Robert Bieber 
Interesting, thanks for the rundown.  I don't really like the idea of 
proprietary graphics drivers, but it seems like Nvidia is still my best 
bet.  Hopefully someday the free AMD drivers will be up to par and I can 
switch back to them.


...now I just have to go see if I can get my hands on a decent Nvidia 
card without the bitcoin miners snapping them all up :p



On 02/04/2018 03:19 PM, Guillermo Rozas wrote:

If the operating system and window manager don't have compatibility
issues with the GPU, GPU processing in Darktable works like a charm
(and it's very useful, specially if you intend to hang onto that
computer for 5 years or more).

The caveats regarding Linux-GPU compatibility:
- if you want to use only open source drivers, you have to go to AMD
(NVidia's open source driver is much slower). The same applies if you
want to use Wayland. However, the open source drivers don't provide
OpenCL in a way that Darktable can use them, so you'll need to add
some libraries to get that working (look in Darktable's forum
archives).
- if you don't have problems with using proprietary drivers and X
Window System, I would recommend NVidia due to the longer and more
explicit commitment to provide (proprietary) driver support (important
for a long lifetime machine). Of course, this recommendation assumes
that NVidia will finally release a Wayland-compatible version of its
proprietary driver by the time all major distributions kill X for good
(not before 2023, when Ubuntu 18.04 support ends)

In any case, check Darktable's forum, the question about best GPU pops
every now and then.

Best regards,
Guillermo

On Sun, Feb 4, 2018 at 7:38 PM, Robert Bieber  wrote:

Oh yeah, I'm just talking about the price of the CPU, not the whole PC. I'm
planning on doing all out on RAM and solid state drives as well. I guess GPU
might be of some concern as well, how has GPU processing in dark table on
Linux been going lately? I know it exists, but I'm always scared of anything
to do with graphics drivers on Linux



On February 4, 2018 1:16:22 PM PST, "Šarūnas" 
wrote:

On 02/04/2018 02:41 PM, Robert Bieber wrote:

  Hi everyone,

  I think it's time to finally replace the computer I built five-ish years
  ago.  It was a good machine at the time, but since then my RAW files
  have gone from 8MP to 16MP and now to 40, and running more expensive
  iops, especially with masks and so on, is getting to be pretty sluggish.

  I haven't really kept up with PC hardware in the meantime, so I'm
  curious what y'all would recommend for CPUs.  How much is a decent
  amount to spend for something high-end in the US market?  I'm guessing
  that dropping a grand on something/really/ high end is probably
  unnecessary, but maybe I'm wrong.


It may depend on where on Earth, but “grand” as in ~1000USD, will only
get you half-way, at best, to a high end PC...

You may want to check AMD Ryzen 5/7 + some higher-end GPUs, NVMe solid
state storage, healthy amounts of RAM.

--
Šarūnas Burdulis
math.dartmouth.edu/~sarunas



darktable user mailing list to unsubscribe send a mail to
darktable-user+unsubscr...@lists.darktable.org


darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org




darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] CPU Recommendations

2018-02-04 Thread Guillermo Rozas 
If the operating system and window manager don't have compatibility
issues with the GPU, GPU processing in Darktable works like a charm
(and it's very useful, specially if you intend to hang onto that
computer for 5 years or more).

The caveats regarding Linux-GPU compatibility:
- if you want to use only open source drivers, you have to go to AMD
(NVidia's open source driver is much slower). The same applies if you
want to use Wayland. However, the open source drivers don't provide
OpenCL in a way that Darktable can use them, so you'll need to add
some libraries to get that working (look in Darktable's forum
archives).
- if you don't have problems with using proprietary drivers and X
Window System, I would recommend NVidia due to the longer and more
explicit commitment to provide (proprietary) driver support (important
for a long lifetime machine). Of course, this recommendation assumes
that NVidia will finally release a Wayland-compatible version of its
proprietary driver by the time all major distributions kill X for good
(not before 2023, when Ubuntu 18.04 support ends)

In any case, check Darktable's forum, the question about best GPU pops
every now and then.

Best regards,
Guillermo

On Sun, Feb 4, 2018 at 7:38 PM, Robert Bieber  wrote:
> Oh yeah, I'm just talking about the price of the CPU, not the whole PC. I'm
> planning on doing all out on RAM and solid state drives as well. I guess GPU
> might be of some concern as well, how has GPU processing in dark table on
> Linux been going lately? I know it exists, but I'm always scared of anything
> to do with graphics drivers on Linux
>
>
>
> On February 4, 2018 1:16:22 PM PST, "Šarūnas" 
> wrote:
>>
>> On 02/04/2018 02:41 PM, Robert Bieber wrote:
>>>
>>>  Hi everyone,
>>>
>>>  I think it's time to finally replace the computer I built five-ish years
>>>  ago.  It was a good machine at the time, but since then my RAW files
>>>  have gone from 8MP to 16MP and now to 40, and running more expensive
>>>  iops, especially with masks and so on, is getting to be pretty sluggish.
>>>
>>>  I haven't really kept up with PC hardware in the meantime, so I'm
>>>  curious what y'all would recommend for CPUs.  How much is a decent
>>>  amount to spend for something high-end in the US market?  I'm guessing
>>>  that dropping a grand on something/really/ high end is probably
>>>  unnecessary, but maybe I'm wrong.
>>
>>
>> It may depend on where on Earth, but “grand” as in ~1000USD, will only
>> get you half-way, at best, to a high end PC...
>>
>> You may want to check AMD Ryzen 5/7 + some higher-end GPUs, NVMe solid
>> state storage, healthy amounts of RAM.
>>
>> --
>> Šarūnas Burdulis
>> math.dartmouth.edu/~sarunas
>>
>
> 
> darktable user mailing list to unsubscribe send a mail to
> darktable-user+unsubscr...@lists.darktable.org

darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] CPU Recommendations

2018-02-04 Thread Robert Bieber 
Oh yeah, I'm just talking about the price of the CPU, not the whole PC. I'm 
planning on doing all out on RAM and solid state drives as well. I guess GPU 
might be of some concern as well, how has GPU processing in dark table on Linux 
been going lately? I know it exists, but I'm always scared of anything to do 
with graphics drivers on Linux


On February 4, 2018 1:16:22 PM PST, "Šarūnas"  wrote:
>On 02/04/2018 02:41 PM, Robert Bieber wrote:
>> Hi everyone,
>> 
>> I think it's time to finally replace the computer I built five-ish
>years
>> ago.  It was a good machine at the time, but since then my RAW files
>> have gone from 8MP to 16MP and now to 40, and running more expensive
>> iops, especially with masks and so on, is getting to be pretty
>sluggish.
>> 
>> I haven't really kept up with PC hardware in the meantime, so I'm
>> curious what y'all would recommend for CPUs.  How much is a decent
>> amount to spend for something high-end in the US market?  I'm
>guessing
>> that dropping a grand on something/really/ high end is probably
>> unnecessary, but maybe I'm wrong. 
>
>It may depend on where on Earth, but “grand” as in ~1000USD, will only
>get you half-way, at best, to a high end PC...
>
>You may want to check AMD Ryzen 5/7 + some higher-end GPUs, NVMe solid
>state storage, healthy amounts of RAM.
>
>-- 
>Šarūnas Burdulis
>math.dartmouth.edu/~sarunas


darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] CPU Recommendations

2018-02-04 Thread I. Ivanov 


On 2018-02-04 01:16 PM, Šarūnas wrote:

On 02/04/2018 02:41 PM, Robert Bieber wrote:

Hi everyone,

I think it's time to finally replace the computer I built five-ish years
ago.  It was a good machine at the time, but since then my RAW files
have gone from 8MP to 16MP and now to 40, and running more expensive
iops, especially with masks and so on, is getting to be pretty sluggish.

I haven't really kept up with PC hardware in the meantime, so I'm
curious what y'all would recommend for CPUs.  How much is a decent
amount to spend for something high-end in the US market?  I'm guessing
that dropping a grand on something/really/ high end is probably
unnecessary, but maybe I'm wrong.

It may depend on where on Earth, but “grand” as in ~1000USD, will only
get you half-way, at best, to a high end PC...

You may want to check AMD Ryzen 5/7 + some higher-end GPUs, NVMe solid
state storage, healthy amounts of RAM.

Sorry for butting in... but what would be a reasonable amount of RAM for 
DT? When expected life of a computer is at least 5-7 years from now?


Regards,
B

darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] CPU Recommendations

2018-02-04 Thread Šarūnas 
On 02/04/2018 02:41 PM, Robert Bieber wrote:
> Hi everyone,
> 
> I think it's time to finally replace the computer I built five-ish years
> ago.  It was a good machine at the time, but since then my RAW files
> have gone from 8MP to 16MP and now to 40, and running more expensive
> iops, especially with masks and so on, is getting to be pretty sluggish.
> 
> I haven't really kept up with PC hardware in the meantime, so I'm
> curious what y'all would recommend for CPUs.  How much is a decent
> amount to spend for something high-end in the US market?  I'm guessing
> that dropping a grand on something/really/ high end is probably
> unnecessary, but maybe I'm wrong. 

It may depend on where on Earth, but “grand” as in ~1000USD, will only
get you half-way, at best, to a high end PC...

You may want to check AMD Ryzen 5/7 + some higher-end GPUs, NVMe solid
state storage, healthy amounts of RAM.

-- 
Šarūnas Burdulis
math.dartmouth.edu/~sarunas



signature.asc
Description: OpenPGP digital signature

Re: [darktable-user] CPU Recommendations

2018-02-04 Thread Michael Rasmussen 
On Sun, 4 Feb 2018 11:41:18 -0800
Robert Bieber  wrote:

> I haven't really kept up with PC hardware in the meantime, so I'm curious 
> what y'all would recommend for CPUs.  How much is a decent amount to spend 
> for something high-end in the US market?  I'm guessing that dropping a grand 
> on something/really/ high end is probably unnecessary, but maybe I'm wrong.  
> I'm also not sure how parallelized DT is in practice, and whether I should be 
> looking for more cores or faster clock speed.
> 
Since cores and threads along with GPU are the most important part when
doing post processing everybody seems to agree on that AMD Ryzen is
where you currently gets the most bang for the bug.
An example of an in-depth build of a Ryzen 7 system and a comparison
between Ryzen 7, Intel i7 and Apple Mac Pro can be found here in the 5
part series:
https://www.youtube.com/watch?v=lXty2M6ZklE=PLUrdf7hvHC2JsO8ak3cTVe5E0bXM0IAZG

-- 
Hilsen/Regards
Michael Rasmussen

Get my public GnuPG keys:
michael  rasmussen  cc
http://pgp.mit.edu:11371/pks/lookup?op=get=0xD3C9A00E
mir  datanom  net
http://pgp.mit.edu:11371/pks/lookup?op=get=0xE501F51C
mir  miras  org
http://pgp.mit.edu:11371/pks/lookup?op=get=0xE3E80917
--
/usr/games/fortune -es says:
 Joy: thanks, joy
 elmo: that's redundant, elmo
 doogie: go play in traffic
 ah, the elmo we know and love


pgp6vX95rW_Wv.pgp
Description: OpenPGP digital signature

Re: [darktable-user] CPU Recommendations

2018-02-04 Thread Robert Bieber 
Lol, what counts as high end for a desktop CPU?

On February 4, 2018 12:02:49 PM PST, Colin Adams  
wrote:
>A grand wouldn't but anything high end.
>
>On Sun, 4 Feb 2018 at 19:42 Robert Bieber 
>wrote:
>
>> Hi everyone,
>>
>> I think it's time to finally replace the computer I built five-ish
>years
>> ago.  It was a good machine at the time, but since then my RAW files
>have
>> gone from 8MP to 16MP and now to 40, and running more expensive iops,
>> especially with masks and so on, is getting to be pretty sluggish.
>>
>> I haven't really kept up with PC hardware in the meantime, so I'm
>curious
>> what y'all would recommend for CPUs.  How much is a decent amount to
>spend
>> for something high-end in the US market?  I'm guessing that dropping
>a
>> grand on something* really* high end is probably unnecessary, but
>maybe
>> I'm wrong.  I'm also not sure how parallelized DT is in practice, and
>> whether I should be looking for more cores or faster clock speed.
>>
>>
>
>> darktable user mailing list to unsubscribe send a mail to
>> darktable-user+unsubscr...@lists.darktable.org
>>


darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org

Re: [darktable-user] CPU Recommendations

2018-02-04 Thread Colin Adams 
A grand wouldn't but anything high end.

On Sun, 4 Feb 2018 at 19:42 Robert Bieber  wrote:

> Hi everyone,
>
> I think it's time to finally replace the computer I built five-ish years
> ago.  It was a good machine at the time, but since then my RAW files have
> gone from 8MP to 16MP and now to 40, and running more expensive iops,
> especially with masks and so on, is getting to be pretty sluggish.
>
> I haven't really kept up with PC hardware in the meantime, so I'm curious
> what y'all would recommend for CPUs.  How much is a decent amount to spend
> for something high-end in the US market?  I'm guessing that dropping a
> grand on something* really* high end is probably unnecessary, but maybe
> I'm wrong.  I'm also not sure how parallelized DT is in practice, and
> whether I should be looking for more cores or faster clock speed.
>
> 
> darktable user mailing list to unsubscribe send a mail to
> darktable-user+unsubscr...@lists.darktable.org
>


darktable user mailing list
to unsubscribe send a mail to darktable-user+unsubscr...@lists.darktable.org