Re: [racket-users] Places code not using all the CPU

2018-10-05 Thread Neil Van Dyke
if not I will have to redesign my system to use 'subprocess' Expanding on this, for students on the list... Having many worker host processes is not necessarily a bad thing.  It can be more programmer work, but it simplifies the parallelism in a way (e.g., "let the Linux kernel worry

Re: [racket-users] Places code not using all the CPU

2018-10-05 Thread Matthew Flatt
At Fri, 5 Oct 2018 17:55:47 +0200, Paulo Matos wrote: > Matthew, Sam, do you understand why this is happening? I still think it's probably allocation, and probably specifically content on the process's page table. Do you see different behavior with a non-allocating variant (via `--no-alloc`

Re: [racket-users] add set-subset?

2018-10-05 Thread Ben Greenman
Yes, @index I learned about it to put "powerset" to the docs, and always go back to that example when something like this comes up: https://github.com/racket/racket/blob/master/pkgs/racket-doc/scribblings/reference/pairs.scrbl#L1333 -- You received this message because you are subscribed to the

Re: [racket-users] Places code not using all the CPU

2018-10-05 Thread 'Paulo Matos' via Racket Users
I was trying to create a much more elaborate example when Matthew sent his tiny one which is enough to show the problem. I started a 64core machine on aws to show the issue. I see a massive degradation as the number of places increases. I use this slightly modified code: #lang racket (define

Re: [racket-users] add set-subset?

2018-10-05 Thread 'John Clements' via Racket Users
Do we have an existing doc redirect mechanism? I’ve just spent five minutes looking at docs for defproc and the “Indexing” section, and didn’t find anything. Doesn’t mean it’s not there, but I did have a look. Then again, this thread is a living testament to my inability to find things in

Re: [racket-users] Places code not using all the CPU

2018-10-05 Thread Sam Tobin-Hochstadt
I tried this same program on my desktop, which also has 4 (i7-4770) cores with hyperthreading. Here's what I see: [samth@huor:~/work/grant_parallel_compilers/nsf_submissions (master) plt] time r ~/Downloads/p.rkt 1 N: 1, cpu: 5808/5808.0, real: 5804

Re: [racket-users] Places code not using all the CPU

2018-10-05 Thread Matthew Flatt
At Fri, 5 Oct 2018 15:36:04 +0200, Paulo Matos wrote: > Again, I am really surprised that you mention that places are not > separate processes. Documentation does say they are separate racket > virtual machines, how is this accomplished if not by using separate > processes? Each place is an OS

Re: [racket-users] add set-subset?

2018-10-05 Thread Greg Hendershott
Could we add a macro to allow defining alias names? Could call it `set!-set-subset?`. And probably want a way to see all such aliases: `get-set!-set-subset?-set-subs`. p.s. In all seriousness, the doc redirect is a great idea. -- You received this message because you are subscribed to the

Re: [racket-users] Places code not using all the CPU

2018-10-05 Thread 'Paulo Matos' via Racket Users
On 05/10/2018 14:15, Matthew Flatt wrote: > It's difficult to be sure from your description, but it sounds like the > problem may just be the usual one of scaling parallelism when > communication is involved. > Matthew, thanks for the reply. The interesting thing here is that there is no

Re: [racket-users] Places code not using all the CPU

2018-10-05 Thread Matthew Flatt
It's difficult to be sure from your description, but it sounds like the problem may just be the usual one of scaling parallelism when communication is involved. Red is probably synchronization. It might be synchronization due to the communication you have between places, it might be

Re: [racket-users] Places code not using all the CPU

2018-10-05 Thread 'Paulo Matos' via Racket Users
All, A quick update on this problem which is in my critical path. I just noticed, in an attempt to reproduce it, that during the package setup part of the racket compilation procedure the same happens. I am running `make CPUS=24 in-place`on a 36 cpu machine and I see that not only sometimes the