Re: [R] parallel: socket connection behind a NAT router

2021-01-19 Thread Jiefei Wang
Thanks! This solution also looks promising. It should be more stable than using ssh tunneling. I will also explore this method. Best, Jiefei On Tue, Jan 19, 2021 at 3:11 PM Martin Morgan wrote: > A different approach uses doRedis > https://CRAN.R-project.org/package=doRedis (currently

Re: [R] parallel: socket connection behind a NAT router

2021-01-19 Thread Jiefei Wang
Thank you! It works now!! Your guess is correct, I'm using windows so the default ssh does not work. Sadly the bug hasn't been fixed yet. The PuTTY solution works like a charm. Glad to know the ssh tunneling trick. This is much simpler than using port hole punching. This package is awesome! Many

Re: [R] parallel: socket connection behind a NAT router

2021-01-18 Thread Martin Morgan
A different approach uses doRedis https://CRAN.R-project.org/package=doRedis (currently archived, but actively developed) for use with the foreach package, or RedisParam https://github.com/mtmorgan/RedisParam (not released) for use with Bioconductor's BiocParallel package. These use a redis

Re: [R] parallel: socket connection behind a NAT router

2021-01-18 Thread Henrik Bengtsson
On Mon, Jan 18, 2021 at 9:42 PM Jiefei Wang wrote: > > Thanks for introducing this interesting package to me! it is great to know a > new powerful tool, but it seems like this method does not work in my > environment. ` parallelly::makeClusterPSOCK` will hang until timeout. > > I checked the

Re: [R] parallel: socket connection behind a NAT router

2021-01-18 Thread Jiefei Wang
Thanks for introducing this interesting package to me! it is great to know a new powerful tool, but it seems like this method does not work in my environment. ` parallelly::makeClusterPSOCK` will hang until timeout. I checked the verbose output and it looks like the parallelly package also

Re: [R] parallel: socket connection behind a NAT router

2021-01-18 Thread Henrik Bengtsson
If you have SSH access to the workers, then workers <- c("machine1.example.org", "machine2.example.org") cl <- parallelly::makeClusterPSOCK(workers) should do it. It does this without admin rights and port forwarding. See also the README in https://cran.r-project.org/package=parallelly.

[R] parallel: socket connection behind a NAT router

2021-01-18 Thread Jiefei Wang
Hi all, I have a few cloud instances and I want to use them to do parallel computing. I would like to create a socket cluster on my local machine to control the remote instances. Here is my network setup: local machine -- NAT -- Internet -- cloud instances In the parallel package, the server