[Rd] Error in socketConnection(master, port = port, blocking = TRUE, open = "a+b", : cannot open the connection

2016-01-15 Thread Soumen Pal via R-devel
Dear All I have sucessfully created cluster of four nodes using localhost in my local machine by executing the following command > cl<-makePSOCKcluster(c(rep("localhost",4)),outfile='',homogeneous=FALSE,port=11001) starting worker pid=4271 on localhost:11001 at 12:12:26.164 starting worker

Re: [Rd] Multiple cores are used in simple for loop

2016-01-15 Thread Martyn Plummer
On Fri, 2016-01-15 at 15:03 +0100, Daniel Kaschek wrote: > Dear all, > > I run different R versions (3.2.1, 3.2.2 and 3.2.3) on different > platforms (Arch, Ubuntu, Debian) with a different number of available > cores (24, 4, 24). The following line produces very different behavior > on the

[Rd] Multiple cores are used in simple for loop

2016-01-15 Thread Daniel Kaschek
Dear all, I run different R versions (3.2.1, 3.2.2 and 3.2.3) on different platforms (Arch, Ubuntu, Debian) with a different number of available cores (24, 4, 24). The following line produces very different behavior on the three machines: for(i in 1:1e6) {n <- 100; M <- matrix(rnorm(n^2),

Re: [Rd] Error in socketConnection(master, port = port, blocking = TRUE, open = "a+b", : cannot open the connection

2016-01-15 Thread Morgan, Martin
Arrange to make the ssh connection passwordless. Do this by copying your 'public key' to the machine that you are trying to connect to. Google will be your friend in accomplishing this. It might be that a firewall stands between you and the other machine, or that the other machine does not

Re: [Rd] JDataFrame API

2016-01-15 Thread Thomas Fuller
Hi Simon, Thanks for your feedback. -- this is an observation that I wasn't considering when I wrote this mainly because I am, in fact, working with rather small data sets. BTW: There is code there, it's under the bitbucket link -- here's the direct link if you'd still like to look at it:

Re: [Rd] JDataFrame API

2016-01-15 Thread Simon Urbanek
Tom, this may be good for embedding small data sets, but for practical purposes is doesn't seem like the most efficient solution. Since you didn't provide any code, I built a test case using the build-in Java JSON API to build a medium-sized dataset (1e6 rows) and read it in just to get a

Re: [Rd] Multiple cores are used in simple for loop

2016-01-15 Thread Henrik Bengtsson
On Fri, Jan 15, 2016 at 10:15 AM, Daniel Kaschek wrote: > Dear Martyn, > > > On Fr, Jan 15, 2016 at 4:01 , Martyn Plummer wrote: >> >> >> Alternatively, you may be able to control the maximum number of threads >> by setting and exporting

Re: [Rd] JDataFrame API

2016-01-15 Thread Simon Urbanek
> On Jan 15, 2016, at 12:35 PM, Thomas Fuller > wrote: > > Hi Simon, > > Thanks for your feedback. -- this is an observation that I wasn't > considering when I wrote this mainly because I am, in fact, working > with rather small data sets. BTW: There is code

Re: [Rd] Multiple cores are used in simple for loop

2016-01-15 Thread Daniel Kaschek
Dear Martyn, On Fr, Jan 15, 2016 at 4:01 , Martyn Plummer wrote: Alternatively, you may be able to control the maximum number of threads by setting and exporting an appropriate environment variable depending on what backend you are using, e.g. OPENBLAS_NUM_THREADS or

Re: [Rd] JDataFrame API

2016-01-15 Thread Thomas Fuller
Hi Simon, Aha! I re-read your message and noticed this line: lapply(J("A")$direct(), .jevalArray) which I had overlooked earlier. I wrote an example that is very similar to yours and see what you mean now regarding how we can do this directly. Many thanks, T groovyScript <- paste ( "def