Re: [Rd] Is it a good choice to increase the NCONNECTION value?

2021-08-26 Thread GILLIBERT, Andre
> as stated earlier, R already uses setrlimit() to raise the limit (see my > earlier reply). Currently, setrlimit() is called by R_EnsureFDLimit() and the latter is called by initLoadedDLL() in Rdynload.c depending on the R_MAX_NUM_DLLS environment variable. R_MAX_NUM_DLLS can be at most

Re: [Rd] Is it a good choice to increase the NCONNECTION value?

2021-08-25 Thread Simon Urbanek
Andre, as stated earlier, R already uses setrlimit() to raise the limit (see my earlier reply). As for "special" connections, that is not feasible (without some serious re-write), since the connection doesn't know what it is used for and connections are not the only way descriptors may be

Re: [Rd] Is it a good choice to increase the NCONNECTION value?

2021-08-25 Thread GILLIBERT, Andre
Hello, The soft limit to the number of file descriptors is 1024 on GNU/Linux but the default hard limit is at 1048576 or 524288 on major modern distributions : Ubuntu, Fedora, Debian. I do not have access to a Macintosh, but it looks like the soft limit is 256 and hard limit is "unlimited",

Re: [Rd] Is it a good choice to increase the NCONNECTION value?

2021-08-24 Thread Simon Urbanek
Martin, I don't think static connection limit is sensible. Recall that connections can be anything, not just necessarily sockets or file descriptions so they are not linked to the system fd limit. For example, if you use a codec then you will need twice the number of connections than the

Re: [Rd] Is it a good choice to increase the NCONNECTION value?

2021-08-24 Thread Martin Maechler
> GILLIBERT, Andre > on Tue, 24 Aug 2021 09:49:52 + writes: > RConnection is a pointer to a Rconn structure. The Rconn > structure must be allocated independently (e.g. by > malloc() in R_new_custom_connection). Therefore, > increasing NCONNECTION to 1024 should only use

Re: [Rd] Is it a good choice to increase the NCONNECTION value?

2021-08-24 Thread GILLIBERT, Andre
RConnection is a pointer to a Rconn structure. The Rconn structure must be allocated independently (e.g. by malloc() in R_new_custom_connection). Therefore, increasing NCONNECTION to 1024 should only use 8 kilobytes on 64-bits platforms and 4 kilobytes on 32 bits platforms. Ideally, it should

Re: [Rd] Is it a good choice to increase the NCONNECTION value?

2021-08-24 Thread Martin Maechler
> qweytr1--- via R-devel > on Tue, 24 Aug 2021 00:51:31 +0800 (GMT+08:00) writes: > At least in 2015, a github user, tobigithub, submit an > [issue](https://github.com/sneumann/xcms/issues/20) about > the error "Error in file(con, "w") : all connections are > in use"

[Rd] Is it a good choice to increase the NCONNECTION value?

2021-08-23 Thread qweytr1--- via R-devel
At least in 2015, a github user, tobigithub, submit an [issue](https://github.com/sneumann/xcms/issues/20) about the error "Error in file(con, "w") : all connections are in use" Nowadays, since AMD have really cool CPUs which increases the thread numbers to 128 or even 256 on a single server,