Displaying 9 results from an estimated 9 matches for "usexdr".
Did you mean:
used
2018 Mar 09
2
parallel:::newPSOCKnode(): background worker fails immediately if socket on master is not set up in time (BUG?)
A solution is to have parallel:::.slaveRSOCK() attempt to connect
multiple times before failing, e.g.
makeSOCKmaster <- function(master, port, timeout, useXDR, maxTries
= 10L, interval = 1.0) {
port <- as.integer(port)
for (i in seq_len(maxTries)) {
con <- tryCatch({
socketConnection(master, port = port, blocking = TRUE,
open = "a+b", timeout = timeout)
},...
2018 Mar 10
1
parallel:::newPSOCKnode(): background worker fails immediately if socket on master is not set up in time (BUG?)
...e as well.
>
> Best,
>
> luke
>
>
> On Fri, 9 Mar 2018, Henrik Bengtsson wrote:
>
>> A solution is to have parallel:::.slaveRSOCK() attempt to connect
>> multiple times before failing, e.g.
>>
>> makeSOCKmaster <- function(master, port, timeout, useXDR, maxTries
>> = 10L, interval = 1.0) {
>> port <- as.integer(port)
>> for (i in seq_len(maxTries)) {
>> con <- tryCatch({
>> socketConnection(master, port = port, blocking = TRUE,
>> open =...
2018 Mar 09
2
parallel:::newPSOCKnode(): background worker fails immediately if socket on master is not set up in time (BUG?)
BACKGROUND:
While troubleshooting random, occasionally occurring, errors from
parallel::makePSOCKcluster("localhost", port = 11000);
Error in socketConnection("localhost", port = port, server = TRUE,
blocking = TRUE, :
cannot open the connection
I had another look at parallel:::newPSOCKnode(), which is used
internally to set up each background worker. It is designed to,
2018 Mar 09
0
parallel:::newPSOCKnode(): background worker fails immediately if socket on master is not set up in time (BUG?)
...the master
died, and then you want the workers to die as well.
Best,
luke
On Fri, 9 Mar 2018, Henrik Bengtsson wrote:
> A solution is to have parallel:::.slaveRSOCK() attempt to connect
> multiple times before failing, e.g.
>
> makeSOCKmaster <- function(master, port, timeout, useXDR, maxTries
> = 10L, interval = 1.0) {
> port <- as.integer(port)
> for (i in seq_len(maxTries)) {
> con <- tryCatch({
> socketConnection(master, port = port, blocking = TRUE,
> open = "a+b", timeou...
2018 Mar 09
0
parallel:::newPSOCKnode(): background worker fails immediately if socket on master is not set up in time (BUG?)
I just noticed that parallel:::.slaveRSOCK() passes 'timeout' to
socketConnection() as a character, i.e. there's a missing timeout <-
as.integer(timeout), cf. port <- as.integer(port) and useXDR <-
as.logical(value):
> parallel:::.slaveRSOCK
function ()
{
makeSOCKmaster <- function(master, port, timeout, useXDR) {
port <- as.integer(port)
con <- socketConnection(master, port = port, blocking = TRUE,
open = "a+b", timeout = timeout)...
SUGGESTION: Proposal to mitigate problem with stray processes left behind by parallel::makeCluster()
2019 Mar 18
2
SUGGESTION: Proposal to mitigate problem with stray processes left behind by parallel::makeCluster()
...39;TIMEOUT=2592000' seconds (= 30
days). The reason for this is that it is currently in the state where
it attempts to set up a connection to the main R process:
> parallel:::.slaveRSOCK
function ()
{
makeSOCKmaster <- function(master, port, setup_timeout, timeout,
useXDR) {
...
repeat {
con <- tryCatch({
socketConnection(master, port = port, blocking = TRUE,
open = "a+b", timeout = timeout)
}, error = identity)
...
}
In other words, it is stuck in 'socketConnect...
SUGGESTION: Proposal to mitigate problem with stray processes left behind by parallel::makeCluster()
2019 Mar 27
0
SUGGESTION: Proposal to mitigate problem with stray processes left behind by parallel::makeCluster()
...ays). The reason for this is that it is currently in the state where
> it attempts to set up a connection to the main R process:
>
> > parallel:::.slaveRSOCK
> function ()
> {
> makeSOCKmaster <- function(master, port, setup_timeout, timeout,
> useXDR) {
> ...
> repeat {
> con <- tryCatch({
> socketConnection(master, port = port, blocking = TRUE,
> open = "a+b", timeout = timeout)
> }, error = identity)
> ...
> }
&g...
2012 Mar 30
0
R 2.15.0 is released
...luster(): this will be used by default in functions
such as parLapply().
o clusterMap() has a new argument .scheduling to allow the use of
load-balancing.
o There are new load-balancing functions parLapplyLB() and
parSapplyLB().
o makePSOCKCluster() has a new option useXDR = FALSE which can be
used to avoid byte-shuffling for serialization when all the nodes
are known to be little-endian (or all big-endian).
PACKAGE INSTALLATION:
o Non-ASCII vignettes without a declared encoding are no longer
accepted.
o C/C++ code in packages is now co...
2012 Mar 30
0
R 2.15.0 is released
...luster(): this will be used by default in functions
such as parLapply().
o clusterMap() has a new argument .scheduling to allow the use of
load-balancing.
o There are new load-balancing functions parLapplyLB() and
parSapplyLB().
o makePSOCKCluster() has a new option useXDR = FALSE which can be
used to avoid byte-shuffling for serialization when all the nodes
are known to be little-endian (or all big-endian).
PACKAGE INSTALLATION:
o Non-ASCII vignettes without a declared encoding are no longer
accepted.
o C/C++ code in packages is now co...