Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

caution about different versions of doRedis on master and workers (if on network) #26

Open
trcook opened this issue Sep 30, 2015 · 0 comments

Comments

@trcook
Copy link

trcook commented Sep 30, 2015

This is not as much a bug as it is an advisement (that might be useful to indicate in change-logs or the documentation): the doredis workers and the doredis master need to be running the same version of doRedis if they are not on the same machine.

I've found this after following advice listed in #24 and installing the latest version of doRedis to my master node (but not my worker nodes, which are baked into images on a remote machine)

If the setup is:

host1:
|  master----------------------->|
|  (dev-version of doRedis 1.2.0)|
|                                |
|                                |
|  |<---------redis-server <---- |
|  |
|  |-------->localWorker
|  (last stable CRAN doRedis 1.1.1)

Then everything works out fine.

if, however, the setup has redis and the workers on a different machine, Then, the differences in version number cause and issue
I.e. when the setup looks like this

host-1:
|  master----------------------->|
|  (dev-version of doRedis 1.2.0)|
                                 |
host-2 :                         |
|                                |
|  |<---------redis-server <---- |
|  |
|  |-------->localWorker
|  (last stable CRAN doRedis 1.1.1)

Then the error returned will suggest some sort of issue with the way the worker reads and processes the jobs:

## Waiting for doRedis jobs.
## Processing job  Error in cat(list(...), file, sep, fill, labels, append) :
##  argument 2 (type 'list') cannot be handled by 'cat'
##  In addition: Warning messages:
## 1: In sprintf("%s:%.0f.env", queue, ID) : NAs introduced by coercion
## 2: In sprintf("%s:%.0f.results", queue, ID) : NAs introduced by coercion

If the workers are running the latest (dev) version of doRedis (1.2.0), then this works as expected (which is quite marvelous and has great potential for using doRedis for scaled HPC tasks : ) .

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant