distributeFiles {affyPara} | R Documentation |
This function distributes files from the master node to the disk of the slaves in the computer cluster.
distributeFiles(cluster, files, to = tempdir(), protocol = c("R", "RCP", "SCP"), hierarchicallyDist = FALSE, master=TRUE, delExistTo=FALSE, full.names=FALSE, verbose = FALSE) hirarchicalDistSF(to, nodes, protocol)
cluster |
A cluster object obtained from the function makeCluster in the SNOW package. |
files |
A character vector containing the names of the files. |
to |
A character that defines the path where the files should be stored at the slaves. Default: tempdir() |
protocol |
A character that defines the Copy-Protocol: "R", "RCP", "SCP" |
hierarchicallyDist |
A logical value. If TRUE data will be hierarchically distributed to all slaves. If FALSE at every slave only a part of data is available. |
master |
A logical value. If TRUE all data will be copied to the 'to' directory at the master node. Default = TRUE |
delExistTo |
A logical value. If TRUE directory 'to' will be deleted at master and all nodes first. Default = FALSE |
full.names |
A logical value. If TRUE , the directory path is prepended to the file names. If FALSE , only the file names are returned . |
verbose |
A logical value. If TRUE it writes out some messages. |
nodes |
A list of character with the node names where the files have to be send. |
This function distributes files from the master node to the disk of the slaves in the computer cluster. First the vector of files get partitioned by the number of slaves. Then the parts will be copied to the to
directory at the slaves. If hierarchicallyDist
is TRUE
, all slaves change the files among each other and in the end at every slave all files are located. (But this is not necessary for distributed computing with the affyPara
package.
For using this function a computer cluster using the SNOW
package has to be started.
hirarchicalDistSF
is a internal function which will be executed at slaves.
hirarchicalDistSF
A list of two objects
to |
A character that defines the path where the files are located at the slaves. |
CELfiles |
A list of characters , how the files are distributed to the slaves. |
For protocol "R" hierarchically distribution not yet available.
Markus Schmidberger schmidb@ibe.med.uni-muenchen.de, Ulrich Mansmann mansmann@ibe.med.uni-muenchen.de
## Not run: library(affyPara) c1 <- makeCluster(10) path <- "tmp/CELfiles" CELfiles <- list.files(path,full.names=TRUE) distList <- distributeFiles(c1, CELfiles, protocol="RCP", verbose=TRUE) stopCluster(c1) ## End(Not run)