Type for service id. ServiceId is typically a random string that is assigned to a worker. (Maybe to other things too?)

Type for basic master to worker messaging

Detailed type for RemoteError. The constructors correspond to various possible AsyncResults.

WorkerLauncher type parametrized by a type for job id.

Run a Process locally using the default RemoteTable. Additionally allows a return value for the Process.

Run a Process locally using the specified RemoteTable. Additionally allows a return value for the Process.

Spawns a new local Control.Distributed.Process.Node and runs the given Process on it. Waits for the process to finish.

Binds to the first available port by specifying port 0.

Get a hostname for the current machine that does not correspond to a local network address (127.* or 10.*)

Convert a Text representation of EndPointAddress to NodeId. The format for the end point address is "TCP host:TCP port:endpoint id"

Inverse to addressToNodeId

The main worker process.

Repeatedly (at most 5 times) send our own ProcessId and the send end of a typed channel (SendPort WorkerMessage) to a master node until it replies Connected (timeout 10 seconds for each attempt). Then expect a ShutDown signal.

While waiting, other processes will be run in a different thread, invoked by master through our NodeId (which it extracts from ProcessId)

Registers (register) the current process under a random ServiceId, then passes the ServiceId to the given continuation. After the continuation returns, unregisters (unregister) the ServiceId.

Start a new remote worker using WorkerLauncher and call a continuation with the NodeId and ServiceId of that worker. The continuation is run in the process that is registered under the ServiceId (see withServiceId).

Throws (throwM) a WorkerConnectionTimeout if worker times out (timeout described in WorkerLauncher)

The call to the user function is bracketed by worker startup and shutdown procedures.

A process that generates the Closure to be run on a remote machine.

Get closure and memoize the result

The type of a function that takes a SerializableClosureProcess and runs the Closure on a remote machine. In case the remote machine returns a Left value (i.e. an error), throws this value wrapped in RemoteError of type RemoteException. May throw other RemoteErrors if remote execution fails in any way.

Starts a new remote worker and runs a user function, which is supplied with RemoteProcessRunner for running closures on that worker. If a RemoteError occurs, it is handled by the onRemoteError supplied in the WorkerLauncher.

Catch any exception, log it, and return as a string. In this way, errors will be logged by the worker where they occurred, and also sent up the tree.

Construct a SerializableClosureProcess for evaluating the closure mb on a remote machine. The action mb that produces the Closure will only be run once -- when a worker first becomes available. The MVar v caches the resulting Closure (so it can be re-used in the event of an error and retry), which will then be sent across the network.

Note that we wrap the given closure in tryLogException. Thus, exception handling is added by catching any exception e, logging e with err (on the worker), and returning a Left result with the textual representation of e from Show instance.