OccamConnector
The Occam SuperComputer is a High-Performance Computing (HPC) facility designed and managed in collaboration between the University of Torino (UniTO) and the National Institute for Nuclear Physics (INFN).
It is different from standard HPC facilities for two main reasons. First, users can reserve computing nodes for specific time slots instead of relying on a batched interaction orchestrated by a queue manager. Second, the execution model is entirely based on unprivileged Docker containers.
This connector allows StreamFlow to offload computation to multi-container environments deployed on the Occam facility. The deployment unit is a multi-container environment deployed on one or more computing nodes. Multi-container environments are described in a YAML file with a syntax similar to the service
section of Docker Compose. Users can pass this file to the connector through the file
parameter. The unit of binding is the single top-level entry in the file, while the scheduling unit is the single container instance.
properties |
||
file (required) |
Path to the file describing Occam environment |
|
type |
string |
|
sshKey (required) |
Path to the SSH key needed to connect with Occam environment |
|
type |
string |
|
username (required) |
Username needed to connect with Occam environment |
|
type |
string |
|
hostname |
Hostname of Occam facility |
|
type |
string |
|
default |
occam.c3s.unito.it |
|
sshKeyPassphraseFile |
Path to a file containing the passphrase protecting the SSH key |
|
type |
string |
|
transferBufferSize |
Buffer size allocated for local and remote data transfers |
|
type |
integer |
|
default |
16kiB |