OccamConnector

The Occam SuperComputer is a High-Performance Computing (HPC) facility designed and managed in collaboration between the University of Torino (UniTO) and the National Institute for Nuclear Physics (INFN).

It is different from standard HPC facilities for two main reasons. First, users can reserve computing nodes for specific time slots instead of relying on a batched interaction orchestrated by a queue manager. Second, the execution model is entirely based on unprivileged Docker containers.

This connector allows StreamFlow to offload computation to multi-container environments deployed on the Occam facility. The deployment unit is a multi-container environment deployed on one or more computing nodes. Multi-container environments are described in a YAML file with a syntax similar to the service section of Docker Compose. Users can pass this file to the connector through the file parameter. The unit of binding is the single top-level entry in the file, while the scheduling unit is the single container instance.

properties

file (required)

Path to the file describing Occam environment

type

string

sshKey (required)

Path to the SSH key needed to connect with Occam environment

type

string

username (required)

Username needed to connect with Occam environment

type

string

hostname

Hostname of Occam facility

type

string

default

occam.c3s.unito.it

sshKeyPassphraseFile

Path to a file containing the passphrase protecting the SSH key

type

string

transferBufferSize

Buffer size allocated for local and remote data transfers

type

integer

default

16kiB