Task collection
This section is not in-place yet. Meanwhile, you can look at
- https://fractal-analytics-platform.github.io/tasks_spec/
- https://fractal-analytics-platform.github.io/fractal-task-tools/usage/
Apptainer
Apptainer task collection builds a SIF image from an uploaded pixi-based package, and then runs its tasks inside that image. It is only supported for SLURM/SSH resources.
Checklist for enabling it on a cluster:
-
Resource configuration. Set
tasks_apptainer_configin the resource:wherepixi_versionis the tag of the base image,apptainer_binis the command used to invokeapptainer(eitherapptaineror an absolute path), andSLURM_CONFIGis the (required) configuration of the build job. -
Job configuration. Apptainer only mounts some host folders into the container by default (typically
$HOME,/tmpand the current folder), while tasks need to access the job folders and the image data (e.g. the Zarr folders). Any other required folder must be added toAPPTAINER_BINDPATH, through theextra_linesof the resourcejobs_runner_config, e.g.:Multiple folders are comma-separated (e.g./shares,/scratch).