Using the JADE Facility¶
The JADE facility consists of 2 head nodes and 63 NVIDIA DGX-MAX-Q servers, each with 8 GPUs and 40 CPU cores.
Users get accounts on the system by following the directions in the Getting an account section, on the left.
New users must provide a public SSH key and are given a user ID on JADE. Using this ID, they will then be able to login to one of the head nodes by using an SSH command like
ssh -l account_name jade2.hartree.stfc.ac.uk
Further details are in the section Connecting to the cluster using SSH.
The software packages already installed on JADE comes in two kinds: standard applications (primarily Molecular Dynamics) and containerised applications (various Machine Learning applications in particular). These are described further in the Software on JADE section on the left.
The module system is used to control your working environment and the particular version of software which you want to use; details are given in the section The `module` tool on the left.
If not using the installed software, you are also welcome to build your own applications. Codes can be built on the head node, and a number of compilers and MPI library stacks are available via the modules.
Applications can only be run on the compute nodes by submitting jobs to the Slurm batch queuing system. Examples of Slurm submission scripts are given in the relevant sections for each of the main software packages.
It is also possible to obtain an interactive session through Slurm on one of the compute nodes. This is usually only for code development purposes; submitting batch jobs is the standard way of working.
The global file system is accessible from both the head nodes and the compute nodes. Any files written during the job execution on the compute nodes will be found on the file system after the job has completed.
For information on your disk space usage and remaining quota, use the following command
quota -hu account_name /jmain02
quota -hu abc18-wga20 /jmain02 Disk quotas for usr abc18-wga20 (uid 1234): Filesystem used quota limit grace files quota limit grace /jmain02 44k 0k 0k - 12 0 0 -
There is also access to local disc space on each compute node, but this access only possible during a Slurm job and once the job is completed the local disc data is removed automatically. In machine learning applications, for example, this local disc space (provided by fast SSD) may be useful as a staging point for very large training sets.
- Getting an account
- Information for PIs and Project Managers
- Creating a Project
- Getting an Account
- Projects and Groups on JADE
- Project Signup Code (instructions for institutional contacts and project managers)
- Adding Users to a Project or group(instructions for institutional contacts and project managers)
- Project groups and shared file system area
- Once a Project has Finished
- Connecting to the cluster using SSH
- The Slurm Scheduler
- Using Containerised Applications