--- title: Manage a Slurm Cluster sidebar_label: Overview --- import { Info, Grid, Cpu, List, Activity, Bell, FileText, HardDrive, Shield, Users, Settings } from 'react-feather'; # Manage a Slurm Cluster Everything after creation happens on the cluster details page: ten tabs and an **Actions** menu. This is the map. }, { href: '#the-page-header', label: 'The page header', icon: }, { href: '#the-tabs', label: 'The tabs', icon: }, { href: '#details-tab', label: 'Details tab', icon: }, { href: '#common-tasks', label: 'Common tasks', icon: }, ]} /> --- ## Open a Cluster 1. Log in to the [TIR console](https://tir.e2enetworks.com/) and select your project. 2. Click **Training Cluster** in the sidebar. The list page is headed **Manage Training Clusters**. 3. Click the cluster name. The list shows `Cluster Name`, `Created By`, `Plan`, `No of Nodes`, `Created At`, a **Connect** shortcut, `Status`, and an **Actions** (⋮) menu per row. It refreshes itself every few seconds while any cluster is **Creating** or **Deleting**. --- ## The Page Header | Control | What it does | |---------|--------------| | **Select Training Cluster** | Switch to another cluster without going back to the list | | Status pill | Green for **Running**, red for **Failed** / **Terminated**, amber for transitional states | | Refresh icon | Reload the current tab. The details page does not auto-refresh | | **Connect** | Opens the SSH panel with copyable commands | | **Restart Workers** | Shortcut for [Restart All Workers](/docs/tir/SlurmCluster/manage/actions#restart-actions). Disabled unless Running | | **Actions** (⋮) | Every [cluster action](/docs/tir/SlurmCluster/manage/actions) | --- ## The Tabs | Tab | What it is for | Page | |-----|----------------|------| | **Details** | Name, image version, status, node count, plan, and how to connect | [below](#details-tab) | | **Cluster Overview** | GPU and job summary, node health, and the Slurm partition table | [Cluster Overview](/docs/tir/SlurmCluster/manage/overview-tab) | | **Nodes** | Per-node and per-GPU DCGM metrics, health filters, XID errors, node reboot | [Nodes](/docs/tir/SlurmCluster/manage/nodes) | | **Jobs** | Live `squeue` with state counters and filters | [Jobs](/docs/tir/SlurmCluster/manage/jobs) | | **Monitoring** | GPU and scheduler charts over selectable time ranges | [Monitoring](/docs/tir/SlurmCluster/manage/monitoring) | | **Alerts** | Attach alerts to the cluster | [Monitoring](/docs/tir/SlurmCluster/manage/monitoring#alerts) | | **Logs** | Controller, worker and login-node logs | [Logs](/docs/tir/SlurmCluster/manage/logs) | | **Volumes** | Mount and unmount PFS, SFS and datasets | [Storage](/docs/tir/SlurmCluster/manage/storage) | | **Network & Security** | Public IP, VPC IP, and security groups | [Network and security](/docs/tir/SlurmCluster/manage/network-security) | | **Login User Management** | Per-user SSH identities and groups | [Login User Management](/docs/tir/SlurmCluster/connect/login-user-management) | :::info Most tabs need a Running cluster On a cluster that is not Running, tabs such as Cluster Overview, Nodes and Login User Management show a message like *"Cluster overview is available when the cluster is running."* The **Details** tab always works, which is where you check status and plan on a Failed or Terminated cluster. Tab availability also varies slightly by region. ::: --- ## Details Tab Three collapsible sections. ### Cluster Details | Field | Meaning | |-------|---------| | **Cluster Name** | The name you gave it | | **Image Version** | The cluster's Slurm image, e.g. `v2-slurm25.11-ubuntu24.04`. Change it with [Update Image](/docs/tir/SlurmCluster/manage/actions#update-image) | | **Status** | Current state | | **Number of Nodes** | Worker nodes. Change it with [Scale Cluster](/docs/tir/SlurmCluster/manage/actions#scale-cluster) | | **Created By** | Who created it | | **Created At** | When | ### Plan Details | Field | Meaning | |-------|---------| | **Plan Name** | The plan or `Private Cluster` | | **CPU** / **Memory** | Per-node resources | | **Plan Type** | On-demand, committed, or private cluster | | **Private Cluster Name** | The reserved cluster it draws from, where applicable | ### Connection Details | Field | Meaning | |-------|---------| | **SSH Keys** | The keys with `root` access, as chips. Change with [Update SSH Keys](/docs/tir/SlurmCluster/manage/actions#update-ssh-keys) | | **SSH Command** | `ssh root@`, with a copy button | :::info The image version tells you what Slurm you have `v2-slurm25.11-ubuntu24.04` means Slurm 25.11 on Ubuntu 24.04. Worth knowing when you read the [SchedMD documentation](https://slurm.schedmd.com/) — directives and flags do change between Slurm releases. ::: --- ## Common Tasks | I want to… | Go to | |------------|-------| | See why my job is not running | [Jobs tab](/docs/tir/SlurmCluster/manage/jobs#a-job-stuck-in-pending) | | Check whether the GPUs are actually busy | [Monitoring](/docs/tir/SlurmCluster/manage/monitoring) | | Find a broken GPU | [Nodes](/docs/tir/SlurmCluster/manage/nodes#xid-errors) | | Add more nodes | [Scale Cluster](/docs/tir/SlurmCluster/manage/actions#scale-cluster) | | Add a partition | [Manage partitions](/docs/tir/SlurmCluster/slurm-configuration/partitions) | | Change a scheduler setting | [Extra slurm.conf](/docs/tir/SlurmCluster/slurm-configuration/slurm-conf) | | Run setup before every job | [Prolog and epilog scripts](/docs/tir/SlurmCluster/slurm-configuration/prolog-epilog) | | Attach more storage | [Storage and volumes](/docs/tir/SlurmCluster/manage/storage) | | Give a colleague access | [Login User Management](/docs/tir/SlurmCluster/connect/login-user-management) | | Pin the cluster's IP | [Network and security](/docs/tir/SlurmCluster/manage/network-security#public-ip) | | Stop paying for it | [Terminate Cluster](/docs/tir/SlurmCluster/manage/actions#terminate-cluster) | | Work out why a control is missing | [Action availability](/docs/tir/SlurmCluster/manage/action-availability) | --- ## Related Resources - [Cluster actions](/docs/tir/SlurmCluster/manage/actions) - [Action availability and blockers](/docs/tir/SlurmCluster/manage/action-availability) - [UI Guide](/docs/tir/SlurmCluster/ui-guide) - [Slurm Configuration](/docs/tir/SlurmCluster/slurm-configuration/) - [Troubleshooting](/docs/tir/SlurmCluster/troubleshoot/)