Create a private cluster

Create a private cluster with the GPU plan, node count, and billing you choose, ready to allocate its nodes to your projects. The cluster belongs to the location you create it in, and its nodes, allocations, and billing stay there.

Before you begin

You need the Owner or Admin role on the project. Only these two roles can create, change, or delete a private cluster; see Nodes, projects, and access.

Choose the GPU plan

1. In TIR, open your project. In the side menu, under PRODUCTS, select Private Cluster, then select Create Private Cluster.

2. Under Select Computing Resource, on the GPU tab, choose a GPU card: H200, H100, A100, L40S, or L4, each shown with its memory size. They are the same GPUs TIR offers for its GPU nodes.

3. Choose how to pay. The GPU’s plans appear once you choose it:

   • On-Demand bills every node by the hour for as long as the cluster exists. Choose it for short or variable work, or while you learn how many nodes you need.
   • A committed plan, named for its term, such as 1 Month Savings Plan or 1 Year Savings Plan, is paid upfront for the whole term at a lower rate per node. The longer the term, the lower the rate. Choose it for steady, predictable work.

   The terms on offer depend on the plan. For how each is billed, see Billing options for TIR Private Cluster.

Name the cluster and set its size

1. Under Cluster Configuration, keep the generated Cluster Name, such as p-cluster-a1b2, or type your own of up to 50 characters.
2. Set Node Count. It starts at 1 and goes up to the number of nodes free for the plan you chose. Start with the smallest count your work needs: you can add nodes later from Update Configuration, and the node count can only grow.

(Optional) Turn on MIG

To split each node’s GPUs into smaller, isolated GPU instances, turn MIG Enable on. MIG, short for Multi-Instance GPU, suits notebooks, inference services, and lightweight training jobs that run well on a slice of a GPU. It applies to every node in the cluster, and you set it only here. For the instance sizes it offers, see GPU partitioning with MIG.

Create the cluster

1. Select Create Private Cluster.

2. If you chose a committed plan, a dialog asks what happens when the term ends. Choose one:

   • Auto Renewal buys another term at the committed rate when this one ends. Choose it for a cluster you will keep.
   • Convert to Hourly Plan keeps the cluster and bills it by the hour after the term.
   • Auto Delete deletes the cluster when the term ends. Choose it only for a cluster whose work ends with the term.

   Your choice takes effect only when the term ends.

3. If your account runs on free credit, a confirmation about your balance opens. Confirm it to continue.

TIR shows “Cluster created successfully.”, returns to Manage Private Cluster, and opens Allocate Nodes to Projects for the new cluster. Its nodes are Free, ready to allocate. If the create fails, TIR shows “Failed to create cluster” with the reason.

Check the cluster

In Manage Private Cluster, the new cluster shows its Total Nodes, with all of them under Available Nodes, and its Plan. A cluster with MIG on shows Mig: Enabled.

Next, give its nodes to a project in Allocate Nodes to Projects, or later from the cluster’s Actions menu; see Allocate nodes to projects. For help with a message on the form, see Troubleshooting TIR Private Cluster.