Private Cluster

Private Cluster enables the creation of a dedicated environment with a predefined allocation of GPU resources. The pricing for the Private Cluster is fixed, unaffected by the actual usage percentage of the allocated resources. Additionally, deploying Nodes, Inference engines, or Vector Databases within the Private Cluster incurs no extra charges.

Create Private Cluster

• To create a new Private Cluster, click the Create Private Cluster button.

• Select the desired Cluster Configuration by choosing the appropriate machine type with the required GPU and an available plan.

Additionally, you can apply filters to the available resources based on CPU, RAM, or GPU Card specifications.

On this page, you can view the details of the selected plan. Depending on whether you choose an Hourly-Billed Plan or a Committed Plan, the summary section will display the corresponding details and associated costs.

Private Cluster Hourly plan

• You can select an Hourly-Based Plan based on your requirements, view the estimated cost, and then click Next to proceed.

Private Cluster Committed plan

• In a Private Cluster with a committed plan, users can choose one of the following post-expiry actions: auto-renew the committed plan, auto-start hourly billing, or automatically delete the cluster after expiry.

Manage Private Cluster

Overview

You can view the details of the selected Private Cluster, including the Cluster Name, Number of Nodes, Plan Name, and the Cluster Node Configuration, which displays the count of GPUs, CPUs, and RAM allocated within the cluster.

Monitoring

You can view the Disk Usage and Memory Usage for the selected Node within the Private Cluster. Additionally, the following metrics are also available: GPU Utilization, GPU Temperature, CPU Utilization, Memory Utilization, Disk Total Read Bytes, and Disk Total Write Bytes.

Services

You can view the list of Services that have been launched on the cluster.

Actions

In the Actions section, you can perform two operation which is Update cluster in which you can increase the Node count and Delete cluster.

Update Private Cluster

• In Actions section, click on Update Cluster.

• To update the node count, click on the Additional Node Count (+) button and increase the nodes as per your requirements.

Delete Private Cluster

• In Actions section, click on Delete Cluster and confirm.