Skip to main content

Private Cluster

Private Cluster enables the creation of a dedicated environment with a predefined allocation of RAM, CPU, and GPU resources. The pricing for the Private Cluster is fixed, unaffected by the actual usage percentage of the allocated resources. Additionally, deploying Nodes, Inference engines, or Vector Databases within the Private Cluster incurs no extra charges.

Create Private Cluster

  • To create a new Private Cluster, click the Create Private Cluster button.

Cluster Create

  • Select the desired Cluster Configuration by choosing the appropriate machine type with the required CPU, GPU, and an available plan.

Cluster Configuration CPU

Cluster Configuration GPU

Additionally, you can apply filters to the available resources based on CPU, RAM, or GPU specifications.

Cluster Configuration Filter

  • On this page, you can view the details of the selected plan. Depending on whether you choose an Hourly-Based Plan or a Committed Plan, the summary section will display the corresponding details and associated costs.

Cluster Detail Hourly

Cluster Detail Committed

Manage Private Cluster

Overview

You can view the details of the selected Private Cluster, including the Cluster Name, Number of Nodes, Plan Name, and the Cluster Node Configuration, which displays the count of GPUs, CPUs, and RAM allocated within the cluster.

Private Cluster Overview

Monitoring

You can view the Disk Usage and Memory Usage for the selected Node within the Private Cluster. Additionally, the following metrics are also available: GPU Utilization, GPU Temperature, CPU Utilization, Memory Utilization, Disk Total Read Bytes, and Disk Total Write Bytes.

Private Cluster Monitoring 1

Private Cluster Monitoring 2

Services

You can view the list of Services that have been launched on the cluster.

Private Cluster Services