Private Cluster

Private Cluster enables the creation of a dedicated environment with a predefined allocation of RAM, CPU, and GPU resources. The pricing for the Private Cluster is fixed, unaffected by the actual usage percentage of the allocated resources. Additionally, deploying Nodes, Inference engines, or Vector Databases within the Private Cluster incurs no extra charges.

Create Private Cluster

To create a new Private Cluster, click the Create Private Cluster button.

Select the desired Cluster Configuration by choosing the appropriate machine type with the required CPU, GPU, and an available plan.

../_images/cluster_configuration_cpu.png

../_images/cluster_configuration_gpu.png

Additionally, you can apply filters to the available resources based on CPU, RAM, or GPU specifications.

../_images/cluster_configuration_filter.png

On this page, you can view the details of the selected plan. Depending on whether you choose an Hourly-Based Plan or a Committed Plan, the summary section will display the corresponding details and associated costs.

Manage Private Cluster

Overview

You can view the details of the selected Private Cluster, including the Cluster Name, Number of Nodes, Plan Name, and the Cluster Node Configuration, which displays the count of GPUs, CPUs, and RAM allocated within the cluster.

Monitoring

You can view the Disk Usage and Memory Usage for the selected Node within the Private Cluster. Additionally, the following metrics are also available: GPU Utilization, GPU Temperature, CPU Utilization, Memory Utilization, Disk Total Read Bytes, and Disk Total Write Bytes.

../_images/private_cluster_monitoring2.png

Services

You can view the list of Services that have been launched on the cluster.