# Introduction to EPFS ## Overview EPFS (E2E Parallel File System) is a highly scalable and reliable parallel file system designed for large-scale High-Performance Computing (HPC) environments. It delivers exceptional performance by supporting parallel data access, making it ideal for handling massive datasets and numerous clients. - **High throughput**: Supports multiple simultaneous clients. - **Scalability**: Can handle petabytes of data and thousands of clients. - **Reliability**: Uses robust mechanisms to ensure data integrity. ## How EPFS Works 1. **Data Distribution**: - Data is striped across multiple OSSs, enabling parallel read/write operations. - The striping pattern can be customized for specific use cases. 2. **Metadata Management**: - The MDS manages metadata, keeping operations like file creation and deletion fast. 3. **Parallelism**: - Clients access data in parallel from OSSs, minimizing bottlenecks. ## Advantages - **High Speed**: Parallel operations increase performance. - **Fault Tolerance**: Data is replicated across nodes. - **Scalability**: Designed for massive datasets and numerous clients. :::info Note This feature is currently available on AlmaLinux and RockyLinux. ::: ## Managing EPFS ### Creating an EPFS 1. Navigate to the **Storage > EPFS** section in the left sidebar of the dashboard. ![Dashboard](images/dashbard.png) 2. Click **Create**. ![Create EPFS](images/create_epfs.png) 3. Provide the following details: - **Name**: Enter a name for your EPFS. - **Plan**: Select an appropriate plan. - **VPC**: Choose the desired Virtual Private Cloud. ![Select Plan](images/select_plan.png) 4. Click **Create EPFS**. Your newly created EPFS will appear in the list. ![List EPFS](images/list_epfs.png) ### Accessing EPFS :::info Note Ensure that EPFS and the Virtual Machine (VM) are on the same network. ::: Follow these steps to set up the client and mount EPFS: 1. **Download the Client Setup Script**: Download the `scripts.tar` file. ![Download Client](images/download_client.png) 2. **Transfer the script to the server**: Use the `scp` command to copy the file into your server. ```bash scp /scripts.tar @:/root/ ``` 3. **Extract the tar file:** Run the following command to extract the script: ```bash tar -xvf ``` 4. **Run the Client Setup Command:** To set up the client, you need to run the setup script using the command below. Each new EPFS (Encrypted Parallel File System) deployment will have its own unique parameters — these values change every time you create a new EPFS instance. Execute the following script to set up the client: ```bash ./client_setup.sh ``` ![](images/run_clientscriptnew.png) 5. **Mount the EPFS:** Use the following command to mount EPFS: ```bash mount -t lustre 10.20.56.8@tcp:/pfs0 ``` ![](images/mount_point.png) ### Upgrading EPFS Enhance your EPFS by increasing its memory capacity through the Upgrade EPFS feature. 1. Click Upgrade under the Action menu. ![](images/action_upgrade.png) 2. Select the desired upgraded plan and Confirm by clicking the Upgrade button. ![](images/update.png) 3. Your EPFS will be upgraded to the selected configuration. ![](images/upgrading_show.png) ![](images/upgraded_list.png) ### Deleting an EPFS - Select Delete from the Action menu. ![](images/action_delete.png) - A warning message will notify you of permanent data loss. - Confirm and proceed by clicking Delete. The selected EPFS storage will be removed. ![](images/delete_epfs.png) ---