Create a PFS

Create a Parallel File System (PFS), ready to mount on an instance, a training cluster, or a Slurm cluster. Create one before you start a job that needs fast, shared, parallel storage.

Before you begin

You need a TIR project in Delhi, where PFS is available, and a role with Create permission on the Dataset service in IAM. A PFS belongs to one project, so create it in the project whose instances, training clusters, and Slurm clusters will mount it.

Open the create form

In TIR, open your Delhi project. In the side menu, under Storage, select Parallel File System, which sits after Shared File System.

Select Create Parallel File-System.

Name the PFS

In Parallel File-System Name, type a name. It must start with a lowercase letter, end with a letter or digit, use only lowercase letters, digits, and hyphens, and be at most 30 characters. Each name must be unique within the project.

Set the size

Set PFS Size to the number of TB you need, using the slider or the number field. You set the size in whole TB, from a minimum of 1 TB up to the limit set for your account, 250 TB by default.

To go above your current limit, ask for a higher one from this screen. The request opens a support ticket with E2E, and your limit stays as it is until E2E changes it.

TIR bills a PFS by the hour for the TB you set. Billing starts once the PFS reaches OK, runs the whole time, mounted or unmounted, and stops when you delete it. After an increase, billing moves to the new size once the increase completes. See E2E’s pricing page.

You pay for the size you set, whatever share of it you use, so choose a size close to what the workload needs, and clear out old files.

Create it

Select Create. The PFS shows Pending while TIR sets it up, then initializing. It reaches OK and is ready to mount in about 80 seconds for 1 TB.

TIR emails the person who created the PFS when it reaches OK, and also if it is still Pending five minutes after it was created. If creation fails, the PFS shows error and is free. TIR emails the creator and opens a support ticket.

When the PFS is ready

Once the new PFS’s Status reads OK in Parallel File System, it is ready to mount on an instance, a training cluster, or a Slurm cluster. See Mount a PFS on an instance or Mount a PFS on a training cluster. If creation stalls or ends in error, see Troubleshooting TIR Parallel File System.