How to launch GPU Notebooks
Create Project
For creating GPU Notebooks Go to my account and click on GPU notebooks in the top left corner of the page
After clicking on GPU notebooks the page will be redirected to the GPU page with by default created project. You can create new project as well
You can create a new project by clicking on Create Project which is at the top left corner of the page
After creating a new project it will be shown on the left side with the default project like this
Create Notebook
To create a Notebook you have to click on Create Notebook which is at the top right corner of the page.
After clicking on Create Notebook button a page will be appear, now enter Notebook name, choose the Notebook Image and select the machine on which you want to run your service, and then choose the plan, After that click on Create button.
After clicking on create button your GPU will be create and it will be shown like this.
DATASET
Go to the TIR AI PLATFORM
Make sure you are on the right project or feel free to create a new project
Go to Datasets
Click on CREATE DATASET
After clicking create dataset, you will redirect on to that below screen.
Here is two options of storage type to create dataset.
1. EOS Bucket
2. DISK
1. EOS Bucket
In EOS BUCKET storage type, here is two options of bucket type to craete dataset.
1. New EOS Bucket
2. Existing EOS Bucket
1. New EOS Bucket : This will create a new EOS bucket tied to your account and also access keys for it.
Enter a name for your dataset.
Click on CREATE button.
You will see a screen to configure EOS bucket to upload data.In that screen you will get Setup Minio CLI , Setup s3cmd and Dataset Details
Setup Minio CLI
In setup minio CLI tab, you will get setup host command and you will get a command to copy folder to a bucket.
Setup S3cmd
In setup S3cmd tab, you will get command for set up endpoints, setup access keys and enable s3 v4 signature APIs.
Dataset Details
In Dataset Details tab, you will get dataset details and bucket details.
2. Existing EOS Bucket :
In Existing EOS Bucket, you can select the Existing bucket.
Enter a name for your dataset (for e.g. paws)
Click on CREATE button.
You will see a screen to configure EOS bucket to upload data.In that screen you will get Setup Minio CLI , Setup s3cmd and Bucket name , Dataset Details
Setup Minio CLI
In setup minio CLI tab, you will get setup host command and you will get a command to copy folder to a bucket.
Setup S3cmd
In setup S3cmd tab, you will get command for set up endpoints, setup access keys and enable s3 v4 signature APIs.
Dataset Details
In Dataset Details tab, you will get dataset details and bucket details.
2. DISK
If you select , DISK storage type to create dataset. You will get the Disk Size field in that field you can set the disk size according to you.
Each GB wil be charged at 5 rupee per month.
The disk size cannot be reduced in future. However it can be increased anytime.
Enter a name for your dataset (for e.g. paws)
Click on CREATE button.
After successfully creation of dataset. You will get Setup , overview and Data Objects.
Setup
In setup tab, you will get the details of Configure EOS Bucket to upload data , Setup minio client and setup s3cmd.
Setup minio client
Setup s3cmd
overview
In that section you will get the information of dataset details (Dataset name, created by and createde at) and storage details like storage tye, bucket name, bucket type, access key , secret key and EOS end points.
Data Objects
In Data Objects you can upload data in your bucket by clicking UPLOAD DATA button.
After clicking on upload data button , you can choose or drag files from your system and click on UPLOAD button.
After successfully uploading files, you can see the list of files/data on list.
You can download file/data by selecting the particular file and then clicking download button.
You can delete file/data by selecting the particular file and then clicking delete button.
Delete Dataset
Select the particular dataset from the list and click on the Delete button to delete the dataset.
After clicking on the Delete button it will show one popup to delete the dataset.you can click delete button to delete dataset.
Model Repositories
To create Model Repositories, go to the ‘Inference’ section select Model Repository and then click the CREATE REPOSITORY button.
To create Model Repository you have to select Model type like Pytorch or Triton or Custom.
After that select Storage Type New EOS Bucket or Existing EOS Bucket or External EOS Bucket then click on Create button.
1. New EOS Bucket
If you select storage type New EOS Bucket.
After clicking on Create button Configure EOS Bucket to upload model weights will appear on the next screen.
Using SDk
In Using SDK tab, you will get the command for install SDk and Run appropriate commands in python shell or jupyter notebook.
Using TIR Notebook
Using CLI
In Using CLI you will get the command to setup minio CLI
In Using CLI you will get the command to setup s3cmd.
After successfully creation of Model Inference ,Model is shown in the list and we can see the Setup and Overview of the Model.
2. Existing EOS Bucket
If the user selects the Storage Type as Existing EOS Bucket then you have an options to select existing bucket.
After clicking on Create button Configure EOS Bucket to upload model weights will appear on the next screen.
Using SDk
In Using SDK tab, you will get the command for install SDk and Run appropriate commands in python shell or jupyter notebook.
Using TIR Notebook
Using CLI
In Using CLI you will get the command to setup minio CLI
In Using CLI you will get the command to setup s3cmd.
After successfully creation of Model Inference ,Model is shown in the list and we can see the Setup and Overview of the Model.
3. External EOS Bucket
If you select Storage Type as External EOS Bucket, you can use EOS bucket (not owned by you) to store model artifacts.
Bucket Name , Access Key and Secret Key will be required for accessing the bucket to store model artifacts.
Please make sure that both Access Key secret and Secret Key are attached to the mentioned bucket.
After clicking on Create button Configure EOS Bucket to upload model weights will appear on the next screen.
Using SDk
In Using SDK tab, you will get the command for install SDk and Run appropriate commands in python shell or jupyter notebook.
Using TIR Notebook
Using CLI
In Using CLI you will get the command to setup minio CLI
In Using CLI you will get the command to setup s3cmd.
After successfully creation of Model Inference ,Model is shown in the list and we can see the Setup and Overview of the Model.
Model Endpoints
To create Model Endpoints you can click on ‘Create Endpoint’ button.
After filling all the parameters in the form then click on the ‘Deploy’
After clicking on Deploy Model Endpoint shown in the list
API Tokens
To create API Tokens click on ‘Create API Token’ button
After clicking on create API Token then you have to select the name of the API Token then click on the right button.
After that you will see the API token in the list
Project Activity
To see the all the activities of the project click on the ‘Project Activity’
Project Usage
“Project usage” refers to the utilization or consumption of resources, services, or tools within the context of a specific project. It typically involves tracking and analyzing the extent to which various components, assets, or functionalities are employed during the course of a project’s execution.
Settings
In settings user can change the project name and descriction of the project.
How to Manage GPU Notebooks using Actions
After clicking on the 3 dots Notebook actions will be shown.
Now click on Launch Notebook to launch a notebook.
Click on Stop button to stop your notebook.
Click on Update Notebook to update your notebook to update your Notebook, Notebook must in Stop state.
Click on Delete button to delete your notebook.
Teams
If you want a team should be access of project and the multiple member should be able to work on the peoject, Then you have to create a team using Private Workspace. For that you can manage your teams click on any of these options.
To manage your teams click on any of these options.
After clicking on manage teams you will be redirected to the manage Teams section.
Click on Private Workspace to see the settings for the Team Management.
After clicking on Private user will be able to see the private workspace for your Team.
To create a Team click on create team.
After clicking on Create Team a page will appear, fill the details like Team Name and give any description if you want to give to your team. Then click on Create button to create your team.
Your created Team will look like this.
Now to see the details of your team click on the that team
How to add Team members in team?
For Adding team members you have to click on Team which you have created and after that you have to click on Members tab.
Under that tab you have to enter email address of that person which you wanted to add.
After entering the email address click on send invite button to send the invitation. Remember if you will try to add a member who has already been added to my account as a primary user you will get an error like this: “Following customers are Primary Users & cannot be invited to any team: ‘………………………….@gmail.com’.”
After sending the invitation it can be seen like this. Here user can also see the current status of the invitation.
Now an email will be sent to that user email where they found a registration link user has to click on that link and register or accept himself.
After clicking on register button enter the OTP which you have received on your number.
After entering the OTP you will be redirected to GPU section. Here you will see a Notification on the top right corner of the page
After clicking on the bell icon a pop up will appear click on Accept to accept the invitation.
After the contact person accepts the invitation the status will be changed from pending to member.
To make a contact person admin click on the admin button as shown in the image.
To revoke the invitation sent click on 3 dots of the invitation and click on remove button.