How to launch GPU Notebooks

Create Project

For creating GPU Notebooks Go to my account and click on GPU notebooks in the top left corner of the page

../_images/brandnewgpu1.png

After clicking on GPU notebooks the page will be redirected to the GPU page with by default created project. You can create new project as well

../_images/brandnewgpu2.png

You can create a new project by clicking on Create Project which is at the top left corner of the page

../_images/gpu3.png ../_images/gpu4.png

After creating a new project it will be shown on the left side with the default project like this

../_images/gpu5.png

Create Notebook

To create a Notebook you have to click on Create Notebook which is at the top right corner of the page.

../_images/gpu6.png

After clicking on Create Notebook button a page will be appear, now enter Notebook name, choose the Notebook Image and select the machine on which you want to run your service, and then choose the plan, After that click on Create button.

../_images/gpu7.png ../_images/gpu8.png

After clicking on create button your GPU will be create and it will be shown like this.

../_images/gpu9.png

DATASET

  • Go to the TIR AI PLATFORM

  • Make sure you are on the right project or feel free to create a new project

  • Go to Datasets

../_images/ds1.png
  • Click on CREATE DATASET

../_images/ds2.png
  • After clicking create dataset, you will redirect on to that below screen.

../_images/ds3.png
  • Here is two options of storage type to create dataset.

1. EOS Bucket

2. DISK

1. EOS Bucket

  • In EOS BUCKET storage type, here is two options of bucket type to craete dataset.

1. New EOS Bucket

2. Existing EOS Bucket

1. New EOS Bucket : This will create a new EOS bucket tied to your account and also access keys for it.

  • Enter a name for your dataset.

  • Click on CREATE button.

../_images/neweosbucket.png
  • You will see a screen to configure EOS bucket to upload data.In that screen you will get Setup Minio CLI , Setup s3cmd and Dataset Details

../_images/ds6.png

Setup Minio CLI

In setup minio CLI tab, you will get setup host command and you will get a command to copy folder to a bucket.

../_images/setupminio.png

Setup S3cmd

In setup S3cmd tab, you will get command for set up endpoints, setup access keys and enable s3 v4 signature APIs.

../_images/ds9.png

Dataset Details

In Dataset Details tab, you will get dataset details and bucket details.

../_images/ds10.png

2. Existing EOS Bucket :

In Existing EOS Bucket, you can select the Existing bucket.

  • Enter a name for your dataset (for e.g. paws)

  • Click on CREATE button.

../_images/ds5.png
  • You will see a screen to configure EOS bucket to upload data.In that screen you will get Setup Minio CLI , Setup s3cmd and Bucket name , Dataset Details

../_images/ds6.png

Setup Minio CLI

In setup minio CLI tab, you will get setup host command and you will get a command to copy folder to a bucket.

../_images/setupminio.png

Setup S3cmd

In setup S3cmd tab, you will get command for set up endpoints, setup access keys and enable s3 v4 signature APIs.

../_images/ds9.png

Dataset Details

In Dataset Details tab, you will get dataset details and bucket details.

../_images/ds10.png

2. DISK

If you select , DISK storage type to create dataset. You will get the Disk Size field in that field you can set the disk size according to you.

  • Each GB wil be charged at 5 rupee per month.

  • The disk size cannot be reduced in future. However it can be increased anytime.

  • Enter a name for your dataset (for e.g. paws)

  • Click on CREATE button.

../_images/disk.png

After successfully creation of dataset. You will get Setup , overview and Data Objects.

Setup

In setup tab, you will get the details of Configure EOS Bucket to upload data , Setup minio client and setup s3cmd.

../_images/setuptab.png

Setup minio client

../_images/ds7.png

Setup s3cmd

../_images/ds8.png

overview

In that section you will get the information of dataset details (Dataset name, created by and createde at) and storage details like storage tye, bucket name, bucket type, access key , secret key and EOS end points.

../_images/overview.png

Data Objects

In Data Objects you can upload data in your bucket by clicking UPLOAD DATA button.

../_images/dataset.png

After clicking on upload data button , you can choose or drag files from your system and click on UPLOAD button.

../_images/choosefile.png ../_images/upload.png

After successfully uploading files, you can see the list of files/data on list.

../_images/afteruploading.png

You can download file/data by selecting the particular file and then clicking download button.

../_images/download.png

You can delete file/data by selecting the particular file and then clicking delete button.

../_images/deletefile.png

Delete Dataset

Select the particular dataset from the list and click on the Delete button to delete the dataset.

../_images/deleteds.png

After clicking on the Delete button it will show one popup to delete the dataset.you can click delete button to delete dataset.

../_images/deleteds2.png

Model Repositories

To create Model Repositories, go to the ‘Inference’ section select Model Repository and then click the CREATE REPOSITORY button.

../_images/modelrepository1.png

To create Model Repository you have to select Model type like Pytorch or Triton or Custom.

../_images/modeltype.png

After that select Storage Type New EOS Bucket or Existing EOS Bucket or External EOS Bucket then click on Create button.

../_images/modelstorage.png

1. New EOS Bucket

If you select storage type New EOS Bucket.

../_images/modelneweoscreate.png

After clicking on Create button Configure EOS Bucket to upload model weights will appear on the next screen.

Using SDk

In Using SDK tab, you will get the command for install SDk and Run appropriate commands in python shell or jupyter notebook.

../_images/newusingsdk.png

Using TIR Notebook

../_images/newusingtirnotebook.png

Using CLI

In Using CLI you will get the command to setup minio CLI

../_images/newusingCLI.png

In Using CLI you will get the command to setup s3cmd.

../_images/news3cmd.png

After successfully creation of Model Inference ,Model is shown in the list and we can see the Setup and Overview of the Model.

../_images/setupTab.png ../_images/OverviewTab.png

2. Existing EOS Bucket

If the user selects the Storage Type as Existing EOS Bucket then you have an options to select existing bucket.

../_images/existingeosbucket2.png

After clicking on Create button Configure EOS Bucket to upload model weights will appear on the next screen.

Using SDk

In Using SDK tab, you will get the command for install SDk and Run appropriate commands in python shell or jupyter notebook.

../_images/newusingsdk.png

Using TIR Notebook

../_images/newusingtirnotebook.png

Using CLI

In Using CLI you will get the command to setup minio CLI

../_images/newusingCLI.png

In Using CLI you will get the command to setup s3cmd.

../_images/news3cmd.png

After successfully creation of Model Inference ,Model is shown in the list and we can see the Setup and Overview of the Model.

../_images/setupTab.png ../_images/OverviewTab.png

3. External EOS Bucket

  • If you select Storage Type as External EOS Bucket, you can use EOS bucket (not owned by you) to store model artifacts.

  • Bucket Name , Access Key and Secret Key will be required for accessing the bucket to store model artifacts.

  • Please make sure that both Access Key secret and Secret Key are attached to the mentioned bucket.

../_images/externaleos.png

After clicking on Create button Configure EOS Bucket to upload model weights will appear on the next screen.

Using SDk

In Using SDK tab, you will get the command for install SDk and Run appropriate commands in python shell or jupyter notebook.

../_images/newusingsdk.png

Using TIR Notebook

../_images/newusingtirnotebook.png

Using CLI

In Using CLI you will get the command to setup minio CLI

../_images/newusingCLI.png

In Using CLI you will get the command to setup s3cmd.

../_images/news3cmd.png

After successfully creation of Model Inference ,Model is shown in the list and we can see the Setup and Overview of the Model.

../_images/setupTab.png ../_images/OverviewTab.png

Model Endpoints

To create Model Endpoints you can click on ‘Create Endpoint’ button.

../_images/gpu25.png

After filling all the parameters in the form then click on the ‘Deploy’

../_images/gpu26.png

After clicking on Deploy Model Endpoint shown in the list

../_images/gpu27.png

API Tokens

To create API Tokens click on ‘Create API Token’ button

../_images/gpu28.png

After clicking on create API Token then you have to select the name of the API Token then click on the right button.

../_images/gpu29.png

After that you will see the API token in the list

../_images/gpu30.png

Project Activity

To see the all the activities of the project click on the ‘Project Activity’

../_images/gpu31.png

Project Usage

“Project usage” refers to the utilization or consumption of resources, services, or tools within the context of a specific project. It typically involves tracking and analyzing the extent to which various components, assets, or functionalities are employed during the course of a project’s execution.

../_images/gpu32.png

Settings

In settings user can change the project name and descriction of the project.

../_images/gpu33.png

How to Manage GPU Notebooks using Actions

After clicking on the 3 dots Notebook actions will be shown.

../_images/gpu34.png

Now click on Launch Notebook to launch a notebook.

../_images/gpu35.png

Click on Stop button to stop your notebook.

../_images/gpu36.png ../_images/gpu37.png ../_images/gpu38.png

Click on Update Notebook to update your notebook to update your Notebook, Notebook must in Stop state.

../_images/gpu39.png ../_images/gpu40.png

Click on Delete button to delete your notebook.

../_images/gpu41.png ../_images/gpu42.png

Teams

If you want a team should be access of project and the multiple member should be able to work on the peoject, Then you have to create a team using Private Workspace. For that you can manage your teams click on any of these options.

To manage your teams click on any of these options.

../_images/gpu43.png

After clicking on manage teams you will be redirected to the manage Teams section.

../_images/gpu44.png

Click on Private Workspace to see the settings for the Team Management.

../_images/gpu44.png

After clicking on Private user will be able to see the private workspace for your Team.

../_images/gpu45.png

To create a Team click on create team.

../_images/gpu46.png

After clicking on Create Team a page will appear, fill the details like Team Name and give any description if you want to give to your team. Then click on Create button to create your team.

../_images/gpu47.png

Your created Team will look like this.

../_images/gpu48.png

Now to see the details of your team click on the that team

../_images/gpu48.png

How to add Team members in team?

For Adding team members you have to click on Team which you have created and after that you have to click on Members tab.

../_images/brandnewgpu28.png

Under that tab you have to enter email address of that person which you wanted to add.

../_images/brandnewgpu29.png

After entering the email address click on send invite button to send the invitation. Remember if you will try to add a member who has already been added to my account as a primary user you will get an error like this: “Following customers are Primary Users & cannot be invited to any team: ‘………………………….@gmail.com’.”

../_images/brandnewgpu30.png ../_images/brandnewgpu31.png

After sending the invitation it can be seen like this. Here user can also see the current status of the invitation.

../_images/brandnewgpu32.png

Now an email will be sent to that user email where they found a registration link user has to click on that link and register or accept himself.

../_images/brandnewgpu32_0.png ../_images/brandnewgpu32_1.png ../_images/brandnewgpu32_2.png

After clicking on register button enter the OTP which you have received on your number.

../_images/brandnewgpu32_3.png

After entering the OTP you will be redirected to GPU section. Here you will see a Notification on the top right corner of the page

../_images/brandnewgpu32_4.png

After clicking on the bell icon a pop up will appear click on Accept to accept the invitation.

../_images/brandnewgpu32_5.png

After the contact person accepts the invitation the status will be changed from pending to member.

../_images/brandnewgpu34.png

To make a contact person admin click on the admin button as shown in the image.

../_images/brandnewgpu35.png

To revoke the invitation sent click on 3 dots of the invitation and click on remove button.

../_images/brandnewgpu32.png