Skip to main content
Effective Date — May 7, 2026
As part of the IAM hierarchy simplification, a new format of the TIR APIs is now available. All endpoints that previously included /teams/:team_id segment will now follow a service-centric structure, with project_id now passed as a query parameter instead of a path segment. You can read more about this change

Create Model Evaluation

POST/model_evaluation/

Query parameters

  • project_idQueryintegerrequired

    Project ID

  • active_iamQueryintegeroptional

    Active IAM ID (To access contact person account) Find your Active IAM ID here

  • locationQuerystringrequired

    Location

Request body

application/json

object
namestring
exampletir-job-021915025656
input_dataset_idstring
example
output_dataset_idstring
exampleasync-invocations-02171142022
input_dataset_configobject
framework_idinteger

1 - text-summarization 2 - general_assistant 3 - question_answering 4 - text_classification

example1
evaluator_llm_idinteger

1 - llama3_2_3b_instruct 2 - llama3_1_8b_instruct

example2
evaluation_configobject
model_evaluation_promptstring
exampletest
sku_item_price_idinteger

SKU item price ID for the evaluation job. This value is region-specific. Use the plans-and-pricing API to get valid IDs for your region.

example207
huggingface_integration_idstring
examplenull

Responses

201Evaluation request created successfully
object
codeinteger
example201
dataobject
errorsobject
messagestring
exampleCreated Successfully