Chat Completions — API

Path parameters

Endpoint_IdPathstringrequired

Query parameters

project_idQueryintegerrequired
Project ID

Request body

application/json

object

modelstringrequired

The model identifier to use for completion.

exampleyour-model-name

messagesarrayrequired

A list of messages comprising the conversation so far.

max_tokensinteger

Maximum number of tokens to generate in the response.

example512

temperaturenumber

Controls randomness. Lower values make output more deterministic, higher values more creative.

example0.7

top_pnumber

Nucleus sampling probability mass. Only tokens with cumulative probability up to top_p are considered.

example1

top_kinteger

Limits the number of highest-probability tokens considered at each step.

example50

frequency_penaltynumber

Penalizes tokens based on how frequently they have appeared in the text so far.

example0

streamboolean

If true, responses are streamed as server-sent events.

examplefalse

Responses

200Successful chat completion response.

object

idstring

Unique identifier for the completion.

examplechatcmpl-ab36a36c-2315-472f-9e58-0f68f19b8bf8

objectstring

Object type, always chat.completion.

examplechat.completion

createdinteger

Unix timestamp of when the completion was created.

example1776750085

modelstring

The model used for the completion.

examplemeta-llama/Llama-3.2-1B-Instruct

choicesarray

List of generated completion choices.

service_tierstring

examplenull

system_fingerprintstring

examplenull

usageobject

prompt_logprobsstring

examplenull

prompt_token_idsstring

examplenull

kv_transfer_paramsstring

examplenull

Request

curl -X POST 'https://api.e2enetworks.com/myaccount/api/v1/gpu/project/p-{Project_Id}/endpoint/is-{Endpoint_Id}/v1/chat/completions?project_id=%3Cproject_id%3E&apikey=%3Capikey%3E' \
  -H 'Authorization: Bearer <JWT>' \
  -H 'Content-Type: application/json' \
  -d '{
  "model": "your-model-name",
  "messages": [
    {
      "role": "user",
      "content": "Hello!!"
    }
  ],
  "max_tokens": 512,
  "temperature": 0.7,
  "top_p": 1,
  "top_k": 50,
  "frequency_penalty": 0,
  "stream": false
}'

Response · 200

{
  "id": "chatcmpl-ab36a36c-2315-472f-9e58-0f68f19b8bf8",
  "object": "chat.completion",
  "created": 1776750085,
  "model": "meta-llama/Llama-3.2-1B-Instruct",
  "choices": [
    {
      "index": 0,
      "message": {
        "role": "assistant",
        "content": "In Nature's embrace, I find my peace,\nA world of wonder, a world to cease,\nFrom mountains high to valleys low,\nA tapestry of life, in all its glow.",
        "refusal": null,
        "tool_calls": [],
        "reasoning": null
      },
      "logprobs": null,
      "finish_reason": "stop",
      "stop_reason": null,
      "token_ids": null
    }
  ],
  "service_tier": null,
  "system_fingerprint": null,
  "usage": {
    "prompt_tokens": 40,
    "completion_tokens": 274,
    "total_tokens": 314,
    "prompt_tokens_details": null
  },
  "prompt_logprobs": null,
  "prompt_token_ids": null,
  "kv_transfer_params": null
}