E2E CloudTIR GenAI API FAQ
For step-by-step fixes, see Troubleshooting TIR GenAI API.
Models and availability
Section titled “Models and availability”Is a model on GenAI API guaranteed to stay available?
Section titled “Is a model on GenAI API guaranteed to stay available?”No. E2E can mark any model out of inventory or remove it from the catalog, including a model used in the examples in these docs. Check a model’s own page before you rely on it, and see what happens when a model is unavailable.
What happens when I request a model that is unavailable?
Section titled “What happens when I request a model that is unavailable?”Request files a support ticket for you, and you get an email when the model is available. A Benchmarking Request also files a ticket, and you get an email when the results are ready. Neither request changes the model automatically.
Is GenAI API available in both Delhi and Chennai?
Section titled “Is GenAI API available in both Delhi and Chennai?”Yes. GenAI API shows the same model catalog in both regions.
Authentication
Section titled “Authentication”Does my Personal Access Token expire?
Section titled “Does my Personal Access Token expire?”Yes. A token and its Auth Token stop working 365 days after you create it. Create a new one from Personal Access Tokens when it expires. See Get started with TIR GenAI API.
Can I have more than one Personal Access Token?
Section titled “Can I have more than one Personal Access Token?”Yes. Create as many as you need, and delete any one of them from the same screen. To replace a token, delete it and create a new one.
Calling the API
Section titled “Calling the API”Which calling method should I use for a model?
Section titled “Which calling method should I use for a model?”It depends on the model’s endpoint. A text or embedding model has its name in the endpoint URL, so call it with the OpenAI SDK or a plain REST request. A speech, image, or translation model takes its name in the request body, so call it with the TIR SDK or REST. See Models and calling methods.
Does Max Tokens limit the model’s memory of the conversation?
Section titled “Does Max Tokens limit the model’s memory of the conversation?”No. Max Tokens caps the length of one reply. How much of the conversation the model can take in is its context length. See My reply stops partway through for how a model’s context length works.
Bulk prompts
Section titled “Bulk prompts”Is there a limit on how many prompts I can upload in one bulk prompt file?
Section titled “Is there a limit on how many prompts I can upload in one bulk prompt file?”No published limit applies to how many prompts a file holds or how many bulk jobs run at once. You upload one file at a time. See Run bulk prompts.
Billing
Section titled “Billing”Is GenAI API billed per request?
Section titled “Is GenAI API billed per request?”No. GenAI API bills for what each request uses, such as its input and output tokens, rather than a flat amount per request. See Billing and usage.
Is there a setup charge or a commitment to use GenAI API?
Section titled “Is there a setup charge or a commitment to use GenAI API?”No. You pay only for what you call, with no setup charge, reserved capacity, or long-term commitment. For prices, see E2E Networks pricing.