Models

Tabnine provides various AI models for Tabnine Chat. Tabnine Enterprise admins can connect Tabnine to their internal endpoints to enrich the Tabnine Chat experience for users. This allows administrators to integrate their company's private LLM instances, making them accessible to the engineering team directly within Tabnine.

Note

Tabnine's code completions only use the Tabnine Universal code completions model, which is both private and protected.

Private Model Endpoints Supported by Tabnine

Note

The list of supported models is updated frequently as new models become available.

Currently, Tabnine supports the following model providers for private endpoint connections:

Model
Bedrock
GCP Vertex AI
Azure
OpenAI
OpenAI-Compatible

Claude 4.6 Sonnet

Claude 4.6 Opus

Claude 4.5 Sonnet

Claude 4.5 Opus

Claude 4.5 Haiku

Claude 4 Sonnet

Gemini 3.0 Pro

Gemini 2.5 Flash

Gemini 2.5 Pro

GPT-5.4

GPT-5.3 Codex

GPT-5.2 Codex

GPT-5.2

GPT-5

GPT-4o

Devstral-Small-2-24B-Instruct-2512

Devstral-2-123B-Instruct-2512**

MiniMax 2.7

Qwen-3-Coder-480B-A35B-Instruct

Qwen-3-30B (Chat only)

*This list changes frequently **Devstral 2 (123B parameters) is operating under a modified MIT license. If your organization's global consolidated monthly revenue is exceeding $20 million, utilizing this model requires Devstral's permission.

Integration Requirements for Models

Amazon Bedrock: Region, Access Key ID, Secret Access Key | Learn more

Azure: Azure endpoint, Key, Deployment ID | Learn more

OpenAI: Key, OpenAI endpoint | Learn more

OpenAI-Compatible: Llama endpoint, OpenAICompatible Model name

Google Vertex AI: Region, Project ID, Service Account | Learn more

Viewing and setting up the available chat models

Note\

If this functionality isn't visible, we recommend contacting your dedicated account manager at Tabnine. They'll assist you in setting the available chat AI models for your team.

Admins manage the available chat models for their accounts and set up private endpoints for chat models:

  1. Sign in to the Tabnine console as an admin.

  2. Go to the Models page under Settings:

  1. Toggle a model on and enter the relevant provider settings for your private endpoint.

Setting the default chat model

Admins can set a model as the account's default chat model. The account default model is the default chat model for the account users. However, users can still switch to any other available model.

Change the account default model by expanding a specific model and toggling Set as default.

Change the account default model by expanding a specific model and toggling Set as default.

Self-Managed Models (v6.1.0)

Self-Managed Models allows enterprise administrators to connect their own large language model (LLM) endpoints to Tabnine. The feature is designed for organizations that want to use self-managed models while keeping the familiar Tabnine governance, orchestration, and user experience.

Model Modes in the Admin Console

When you open the Admin Console and go to the Models section. Beneath the “Self-Managed” panel you will see a list of all models your organization has configured, including their names, providers, and availability for Chat or Agent use.

Each model entry also shows whether it is set as the default for Chat or Agent. This makes it easy to see which models are active and how they are being used.

Adding a Self-Managed Model

To add a new self‑managed model, click Add model on the right side of the Models page. This opens the Add AI Model wizard, where you choose a provider, enter credentials, and define model details.

On the Provider step, select the AI provider you want to configure (for example, ChatGPT, Amazon Bedrock, GCP Vertex AI, Azure AI Foundry, or an OpenAI‑compatible endpoint).

On the Credentials step, enter the authentication details required for that provider. For example, Amazon Bedrock requires a region, access key ID, secret access key, and an optional custom endpoint.

You can also load an existing credential configuration instead of entering new values.

On the Model Details step, provide the technical model name (the exact identifier used by the provider API) and an optional display name for users. Then configure limits such as maximum context length, maximum tokens per request, and maximum response tokens.

These settings ensure Tabnine can connect securely to your provider, identify the correct model, and apply token limits that match your organization’s policies. When you are done, click Run Test to verify the connection, then save the model.

Managing Models and Defaults

Once you save your new model, it appears in the list of self-managed models. You can see which models are active, which are available for Chat or Agent, and which are set as defaults.

If you want to change the default model for Chat or Agent, you can do so directly from this list by clicking “Set default” next to the relevant model. Only one model can be the default for each use case at any time.

You cannot disable or remove a model that is set as a default without first changing the default to another model.

Editing and Deleting Models

Editing or deleting a model follows the same pattern as adding one. You can open the model’s settings to update provider details, token limits, or other configuration values.

You can remove a model entirely as long as it is not set as a default. If a model is the default for Chat or Agent, you need to assign another model as the default before deleting or disabling it.

All changes, including mode switches, additions, edits, and deletions, are logged for audit and analytics purposes. This supports your organization’s governance and compliance requirements.

Quotas, Reporting, and Security

Self-managed models affect how Tabnine handles quotas, cost controls, and reporting. Usage limits and reporting mechanisms apply to both Tabnine-managed and self-managed models.

If your organization tracks token consumption or costs, these metrics include activity from self-managed models. From a security perspective, Tabnine sends prompts and requests to the model endpoints you configure.

The user experience and governance controls remain the same. Users continue to interact with Tabnine through their usual interfaces, and all orchestration is handled as before.

Last updated

Was this helpful?