LogoLogo
Tabnine websiteContact Sales
  • 👋Welcome
    • Overview
      • Architecture
        • Deployment options
      • Security
      • Privacy
      • Protection
        • Provenance and Attribution
      • Personalization
        • Tabnine’s Personalization in Depth
        • Connection: Global Codebase Awareness
      • AI Models
        • Tabnine's private and protected Universal models
        • Tabnine's fine-tuned AI models
      • Integrations
        • Atlassian Jira
      • System Requirements
      • Supported Languages
      • Supported IDEs
      • Tabnine Subscription Plans
        • Dev Preview
        • Dev
        • Enterprise (SaaS)
        • Enterprise (private installation)
    • Support & Feedback
  • 🚀Getting started
    • Install
      • Client setup (SaaS)
        • VS Code
          • Install Tabnine in VS Code
          • Activate Tabnine in VS Code
        • JetBrains IDEs
          • Install Tabnine in a JetBrains IDE
          • Activate Tabnine in a JetBrains IDE
        • Visual Studio
          • Install Tabnine in Visual Studio 2022
          • Activate Tabnine in Visual Studio 2022
        • Eclipse
          • Install Tabnine in Eclipse
          • Activate Tabnine in Eclipse
        • Sign in
          • Using an email
          • Using an authentication token
      • Client setup (private installation)
        • Join your team (private installation)
        • VS Code (private installation)
        • JetBrains IDEs (private installation)
        • Visual Studio (private installation)
        • Eclipse (private installation)
    • Quickstart Guide
      • Menus and Icons
    • Getting the Most from Tabnine Code Completions
      • Pause (snooze)
    • Getting the Most from Inline Actions
    • Getting the Most from Tabnine Chat
      • Launching Tabnine Chat
      • Interacting with Tabnine Chat
      • Reviewing suggestions
      • Writing prompts
      • Chat Context
        • Understanding Context
        • Jira Connection
        • Context Scoping
      • Conversing with Tabnine Chat
      • Switching between chat AI models
      • Image Prompts
      • Tabnine's Prompting Guide
        • Getting Started
        • Basic Prompting
          • Be specific and clear
          • Define the context
          • Start a fresh conversation as appropriate
          • Include necessary details
          • Ask for examples
          • Be concise but complete
  • 💪Software Development with Tabnine
    • Overview
    • Plan
    • Create
    • Test
      • Intro to the Test Agent
      • Test Agent Workflow
      • Custom Commands
      • Generate Test Files with @Mentions
    • Review
    • Fix
    • Document
    • Explain
    • Maintain
  • 🏭Administering Tabnine
    • Start a team
    • Manage a team
    • SaaS
      • Enterprise (SaaS) team admin
        • Set up a Tabnine Enterprise (SaaS) account
        • Invite team members
        • Manage your team
        • AI models for Chat (Enterprise SaaS)
      • Enterprise (SaaS) team member
        • Join your Tabnine team by invitation email (team member)
        • Join Tabnine team by link (member)
    • Private installation
      • Server setup guide
        • Kubernetes (MicroK8s) Installation guide
        • Deployment guide
          • Tabnine update guide
        • Air-gapped deployment guide
      • Admin guide
        • Monitoring Tabnine
        • Prometheus Operator install
        • Audit logs
      • Managing your team
        • Tabnine teams
        • Roles in an enterprise
        • Inviting users to your team
        • Deactivating and reactivating users
        • Deleting PII data of a deactivated user
        • Reset user's password
        • Usage reports
          • Reports Glossary
          • CSV-based reports (V2)
            • Configuring scheduled CSV reports
            • CSV-based reports V1 (Depracted since version 5.7.0
          • Usage API
        • Settings
          • General
          • Single Sign-On (SSO)
          • Personalization (f.k.a. Workspace)
            • Connecting to External Code Repositories
          • Email
          • License
          • Models
          • Access Tokens
        • IdP Sync
      • Release Notes
  • 📣Product Updates
    • What's new?
      • What's new? (August 2024)
      • What's new? (July 2024)
      • What's new? (June 2024)
      • What's new? (May 2024)
      • What's new? (April 2024)
      • What's new? (March 2024)
      • What's new? (February 2024)
      • What's new? (January 2024)
Powered by GitBook
On this page
  • User Status
  • Active User
  • Automation Factor (Code Completions)
  • Productivity Factor (Code Completions & Chat)
  • Chat Interactions and Useful Chat Interaction
  • Chat Consumption Rate
  • Accepted Lines of code

Was this helpful?

  1. Administering Tabnine
  2. Private installation
  3. Managing your team
  4. Usage reports

Reports Glossary

Last updated 1 month ago

Was this helpful?

User Status

A user in Tabnine private installation can be in one of these states:

  • Invited User (Status=Invited): Has a pending email invitation to join Tabnine but has not yet registered. This user is authorized to use Tabnine but cannot connect and use Tabnine until registered.

  • Registered User: This user has signed up to Tabnine after an invitation (by email or link), by self-registration, or through SSO. This user is authorized to connect and use Tabnine. Registered users can be in one of the following statuses based on how advanced they are in onboarding to Tannine.

    • Status=Registered: This is a registered user who has not yet connected to Tabnine in the IDE.

    • Status=Connected: This is a registered user who has connected to Tabnine in the IDE but has not actually used Tabnine yet.

    • Status=Used: This is a registered user who has connected to the Tabnine in the IDE and has completed at least one chat interaction or code completion.

  • Deactivated User (Status=Deactivated): This user had been a registered user at some point, but has been deactivated by an admin since then. This user is no longer an authorized user and cannot use Tabnine.

Notes:

  1. Admin can deactivate Registered users (changing their status to Deactivated) or activate Deactivated users (changing their status to back to Registered, Connected, or Used).

  2. The transition between the Registered, Connected, and Used statuses is one-directional, meaning that once a user has connected Tabnine in the IDE, they cannot be back in "Registered" status. Once a user has used Tabnine, they cannot be back in "Connected" status.

The following chart explains the user status flow for a Tabnine user:

Active User

Automation Factor (Code Completions)

The Automation Factor is a metric that represents the percentage of code generated using Tabnine code completions compared to all code written in the IDE and is calculated in the following manner:

Example:

If a developer typed 20 characters and Tabnine code completions contributed 5 characters:

Automation Factor = 5 / (20 + 5) = 20%

The sum of typed characters is approximated using the number of user keystrokes in the editor.

The Automation Factor can be calculated for the entire organization, a specific team, or individuals, and in different time frames.

Automation Factor can be measured across different scopes: individual developers, teams, or the entire organization, and over various time periods. However, the calculation relies on a minimal threshold of code completion activity over time for accuracy.

Productivity Factor (Code Completions & Chat)

The Productivity Factor is a broader metric that includes code generated by both Tabnine's code completions and Tabnine Chat. It measures the total contribution of Tabnine's code generation to the overall code written in the IDE and is calculated in the following manner:

Example:

If a developer typed 20 characters, accepted a code completion in the length of 5 characters, and copied a line of code from chat Chat with 15 characters:

Productivity Factor = (5 + 15) / (20 + 5 + 15) = 20 / 40 = 50%

The sum of typed characters is approximated using the number of user keystrokes in the editor.

The Automation Factor can be calculated for the entire organization, a specific team, or individuals, and in different time frames.

Currently, the Productivity Factor is only available in external PDF reports or can be calculated manually using the raw data provided in CSV reports. It is not yet shown in the in-app reporting dashboards.

Chat Interactions and Useful Chat Interaction

Chat interaction: Refers to a user action that triggers Tabnine chat, either through a free text prompt or using a built-in command (i.e., "The user asks a question").

Useful chat interaction: (AKA "Chat consumption") Refers to any engagement with the chat answer that suggests that the user found the chat answer useful (i.e., "The user found the chat answer to be useful").

Note: The useful chat interaction data has been collected since version 5.6.0

There are different types of useful chat interactions:

  • Copy code: The user copied code from the answer by clicking copy/insert code or by free copying parts of the code in the chat answer.

  • Follow-up click: The user clicked a related question offered by the chat, which further suggests that the chat helped the user discover more relevant information or context on the problem they're trying to solve.

  • Navigate to a reference: The user navigated to a code reference included in the chat answer, which helped the user navigate and find the reference more easily.

  • Review: The chat helps the user review and compare a specific suggestion to their existing code.

  • Thumbs up: Explicit expression of content from the user by clicking thumbs up for a specific answer.

Chat Consumption Rate

The Chat Consumption Rate is a metric that measures the usefulness of Tabnine chat answers. It is calculated as the ratio between the total number of times a user copied code from a chat answer and the total number of questions the user asked:

Since a user can copy code more than once from the same chat answer (for example, when the answer contains multiple code blocks), the Chat Consumption Rate can exceed 100%.

This rate can be calculated at various levels: for the entire organization, specific teams, or individual users, and across different time frames.

Note: Chat Consumption Rate data has been collected since version 5.6.0.

Accepted Lines of code

The total number of lines of code accepted from code completions or useful chat interactions (specifically of type "copy code").

Note: Lines of code data has been collected since version 5.7.0.

An active user refers to a user who has completed at least one or code completion in a specific time frame. For example, a user can be active in March but not in April. Another example is that a user can be an active user in the last 30 days, but not in the last 7 days.

🏭
chat interaction
Tabnine's users' status flow
Drawing
Drawing
Drawing