Reports Glossary
Last updated
Was this helpful?
Last updated
Was this helpful?
A user in Tabnine private installation can be in one of these states:
Invited User (Status=Invited): Has a pending email invitation to join Tabnine but has not yet registered. This user is authorized to use Tabnine but cannot connect and use Tabnine until registered.
Registered User: This user has signed up to Tabnine after an invitation (by email or link), by self-registration, or through SSO. This user is authorized to connect and use Tabnine. Registered users can be in one of the following statuses based on how advanced they are in onboarding to Tannine.
Status=Registered: This is a registered user who has not yet connected to Tabnine in the IDE.
Status=Connected: This is a registered user who has connected to Tabnine in the IDE but has not actually used Tabnine yet.
Status=Used: This is a registered user who has connected to the Tabnine in the IDE and has completed at least one chat interaction or code completion.
Deactivated User (Status=Deactivated): This user had been a registered user at some point, but has been deactivated by an admin since then. This user is no longer an authorized user and cannot use Tabnine.
An active user refers to a user who has completed at least one chat interaction or code completion in a specific time frame. For example, a user can be active in March but not in April. Another example is that a user can be an active user in the last 30 days, but not in the last 7 days.
The Automation Factor is a metric that represents the percentage of code generated using Tabnine code completions compared to all code written in the IDE and is calculated in the following manner:
Example:
If a developer typed 20 characters and Tabnine code completions contributed 5 characters:
Automation Factor = 5 / (20 + 5) = 20%
The sum of typed characters is approximated using the number of user keystrokes in the editor.
The Automation Factor can be calculated for the entire organization, a specific team, or individuals, and in different time frames.
Automation Factor can be measured across different scopes: individual developers, teams, or the entire organization, and over various time periods. However, the calculation relies on a minimal threshold of code completion activity over time for accuracy.
The Productivity Factor is a broader metric that includes code generated by both Tabnine's code completions and Tabnine Chat. It measures the total contribution of Tabnine's code generation to the overall code written in the IDE and is calculated in the following manner:
Example:
If a developer typed 20 characters, accepted a code completion in the length of 5 characters, and copied a line of code from chat Chat with 15 characters:
Productivity Factor = (5 + 15) / (20 + 5 + 15) = 20 / 40 = 50%
The sum of typed characters is approximated using the number of user keystrokes in the editor.
The Automation Factor can be calculated for the entire organization, a specific team, or individuals, and in different time frames.
Chat interaction: Refers to a user action that triggers Tabnine chat, either through a free text prompt or using a built-in command (i.e., "The user asks a question").
Useful chat interaction: (AKA "Chat consumption") Refers to any engagement with the chat answer that suggests that the user found the chat answer useful (i.e., "The user found the chat answer to be useful").
Note: The useful chat interaction data has been collected since version 5.6.0
Copy code: The user copied code from the answer by clicking copy/insert code or by free copying parts of the code in the chat answer.
Follow-up click: The user clicked a related question offered by the chat, which further suggests that the chat helped the user discover more relevant information or context on the problem they're trying to solve.
Navigate to a reference: The user navigated to a code reference included in the chat answer, which helped the user navigate and find the reference more easily.
Review: The chat helps the user review and compare a specific suggestion to their existing code.
Thumbs up: Explicit expression of content from the user by clicking thumbs up for a specific answer.
The Chat Consumption Rate is a metric that measures the usefulness of Tabnine chat answers. It is calculated as the ratio between the total number of times a user copied code from a chat answer and the total number of questions the user asked:
Since a user can copy code more than once from the same chat answer (for example, when the answer contains multiple code blocks), the Chat Consumption Rate can exceed 100%.
This rate can be calculated at various levels: for the entire organization, specific teams, or individual users, and across different time frames.
Note: Chat Consumption Rate data has been collected since version 5.6.0.
The total number of lines of code accepted from code completions or useful chat interactions (specifically of type "copy code").
Note: Lines of code data has been collected since version 5.7.0.
