-
Notifications
You must be signed in to change notification settings - Fork 43
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
4 changed files
with
77 additions
and
34 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,6 +1,8 @@ | ||
| # Sourcegraph Analytics for Cloud customers | ||
| # Sourcegraph Cloud Analytics | ||
|
|
||
| The following instructions are for Sourcegraph Cloud customers only. Customers that self-host can view our [self-hosted analytics enablement](./self-hosted). | ||
| The following instructions are for all Sourcegraph Cloud customers, and self-hosted customers who have upgraded to a sufficient version of Sourcegraph (5.9+) and have fully enabled usage telemetry. Customers that self-host can also view our [self-hosted analytics enablement](./self-hosted). | ||
|
|
||
|  | ||
|
|
||
| ## Enablement instructions | ||
|
|
||
|
|
@@ -9,4 +11,4 @@ To enable Sourcegraph Analytics: | |
| - Create an account on [Sourcegraph Accounts](https://accounts.sourcegraph.com/), or find the email address associated with your existing account. | ||
| - Get in touch with your Sourcegraph Technical Advisor or point of contact (or email us at [email protected] if you don't know your contact), provide them with the email address you used to register above, and ask for access to Sourcegraph Analytics. | ||
| - They will validate your account and link it to your Sourcegraph Enterprise instance's usage metrics. | ||
| - Sign in to [Sourcegraph Analytics](https://analytics.sourcegraph.com). | ||
| - Sign in to [Sourcegraph Analytics](https://cody-analytics.sourcegraph.com). | ||
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,59 +1,98 @@ | ||
| # Sourcegraph Analytics | ||
|
|
||
| Enterprise customers can use Sourcegraph Analytics to get a clear view of usage, engagement, performance, and impact on a self-serve basis. | ||
| Enterprise customers can use Sourcegraph Analytics to get a clear view of usage, engagement, performance, and impact. | ||
|
|
||
| ## [For Sourcegraph Cloud customers](/analytics/cloud) | ||
| ## [Sourcegraph Cloud Analytics](/analytics/cloud) | ||
|
|
||
| [Sourcegraph Cloud](/cloud) customers can use our managed [cloud analytics service](https://analytics.sourcegraph.com) for Cody and Code Search usage data. | ||
| [Sourcegraph Cloud](/cloud) customers can use our managed [cloud analytics service](https://cody-analytics.sourcegraph.com) for Cody and Code Search usage data. | ||
| Self-hosted customers can also use this service, but they must (1) be upgraded to a sufficient version of Sourcegraph (5.9+), (2) fully enable usage telemetry. | ||
| - [Enablement instructions](/analytics/cloud#enablement) | ||
|
|
||
|  | ||
|
|
||
| ## [For self-hosted customers](/analytics/self-hosted) | ||
| ## [Self-Hosted Analytics](/analytics/self-hosted) | ||
|
|
||
| Self-hosted customers can use our self-hosted and locally deployed analytics service, built on Grafana, to see Cody and Code Search usage data. | ||
| Self-hosted customers will soon also be able to use our self-hosted and locally deployed analytics service, built on Grafana, to see Sourcegraph usage data. | ||
|
|
||
| - [Set up instructions](/analytics/self-hosted#set-up) | ||
| - [Updates](/analytics/self-hosted#updates) | ||
| - [Custom metrics](/analytics/self-hosted#custom-metrics) | ||
|
|
||
|  | ||
| This product is in development now. If you would like to learn more, please reach out to your Sourcegraph representative. | ||
|
|
||
| ## Metrics | ||
|
|
||
| We provide a set of metrics that can be used to monitor the usage, engagement, performance, and impact of Sourcegraph inside of your enterprise. | ||
|
|
||
| Learn more about how we think about [the ROI of Sourcegraph in our blog](https://sourcegraph.com/blog/measuring-the-impact-of-ai-coding-tools). | ||
|
|
||
| ### Summary metrics | ||
|
|
||
| Summary metrics are not yet available. | ||
| ### User metrics available | ||
|
|
||
| ### Code Search metrics | ||
| | Metric | Description | | ||
| |--------|-------------| | ||
| | Total active users | Total number of unique users who have used any Sourcegraph product during the selected time period | | ||
| | Average daily users | The average number of unique users who use Sourcegraph per day during the selected time period | | ||
| | Average days of activity per user | The average number of days each user actively uses Sourcegraph during the selected time period | | ||
| | Daily active users | Number of unique users who used Sourcegraph, by day | | ||
| | Weekly active users | Number of unique users who used Sourcegraph, by week | | ||
| | Daily users by product | Count of daily users across different Sourcegraph products (Cody, Code Search, Code Insights, etc.) | | ||
| | Product usage distribution (by percentage of users) | Percentage breakdown of users across different Sourcegraph product groupings during the selected time period | | ||
| | Detailed user activity (top 20 users) | List of the 20 most active users during the selected time period and their usage patterns | | ||
| | Frequency of usage | Count of users who used Sourcegraph _n_ times over the past 30 days | | ||
|
|
||
| Cody-only user metrics | ||
|
|
||
| Many of the metrics above are also available for Cody only. However, some user definitions are slightly different: | ||
|
|
||
| | User category | Description | | ||
| |---------------|-------------| | ||
| | Authenticated users | All users who are signed in to Cody in an editor or interact with Cody on the web, during the period selected. [Read more](/admin/pricing#authenticated-users). | | ||
| | Active users | All users who sign in to Cody in an editor or interact with Cody on the web, during the period selected. [Read more](/admin/pricing#billable-active-users). | | ||
|
|
||
| Code Search metrics are not yet available. | ||
| ### Code Search & navigation metrics | ||
|
|
||
| ### Cody user metrics | ||
| | Metric | Description | | ||
| |--------|-------------| | ||
| | Total in-product searchers | Number of unique users who performed searches using the Sourcegraph search interface during the selected time period | | ||
| | Total result clicks | Count of times users clicked on search results to view files or other resources during the selected time period | | ||
| | Total file views | Number of times users viewed individual files through Sourcegraph during the selected time period | | ||
| | Daily in-product search activity | Count of search operations performed each day through the Sourcegraph interface | | ||
| | Daily search users (in-product and API) | Number of unique users performing searches each day, including both UI and API usage | | ||
| | All searches (in-product and API) by type | Breakdown of searches by category (e.g., literal, regex), including both UI and API usage | | ||
| | Total code navigation actions | Count of all code navigation operations performed (e.g., go-to-definition, find references) during the selected time period | | ||
| | Precise code navigation % | Percentage of code navigation actions that used precise intelligence rather than search-based results, during the selected time period | | ||
| | Daily code navigation activity | Count of code navigation operations performed each day | | ||
| | Daily code navigation users | Number of unique users utilizing code navigation features each day | | ||
| | Precise vs search-based code navigation actions by language | Comparison of precise vs search-based navigation success rates broken down by programming language | | ||
|
|
||
| ### Autocompletion metrics | ||
|
|
||
| | Metric | Description | | ||
| |--------|-------------| | ||
| | Authenticated users | All users who sign in to Cody in an editor or interact with Cody on the web, during the period selected. [Read more](/admin/pricing#authenticated-users). | | ||
| | Active users | All users who sign in to Cody in an editor or interact with Cody on the web, during the period selected. [Read more](/admin/pricing#billable-active-users). | | ||
| | Frequency of Usage | Count of users who used Cody n times over the past 30 days. | | ||
| | Total accepted completions | Count of completions accepted by users during the selected time period | | ||
| | Hours saved | The number of hours saved by Cody users, assuming 2 minutes saved per completion | | ||
| | Completions by day | The number of completions suggested by day and by editor. | | ||
| | Completion acceptance rate (CAR) | The percent of completions presented to a user for at least 750ms that were accepted by day, by editor, by day and by month. | | ||
| | Weighted completion acceptance rate (wCAR) | Similar to CAR, but weighted by the number of characters presented in the completion, and only counting those that were fully retained by the user for X minutes after accepting the completion, by editor, by day and by month. | | ||
| | Average completion latency (ms) | The average milliseconds of latency before a user is presented with a completion suggestion, by editor. | | ||
| | Acceptance rate by language | CAR and total completion suggestions broken down by editor, during the selected time period | | ||
|
|
||
| ### Cody completion metrics | ||
| ### Chat and prompt metrics | ||
|
|
||
| | Metric | Description | | ||
| |--------|-------------| | ||
| | Hour saved | The number of hours saved by Cody users, assuming 2 minutes saved per completion. | | ||
| | Completions and completion users | The number of completions suggested and users who were presented with a completion suggestion. | | ||
| | Completion acceptance rate (CAR) | The percent of completions presented to a user for at least 750ms that were accepted. | | ||
| | Weighted completion acceptance rate (wCAR) | Similar to CAR, but weighted by the number of characters presented in the completion, and only counting those that were fully retained by the user for X minutes after accepating the completion. | | ||
| | Average completion latency (ms) | The average milliseconds of latency before a user is presented with a completion suggestion. | | ||
| | Total chat events | Total number of chat interactions with Cody during the selected time period | | ||
| | Minutes saved per chat | Average time saved per chat interaction with Cody during the selected time period | | ||
| | Hours saved by chats | Total hours saved through Cody chat interactions during the selected time period, assuming 5 minutes saved per chat | | ||
| | Cody chats by day | Daily count of chat interactions | | ||
| | Cody chat users | Daily count of chat users | | ||
| | Prompts created, edited, deleted by day | Daily count of prompt management activities, including creation, modification, and removal | | ||
| | Users creating, editing, deleting prompts by day | Number of unique users performing prompt management activities each day | | ||
|
|
||
| ### Command metrics (deprecated) | ||
|
|
||
| ### Cody chat metrics | ||
| _As of Sourcegraph version 5.10, commands are being deprecated in favor of our new feature, chat prompts. As a result, if your Sourcegraph instance is running version 5.10 or later, you may see decreased command usage. In the coming weeks these command metrics will be deprecated and replaced with new prompt metrics on the Chats tab._ | ||
|
|
||
| | Metric | Description | | ||
| |--------|-------------| | ||
| | Hour saved | The number of hours saved by Cody users, assuming 5 minutes saved per completion. | | ||
| | Chats and chat users | The number of chats and users who chatted with Cody. | | ||
| | Total command events | Total number of command executions during the selected time period | | ||
| | Hours saved by commands | Total hours saved through command executions during the selected time period, assuming 5 minutes saved per command | | ||
| | Cody commands by day | Daily count of command executions | | ||
| | Cody command users | Daily count of command users | | ||
| | Most used commands | Ranking of most frequently used Cody commands during the selected time period | |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters