diff --git a/docs/admin/pricing.mdx b/docs/admin/pricing.mdx index 1f91442b5..5d539c874 100644 --- a/docs/admin/pricing.mdx +++ b/docs/admin/pricing.mdx @@ -48,4 +48,4 @@ A billable active Code Search or Code Intelligence Platform user is one who is s A user who has accessed a Sourcegraph product is counted as active once they complete an action that represents usage reflected above. -User counts can be found in the **Site admin** section of the Sourcegraph web application, and Cody-specific usage metrics can be found in the [Cody Analytics service](../cody/clients/enable-cody-enterprise#analytics). +User counts and more usage metrics can be found in [Sourcegraph Analytics](../analytics). diff --git a/docs/analytics/cloud.mdx b/docs/analytics/cloud.mdx new file mode 100644 index 000000000..8bf30a0c2 --- /dev/null +++ b/docs/analytics/cloud.mdx @@ -0,0 +1,18 @@ +# Sourcegraph Cloud Analytics + +The following instructions are for all Sourcegraph Cloud customers, and self-hosted customers who have upgraded to a sufficient version of Sourcegraph (5.9+) and have fully enabled usage telemetry. Customers that self-host can also view our [self-hosted analytics enablement](./self-hosted). + +![Sourcegraph-cloud-analytics](https://storage.googleapis.com/sourcegraph-assets/cloud-analytics.png) + +## Enablement instructions + +To enable Sourcegraph Analytics: + +- Create an account on [Sourcegraph Accounts](https://accounts.sourcegraph.com/), or find the email address associated with your existing account. +- Get in touch with your Sourcegraph Technical Advisor or point of contact (or email us at support@sourcegraph.com if you don't know your contact), provide them with the email address you used to register above, and ask for access to Sourcegraph Analytics. +- They will validate your account and link it to your Sourcegraph Enterprise instance's usage metrics. +- Sign in to [Sourcegraph Analytics](https://cody-analytics.sourcegraph.com). + +## Data export + +Sourcegraph Cloud Analytics also includes a CSV export option with key metrics like number of searches, chats, autocomplete suggestions, completion acceptance rate (CAR %), and more. The data is split by user, day, client/editor, and programming language; perfect for automating retrieval and analyzing data in ways that make the most sense to your organization. \ No newline at end of file diff --git a/docs/analytics/index.mdx b/docs/analytics/index.mdx new file mode 100644 index 000000000..ed1878091 --- /dev/null +++ b/docs/analytics/index.mdx @@ -0,0 +1,98 @@ +# Sourcegraph Analytics + +Enterprise customers can use Sourcegraph Analytics to get a clear view of usage, engagement, performance, and impact. + +## [Sourcegraph Cloud Analytics](/analytics/cloud) + +[Sourcegraph Cloud](/cloud) customers can use our managed [cloud analytics service](https://cody-analytics.sourcegraph.com) for Cody and Code Search usage data. +Self-hosted customers can also use this service, but they must (1) be upgraded to a sufficient version of Sourcegraph (5.9+), (2) fully enable usage telemetry. +- [Enablement instructions](/analytics/cloud#enablement) + +![Sourcegraph-cloud-analytics](https://storage.googleapis.com/sourcegraph-assets/cloud-analytics.png) + +## [Self-Hosted Analytics](/analytics/self-hosted) + +Self-hosted customers will soon also be able to use our self-hosted and locally deployed analytics service, built on Grafana, to see Sourcegraph usage data. + +This product is in development now. If you would like to learn more, please reach out to your Sourcegraph representative. + +## Metrics + +We provide a set of metrics that can be used to monitor the usage, engagement, performance, and impact of Sourcegraph inside of your enterprise. + +Learn more about how we think about [the ROI of Sourcegraph in our blog](https://sourcegraph.com/blog/measuring-the-impact-of-ai-coding-tools). + +### User metrics available + +| Metric | Description | +|--------|-------------| +| Total active users | Total number of unique users who have used any Sourcegraph product during the selected time period | +| Average daily users | The average number of unique users who use Sourcegraph per day during the selected time period | +| Average days of activity per user | The average number of days each user actively uses Sourcegraph during the selected time period | +| Daily active users | Number of unique users who used Sourcegraph, by day | +| Weekly active users | Number of unique users who used Sourcegraph, by week | +| Daily users by product | Count of daily users across different Sourcegraph products (Cody, Code Search, Code Insights, etc.) | +| Product usage distribution (by percentage of users) | Percentage breakdown of users across different Sourcegraph product groupings during the selected time period | +| Detailed user activity (top 20 users) | List of the 20 most active users during the selected time period and their usage patterns | +| Frequency of usage | Count of users who used Sourcegraph _n_ times over the past 30 days | + +Cody-only user metrics + +Many of the metrics above are also available for Cody only. However, some user definitions are slightly different: + +| User category | Description | +|---------------|-------------| +| Authenticated users | All users who are signed in to Cody in an editor or interact with Cody on the web, during the period selected. [Read more](/admin/pricing#authenticated-users). | +| Active users | All users who sign in to Cody in an editor or interact with Cody on the web, during the period selected. [Read more](/admin/pricing#billable-active-users). | + +### Code Search & navigation metrics + +| Metric | Description | +|--------|-------------| +| Total in-product searchers | Number of unique users who performed searches using the Sourcegraph search interface during the selected time period | +| Total result clicks | Count of times users clicked on search results to view files or other resources during the selected time period | +| Total file views | Number of times users viewed individual files through Sourcegraph during the selected time period | +| Daily in-product search activity | Count of search operations performed each day through the Sourcegraph interface | +| Daily search users (in-product and API) | Number of unique users performing searches each day, including both UI and API usage | +| All searches (in-product and API) by type | Breakdown of searches by category (e.g., literal, regex), including both UI and API usage | +| Total code navigation actions | Count of all code navigation operations performed (e.g., go-to-definition, find references) during the selected time period | +| Precise code navigation % | Percentage of code navigation actions that used precise intelligence rather than search-based results, during the selected time period | +| Daily code navigation activity | Count of code navigation operations performed each day | +| Daily code navigation users | Number of unique users utilizing code navigation features each day | +| Precise vs search-based code navigation actions by language | Comparison of precise vs search-based navigation success rates broken down by programming language | + +### Autocompletion metrics + +| Metric | Description | +|--------|-------------| +| Total accepted completions | Count of completions accepted by users during the selected time period | +| Hours saved | The number of hours saved by Cody users, assuming 2 minutes saved per completion | +| Completions by day | The number of completions suggested by day and by editor. | +| Completion acceptance rate (CAR) | The percent of completions presented to a user for at least 750ms that were accepted by day, by editor, by day and by month. | +| Weighted completion acceptance rate (wCAR) | Similar to CAR, but weighted by the number of characters presented in the completion, and only counting those that were fully retained by the user for X minutes after accepting the completion, by editor, by day and by month. | +| Average completion latency (ms) | The average milliseconds of latency before a user is presented with a completion suggestion, by editor. | +| Acceptance rate by language | CAR and total completion suggestions broken down by editor, during the selected time period | + +### Chat and prompt metrics + +| Metric | Description | +|--------|-------------| +| Total chat events | Total number of chat interactions with Cody during the selected time period | +| Minutes saved per chat | Average time saved per chat interaction with Cody during the selected time period | +| Hours saved by chats | Total hours saved through Cody chat interactions during the selected time period, assuming 5 minutes saved per chat | +| Cody chats by day | Daily count of chat interactions | +| Cody chat users | Daily count of chat users | +| Prompts created, edited, deleted by day | Daily count of prompt management activities, including creation, modification, and removal | +| Users creating, editing, deleting prompts by day | Number of unique users performing prompt management activities each day | + +### Command metrics (deprecated) + +_As of Sourcegraph version 5.10, commands are being deprecated in favor of our new feature, chat prompts. As a result, if your Sourcegraph instance is running version 5.10 or later, you may see decreased command usage. In the coming weeks these command metrics will be deprecated and replaced with new prompt metrics on the Chats tab._ + +| Metric | Description | +|--------|-------------| +| Total command events | Total number of command executions during the selected time period | +| Hours saved by commands | Total hours saved through command executions during the selected time period, assuming 5 minutes saved per command | +| Cody commands by day | Daily count of command executions | +| Cody command users | Daily count of command users | +| Most used commands | Ranking of most frequently used Cody commands during the selected time period | \ No newline at end of file diff --git a/docs/analytics/self-hosted.mdx b/docs/analytics/self-hosted.mdx new file mode 100644 index 000000000..af34b4979 --- /dev/null +++ b/docs/analytics/self-hosted.mdx @@ -0,0 +1,17 @@ +# Sourcegraph Self-Hosted Analytics (coming soon) + +Sourcegraph Self-Hosted Analytics is coming soon! Self-hosted customers will be able to view usage metrics in a locally deployed analytics service, built on Grafana. + +This product is in development now. If you would like to learn more, please reach out to your Sourcegraph representative. + +## Set-up instructions + +Coming soon. + +## Updates + +Coming soon. + +## Custom metrics + +Coming soon. diff --git a/src/data/navigation.ts b/src/data/navigation.ts index d01a75831..7ba9e9a95 100644 --- a/src/data/navigation.ts +++ b/src/data/navigation.ts @@ -256,6 +256,15 @@ export const navigation: NavigationItem[] = [ { title: "Pricing", href: "/admin/pricing" }, ], }, + { + title: "Sourcegraph Analytics", + href: "/analytics", + sections: [ + { title: "Metrics", href: "/analytics#metrics" }, + { title: "Cloud Analytics", href: "/analytics/cloud" }, + { title: "Self-hosted Analytics (coming soon)", href: "/analytics/self-hosted" }, + ], + }, { title: "Sourcegraph Cloud", href: "/cloud",