Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(rosetta): Local cluster setup for Rosetta #3485

Merged
merged 12 commits into from
Jan 24, 2025

Conversation

fsodre
Copy link
Contributor

@fsodre fsodre commented Jan 16, 2025

This PR introduces a script that manages a local kubernetes set up that runs Rosetta (icp and icrc) with prod images as well as locally built images.
The cluster also provides a Grafana instance connected to the rosetta nodes that allows us to easily track system utilization (CPU, Memory, IO) as well as other custom metrics.

The intent is to have a quick way to investigate issues and visualize the impact of local changes against the prod versions.

See the README.md file for more details.

@fsodre fsodre requested a review from a team as a code owner January 16, 2025 18:50
@github-actions github-actions bot added the feat label Jan 16, 2025
Copy link
Member

@mbjorkqvist mbjorkqvist left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks a lot for working on this @fsodre, I can see that it has the potential to be incredibly useful! I left some initial comments based on running ./deploy.sh and eyeballing the PR, I'll come back with more feedback once I've had some time to look around in Grafana and syncing against the different ledgers.

rs/rosetta-api/local/cluster/README.md Outdated Show resolved Hide resolved
rs/rosetta-api/local/cluster/README.md Outdated Show resolved Hide resolved
rs/rosetta-api/local/cluster/README.md Show resolved Hide resolved
rs/rosetta-api/local/cluster/deploy.sh Outdated Show resolved Hide resolved
Copy link
Member

@mbjorkqvist mbjorkqvist left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks again for working on this @fsodre, and thanks for your patience with my slow review! Since you're still working on related improvements I'll approve this now to unblock you, and if I later spot any things that could be changed, we can iterate in subsequent PRs.

rs/rosetta-api/local/cluster/rosetta_load_dashboard.json Outdated Show resolved Hide resolved
@fsodre fsodre enabled auto-merge January 22, 2025 10:48
@fsodre fsodre added this pull request to the merge queue Jan 24, 2025
Merged via the queue into master with commit c22d478 Jan 24, 2025
25 checks passed
@fsodre fsodre deleted the fsodre/rosetta-local-cluster branch January 24, 2025 10:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants