Skip to content

Commit

Permalink
Note regarding mega nodes
Browse files Browse the repository at this point in the history
  • Loading branch information
Tejeev authored Jan 25, 2022
1 parent 5f2b72d commit f674d89
Showing 1 changed file with 8 additions and 0 deletions.
8 changes: 8 additions & 0 deletions content/rke/latest/en/os/_index.md
Original file line number Diff line number Diff line change
Expand Up @@ -289,6 +289,14 @@ Confirm that a Kubernetes supported version of Docker is installed on your machi

This section describes the hardware requirements for the worker role, large Kubernetes clusters, and etcd clusters.

---
*NOTE regarding large nodes for Kubernetes*
Kubernetes is engineered around the concept of horizontal scaling for redundancy so scaling vertically with large nodes can be very problematic
- If you must use nodes larger than 24 CPU, utilize virtualization tooling such as Harvester to subdivide the nodes.
- There are Kubernetes, kernel, and network limitations that prohibit too many pods per node so we advise keeping to roughly 24 cores per node and the recommended 100 pods per node as a maximum unless you are deploying workloads that specifically require enormous amounts of resources (such as multi threaded heavy compute jobs) or have good reason to increase the pod limit (with an upper limit of 250).
- Even when deploying workloads like the above, it is recommended to use a virtualization layer to facilitate less downtime/shorter reboots during upgrades and failures
---

### Worker Role

The hardware requirements for nodes with the `worker` role mostly depend on your workloads. The minimum to run the Kubernetes node components is 1 CPU (core) and 1GB of memory.
Expand Down

0 comments on commit f674d89

Please sign in to comment.