A simple kubernetes cluster using Fedora Core OS, Proxmox and k0sctl.
Client refers to the node that will be executing terraform apply to create the cluster.
| Dependency | Location |
|---|---|
| Proxmox | Proxmox node |
| xz | Proxmox node & Client |
| jq | Client |
| Terraform | Client |
| k0sctl | Client |
The variables needed to configure this script are documented in this doc.
cp terraform.tfvars.example terraform.tfvars
# Edit and save the variables according to your liking
vim terraform.tfvars
In the proxmox web portal, go to Datacenter > Storage > Click on local > Edit > Under Content choose Snippets > Click on OK to save.
terraform init -upgrade
# You don't need to run the next command if you're using this repo for the 1st time
# Only do this if you don't want to reuse the older coreos image existing in the current dir
rm coreos.qcow2
terraform plan
# WARNING: The next command will override ~/.kube/config. Make a backup if needed.
terraform apply --auto-approve
The created VMs will reboot twice before qemu-guest-agent is able to detect their IP addresses. This can take anywhere from 2-5 mins depending on your hardware.
It is possible to expose your cluster to the internet over a small vps even if both your vps and your public ips are dynamic. This is possible by setting up dynamic dns for both your internal network and the vps using something like duckdns and a docker container to regularly monitor the IP addresses on both ends. A connection can be then made using wireguard to traverse the network between these 2 nodes. This way you can hide your public IP while exposing services to the internet.
Project Link: wireguard-k8s-lb (This is one possible implementation)
ansible-playbook -i hosts poweroff.yaml
haproxy -c -f /etc/haproxy/haproxy.cfg
There is a branch named 'kvm' in the repo that has steps to create a similar cluster using the 'dmacvicar/libvirt' provider. I won't be maintaining that branch - but it can be used as a frame of reference for someone who wants to create a Core OS based k8s cluster in their homelab.