AI Work Environment

An AI-first work environment using only OSS tools and local LLMs

What do we need?

• Docker (Desktop) (https://www.docker.com/products/docker-desktop/)
• Docker Compose (Now included as part of Docker desktop)
• Anaconda (https://www.anaconda.com/download)
• NVIDIA Container Toolkit (https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html)

Tabby

https://tabby.tabbyml.com/docs/installation/docker-compose Use this for Cuda