Book Overview

This book is divided into four main parts, each focusing on a different aspect of setting up and managing a Kubernetes infrastructure for LLM applications:

Part One: Setting Up the Host - Covers initial server setup, user creation, SSH configuration, and LXD installation and configuration. This section provides the foundation for your Kubernetes environment.

Part Two: Setting Up Containers and Kubernetes - Walks through creating LXC containers, installing MicroK8s, configuring storage with OpenEBS ZFS, and setting up networking with MetalLB.

Part Three: Test Deployments - Provides guidance on testing your Kubernetes setup with sample deployments, including ingress services and Cloudflared for secure external access.

Part Four: LLM Deployments - Focuses on deploying and managing LLM applications on your Kubernetes cluster, including setting up a local registry for worker nodes.