Wizard Dev House | Wizard Dev House

This guide will walk you through setting up a Raspberry Pi cluster, including configuring static IPs, disabling Wi-Fi, enabling cgroups, and installing k3s.

Prerequisites:

Raspberry Pi boards (3 or 4 recommended)
MicroSD cards
Power supplies for each Raspberry Pi
Ethernet cables
Network switch (if using Option 2)
A computer to configure the Raspberry Pis
Raspberry Pi OS (64-bit Lite version recommended)

Step 1: Install Raspberry Pi OS

Download the Raspberry Pi OS (64-bit Lite) from the official Raspberry Pi website.
Flash the OS onto each microSD card using a tool like Raspberry Pi Imager, BalenaEtcher, or dd.

Step 2: Initial Setup (per Pi)

Insert the microSD card into a Raspberry Pi.
Connect a keyboard, mouse, and monitor (or use SSH after enabling it).
Boot up the Raspberry Pi.
Follow the initial setup prompts (change the default password, set the hostname, etc.). If you plan to use SSH, you can create an empty file named ssh in the boot partition of the SD card before booting it up for the first time. This will enable SSH.
Open a terminal.
Update and upgrade the system:
```
sudo apt update
sudo apt upgrade
```
Install dhcpcd if it's not already installed:
```
sudo apt-get install dhcpcd
```

Step 3: Set Static IP Address for the Master Node

Choose one of the following options based on your network setup:

Option 1: Each Raspberry Pi Connected to the Router
1. Open the dhcpcd.conf file:
```
sudo nano /etc/dhcpcd.conf
```
2. Add the following lines to the end of the file, replacing the placeholders:
```
interface INTERFACE_NAME
static ip_address=YOUR_STATIC_IP/24
static routers=YOUR_GATEWAY_IP
static domain_name_servers=YOUR_GATEWAY_IP # DNS same as router IP
```
  - INTERFACE_NAME: e.g., eth0 for wired, wlan0 for Wi-Fi. You'll be disabling Wi-Fi later for the master, so use eth0.
  - YOUR_STATIC_IP: e.g., 192.168.1.100. Choose an IP address outside of your router's DHCP range.
  - YOUR_GATEWAY_IP: Your router's IP address (e.g., 192.168.1.1).
3. Save and exit: Ctrl+X, then Y, then Enter.
4. Restart dhcpcd:
```
sudo systemctl restart dhcpcd
```
5. Verify the IP address:
```
ip addr
```

Option 2: Using a Network Switch

Master Node Configuration:
1. Open dhcpcd.conf:
```
sudo nano /etc/dhcpcd.conf
```
2. Add the following lines:
```
interface eth0
static ip_address=192.168.50.1/24
```
3. Save and exit.
4. Install iptables (if not installed):
```
sudo apt install iptables
```
5. Enable internet forwarding from eth1 (your internet-connected interface) to eth0 (the switch):
```
sudo iptables -t nat -A POSTROUTING -o eth1 -s 192.168.50.0/24 -j MASQUERADE
```
6. Install iptables-persistent:
```
sudo apt install iptables-persistent -y
```
7. Save current IPv4 rules (and likely No for IPv6):
8. To save iptables rules in the future:
```
sudo netfilter-persistent save
```
9. Restart the network service:
```
sudo systemctl restart dhcpcd
```
10. Reboot the Raspberry Pi:
```
sudo reboot
```

Node Configuration:

Open dhcpcd.conf:
```
sudo nano /etc/dhcpcd.conf
```

Add the following lines:

interface eth0
static ip_address=192.168.50.2/24 # Use .2 for the first node, .3 for the second, etc.
static routers=192.168.50.1      # Gateway is the master node
static domain_name_servers=192.168.50.1 8.8.8.8 # Master IP and Google DNS

Save and exit.
Check network connections:
```
ip r
```

Step 4: Disable Wi-Fi on the Master and then Nodes (optional but improves network bandwidth and security and declutters the routers network)

Open the config.txt file:
```
sudo nano /boot/config.txt 

# 64 bit version -  sudo nano /boot/firmware/config.txt
```
<aside> 💡My file on the 64bit version moved to - sudo nano /boot/firmware/config.txt</aside>
Add the following line:
```
dtoverlay=pi3-disable-wifi
```
Save and exit.
Reboot the Raspberry Pi:
```
sudo reboot
```

Step 5: Enable Cgroups (Master & Nodes)

Open the cmdline.txt file:
```
sudo nano /boot/cmdline.txt 

64 bit version - sudo nano /boot/firmware/cmdline.txt
```
<aside> 💡My file on the 64bit version moved to - sudo nano /boot/firmware/cmdline.txt</aside>

Add the following to the end of the line:

cgroup_enable=cpuset cgroup_memory=1 cgroup_enable=memory

Save and exit.
Reboot the Raspberry Pi:
```
sudo reboot
```

Step 6: Install k3s

Install k3sup:

curl -sLS <https://get.k3sup.dev> | sh
sudo install k3sup /usr/local/bin/

Master Node:

Set the MASTER_IP environment variable:
```
export MASTER_IP=YOUR_MASTER_IP
```
e.g., export MASTER_IP=192.168.50.1 ( .1 as first on the subnet if using network switch)

Install k3s:

k3sup install --ip $MASTER_IP \\
--user pi \\ # Replace with your username
--k3s-channel v1.24 \\ # Or the version you want
--local-path /tmp/config

Node(s):

Set the AGENT_IP environment variable:
```
export AGENT_IP=YOUR_NODE_IP
```
e.g., export AGENT_IP=192.168.50.2

Join the node to the cluster:

k3sup join --ip $AGENT_IP \\
--user pi \\ # Replace with your username
--server-ip $MASTER_IP \\
--k3s-channel v1.24 \\ # Or the version you want
--server-user pi # Replace with the master node username

SSH Key Issues:

If you get an SSH error, generate SSH keys on the master (if needed):
```
ssh-keygen
```
Copy the SSH key to the target Raspberry Pi:
```
ssh-copy-id -i /home/{username}/.ssh/id_rsa.pub <target_ip_address>
```
Replace username with your Raspberry Pi’s username Replace target_ip_address with the Targe Raspberry Pi’s IP Address

Configure kubectl:
- On the master node, set the KUBECONFIG environment variable:
```
export KUBECONFIG=/tmp/config
```
- Use the default context:
```
kubectl config use-context default
```