apt-get update && apt-get upgrade -y
apt-get install net-tools
sudo adduser username
Replace username with your desired username.
You will be prompted to set a password and provide optional user information.
sudo usermod -aG sudo username
Add The user to the sudo group
setup ssh
sudo mkdir -p /home/username/.ssh
sudo chmod 700 /home/username/.ssh
sudo chown username:username /home/username/.ssh
Enable Bash Completion
sudo apt update
sudo apt install -y bash-completion
Add bash completion to the user's .bashrc:
echo "source /usr/share/bash-completion/bash_completion" >> /home/username/.bashrc
Reload the .bashrc for the user:
sudo su - username -c "source ~/.bashrc"
Now Lets Install Ollama and open webgui inside the proxmox container
First we Install some Basic Tools
sudo apt install -y curl wget git unzip build-essential python3 python3-pip
Ollama requires Node.js. You can install it without Docker as follows
curl -fsSL https://deb.nodesource.com/setup_18.x | sudo -E bash -
sudo apt install -y nodejs
Install Ollama: Ollama provides a binary for manual installation:
curl -fsSL https://ollama.com/install.sh | sh
Lets Check it's working
ollama list
Let Get our first Model
ollama pull llama3.2
Let's check it worked
ollama list
Head over to https://ollama.com/search to see a full list of available Models