Linux

Self-Host n8n, Ollama & Qdrant on Ubuntu Server (2026)

TechYXE Team
9 min read

More Saskatoon businesses and tech-curious people are asking us the same question lately: can I run AI tools and automation on my own server instead of paying monthly cloud fees? The answer is yes, and the setup is more accessible than you might think.

In this guide, I will walk you through installing Ubuntu Server and setting up three powerful self-hosted tools: n8n for workflow automation, Ollama for running AI models locally, and Qdrant as a vector database for Retrieval-Augmented Generation (RAG). You can even host your own website on the same machine. These are the same tools and steps our software installation team uses when setting up self-hosted stacks for clients here in Saskatoon.

Self-hosting gives you full control over your data, eliminates recurring API costs, and lets you run AI workflows entirely on your own hardware — no cloud subscription required.

Why Ubuntu Server Is the Right Foundation

Ubuntu Server is the most widely used Linux distribution for servers, and for good reason. It is free, stable, and backed by a massive community. When something goes wrong, you can find a solution in minutes because millions of people run the same system. Canonical provides long-term support (LTS) releases with five years of security updates, so you are not constantly rebuilding your setup.

For self-hosting n8n, Ollama, and Qdrant, Ubuntu Server is ideal because all three tools have first-class Linux support. Docker runs smoothly on Ubuntu, and most installation guides assume you are using it. If you have ever considered switching to Linux on a desktop, Ubuntu Server is the natural next step for running services that stay on 24/7.

  • Free and open source: No licensing fees, ever.
  • LTS releases: Ubuntu 24.04 LTS is supported until 2029.
  • Docker-ready: Clean Docker and Docker Compose support out of the box.
  • Huge community: Troubleshooting help is always a search away.

Installing Ubuntu Server

Start by downloading the latest Ubuntu Server LTS image from the official Ubuntu website. Flash it to a USB drive using a tool like Balena Etcher or Rufus, then boot your target machine from the USB. The installer walks you through language, network, storage, and user setup in a straightforward text interface.

Key steps during installation:

  1. Choose minimal install: Skip the desktop environment. A server does not need a GUI, and skipping it saves resources for your actual workloads.
  2. Enable OpenSSH: Check the OpenSSH server option during setup so you can manage the server remotely from any computer on your network.
  3. Set a static IP: Configure a static IP address in your router or during Ubuntu's network setup. Your services need a consistent address.
  4. Update immediately: After first boot, run sudo apt update && sudo apt upgrade -y to pull in the latest security patches.
  5. Install Docker: Run sudo apt install docker.io docker-compose-v2 -y and add your user to the docker group with sudo usermod -aG docker $USER.

Once Docker is running, you have the foundation for everything else. Our OS installation service covers this entire process if you would rather have it done right the first time — flat $49, no surprises.

Set Up n8n for Workflow Automation

n8n is a workflow automation platform similar to Zapier or Make, but you own it completely. It connects apps, moves data between services, and triggers actions based on events — all through a visual drag-and-drop editor. For Saskatoon businesses, self-hosting n8n means your automation data never leaves your server.

Quick Docker setup:

Create a directory for n8n and launch it with Docker Compose. A basic docker-compose.yml file needs just the n8n image, a volume for persistent data, and port 5678 exposed. Once running, open http://your-server-ip:5678 in a browser to access the visual workflow editor.

  • Connect anything: n8n has 400+ integrations — email, spreadsheets, databases, APIs, and more.
  • Schedule workflows: Run tasks on a timer, on webhook triggers, or when files change.
  • AI-ready: n8n includes built-in nodes for Ollama and vector databases, which we will use later for RAG.
  • No per-task fees: Unlike cloud automation tools, self-hosted n8n has no execution limits.

If workflow automation is new to you, start simple. Automate a daily email summary, sync form submissions to a spreadsheet, or send Slack alerts when something changes. You can build more advanced AI workflows once the basics are solid.

Host a Website on Your Server

Your Ubuntu Server can also serve websites. For most small business sites, a reverse proxy like Caddy or Nginx handles HTTPS certificates automatically and routes traffic to your applications. Caddy is especially easy — point your domain's DNS to your server's public IP, and Caddy obtains and renews SSL certificates from Let's Encrypt without extra configuration.

Self-hosting works well for custom web apps, internal dashboards, and staging environments. For public-facing business websites, however, a CDN-backed hosting provider often delivers better speed and uptime. If you are choosing between self-hosting and managed hosting, our guide on choosing website hosting breaks down the tradeoffs clearly.

  • Caddy: Automatic HTTPS, simple config file, great for small deployments.
  • Nginx: More control, widely documented, best for complex routing.
  • Static sites: Tools like Astro, Hugo, or Next.js export static files that any web server can handle instantly.
  • Dynamic apps: WordPress, Ghost, or custom Node.js apps run behind your reverse proxy.

Need a professional website built for your Saskatoon business? Our website development service starts at $199 and includes SEO optimization so local customers can find you online.

Run Local AI With Ollama

Ollama makes running large language models on your own hardware surprisingly simple. Instead of paying per API call to OpenAI or Anthropic, you download a model once and run it locally as many times as you want. For businesses handling sensitive documents or private customer data, this means your information never leaves your server.

Getting started:

  1. Install Ollama: Run the one-line installer: curl -fsSL https://ollama.com/install.sh | sh
  2. Pull a model: Start with a capable, efficient model like ollama pull llama3.1:8b or try ollama pull gemma3:4b for lighter hardware.
  3. Test it: Run ollama run llama3.1:8b to chat directly in the terminal and verify everything works.
  4. API access: Ollama exposes a local API at http://localhost:11434 that n8n and other tools can call directly.

A machine with 16 GB of RAM can comfortably run 7-8 billion parameter models. If you have a dedicated GPU, larger models like Llama 3.1 70B become practical. Even without a GPU, CPU inference on modern processors is usable for many automation tasks.

Add Qdrant for RAG and Vector Search

Qdrant is a vector database purpose-built for similarity search. In a RAG setup, it stores document embeddings — numerical representations of your text — and retrieves the most relevant chunks when a user asks a question. Think of it as giving your AI model a searchable memory of your own documents, manuals, or knowledge base.

Deploy with Docker:

Add Qdrant to your Docker Compose file alongside n8n. Expose port 6333 for the API and port 6334 for the gRPC interface. Qdrant starts quickly and includes a built-in web dashboard at http://your-server-ip:6333/dashboard where you can browse collections and test queries.

  • Fast vector search: Qdrant handles millions of vectors efficiently, even on modest hardware.
  • Simple API: REST and gRPC interfaces make integration straightforward from n8n or custom code.
  • Filtering: Combine vector similarity with metadata filters for precise retrieval.
  • Persistent storage: Mount a Docker volume so your vectors survive container restarts.

Putting It Together: Your Self-Hosted RAG Pipeline

With all three tools running, you can build a complete RAG pipeline that answers questions using your own documents — entirely on your server. Here is how the pieces connect:

  1. Ingest documents: Use an n8n workflow to read PDFs, web pages, or text files and split them into chunks.
  2. Generate embeddings: Send each chunk to Ollama's embedding endpoint (using a model like nomic-embed-text) to create vector representations.
  3. Store in Qdrant: Push the embeddings and original text into a Qdrant collection for fast retrieval.
  4. Query with context: When a question comes in, embed the question, search Qdrant for relevant chunks, and pass them to Ollama along with the question for a grounded answer.

n8n ties everything together visually. You can trigger this pipeline from a webhook, a chat interface, an email, or a scheduled job. The result is a private AI assistant that knows your business documents and runs without ongoing API costs.

This kind of setup is especially valuable for Saskatoon businesses that handle sensitive client information, internal procedures, or technical documentation. Instead of uploading proprietary data to a third-party AI service, everything stays on hardware you control.

Need Help Setting This Up in Saskatoon?

If this guide sounds useful but you would rather have someone handle the setup, TechYXE does exactly this for Saskatoon businesses and individuals. Our software installation service covers n8n, Ollama, Qdrant, Docker, and any other self-hosted tools you need configured and running.

What we can set up for you:

  • Ubuntu Server installation — our OS installation service is a flat $49 including full system setup and SSH access.
  • n8n workflow automation — installed, secured, and configured with your first workflows starting from $19.
  • Ollama + AI models — installed with the right models for your hardware and use case.
  • Qdrant vector database — deployed with persistent storage and ready for your document pipeline.
  • RAG pipeline setup — the full workflow connected end-to-end so you can start querying your documents immediately.
  • Website hosting — if you want to host your site on the same server, we configure the reverse proxy and SSL too.

Already have a business that needs a professional online presence? Our website development service starts at $199 and pairs perfectly with a self-hosted automation stack.

Contact us today and we will scope out the right self-hosted setup for your needs — no cloud lock-in, no recurring AI fees.

TechYXE

About TechYXE Team

The TechYXE team provides expert software and technology services in Saskatoon, Saskatchewan. With years of experience in web development, workflow automation, and software solutions, we share practical tips to help you get the most out of your technology.

Learn more about us

Related Articles

Need Professional Software Support?

Whether it's website development, workflow automation, software troubleshooting, or data recovery, we're here to help. Serving Saskatoon with professional, expert software services.