GLWS · Model runtimes

Ollama.
On your own server.

Run supported language models locally and connect applications to a model runtime.

What it is for.

Common uses of Ollama.

Common uses

  • Local model execution
  • Application integration
  • Model experimentation

Keep in mind

Model size strongly affects memory and response time. CPU-based VPS plans do not include a GPU. Restrict access to model endpoints.

Sizing and setup.

Planning examples, not official minimum requirements.

Model runtimes

Start with the whole stack.

Memory planning example
8 GB
Server environment
Linux / CPU-based VPS
Deployment method
Follow the publisher's documentation
Installed for you?
No. Your preference is saved with your configuration

Before you install

Check the current supported operating systems, deployment methods, dependencies and licence terms. What you need depends on your workload, not just the application's name.

Large datasets and busy workloads can need far more memory, storage or different hardware. Any external API or service subscriptions are separate.

Read the Ollama documentation ↗ (opens in a new tab)

Things to decide before you install Ollama.

Advice specific to this application.

A runtime needs a model-sized budget

Select a model only after reviewing its memory and storage requirements. Larger model files and parallel requests can change the capacity needed substantially. The CPU-only VPS examples here do not promise GPU acceleration or interactive performance for any specific model.

Protect the model endpoint

Identify which applications need to reach the runtime. Keep access restricted rather than exposing an unrestricted endpoint to the public network. Account for model storage and a repeatable way to recreate the configuration; model files and application data may need different backup treatment.

Get the server ready.

Linux guides that help with this setup.

A repeatable deployment.

Four steps that make the environment easier to maintain.

  1. 01

    Check requirements

    Read the publisher's instructions and choose a supported installation method.

  2. 02

    Limit access

    Protect the dashboard, credentials and network endpoints before you expose any service.

  3. 03

    Persist your data

    Work out where the application keeps its state and store it separately from replaceable runtime files.

  4. 04

    Test recovery

    Back up the data and configuration, then check that you can restore them.

A checklist to keep.

Run through it before and after you install.

glws / application planningbash

$ application-checklist --name ollama

[ ] Supported deployment method

[ ] Authentication and access restrictions

[ ] Independent data backup

[ ] Updates and restoration tested

root@glws:~#

Ollama questions.

Quick answers before you choose resources.

Does choosing this application install it?

No. The configurator only saves your application preference. It does not connect to any infrastructure or run an installer.

How much memory will I need?

Use the planning example as a starting point only. Check the publisher's requirements and measure the whole stack under a realistic workload.

Who maintains the application?

You do. Self-hosted applications need updates, configuration and recovery planning from the operator. The publisher's documentation describes supported maintenance.

Where can I learn the server basics?

The knowledge base covers Linux access, packages, services, firewalls and backups.

Similar applications.

Other tools you might run alongside or instead.

AutomationSelf-hosted

n8n

Connect services and build repeatable workflows with a self-hosted automation platform.

Explore application →