docs(services): add Ollama iGPU (Radeon 780M / ROCm) entry
ci/woodpecker/push/woodpecker Pipeline was successful
ci/woodpecker/push/woodpecker Pipeline was successful
- Document ollama migrated to Dockge stack on ollama/ollama:rocm with gfx1103 enablement (HSA_OVERRIDE_GFX_VERSION=11.0.0, OLLAMA_IGPU_ENABLE=1) - Verified Ornith 1.0 9B runs 100% on the 780M iGPU (~11 tok/s) - CHANGELOG entry for 2026-06-29 - (also includes previously-uncommitted Development services section already present in the working tree) Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
This commit is contained in:
+66
-13
@@ -1,6 +1,6 @@
|
|||||||
# Other Services
|
# Other Services
|
||||||
|
|
||||||
**Last Updated:** 2026-05-05
|
**Last Updated:** 2026-06-29
|
||||||
|
|
||||||
Non-critical services that enhance functionality but don't affect core network operation.
|
Non-critical services that enhance functionality but don't affect core network operation.
|
||||||
|
|
||||||
@@ -308,18 +308,6 @@ Non-critical services that enhance functionality but don't affect core network o
|
|||||||
|
|
||||||
**Purpose:** Mesh VPN for remote access
|
**Purpose:** Mesh VPN for remote access
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## AI / LLM
|
|
||||||
|
|
||||||
### Ollama
|
|
||||||
|
|
||||||
| Component | Port |
|
|
||||||
|-----------|------|
|
|
||||||
| ollama | 11434 |
|
|
||||||
|
|
||||||
**Purpose:** Local LLM inference server
|
|
||||||
|
|
||||||
### Open WebUI
|
### Open WebUI
|
||||||
|
|
||||||
| Component | Port |
|
| Component | Port |
|
||||||
@@ -415,6 +403,42 @@ Non-critical services that enhance functionality but don't affect core network o
|
|||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
|
## Development
|
||||||
|
|
||||||
|
### OpenVSCode Server (Web IDE)
|
||||||
|
|
||||||
|
| Network | Port | URL |
|
||||||
|
|---------|------|-----|
|
||||||
|
| host | 3100 | https://code.xtrm-lab.org |
|
||||||
|
|
||||||
|
**Purpose:** Web-based VS Code IDE with full host access
|
||||||
|
**Auth:** Authentik forward auth (SSO)
|
||||||
|
**Binary:** `/mnt/user/appdata/openvscode/current/` (host-native, not a container)
|
||||||
|
**Config:** `/mnt/user/appdata/openvscode/config/`
|
||||||
|
**Workspace:** `/mnt/user/projects/` (12 personal repos + 18 AMPECO projects)
|
||||||
|
**See:** `12-DEVELOPMENT-ENVIRONMENT.md`
|
||||||
|
|
||||||
|
### Claude Code
|
||||||
|
|
||||||
|
| Network | Version |
|
||||||
|
|---------|---------|
|
||||||
|
| host | 2.1.71 |
|
||||||
|
|
||||||
|
**Purpose:** AI coding assistant CLI
|
||||||
|
**Binary:** `/mnt/user/appdata/claude-code/.npm-global/bin/claude`
|
||||||
|
**Config:** `/mnt/user/appdata/claude-code/.claude/`
|
||||||
|
|
||||||
|
### Cooperator CLI
|
||||||
|
|
||||||
|
| Network | Version |
|
||||||
|
|---------|---------|
|
||||||
|
| host | 3.36.1 |
|
||||||
|
|
||||||
|
**Purpose:** AI-driven development workflow automation (AMPECO)
|
||||||
|
**Binary:** `/usr/local/lib/node_modules/@ampeco/cooperator/`
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
## Container Management
|
## Container Management
|
||||||
|
|
||||||
### Dockge
|
### Dockge
|
||||||
@@ -466,6 +490,35 @@ Non-critical services that enhance functionality but don't affect core network o
|
|||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
|
## AI / LLM
|
||||||
|
|
||||||
|
### Ollama (Local LLM Inference)
|
||||||
|
|
||||||
|
| Network | Port |
|
||||||
|
|---------|------|
|
||||||
|
| bridge | 11434 |
|
||||||
|
|
||||||
|
**Purpose:** Local LLM inference, GPU-accelerated on the integrated AMD Radeon 780M (gfx1103) via ROCm 7.2.
|
||||||
|
**Image:** `ollama/ollama:rocm` (Dockge stack — replaced old `dockerman` template `my-ollama.xml`)
|
||||||
|
**API:** http://192.168.10.20:11434
|
||||||
|
**Data:** `/mnt/user/appdata/ollama`
|
||||||
|
**Stack:** `/mnt/user/appdata/dockge/stacks/ollama/compose.yaml`
|
||||||
|
|
||||||
|
**iGPU enablement** (gfx1103 not on AMD's official ROCm allowlist):
|
||||||
|
|
||||||
|
| Setting | Value |
|
||||||
|
|---------|-------|
|
||||||
|
| `HSA_OVERRIDE_GFX_VERSION` | 11.0.0 (report 780M as gfx1100) |
|
||||||
|
| `OLLAMA_IGPU_ENABLE` | 1 (Ollama 0.30+ drops iGPUs otherwise) |
|
||||||
|
| `OLLAMA_FLASH_ATTENTION` | 1 |
|
||||||
|
| `OLLAMA_KV_CACHE_TYPE` | q8_0 |
|
||||||
|
| devices | `/dev/kfd`, `/dev/dri` |
|
||||||
|
| group_add | `18` (video) |
|
||||||
|
|
||||||
|
**Verified:** Ornith 1.0 9B GGUF runs 100% on GPU (33/33 layers), ~11 tok/s. iGPU is RAM-bandwidth bound (shared GTT, ~23 GiB addressable). 9B fits; 35B RAM-tight (no swap); 397B not feasible.
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
## Stopped/Disabled Services
|
## Stopped/Disabled Services
|
||||||
|
|
||||||
| Service | Reason | Status |
|
| Service | Reason | Status |
|
||||||
|
|||||||
@@ -2,6 +2,14 @@
|
|||||||
|
|
||||||
**Purpose:** Major infrastructure events only. Minor changes are in git commit messages.
|
**Purpose:** Major infrastructure events only. Minor changes are in git commit messages.
|
||||||
|
|
||||||
|
---
|
||||||
|
## 2026-06-29
|
||||||
|
|
||||||
|
### Ollama GPU acceleration on Radeon 780M iGPU
|
||||||
|
- **[OLLAMA]** Migrated ollama from Unraid `dockerman` template (CPU image, no devices) to a Dockge stack using `ollama/ollama:rocm`
|
||||||
|
- **[OLLAMA]** Enabled AMD Radeon 780M (gfx1103) ROCm offload via `HSA_OVERRIDE_GFX_VERSION=11.0.0` + `OLLAMA_IGPU_ENABLE=1`, passing `/dev/kfd` and `/dev/dri`
|
||||||
|
- **[OLLAMA]** Verified Ornith 1.0 9B GGUF runs 100% on GPU (33/33 layers), ~11 tok/s; iGPU is RAM-bandwidth bound
|
||||||
|
|
||||||
---
|
---
|
||||||
## 2026-05-05
|
## 2026-05-05
|
||||||
|
|
||||||
|
|||||||
Reference in New Issue
Block a user