Skip to main content

Dashboard & Navigation

miLLM Dashboard

The collapsible sidebar provides access to all pages. A persistent status bar at the top right shows the loaded model, SAE status, GPU metrics, and WebSocket connection state.

PagePurpose
DashboardSystem overview, GPU metrics, quick start guide
ModelsDownload, load, unload, and manage LLMs
SAEsDownload, attach, and manage Sparse Autoencoders
SteeringConfigure feature steering values
ProbeReal-time activation monitoring
ProfilesSave/load steering configurations
SettingsTheme, connection status, server info

Dashboard Overview

System Status

Four status cards show the current state at a glance:

CardStates
ModelLOADED (green, shows model name) or No Model warning
SAEATTACHED (green, shows layer) or NOT ATTACHED (yellow)
SteeringACTIVE with feature count, or WAITING (attach SAE first)
ProbeLIVE when monitoring, or WAITING (attach SAE first)

System Metrics

Four real-time GPU metric cards below the status:

MetricFormatNotes
GPU UtilizationPercentage (e.g., 24%)100% = fully utilized
GPU MemoryUsed/Total GB (e.g., 9.5/24.0 GB)Watch for >90% before starting jobs
GPU TemperatureDegrees C (e.g., 64°C)Green <70°C, Yellow 70–85°C, Red ≥85°C
CPU UsagePercentageSystem CPU load

Quick Start Guide

The dashboard includes a step-by-step Quick Start checklist:

  1. Load a Model — Download and load from HuggingFace (green checkmark when complete)
  2. Download & Attach SAE — Get an SAE and hook it to a model layer
  3. Configure Steering — Add features and set strength values
  4. Monitor Activations — Watch which features fire during inference

Steps unlock progressively — each step links directly to the relevant page.

Quick Actions

Four shortcut buttons provide direct access to:

  • Manage Model → Models page
  • Attach SAE → SAEs page
  • Configure Steering → Steering page
  • View Probe → Probe page

Top Status Bar

The persistent bar across the top right of every page shows:

  • Model name (teal badge) or nothing if unloaded
  • SAE statusNo SAE badge if not attached
  • GPU metrics — utilization %, memory, temperature (compact)
  • ConnectionConnected (green) or Disconnected (red)

Settings Page

miLLM Settings Page

The Settings page provides:

  • Theme toggle — Switch between light and dark mode
  • Connection status — WebSocket state and reconnect button
  • Server information — API version, base paths, WebSocket endpoint
  • Keyboard shortcuts reference
Keyboard Shortcuts
  • G + D — Go to Dashboard
  • G + M — Go to Models
  • G + S — Go to SAE
  • G + T — Go to Steering
  • Ctrl+Shift+T — Toggle theme