odysseus

jpmschweitzer/odysseus

Fork 0

mirror of https://github.com/pewdiepie-archdaemon/odysseus.git synced 2026-09-23 16:42:21 +02:00

Commit Graph

Author	SHA1	Message	Date
RaresKeY	a031a94a2e	fix(cookbook): harden remote serve host handling (#4345 )	2026-06-16 03:46:32 +01:00
Dividesbyzer0	b28aa1f2c4	fix(cookbook): allow local Windows Diffusers serving (#4077 )	2026-06-15 15:21:01 +09:00
lekt8andClaude Opus 4.8	0e6cbd8315	Drop GPU-only flags from the CPU-only (-ngl 0) serve command (#1433 ) A CPU-only llama.cpp serve config still emitted --flash-attn on and exported GGML_CUDA_ENABLE_UNIFIED_MEMORY=1 (independent toggles, often left on by an Auto profile), so the command mixed "zero GPU layers" with CUDA/flash-attn and failed to start (issue #1291). Gate both on a _cpuOnly check (ngl == 0). GPU serving is unchanged — the gate only affects the ngl=0 path. Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>	2026-06-03 04:26:15 +09:00

Author

SHA1

Message

Date

RaresKeY

a031a94a2e

fix(cookbook): harden remote serve host handling (#4345 )

2026-06-16 03:46:32 +01:00

Dividesbyzer0

b28aa1f2c4

fix(cookbook): allow local Windows Diffusers serving (#4077 )

2026-06-15 15:21:01 +09:00

lekt8andClaude Opus 4.8

0e6cbd8315

Drop GPU-only flags from the CPU-only (-ngl 0) serve command (#1433 )

A CPU-only llama.cpp serve config still emitted --flash-attn on and exported
GGML_CUDA_ENABLE_UNIFIED_MEMORY=1 (independent toggles, often left on by an Auto
profile), so the command mixed "zero GPU layers" with CUDA/flash-attn and failed
to start (issue #1291). Gate both on a _cpuOnly check (ngl == 0). GPU serving is
unchanged — the gate only affects the ngl=0 path.

Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

2026-06-03 04:26:15 +09:00