2 Commits

Include renames

Author	SHA1	Message	Date
jpmschweitzerandClaude Opus 4.6	cf8a4e37d8	fix(engine): offload Gemma to GPU by setting n_gpu_layers=999 (#833) ... LlamaModelParams::default() sets n_gpu_layers=0, so even with --features rocm the model ran entirely on CPU at ~19 t/s. Setting n_gpu_layers to a large sentinel value asks llama.cpp to offload every layer the model has; llama.cpp clamps to the real count (27 for Gemma 2 2B). Observed throughput jumps from 19 t/s to 74 t/s on an RX 9070 once the ROCm binary is also compiled for gfx1201 (see tooling commit). Also adds server/sr-voice/.gitignore so locally-built binaries don't sneak into the worktree. Release binaries ship out-of-tree per #850. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>	2026-04-15 23:11:14 +02:00
jpmschweitzerandClaude Opus 4.6	1b58d8f949	feat(engine): add sr-voice LLM inference service for NPC voice pipeline ... Standalone Rust crate wrapping llama-cpp-2 for GGUF model inference. Persistent HTTP server architecture — model loaded once, requests processed sequentially, zero CPU contention by construction. Subcommands: serve (load model, listen), generate (single prompt), batch (JSONL), benchmark (5-run average). Makefile targets for build/serve/run/stop workflow. Spike 1 validated: Gemma 2B Q4_K_M at ~16 t/s CPU, 4 cultures tested (Krenn, Ireland, Shek'na, Aranthi), composition-engine oath injection mechanism proven. GO for Spike 2. Refs: D-138, #639 Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	2026-03-07 15:44:37 +01:00