variety of changes: custom system prompt, some bugs, dev qol

This commit is contained in:
cra88y/pc
2026-05-02 21:01:37 -05:00
parent 264578caec
commit d0c29f4b34
4 changed files with 543 additions and 673 deletions
+2 -2
View File
@@ -38,6 +38,7 @@ Configure via the environment variables:
- `LLM_MODEL`: Model identifier. Defaults vary. Recommended: 10-30B dense or 5-15B MoE activated.
- `LLM_URL`: Overrides endpoint URL for any provider preset.
- `LLM_SYSTEM_PROMPT`: Overrides some of the system prompt. Default `You are a direct, citation-accurate search synthesis engine.`.
- `LLM_MAX_TOKENS`: Default `500`.
- `LLM_TEMPERATURE`: Default `0.2`.
- `LLM_CONTEXT_DEEP_COUNT`: results as context with full snippets. Default `5`.
@@ -105,6 +106,5 @@ LLM_MODEL=meta-llama/Meta-Llama-3-8B-Instruct
```bash
pip install flask flask-babel
python tests/demo.py # Interactive demo at localhost:5000
python tests/test.py # One-shot test suite
python tests/demo.py # UI demo at localhost:5000
```