893 B
893 B
SearXNG Gemini & OpenRouter Stream
A SearXNG plugin that streams AI responses using search results as grounding context. Supports Google Gemini and OpenAI-compatible providers (OpenRouter, Ollama, etc.).
Configuration
Set the following environment variables:
General
LLM_PROVIDER:gemini(default) oropenrouter.GEMINI_MAX_TOKENS: Defaults to500.GEMINI_TEMPERATURE: Defaults to0.2.
Google Gemini
GEMINI_API_KEY: Your Google AI API key.GEMINI_MODEL: Defaults togemini-1.5-flash.
OpenRouter / OpenAI / Ollama
OPENROUTER_API_KEY: Your API key.OPENROUTER_MODEL: e.g.,meta-llama/llama-3-8b-instruct:free.OPENROUTER_BASE_URL: Defaults toopenrouter.ai. (Change tolocalhost:11434for Ollama).
Installation
Place gemini_flash.py into the searx/plugins directory of your instance and enable it in settings.yml.