TySS-Dev/ollama-ai-answers-searxng
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

refactor: default to openrouter with gemma-3-27b fallback

Browse Source
This commit is contained in:
cra88y
2026-01-10 21:18:11 -06:00
parent f84c1791e8
commit 0d55fb123f
2 changed files with 4 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+2 -2
View File
@@ -7,7 +7,7 @@ A SearXNG plugin that streams AI responses using search results as grounding con
Set the following environment variables: Set the following environment variables:
### General ### General
- `LLM_PROVIDER`: `gemini` (default) or `openrouter`. - `LLM_PROVIDER`: `openrouter` (default) or `gemini`.
- `GEMINI_MAX_TOKENS`: Defaults to `500`. - `GEMINI_MAX_TOKENS`: Defaults to `500`.
- `GEMINI_TEMPERATURE`: Defaults to `0.2`. - `GEMINI_TEMPERATURE`: Defaults to `0.2`.
@@ -17,7 +17,7 @@ Set the following environment variables:
### OpenRouter / OpenAI / Ollama ### OpenRouter / OpenAI / Ollama
- `OPENROUTER_API_KEY`: Your API key. - `OPENROUTER_API_KEY`: Your API key.
- `OPENROUTER_MODEL`: e.g., `meta-llama/llama-3-8b-instruct:free`. - `OPENROUTER_MODEL`: Defaults to `google/gemma-3-27b-it:free`.
- `OPENROUTER_BASE_URL`: Defaults to `openrouter.ai`. (Change to `localhost:11434` for Ollama). - `OPENROUTER_BASE_URL`: Defaults to `openrouter.ai`. (Change to `localhost:11434` for Ollama).
## Installation ## Installation
gemini_flash.py
+2 -2
View File
@@ -18,9 +18,9 @@ class SXNGPlugin(Plugin):
description=gettext("Live AI search answers using Google Gemini Flash"), description=gettext("Live AI search answers using Google Gemini Flash"),
preference_section="general", preference_section="general",
) )
self.provider = os.getenv('LLM_PROVIDER', 'gemini').lower() self.provider = os.getenv('LLM_PROVIDER', 'openrouter').lower()
self.api_key = os.getenv('OPENROUTER_API_KEY') if self.provider == 'openrouter' else os.getenv('GEMINI_API_KEY') self.api_key = os.getenv('OPENROUTER_API_KEY') if self.provider == 'openrouter' else os.getenv('GEMINI_API_KEY')
self.model = os.getenv('GEMINI_MODEL', 'gemini-1.5-flash') if self.provider == 'gemini' else os.getenv('OPENROUTER_MODEL', 'google/gemini-2.0-flash-exp:free') self.model = os.getenv('GEMINI_MODEL', 'gemini-1.5-flash') if self.provider == 'gemini' else os.getenv('OPENROUTER_MODEL', 'google/gemma-3-27b-it:free')
self.max_tokens = int(os.getenv('GEMINI_MAX_TOKENS', 500)) self.max_tokens = int(os.getenv('GEMINI_MAX_TOKENS', 500))
self.temperature = float(os.getenv('GEMINI_TEMPERATURE', 0.2)) self.temperature = float(os.getenv('GEMINI_TEMPERATURE', 0.2))
self.base_url = os.getenv('OPENROUTER_BASE_URL', 'openrouter.ai') self.base_url = os.getenv('OPENROUTER_BASE_URL', 'openrouter.ai')