AnythingLLM Integration Guide

Overview

AnythingLLM treats Routerah as a Generic OpenAI provider. Type the model, set the context window, save.

Quick Config

Paste these into the client. Your key auto-fills when signed in.

Base URL: https://api.routerah.app/v1
API Key: YOUR_API_KEY

Compatibility

Step-by-step setup

1. 1
   Open LLM Preference

   Open Settings in the sidebar, then LLM Preference.

2. 2
   Pick Generic OpenAI

   Set LLM Provider to Generic OpenAI and fill the form. Max Tokens defaults to 1024 and caps every reply, so raise it.

   text

   Base URL: https://api.routerah.app/v1
   API Key: YOUR_API_KEY
   Chat Model Name: YOUR_MODEL_ID
   Model context window: 50000
   Max Tokens: 8192

   Sign in to auto-fill your API key

3. 3
   Save

   Save. AnythingLLM uses Routerah for chat workspaces.

Recommended models

Free models that work here. Paste any model id into the client.

Gotchas

• !Generic OpenAI fetches the catalog once Base URL and API Key are set. If the fetch fails the field falls back to a text box, so type the model id manually.
• !Embedding Preference is a separate tab. Leave it on a working embedding provider unless Routerah exposes embeddings on your plan.