Skip to content

feat(llm): add OrcaRouter as a first-class model provider - #2

Open
bangla24bdrang-lab wants to merge 1 commit into
while-coder:mainfrom
bangla24bdrang-lab:feat/add-orcarouter-provider
Open

feat(llm): add OrcaRouter as a first-class model provider#2
bangla24bdrang-lab wants to merge 1 commit into
while-coder:mainfrom
bangla24bdrang-lab:feat/add-orcarouter-provider

Conversation

@bangla24bdrang-lab

Copy link
Copy Markdown

Add OrcaRouter as a first-class model provider

sbot's model layer is modular — providers are independent building blocks registered into llmProviderRegistry, and sbot already ships OpenAI, Anthropic, Gemini, and Ollama among others. This PR adds OrcaRouter the same way: a new scorpio.llm.orcarouter package that mirrors the existing scorpio.llm.openai wiring and registers a named provider, so it appears in the admin Language Models provider list instead of being treated as an anonymous custom base URL.

OrcaRouter is an OpenAI-compatible AI gateway built for both models and agents. Like OpenRouter, it exposes a provider/model namespace across many models — but it also combines adaptive routing, automatic failover, zero-markup inference, observability, guardrails, and agent-tool governance behind the same endpoint. Adding orcarouter as a first-class provider means this project's users can use that stack directly. It also runs gateway-level, zero-trust security for AI agents on the same endpoint — screening every prompt/response and governing every tool call on a default-deny basis, with no application code changes.

What changed

  • packages/backend/llm/scorpio.llm.orcarouter/ — new provider package, reusing OpenAIModelService against https://api.orcarouter.ai/v1 with /models listing (default model orcarouter/fusion)
  • packages/backend/sbot/src/Core/LlmProviders.ts — register the provider in registerBuiltInLlmProviders()
  • docs (packages/apps/docs/guide/models.md + zh) — added OrcaRouter to the supported providers table

Verification

  • scorpio.llm.orcarouter builds (tsc -b --force)
  • full @qingfeng346/sbot typecheck passes (0 errors)
  • live test through the registered provider returned 200 with orcarouter/fusion; /models listing returned 203 models

Discord: discord.gg/YEubt8enRA · X: https://x.com/OrcaRouter

I'm an engineer on the OrcaRouter team.

Adds scorpio.llm.orcarouter, a named provider package mirroring the
existing scorpio.llm.openai wiring. OrcaRouter is an OpenAI-compatible
gateway for models and agents, so the provider reuses OpenAIModelService
against https://api.orcarouter.ai/v1 with model listing enabled.

Registered in registerBuiltInLlmProviders() so it shows up in the admin
UI provider list alongside the existing providers, and documented in the
models guide (EN + zh).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant