Skip to main content

Internal

Use this modality to test systems that are not publicly reachable: local development builds, private infrastructure, or any AI system that doesn't expose a public endpoint.

spectral-bridge is the open-source component that makes this possible. It runs on your infrastructure alongside your system and consists of two processes:

  • A relay process that opens an outbound-only connection to Spectral.
  • An adapter that exposes a /v1/chat/completions endpoint locally and takes care of translating requests from the relay into calls to your system.
Sspectral-bridge OverviewHow the protocol works and how to deploy it

Setup​

When you create an Internal target, Spectral generates an API key and shows a dialog with all the commands you need to install and start spectral-bridge on your network. The API key is shown once and cannot be retrieved afterwards.

spectral-bridge setup dialog showing the API key and start commands

Follow the steps in the dialog to install spectral-bridge, set the API key, and start the bridge pointed at your system. Once the bridge is running, use the Test connection button to verify Spectral can reach it before saving the target.

Adapters​

Two adapters are available. The choice depends on whether your system already exposes a /v1/chat/completions endpoint:

  • Passthrough: your system already exposes a local /v1/chat/completions endpoint. spectral-bridge forwards requests directly to it.
  • Custom: your system does not expose a /v1/chat/completions endpoint. You implement a small adapter server that translates requests into calls to your system and converts the responses back into the expected format.