Built-in Middleware

Built-in middleware for common proxy use cases XpertAI provides built-in middleware for common use cases. Each middleware is production-tested and can be configured according to your specific needs.

Model Provider Agnostic Middleware

The following middleware works with any LLM provider:

Middleware	Description
Context Compression	Automatically summarizes conversation history when approaching session limit.
Browser Automation Middleware	Lets ChatKit clients execute safe browser-page actions such as snapshot, click, fill, scroll, screenshot, and wait.
Ralph Loop Middleware	Retries an agent from a clean message context until it emits the completion promise or reaches the retry limit.
Human-in-the-Loop Middleware	Pauses configured tool calls for human approval, editing, or rejection before execution.
Sensitive Filter Middleware	Filters sensitive input/output content using rule-based or LLM policies.
Agent Behavior Monitor Middleware	Detects prompt injection, risky instructions, high-frequency tool calls, and repeated failures.

Context Compression

Automatically summarizes conversation history when approaching token limits, preserving recent messages while compressing older context. The summarization feature is suitable for the following scenarios:

Long conversations that exceed the context window.
Multi-turn dialogues with extensive history.
Applications that need to retain full conversation context.

Default

Built In

Built-in Middleware

Model Provider Agnostic Middleware

Context Compression

​Model Provider Agnostic Middleware

​Context Compression

Model Provider Agnostic Middleware

Context Compression