Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.xpertai.cn/llms.txt

Use this file to discover all available pages before exploring further.

Built-in middleware for common proxy use cases XpertAI provides built-in middleware for common use cases. Each middleware is production-tested and can be configured according to your specific needs.

Model Provider Agnostic Middleware

The following middleware works with any LLM provider:
MiddlewareDescription
Context CompressionAutomatically summarizes conversation history when approaching session limit.
Browser Automation MiddlewareLets ChatKit clients execute safe browser-page actions such as snapshot, click, fill, scroll, screenshot, and wait.
Ralph Loop MiddlewareRetries an agent from a clean message context until it emits the completion promise or reaches the retry limit.
Human-in-the-Loop MiddlewarePauses configured tool calls for human approval, editing, or rejection before execution.
Sensitive Filter MiddlewareFilters sensitive input/output content using rule-based or LLM policies.
Agent Behavior Monitor MiddlewareDetects prompt injection, risky instructions, high-frequency tool calls, and repeated failures.

Context Compression

Automatically summarizes conversation history when approaching token limits, preserving recent messages while compressing older context. The summarization feature is suitable for the following scenarios:
  • Long conversations that exceed the context window.
  • Multi-turn dialogues with extensive history.
  • Applications that need to retain full conversation context.