Skip to main content
Built-in middleware for common proxy use cases XpertAI provides built-in middleware for common use cases. Each middleware is production-tested and can be configured according to your specific needs.

​
Model Provider Agnostic Middleware

The following middleware works with any LLM provider:
MiddlewareDescription
Context CompressionAutomatically summarizes conversation history when approaching session limit.

​
Context Compression

Automatically summarizes conversation history when approaching token limits, preserving recent messages while compressing older context. The summarization feature is suitable for the following scenarios:
  • Long conversations that exceed the context window.
  • Multi-turn dialogues with extensive history.
  • Applications that need to retain full conversation context.