How to integrate DeepSeek in Higress AI Gateway

DeepSeek 是一家领先的 AI 技术公司,提供高性能、低成本的大型语言模型。其开源模型在多个基准测试中表现卓越。

Core Advantages

极高性价比
强大的代码生成能力
支持 OpenAI 协议兼容
低延迟响应

Quick Configuration Example

provider:
  type: deepseek
  apiTokens:
    - "YOUR_DEEPSEEK_API_TOKEN"

Note: Please replace YOUR_API_TOKEN with the actual token you applied for on the DeepSeek platform.

Why choose Higress to manage DeepSeek?

By accessing DeepSeek through Higress AI Gateway, you not only get simple protocol forwarding, but also enterprise-level governance capabilities:

  • Unified Protocol Adaptation: Use the standard OpenAI protocol to call DeepSeek without worrying about underlying differences.
  • Intelligent Retry and Circuit Breaking: When the model service is unstable, Higress automatically handles retries to ensure business continuity.
  • Security Audit and Rate Limiting: Protect your API Key from abuse and perform precise rate limiting based on Token consumption.
  • Semantic Caching: Significantly reduce response time for repeated questions and save inference costs.

Ready to get started?

Click the button below to view Higress detailed documentation, or experience it directly in the console.

View Detailed Documentation Star on GitHub