If you are deploying a large model application, be sure to communicate with the CEO in advance. Large model applications are far less controllable in terms of resource costs compared to web applications.

Today we introduce 8 common application scenarios of AI gateways from the consumer perspective. Since most enterprises are currently deploying large models mainly for internal use, the application scenarios listed in this article mostly stem from internal demands. Providing services externally will further rely on AI gateways in terms of the granularity and extent of demand.

We believe that the AI gateway is not a new form independent of the API gateway; it is essentially a type of API gateway that has been specifically extended to address new requirements in AI scenarios. It is both an inheritance of the API gateway and an evolution of it. Therefore, from the API perspective, we have categorized the capabilities of the AI gateway to facilitate a consensus on the concept.