--- id: sm-azure-aigateway name: "azure-aigateway" url: https://skills.yangsir.net/skill/sm-azure-aigateway author: microsoft domain: ai-backend-engineering tags: ["azure-api-management", "ai-gateway", "microservices", "api-security", "ai-infrastructure"] install_count: 141835 rating: 4.80 (2000 reviews) github: https://github.com/microsoft/github-copilot-for-azure --- # azure-aigateway > 协助用户部署和管理Azure AI网关，统一访问和管理各种AI服务，简化AI解决方案的集成与扩展。 **Stats**: 141,835 installs · 4.8/5 (2000 reviews) ## Before / After 对比 ### Azure AI网关部署与管理提速 ## Readme # azure-aigateway # Azure AI Gateway Configure Azure API Management (APIM) as an AI Gateway for governing AI models, MCP tools, and agents. **To deploy APIM**, use the **azure-prepare** skill. See [APIM deployment guide](https://learn.microsoft.com/azure/api-management/get-started-create-service-instance). ## When to Use This Skill Category Triggers **Model Governance** "semantic caching", "token limits", "load balance AI", "track token usage" **Tool Governance** "rate limit MCP", "protect my tools", "configure my tool", "convert API to MCP" **Agent Governance** "content safety", "jailbreak detection", "filter harmful content" **Configuration** "add Azure OpenAI backend", "configure my model", "add AI Foundry model" **Testing** "test AI gateway", "call OpenAI through gateway" ## Quick Reference Policy Purpose Details `azure-openai-token-limit` Cost control [Model Policies](https://github.com/microsoft/github-copilot-for-azure/blob/HEAD/plugin/skills/azure-aigateway/references/policies.md#token-rate-limiting) `azure-openai-semantic-cache-lookup/store` 60-80% cost savings [Model Policies](https://github.com/microsoft/github-copilot-for-azure/blob/HEAD/plugin/skills/azure-aigateway/references/policies.md#semantic-caching) `azure-openai-emit-token-metric` Observability [Model Policies](https://github.com/microsoft/github-copilot-for-azure/blob/HEAD/plugin/skills/azure-aigateway/references/policies.md#token-metrics) `llm-content-safety` Safety & compliance [Agent Policies](https://github.com/microsoft/github-copilot-for-azure/blob/HEAD/plugin/skills/azure-aigateway/references/policies.md#content-safety) `rate-limit-by-key` MCP/tool protection [Tool Policies](https://github.com/microsoft/github-copilot-for-azure/blob/HEAD/plugin/skills/azure-aigateway/references/policies.md#request-rate-limiting) ## Get Gateway Details ``` # Get gateway URL az apim show --name --resource-group --query "gatewayUrl" -o tsv # List backends (AI models) az apim backend list --service-name --resource-group \ --query "[].{id:name, url:url}" -o table # Get subscription key az apim subscription keys list \ --service-name --resource-group --subscription-id ``` ## Test AI Endpoint ``` GATEWAY_URL=$(az apim show --name --resource-group --query "gatewayUrl" -o tsv) curl -X POST "${GATEWAY_URL}/openai/deployments//chat/completions?api-version=2024-02-01" \ -H "Content-Type: application/json" \ -H "Ocp-Apim-Subscription-Key: " \ -d '{"messages": [{"role": "user", "content": "Hello"}], "max_tokens": 100}' ``` ## Common Tasks ### Add AI Backend See [references/patterns.md](https://github.com/microsoft/github-copilot-for-azure/blob/HEAD/plugin/skills/azure-aigateway/references/patterns.md#pattern-1-add-ai-model-backend) for full steps. ``` # Discover AI resources az cognitiveservices account list --query "[?kind=='OpenAI']" -o table # Create backend az apim backend create --service-name --resource-group \ --backend-id openai-backend --protocol http --url "https://.openai.azure.com/openai" # Grant access (managed identity) az role assignment create --assignee \ --role "Cognitive Services User" --scope ``` ### Apply AI Governance Policy Recommended policy order in ``: - **Authentication** - Managed identity to backend - **Semantic Cache Lookup** - Check cache before calling AI - **Token Limits** - Cost control - **Content Safety** - Filter harmful content - **Backend Selection** - Load balancing - **Metrics** - Token usage tracking See [references/policies.md](https://github.com/microsoft/github-copilot-for-azure/blob/HEAD/plugin/skills/azure-aigateway/references/policies.md#combining-policies) for complete example. ## Troubleshooting Issue Solution Token limit 429 Increase `tokens-per-minute` or add load balancing No cache hits Lower `score-threshold` to 0.7 Content false positives Increase category thresholds (5-6) Backend auth 401 Grant APIM "Cognitive Services User" role See [references/troubleshooting.md](https://github.com/microsoft/github-copilot-for-azure/blob/HEAD/plugin/skills/azure-aigateway/references/troubleshooting.md) for details. ## References - [**Detailed Policies**](https://github.com/microsoft/github-copilot-for-azure/blob/HEAD/plugin/skills/azure-aigateway/references/policies.md) - Full policy examples - [**Configuration Patterns**](https://github.com/microsoft/github-copilot-for-azure/blob/HEAD/plugin/skills/azure-aigateway/references/patterns.md) - Step-by-step patterns - [**Troubleshooting**](https://github.com/microsoft/github-copilot-for-azure/blob/HEAD/plugin/skills/azure-aigateway/references/troubleshooting.md) - Common issues - [AI-Gateway Samples](https://github.com/Azure-Samples/AI-Gateway) - [GenAI Gateway Docs](https://learn.microsoft.com/azure/api-management/genai-gateway-capabilities) ## SDK Quick References - **Content Safety**: [Python](https://github.com/microsoft/github-copilot-for-azure/blob/HEAD/plugin/skills/azure-aigateway/references/sdk/azure-ai-contentsafety-py.md) | [TypeScript](https://github.com/microsoft/github-copilot-for-azure/blob/HEAD/plugin/skills/azure-aigateway/references/sdk/azure-ai-contentsafety-ts.md) - **API Management**: [Python](https://github.com/microsoft/github-copilot-for-azure/blob/HEAD/plugin/skills/azure-aigateway/references/sdk/azure-mgmt-apimanagement-py.md) | [.NET](https://github.com/microsoft/github-copilot-for-azure/blob/HEAD/plugin/skills/azure-aigateway/references/sdk/azure-mgmt-apimanagement-dotnet.md) Weekly Installs102.9KRepository[microsoft/githu…or-azure](https://github.com/microsoft/github-copilot-for-azure)GitHub Stars157First SeenFeb 4, 2026Security Audits[Gen Agent Trust HubPass](/microsoft/github-copilot-for-azure/azure-aigateway/security/agent-trust-hub)[SocketPass](/microsoft/github-copilot-for-azure/azure-aigateway/security/socket)[SnykFail](/microsoft/github-copilot-for-azure/azure-aigateway/security/snyk)Installed ongithub-copilot102.9Kcodex366gemini-cli354opencode329cursor320kimi-cli318 --- *Source: https://skills.yangsir.net/skill/sm-azure-aigateway* *Markdown mirror: https://skills.yangsir.net/api/skill/sm-azure-aigateway/markdown*