Make your AI more sustainable with API Management

Make your AI more sustainable with API Management

Use Azure API Management to enhance your Microsoft AI Foundry LLM models. By implementing semantic caching your can use an Managed Redis Cache as a vector database to check for similar requests. This way you can reduce the amount on inferences done by your LLM and reduce your environmental impact.

Read More