Data Engineer at a educational organization with 201-500 employees
Enables task automation and predictive analysis while needing increased model variety and token limits
Pros and Cons
- "Azure OpenAI is used as chat services, allowing me to replace human tasks with analytical capabilities."
- "Azure could significantly benefit from including more LLM models apart from OpenAI, as I often need to switch clouds when a model doesn't meet my requirements."
What is our primary use case?
I utilize Azure OpenAI primarily for creating embeddings, model embeddings, query services, and scenarios where user queries require significant cognitive processing. I also use it for chat services, data analytics, and predictive analysis within my ML and AI firm.
What is most valuable?
Azure OpenAI is used as chat services, allowing me to replace human tasks with analytical capabilities. OpenAI models help me create predictive analysis products and chat applications, enabling me to automate tasks and reduce the workforce needed for repetitive work, thereby streamlining operations.
What needs improvement?
Azure could significantly benefit from including more LLM models apart from OpenAI, as I often need to switch clouds when a model doesn't meet my requirements. Expanding token limitations for scaling while ensuring concurrent user access is crucial.
For how long have I used the solution?
I have been using Azure OpenAI for about a year and a half, since the emergence of OpenAI's inclusion in Azure.
Buyer's Guide
Azure OpenAI
March 2025

Learn what your peers think about Azure OpenAI. Get advice and tips from experienced pros sharing their opinions. Updated: March 2025.
845,040 professionals have used our research since 2012.
What do I think about the stability of the solution?
I have not experienced any performance or stability issues with Azure OpenAI.
What do I think about the scalability of the solution?
Scaling involves considerations such as token limits and requires intermediary services for load balancing, but the model setup itself is uncomplicated.
How are customer service and support?
The customer service follows a hierarchical system. If the initial support personnel cannot resolve a query, it escalates to someone with more expertise. Tickets can be prioritized for critical issues, and the service has been helpful overall.
How would you rate customer service and support?
Positive
How was the initial setup?
The initial setup process for Azure OpenAI is straightforward. Once an application is ready, I simply input model credentials to begin using the services, which typically takes five to ten minutes.
What's my experience with pricing, setup cost, and licensing?
In the past, the primary expense involved token limitations which constrained scaling. Recent iterations have increased token allowances, mitigating some challenges associated with concurrent user access at scale.
What other advice do I have?
On a scale of one to ten, I would rate Azure OpenAI as seven to seven and a half. The inclusion of a larger variety of models and the improvement of scaling capabilities are essential areas of focus. My overall product rating is 7.
Which deployment model are you using for this solution?
Public Cloud
If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?
Microsoft Azure
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Last updated: Mar 31, 2025
Flag as inappropriate

Buyer's Guide
Download our free Azure OpenAI Report and get advice and tips from experienced pros
sharing their opinions.
Updated: March 2025
Product Categories
AI Development PlatformsPopular Comparisons
Microsoft Azure Machine Learning Studio
Google Vertex AI
Amazon SageMaker
Hugging Face
TensorFlow
Google Cloud AI Platform
IBM Watson Studio
Replicate
Together Inference
DataRobot
OpenVINO
Fireworks AI
IBM Watson Machine Learning
GroqCloud Platform
Buyer's Guide
Download our free Azure OpenAI Report and get advice and tips from experienced pros
sharing their opinions.
Quick Links
Learn More: Questions:
- When evaluating Artificial Intelligence Development Platforms, what aspect do you think is the most important to look for?
- What are the main storage requirements to support Artificial Intelligence and Deep Learning applications?
- What is the most effective AI platform to work with? Does it help if it is also "fun"?
- What are the major Edge AI technology use cases that can be used in the Banking/Finance, Power and Agricultural sectors?
- What are the top emerging trends in AI and ML in 2022?
- How do I do AI implementation?
- Why is AI Development Platforms important for companies?