Try our new research platform with insights from 80,000+ expert users
reviewer2214366 - PeerSpot reviewer
Data Engineer at a educational organization with 201-500 employees
Real User
Top 5
Enables task automation and predictive analysis while needing increased model variety and token limits
Pros and Cons
  • "Azure OpenAI is used as chat services, allowing me to replace human tasks with analytical capabilities."
  • "Azure could significantly benefit from including more LLM models apart from OpenAI, as I often need to switch clouds when a model doesn't meet my requirements."

What is our primary use case?

I utilize Azure OpenAI primarily for creating embeddings, model embeddings, query services, and scenarios where user queries require significant cognitive processing. I also use it for chat services, data analytics, and predictive analysis within my ML and AI firm.

What is most valuable?

Azure OpenAI is used as chat services, allowing me to replace human tasks with analytical capabilities. OpenAI models help me create predictive analysis products and chat applications, enabling me to automate tasks and reduce the workforce needed for repetitive work, thereby streamlining operations.

What needs improvement?

Azure could significantly benefit from including more LLM models apart from OpenAI, as I often need to switch clouds when a model doesn't meet my requirements. Expanding token limitations for scaling while ensuring concurrent user access is crucial.

For how long have I used the solution?

I have been using Azure OpenAI for about a year and a half, since the emergence of OpenAI's inclusion in Azure.
Buyer's Guide
Azure OpenAI
March 2025
Learn what your peers think about Azure OpenAI. Get advice and tips from experienced pros sharing their opinions. Updated: March 2025.
845,040 professionals have used our research since 2012.

What do I think about the stability of the solution?

I have not experienced any performance or stability issues with Azure OpenAI.

What do I think about the scalability of the solution?

Scaling involves considerations such as token limits and requires intermediary services for load balancing, but the model setup itself is uncomplicated.

How are customer service and support?

The customer service follows a hierarchical system. If the initial support personnel cannot resolve a query, it escalates to someone with more expertise. Tickets can be prioritized for critical issues, and the service has been helpful overall.

How would you rate customer service and support?

Positive

How was the initial setup?

The initial setup process for Azure OpenAI is straightforward. Once an application is ready, I simply input model credentials to begin using the services, which typically takes five to ten minutes.

What's my experience with pricing, setup cost, and licensing?

In the past, the primary expense involved token limitations which constrained scaling. Recent iterations have increased token allowances, mitigating some challenges associated with concurrent user access at scale.

What other advice do I have?

On a scale of one to ten, I would rate Azure OpenAI as seven to seven and a half. The inclusion of a larger variety of models and the improvement of scaling capabilities are essential areas of focus. My overall product rating is 7.

Which deployment model are you using for this solution?

Public Cloud

If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

Microsoft Azure
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Flag as inappropriate
PeerSpot user
Buyer's Guide
Download our free Azure OpenAI Report and get advice and tips from experienced pros sharing their opinions.
Updated: March 2025
Product Categories
AI Development Platforms
Buyer's Guide
Download our free Azure OpenAI Report and get advice and tips from experienced pros sharing their opinions.