We use it to streamline and reduce the time spent on fundamental tasks within our organization.
Public Cloud at a comms service provider with 10,001+ employees
Slow tech support associated with high costs and overall instability leading to reservations and a non-recommendations
Pros and Cons
- "There is room for improvement in their support services."
What is our primary use case?
What needs improvement?
There are ongoing issues with Azure in Japan. Enhancing customer understanding of AI and how it operates, and laying the foundation for effective collaboration would be beneficial. Also, optimizing data utilization, as the current practice of relying extensively on external data can pose challenges for efficient business management. I would like to emphasize the importance of each significant customer having a tailored AI model to ensure a more nuanced and effective approach to addressing their unique needs. There is room for improvement in their support services.
For how long have I used the solution?
I have been working with it for approximately seven months.
What do I think about the stability of the solution?
The system's instability is attributed to the absence of certain optimizations and despite attempts to address core issues, the system remains unsteady. I would rate it six out of ten.
Buyer's Guide
Azure OpenAI
December 2025
Learn what your peers think about Azure OpenAI. Get advice and tips from experienced pros sharing their opinions. Updated: December 2025.
879,425 professionals have used our research since 2012.
What do I think about the scalability of the solution?
Only a small percentage of employees currently use AI, making it challenging to discuss scalability at this point.
How are customer service and support?
Tech support tends to be slow, varying based on the specific team. While some individuals excel in providing assistance, others may lag. I would rate it three out of ten.
How would you rate customer service and support?
Negative
Which solution did I use previously and why did I switch?
We previously used AWS, which is widely adopted in Japan.
What about the implementation team?
A team of twenty engineers is responsible for deployment, and maintenance, along with partners.
What's my experience with pricing, setup cost, and licensing?
The cost is quite high and fixed. I would rate it two out of ten.
What other advice do I have?
Overall, I do not recommend it. I would rate it five out of ten.
Which deployment model are you using for this solution?
Public Cloud
If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?
Microsoft Azure
Disclosure: My company has a business relationship with this vendor other than being a customer. Partner
Founder & CEO at a computer software company with 11-50 employees
Saves a lot of time, increases productivity, and can be used to summarize key elements of long documents
Pros and Cons
- "The product saves a lot of time."
- "Sometimes, the responses are repetitive."
What is our primary use case?
We work with a lot of enterprise-level customers in healthcare, retail, and manufacturing. The solution can be used to predict diseases based on X-rays in healthcare and for predictive analytics in retail. In manufacturing, we need more than 100 images to train the models. DALL·E can generate more than 1000 images based on the specific descriptions we give.
What is most valuable?
The tool is the best choice for summarizing the key elements of a document that contains more than 1000 pages. It is the best at summarizing documents.
What needs improvement?
Sometimes, the responses are repetitive. It is easy to identify whether a text is created by OpenAI. The responses must be made more natural. The keywords must not be repeated every time.
For how long have I used the solution?
I have been working with the product for more than two years.
What do I think about the scalability of the solution?
The tool is easily scalable.
How are customer service and support?
I have been working with the support team for the past ten years. My experience has always been wonderful.
How would you rate customer service and support?
Positive
How was the initial setup?
The initial setup is very easy.
What was our ROI?
The product saves a lot of time. We use it for our customers and our development processes. Our developers have stopped using Stack Overflow. Most of them use ChatGPT for development. We have integrated the solution with GitHub Copilot, which has expedited our code-writing practices.
Our testers describe the test cases and search for use cases on OpenAI. It gives the right results almost 70 to 80% of the time. Our productivity has increased by 40% to 45%. It is a great return on investment for me. The projects that we delivered with the help of three people, we now deliver with one or two people. The customers also see an increase in productivity.
What other advice do I have?
We are a Microsoft Gold partner. We get access to all the latest technologies. Overall, I rate the product a nine out of ten.
Disclosure: My company has a business relationship with this vendor other than being a customer. Partner
Buyer's Guide
Azure OpenAI
December 2025
Learn what your peers think about Azure OpenAI. Get advice and tips from experienced pros sharing their opinions. Updated: December 2025.
879,425 professionals have used our research since 2012.
Analyst Developer at a government with 1,001-5,000 employees
Makes our product information much more accessible than traditional keyword-based search but some issues with scaling
Pros and Cons
- "It's very powerful. It allows users to query our documents using natural language and receive answers in the same way. This makes our product information much more accessible than traditional keyword-based search."
- "Since we don't train the model on our data, it's a struggle to ensure OpenAI answers questions exclusively from our data. During user testing, we found ways to make the system provide answers from outside sources."
What is our primary use case?
We're implementing an assistant using Azure OpenAI. The challenge is grounding OpenAI responses to our specific data.
We can only offer users basic querying, like for documents they're stuck on. It handles the request. It's primarily the question-answering feature.
What is most valuable?
It's very powerful. It allows users to query our documents using natural language and receive answers in the same way. This makes our product information much more accessible than traditional keyword-based search.
It's focused on information retrieval and question-answering, which suits our needs perfectly. It is more like a natural language query tool we leverage.
We use Azure OpenAI alongside Azure Cognitive Search. These are both new services we've deployed. There's a process where we need to ask Microsoft to create private endpoints to link OpenAI to Azure as a connectivity service.
What needs improvement?
Since we don't train the model on our data, it's a struggle to ensure OpenAI answers questions exclusively from our data. During user testing, we found ways to make the system provide answers from outside sources.
As a governance department, accuracy and control are crucial. We're trying to tune the system to stick with our content, but it's an ongoing challenge.
We've been working on fine-tuning prompts and parameters for about four weeks now.
For how long have I used the solution?
I've been using Azure OpenAI as a creative source for the past six months.
What do I think about the scalability of the solution?
We've noticed some issues with scaling. It takes time for the service to adapt when we increase the load. We're still in the pre-production phase, and we're seeing this even during testing.
Also, there's limited capacity in our region (Canada East), which makes it difficult to accommodate the expected load. We've submitted capacity increase requests, but we're not sure if they'll be approved.
The main challenge we've faced is around capacity. Even after running extensive load tests, we don't have sufficient capacity to handle our projected volume.
How are customer service and support?
We have a consultant from Microsoft working with us. They've been very helpful.
However, they're very busy. We could use more of their time if they were available. But they're very competent and helpful. We just wish we could have more access to their expertise.
How would you rate customer service and support?
Positive
Which solution did I use previously and why did I switch?
We have an alternative search engine that indexes our document base. We use Azure OpenAI's question-answering feature to query that index, generating answers from relevant documents.
We don't use GPT-4 specifically, nor are we training any models. Our IT group leverages Azure OpenAI for its existing capabilities.
It is our first implementation of this kind.
What other advice do I have?
There are some limitations right now. For our specific use case, where we need a traditional information retrieval system, it's not an ideal fit.
Azure OpenAI is a question-answering system built on top of information retrieval, and that distinction is important for us. Given our use case, I don't think it's well-suited.
Our management team requires accurate and complete results, with precision that matches our existing keyword search tools. It's difficult to evaluate and prove that Azure OpenAI consistently meets that standard.
We're still early in our adoption, so the rating could change as we deploy it to a larger audience.
For now, I would rate the solution a five out of ten.
Disclosure: My company does not have a business relationship with this vendor other than being a customer.
Consulting Chief Information Officer at a tech services company with 11-50 employees
Ensures its users experience a good percentage of cost-saving outcomes from its use
Pros and Cons
- "The product's initial setup phase was pretty easy."
- "Azure OpenAI is not an optimized tool yet, making it one of its shortcomings where improvements are required."
What is most valuable?
One of the tasks for which I found the use of Azure OpenAI to be useful for my business is related to the area of annotations in images.
What needs improvement?
Azure OpenAI is not an optimized tool yet, making it one of its shortcomings where improvements are required.
I would like Azure Open AI to provide more integrations with other platforms.
The cost of the product should be lowered.
For how long have I used the solution?
I have been using Azure OpenAI for six to seven months.
What do I think about the stability of the solution?
It is a stable solution.
What do I think about the scalability of the solution?
The scalability part of the product depends on whether you have declared the product on an on-premises model and what kind of configurations you are keeping with your back-end servers. I cannot talk about the product's scalability since the tool has more areas like outcomes, precision, and accuracy.
Conversational AI is used across hospitals. The hospital runs Azure OpenAI for EMRs. Businesses have started using AI components for various applications.
How are customer service and support?
The technical support part is documented, and my business works together with Azure OpenAI.
The technical support required by our business depends on the algorithms and the models being developed, which is not what Azure OpenAI provides. It basically lies with the user to solve a problem.
Which solution did I use previously and why did I switch?
My company works not only with Azure OpenAI but with foundation models, too.
How was the initial setup?
The product's initial setup phase was pretty easy. Installation is not an issue in the tool, but achieving the outcomes matters to our company, which is dependent on algorithms, models, and how much data you use to train your models.
The solution is deployed majorly on the cloud and then on an on-premises model.
The steps that can be deployed in Azure OpenAI include areas like integration with your applications.
Accessibility from your applications and browser is required to deploy the product.
What about the implementation team?
My company has a team of several solution providers who work together. My company has partnered with some of the startups in our ecosystems, so they work with us.
What was our ROI?
There are around 30 to 40 percent cost-saving outcomes in our company from the use of the solution.
What's my experience with pricing, setup cost, and licensing?
According to the negotiations taking place and the contract, there is a need to make either monthly or yearly payments to use the solution.
What other advice do I have?
With Azure OpenAI, there are a number of alignments that my business is into.
My company works with Azure OpenAI and our own private LLMs.
Though Azure OpenAI is not optimized, it is one of the best when it comes to text generation.
Azure OpenAI is regarded as a foundation model on which our company plans to use our private LLMs.
The natural language understanding capability of Azure OpenAI has improved our company's data analysis since we use the product's integration capabilities for areas like translations and conversational AI.
I recommend the solution to those who plan to use it, but there are also other products that are available on the market.
I rate the overall tool a nine out of ten.
Which deployment model are you using for this solution?
Hybrid Cloud
Disclosure: My company does not have a business relationship with this vendor other than being a customer.
IT Operations Tech Lead at a financial services firm with 10,001+ employees
Streamlines document creation process and enhances real-time coding capabilities
Pros and Cons
- "The document intelligence feature has significantly aided in our operations, facilitating the creation of descriptive content."
- "In the next release, they could enhance the product's features for even greater usability and efficiency."
How has it helped my organization?
Implementing Azure OpenAI has notably streamlined our document creation process, increasing efficiency and productivity.
It aligns with our organization's compliance policies and data security requirements, assuring regulatory compliance.
It enhances our AI-driven projects by seamlessly integrating with tools like GitHub CoPilot, improving real-time coding capabilities, and facilitating development workflows.
What needs improvement?
In the next release, they could enhance the product's features for even greater usability and efficiency.
For how long have I used the solution?
I have been working with Azure OpenAI for approximately one year.
What do I think about the stability of the solution?
I rate the platform's stability a seven.
What do I think about the scalability of the solution?
Currently, over 1000 users within our organization utilize Azure OpenAI.
I rate the platform's scalability an eight.
How are customer service and support?
There can be delays in receiving responses from the technical support team.
How would you rate customer service and support?
Neutral
How was the initial setup?
The initial setup has been relatively straightforward, although it may present challenges for beginners, particularly when deploying with infrastructure as code.
Depending on the backend infrastructure, the deployment typically takes just a few minutes, ranging from two to five minutes. Two executives are required to handle the operations.
I rate the process around a seven.
What's my experience with pricing, setup cost, and licensing?
I rate the product pricing six out of ten.
What other advice do I have?
The product is integrated into our business workflows, particularly within our application development platforms.
The writing capabilities have been particularly crucial for generating descriptive content, such as case studies and product descriptions.
The document intelligence feature has significantly aided in our operations, facilitating the creation of descriptive content.
I recommend it to others, particularly those already utilizing Microsoft products or seeking a robust AI solution.
I rate the product a nine.
If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?
Microsoft Azure
Disclosure: My company does not have a business relationship with this vendor other than being a customer.
Head of Business at a tech services company with 11-50 employees
Enhances work productivity across all domains, but it could have more user-friendly features
Pros and Cons
- "Its versatility makes it incredibly useful for technical problem-solving, content creation, data analytics, and more."
- "There could be an ability to generate visual data, such as architecture diagrams."
What is our primary use case?
I use the platform for troubleshooting issues. When I encounter a problem, I turn to OpenAI to understand the reasons behind the issue and how to resolve it.
What is most valuable?
I find the platform's accessibility across all devices to be highly valuable. Additionally, the paid version offers a wide range of GPTs for various tasks, including technical problem-solving, scientific research, communication improvement, writing, art, and design. These GPTs use ChatGPT to build specific tools that leverage AI to expedite work processes.
What needs improvement?
The product could be more user-friendly in terms of features. There could be an ability to generate visual data, such as architecture diagrams. This could enhance its utility for various use cases.
For how long have I used the solution?
I have been working with OpenAI for for approximately two to six months.
What do I think about the stability of the solution?
The product has been highly stable. I have not encountered any outages so far.
What do I think about the scalability of the solution?
Since OpenAI is cloud-based, it can scale to accommodate any number of users. Each user needs a unique email ID, but otherwise, it is quite flexible in terms of scalability. Approximately 200 or more users in our organization are utilizing it regularly.
How are customer service and support?
The free version does not offer support. To receive support, one typically needs to purchase a monthly subscription, which costs $19.
How was the initial setup?
OpenAI is a cloud-based solution, so there is no need for local setup. It operates on the cloud and is accessible via cloud-based services.
What was our ROI?
The platform generates a return on investment in terms of efficiency in problem-solving and task automation has contributed to productivity gains.
What's my experience with pricing, setup cost, and licensing?
While the product meets our business requirements well, I consider it relatively expensive, especially for individual users like myself. However, as I become more accustomed to its benefits, it may become more affordable over time.
What other advice do I have?
I would recommend OpenAI to anyone who can afford it. Its versatility makes it incredibly useful for technical problem-solving, content creation, data analytics, and more. It is a powerful tool for enhancing productivity across various domains.
It is at the forefront of the AI trend, providing powerful tools that leverage AI to streamline workflows and improve efficiency.
I rate it a seven out of ten.
Disclosure: My company does not have a business relationship with this vendor other than being a customer.
Solution Sales Architect at a tech vendor with 1-10 employees
Offers cost savings and requires less expertise
Pros and Cons
- "It is easy to integrate and develop a solution. Most customers are concerned about the security of their data and how cost-effective it is. We have developed some methodologies so that our customers will not be charged too much for these OpenAI services but will still get the same kind of performance and results. It's all developed on Azure, so customers also see its benefit."
- "I faced one issue with Azure OpenAI: My customer wanted more clarity on the pricing. They were not able to get proper answers from the documentation or the pricing calculator. I suggest that Microsoft maintain standardization in the pricing details published in the documentation and the pricing calculator."
What is our primary use case?
Our team has developed virtual assistants for healthcare organizations, also published in Azure Marketplace. This can be used for a personal assistant perspective. We have also developed an application for one of the fertilizer companies. Here, a farmer can go to their application, click a photo of any disease or progress in the plant, and it will identify what type of fungus or disease that plant has. Accordingly, it will recommend what kind of fertilizers and how to use them. These are a couple of use cases we have worked on.
What is most valuable?
It is easy to integrate and develop a solution. Most customers are concerned about the security of their data and how cost-effective it is. We have developed some methodologies so that our customers will not be charged too much for these OpenAI services but will still get the same kind of performance and results. It's all developed on Azure, so customers also see its benefit.
What needs improvement?
I faced one issue with Azure OpenAI: My customer wanted more clarity on the pricing. They were not able to get proper answers from the documentation or the pricing calculator. I suggest that Microsoft maintain standardization in the pricing details published in the documentation and the pricing calculator.
Sometimes, customers check the prices independently, but the details of the pricing parameter and the documentation sheet are inconsistent. This confuses customers, making them unsure if the service is live or how to test it.
For how long have I used the solution?
I have been working with the product for a couple of days.
What do I think about the stability of the solution?
I haven't faced any issues with the tool's stability.
What do I think about the scalability of the solution?
The tool is highly scalable. I don't think any of my customers have faced any issues from a performance or scalability perspective when the load on their website has increased. We designed the solution to be highly scalable and reliable so they don't face challenges at the application or performance level. I have not seen any customers complaining about issues or performance problems.
My company has seven to eight clients using Azure OpenAI. Because of data concerns, all features should be available in at least one data center in each region. For example, there are three data centers in India, and until recently, Azure OpenAI was available in only four regions. Now, it is also available in one of the data centers in India. If Microsoft introduces a new product, it should ensure it is available in at least one data center per region so that customers from that region can validate it.
How was the initial setup?
Azure OpenAI's deployment is easy. It depends on a couple of things, including the solution we are developing. If it is a normal chatbot, it shouldn't take more than two to three days to complete the project. However, it might take longer if the customer has a very complex environment.
What was our ROI?
You can enjoy cost savings because you need only less expertise. Traditionally, IT services or SLM models require a lot of computing power to train models, but Microsoft has already invested in them. Customers can directly use this high-efficiency model available on the Microsoft platform. Microsoft has already done that, they don't have to build anything from scratch or use high computing resources. So, there is a good ROI.
What other advice do I have?
I rate the overall product an eight out of ten. You should start by researching and experimenting with Azure OpenAI. You can create a simple chatbot or a computer vision model that identifies objects in images. This will help you understand how it works and develop use cases based on your requirements. I would also suggest testing those use cases.
In India, I'm seeing that customers across various industries, whether manufacturing, BFSI, or healthcare, are all starting to use AI in some form. Each customer develops solutions for cross-selling and processing products based on specific use cases. They design user stories for their customers, create offers to grab attention, integrate interactive chatbots into their applications or websites, and develop AI-based visitor and document management systems. Everyone wants to use AI differently, but no two use cases are the same.
Disclosure: My company has a business relationship with this vendor other than being a customer. Partner
Practice leader Digital Workplace at a computer software company with 1,001-5,000 employees
Industry-leading coding and language AI models that you can fine-tune to your specific needs for a variety of use cases
Pros and Cons
- "I noticed there are no instructional videos or guides on the network portal for initial configurations. There is limited information available, and this is a concern for me. I would like to see more resources and guides to address these issues."
What needs improvement?
I'll provide feedback on additional features after the project is completed. I think it would be better to comment on that after the implementation is finished.
For how long have I used the solution?
I have been testing this solution for the past month.
What do I think about the scalability of the solution?
The deployment is not finished yet. To assess performance and stability, the project needs completion. Currently, our professional service is actively involved, managing tasks related to services and users in the ongoing termination process.
How are customer service and support?
Currently, I'm in constant communication with them. They are professional, helpful, and highly experienced.
How would you rate customer service and support?
Positive
How was the initial setup?
They need to simplify the implementation process. I've observed that sometimes the professional service is focused on the database, especially around log shipping, and it can be challenging. I'm actively involved in the deployment process, but it's carried out by our professional service. Our plans are implemented through this service, acting as intermediaries between our clients and the professionals. The implementation typically takes around a month, but various issues, such as management, resource, and other challenges, may arise during the deployment.
One notable difficulty we face is the lack of exceptional resources for deploying the solution in our plans. Despite encountering challenges, our satisfaction with the professional service remains high. They are dedicated to implementing the solution effectively.
What's my experience with pricing, setup cost, and licensing?
I'm uncertain about the licensing, specifically the pricing. This falls under the purview of other teams, particularly the sales teams. I am not informed about the pricing details.
What other advice do I have?
I would also rate it a ten overall. It's scalable and easy to deploy. However, I have some concerns. I noticed there are no instructional videos or guides on the network portal for initial configurations. There is limited information available, and this is a concern for me. I would like to see more resources and guides to address these issues.
Regrettably, this product remains incomplete, and the interim phase is still pending. It is challenging to determine its effectiveness due to some significant license initial issues.
Which deployment model are you using for this solution?
On-premises
Disclosure: My company has a business relationship with this vendor other than being a customer. Partner
Buyer's Guide
Download our free Azure OpenAI Report and get advice and tips from experienced pros
sharing their opinions.
Updated: December 2025
Product Categories
AI Development PlatformsPopular Comparisons
Google Vertex AI
Hugging Face
Amazon SageMaker
Microsoft Azure Machine Learning Studio
Replicate
TensorFlow
Fireworks AI
IBM Watson Studio
Together Inference
Google Cloud AI Platform
DataRobot
GroqCloud Platform
OpenVINO
IBM Watson Machine Learning
Cohere
Buyer's Guide
Download our free Azure OpenAI Report and get advice and tips from experienced pros
sharing their opinions.
Quick Links
Learn More: Questions:
- When evaluating Artificial Intelligence Development Platforms, what aspect do you think is the most important to look for?
- What are the main storage requirements to support Artificial Intelligence and Deep Learning applications?
- What is the most effective AI platform to work with? Does it help if it is also "fun"?
- What are the major Edge AI technology use cases that can be used in the Banking/Finance, Power and Agricultural sectors?
- What are the top emerging trends in AI and ML in 2022?
- How do I do AI implementation?
- Why is AI Development Platforms important for companies?




















