I use it in my company for generative AI or GenAI, transcription services, chat services, and text summarization API services.
Though the solution's GenAI is great, the product's support needs improvement
Pros and Cons
- "Generative AI or GenAI seems to be the best part of the solution."
- "There are certain shortcomings with the product's scalability and support team where improvements are required."
What is our primary use case?
What is most valuable?
The chatbot available with the help of the tool seems to be the best feature for our company as we are into healthcare, and whatever work we want the tool to help us with when it comes to the healthcare section, we get prompt responses. Generative AI or GenAI seems to be the best part of the solution.
What needs improvement?
The developer access provided by the tool is a bit less, while the costing part doesn't seem to be clear, making both areas where improvements are needed. A user is not able to get a clear-cut idea of the cost side of the product, making it an area where some improvements are required.
There are certain shortcomings with the product's scalability and support team where improvements are required.
For how long have I used the solution?
I have been using Azure OpenAI for about six months. My company is a customer of the product.
Buyer's Guide
Azure OpenAI
November 2024
Learn what your peers think about Azure OpenAI. Get advice and tips from experienced pros sharing their opinions. Updated: November 2024.
815,854 professionals have used our research since 2012.
What do I think about the stability of the solution?
The product's stability is good. Stability-wise, I rate the solution a seven out of ten.
What do I think about the scalability of the solution?
The product's scalability is low. Scalability-wise, I rate the solution a five out of ten.
In my company, we are mostly into research and development, and we use the tool for certain analyses that we have made public, so we have not tried to figure out the number of users who use the solution.
How are customer service and support?
Earlier, my company had tried to contact the product's technical support team, but we did not get a proper response back then. The response from the technical support team was not quick.
I rate the technical support a three out of ten.
How would you rate customer service and support?
Negative
Which solution did I use previously and why did I switch?
I don't have any experience with any solutions before Azure OpenAI.
How was the initial setup?
The product's initial setup phase was not that difficult to handle as it was a manageable process. One does not need to have any experience to take care of the initial setup phase.
The solution's deployment didn't take much time for our company.
What was our ROI?
Regarding ROI, I would say that my company is still working on it.
What's my experience with pricing, setup cost, and licensing?
Cost-wise, the product's price is a bit on the higher side.
What other advice do I have?
I would tell those who plan to use the solution that Azure OpenAI's developer forum and support need improvement.
I rate the overall product a seven out of ten.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Lead Engineer at EDP
A stable product that enables organizations to implement tasks quickly and improves the response time of support teams
Pros and Cons
- "We can use the solution to implement our tasks and models quickly."
- "The product must improve its dashboards."
What is most valuable?
We can use the solution to implement our tasks and models quickly.
What needs improvement?
The product must improve its dashboards. I would like to know how many tokens my requests use and how accurate the search is. We are using Python language to find out about it.
For how long have I used the solution?
I have been using the solution for six months. I am using the latest version of the solution.
What do I think about the stability of the solution?
I rate the tool’s stability a ten out of ten. I do not have any problems with it.
What do I think about the scalability of the solution?
About 5000 people use the tool in our organization. I rate the tool’s scalability a six out of ten because it doesn’t have automatic installation options.
Which solution did I use previously and why did I switch?
We have done some POCs with AWS Bedrock and some AI products from Google. We chose Azure OpenAI because we have a preference for the vendor. All our infrastructure is deployed on Azure.
How was the initial setup?
We are maintaining the solution, but the maintenance is not on OpenAI services. We maintain the Python code that we embedded. Our technical team has five people, including two engineers and two data scientists.
What was our ROI?
The response time of our call centers has improved. The team is using the language models to ask simple questions.
What other advice do I have?
I would recommend the tool to others. Overall, I rate the solution an eight out of ten.
Which deployment model are you using for this solution?
Public Cloud
If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?
Microsoft Azure
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Buyer's Guide
Azure OpenAI
November 2024
Learn what your peers think about Azure OpenAI. Get advice and tips from experienced pros sharing their opinions. Updated: November 2024.
815,854 professionals have used our research since 2012.
Manager at PricewaterhouseCoopers
Powerful language processing capabilities with high precision of information extraction
Pros and Cons
- "The high precision of information extraction is the most valuable feature."
- "There are no available updates of information that are currently provided."
What is our primary use case?
The main use case for Azure OpenAI is invoice processing. The first step is to recognize the text from images through Azure Cognitive Services, and then utilize Azure OpenAI to extract relevant information from the text. It provides more accurate information extraction compared to Azure Recognizer. This automation helps streamline the accounting process.
What is most valuable?
The high precision of information extraction is the most valuable feature. It enables the accurate extraction of information from various types of documents, including contracts, invoices, CDs, and fiscal documents.
What needs improvement?
Azure OpenAI needs to be updated quickly to keep up with rapidly changing technologies. There are no available updates of information that are currently provided. It is important to integrate newer technologies and ensure accurate information is available for seamless operation.
For how long have I used the solution?
It is a recently launched platform, so I have used it for a couple of months now.
What do I think about the stability of the solution?
I didn't face any issues regarding the stability. I would rate it nine out of ten.
What do I think about the scalability of the solution?
I would rate the scalability ten out of ten.
How are customer service and support?
Microsoft offers very good support services. If there is any issue, regarding the operation or during deployment, you can reach out to their global IT department for assistance. I would rate it nine out of ten.
How would you rate customer service and support?
Positive
How was the initial setup?
The initial setup was easy. I would rate it eight out of ten. It is simple to use. There are certain security concerns that may arise with multinational companies, that require approval from IT department to use it. Overall, it is not a difficult process.
What about the implementation team?
We received notification that our team works on the deployment of the solution on the preferred cloud.
What's my experience with pricing, setup cost, and licensing?
The cost structure depends on the volume of data processed and the computational resources required. There might be additional costs for private cloud usage and security considerations.
What other advice do I have?
It is a useful solution that offers a variety of purposes. Developers can benefit from improvements in the system that would align with current technologies. Different departments, such as marketing, accounting, and finance can already use Azure OpenAI as a helpful assistant. I would rate it nine out of ten.
Which deployment model are you using for this solution?
Private Cloud
If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?
Microsoft Azure
Disclosure: My company has a business relationship with this vendor other than being a customer: Partner
Lead automation engineer at Dentsu
Provides prompt responses and speeds up the development process
Pros and Cons
- "GPT was useful for our projects."
- "The UI could be a little easier."
What is our primary use case?
We use the solution for training. We did a POC. We use it for some hackathon projects we have been working on.
How has it helped my organization?
The solution has improved our development process. When we integrate with OpenAI, we get immediate responses for what kind of code or logic we must use.
What is most valuable?
GPT was useful for our projects.
What needs improvement?
The UI could be a little easier. The prompts must be updated.
What do I think about the stability of the solution?
The product is not stable. We get different results for the same prompts. The stability must be improved. However, it is common across any AI tool we use.
What do I think about the scalability of the solution?
The product is pretty much scalable. It helped us scale some of our projects. The internal teams use the tool for projects.
How was the initial setup?
The setup is easier compared to AWS. The tool can be deployed on the cloud.
What other advice do I have?
We use the API calls to integrate OpenAI into our existing workflows. I use API calls. We used the tool for testing purposes for a small project. It was not given to the end users. People who want to use the solution must go through its capabilities. Though AI is available in the market, not everyone is exploring it. The tool is an advanced alternative to Google Search. It helps with development and coding by providing prompt responses. Overall, I rate the product a nine out of ten.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Last updated: Jun 2, 2024
Flag as inappropriatePrincipal consultant and enterprise architect at Dell Technologies
Helps to build chatbots and has good turnaround time
Pros and Cons
- "Two aspects I appreciate are the turnaround time and ease of use. As it's a managed service, the quick turnaround is beneficial, and the simple interface makes it easy to work with. Performance and scalability are also strong points since you can scale as needed."
- "I have found the tool unreliable in certain use cases. I aim to enhance the system's latency, particularly in responding to calls. Occasionally, calls don't respond, so I want to improve reliability."
What is our primary use case?
The typical use cases include building chatbots for financial document analysis, agents for transaction categorization, and call centre voice identification or conversation analytics.
What is most valuable?
Two aspects I appreciate are the turnaround time and ease of use. As it's a managed service, the quick turnaround is beneficial, and the simple interface makes it easy to work with. Performance and scalability are also strong points since you can scale as needed.
We used Azure OpenAI to analyze call center voice data. This helped us better understand customer sentiments and make recommendations.
What needs improvement?
I have found the tool unreliable in certain use cases. I aim to enhance the system's latency, particularly in responding to calls. Occasionally, calls don't respond, so I want to improve reliability.
For how long have I used the solution?
I have been working with the product for six months.
What do I think about the stability of the solution?
I have issues with Azure OpenAI's stability and reliability.
What do I think about the scalability of the solution?
The tool's scalability is good.
Which solution did I use previously and why did I switch?
I have worked with Amazon AWS but found Azure OpenAPI to be simpler.
How was the initial setup?
Azure OpenAI's deployment is straightforward. The deployment process takes around half a day to a full day, considering the use case and the end-to-end deployment. It works for around four to eight hours. To deploy the product, typical steps include data analysis, setting up keys for OpenAI, making API calls with the relevant dataset, implementing basic guardrails, and analyzing the final output. These are the basic steps involved in the deployment process.
What was our ROI?
A project that would have taken three to six months to build was completed in just six weeks with the help of Azure OpenAPI. So, that's our ROI. The biggest value of the service is how quickly you can prototype your use cases. It offers unlimited scalability, and it is easy to find something closer to your country. Plus, it's highly scalable and comparatively cheaper than other solutions.
What other advice do I have?
I rate the overall product an eight out of ten. If you're comfortable with your data being in the cloud and want quick results, Azure OpenAI is a great option. However, I haven't used it in a production environment yet, so I can't comment.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Last updated: May 11, 2024
Flag as inappropriateKierownik Biura Informatyki at EIB SA
Handles complex reports involving analysis and comparison of multiple documents
Pros and Cons
- "The most valuable features include analyzing comments and preparing requests for customers, making emails easier and faster."
- "Sometimes, it gives answers in English, even when the request is in Polish."
What is our primary use case?
We use OpenAI for the insurance process to analyze documents and insurer-to-client requests in the public parts of our process.
We plan to use it for confidential parts as well. This is the main solution we're aiming for.
How has it helped my organization?
We have a case from a company where we need to generate a complex report for a customer, comparing multiple documents. We plan to use OpenAI for this.
What is most valuable?
The most valuable features include analyzing comments and preparing requests for customers, making emails easier and faster.
What needs improvement?
Sometimes, it gives answers in English, even when the request is in Polish. That's the main reason it's not a perfect ten.
So, the language support could be better.
For how long have I used the solution?
We started a few months ago. It was a good first choice but not the best.
What do I think about the stability of the solution?
I would rate the stability a nine out of ten. It is quite good.
What do I think about the scalability of the solution?
We haven't had any problems with scalability. We have around 40 end users.
We will increase the number of users.
How are customer service and support?
We're in touch with customer service and support because we plan to implement Azure and Azure OpenAI. We also have a dedicated contact person at Microsoft, so we haven't had any issues getting support.
Which solution did I use previously and why did I switch?
We currently use OpenAI, but we've decided to use Azure in the future.
What about the implementation team?
My colleagues from the programming team handled the setup. I don't know the specifics, but they didn't have any issues using it.
What's my experience with pricing, setup cost, and licensing?
We started with monthly payments, but we plan to switch to yearly billing once we've stabilized our solution.
What other advice do I have?
Overall, I would rate the solution an eight out of ten.
I chose Azure OpenAI and would recommend it to others because it's easy to set up, and I plan to use the cloud, which eliminates concerns about equipment and other infrastructure.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Last updated: Jun 6, 2024
Flag as inappropriateConsulting & Solutions, BA/BD in Enterprise IT on Open Source, Red Hat & EDB at KEEN AND ABLE COMPUTERS PVT LTD
Enhances work productivity across all domains, but it could have more user-friendly features
Pros and Cons
- "Its versatility makes it incredibly useful for technical problem-solving, content creation, data analytics, and more."
- "There could be an ability to generate visual data, such as architecture diagrams."
What is our primary use case?
I use the platform for troubleshooting issues. When I encounter a problem, I turn to OpenAI to understand the reasons behind the issue and how to resolve it.
What is most valuable?
I find the platform's accessibility across all devices to be highly valuable. Additionally, the paid version offers a wide range of GPTs for various tasks, including technical problem-solving, scientific research, communication improvement, writing, art, and design. These GPTs use ChatGPT to build specific tools that leverage AI to expedite work processes.
What needs improvement?
The product could be more user-friendly in terms of features. There could be an ability to generate visual data, such as architecture diagrams. This could enhance its utility for various use cases.
For how long have I used the solution?
I have been working with OpenAI for for approximately two to six months.
What do I think about the stability of the solution?
The product has been highly stable. I have not encountered any outages so far.
What do I think about the scalability of the solution?
Since OpenAI is cloud-based, it can scale to accommodate any number of users. Each user needs a unique email ID, but otherwise, it is quite flexible in terms of scalability. Approximately 200 or more users in our organization are utilizing it regularly.
How are customer service and support?
The free version does not offer support. To receive support, one typically needs to purchase a monthly subscription, which costs $19.
How was the initial setup?
OpenAI is a cloud-based solution, so there is no need for local setup. It operates on the cloud and is accessible via cloud-based services.
What was our ROI?
The platform generates a return on investment in terms of efficiency in problem-solving and task automation has contributed to productivity gains.
What's my experience with pricing, setup cost, and licensing?
While the product meets our business requirements well, I consider it relatively expensive, especially for individual users like myself. However, as I become more accustomed to its benefits, it may become more affordable over time.
What other advice do I have?
I would recommend OpenAI to anyone who can afford it. Its versatility makes it incredibly useful for technical problem-solving, content creation, data analytics, and more. It is a powerful tool for enhancing productivity across various domains.
It is at the forefront of the AI trend, providing powerful tools that leverage AI to streamline workflows and improve efficiency.
I rate it a seven out of ten.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Last updated: Jun 2, 2024
Flag as inappropriateAnalyst Developer at a government with 1,001-5,000 employees
Makes our product information much more accessible than traditional keyword-based search but some issues with scaling
Pros and Cons
- "It's very powerful. It allows users to query our documents using natural language and receive answers in the same way. This makes our product information much more accessible than traditional keyword-based search."
- "Since we don't train the model on our data, it's a struggle to ensure OpenAI answers questions exclusively from our data. During user testing, we found ways to make the system provide answers from outside sources."
What is our primary use case?
We're implementing an assistant using Azure OpenAI. The challenge is grounding OpenAI responses to our specific data.
We can only offer users basic querying, like for documents they're stuck on. It handles the request. It's primarily the question-answering feature.
What is most valuable?
It's very powerful. It allows users to query our documents using natural language and receive answers in the same way. This makes our product information much more accessible than traditional keyword-based search.
It's focused on information retrieval and question-answering, which suits our needs perfectly. It is more like a natural language query tool we leverage.
We use Azure OpenAI alongside Azure Cognitive Search. These are both new services we've deployed. There's a process where we need to ask Microsoft to create private endpoints to link OpenAI to Azure as a connectivity service.
What needs improvement?
Since we don't train the model on our data, it's a struggle to ensure OpenAI answers questions exclusively from our data. During user testing, we found ways to make the system provide answers from outside sources.
As a governance department, accuracy and control are crucial. We're trying to tune the system to stick with our content, but it's an ongoing challenge.
We've been working on fine-tuning prompts and parameters for about four weeks now.
For how long have I used the solution?
I've been using Azure OpenAI as a creative source for the past six months.
What do I think about the scalability of the solution?
We've noticed some issues with scaling. It takes time for the service to adapt when we increase the load. We're still in the pre-production phase, and we're seeing this even during testing.
Also, there's limited capacity in our region (Canada East), which makes it difficult to accommodate the expected load. We've submitted capacity increase requests, but we're not sure if they'll be approved.
The main challenge we've faced is around capacity. Even after running extensive load tests, we don't have sufficient capacity to handle our projected volume.
How are customer service and support?
We have a consultant from Microsoft working with us. They've been very helpful.
However, they're very busy. We could use more of their time if they were available. But they're very competent and helpful. We just wish we could have more access to their expertise.
How would you rate customer service and support?
Positive
Which solution did I use previously and why did I switch?
We have an alternative search engine that indexes our document base. We use Azure OpenAI's question-answering feature to query that index, generating answers from relevant documents.
We don't use GPT-4 specifically, nor are we training any models. Our IT group leverages Azure OpenAI for its existing capabilities.
It is our first implementation of this kind.
What other advice do I have?
There are some limitations right now. For our specific use case, where we need a traditional information retrieval system, it's not an ideal fit.
Azure OpenAI is a question-answering system built on top of information retrieval, and that distinction is important for us. Given our use case, I don't think it's well-suited.
Our management team requires accurate and complete results, with precision that matches our existing keyword search tools. It's difficult to evaluate and prove that Azure OpenAI consistently meets that standard.
We're still early in our adoption, so the rating could change as we deploy it to a larger audience.
For now, I would rate the solution a five out of ten.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Last updated: Apr 10, 2024
Flag as inappropriateBuyer's Guide
Download our free Azure OpenAI Report and get advice and tips from experienced pros
sharing their opinions.
Updated: November 2024
Product Categories
AI Development PlatformsPopular Comparisons
Microsoft Azure Machine Learning Studio
Amazon SageMaker
Google Vertex AI
Hugging Face
TensorFlow
Google Cloud AI Platform
IBM Watson Studio
Replicate
OpenVINO
DataRobot
IBM Watson Machine Learning
Together Inference
Wit.ai
Buyer's Guide
Download our free Azure OpenAI Report and get advice and tips from experienced pros
sharing their opinions.
Quick Links
Learn More: Questions:
- When evaluating Artificial Intelligence Development Platforms, what aspect do you think is the most important to look for?
- What are the main storage requirements to support Artificial Intelligence and Deep Learning applications?
- What is the most effective AI platform to work with? Does it help if it is also "fun"?
- What are the major Edge AI technology use cases that can be used in the Banking/Finance, Power and Agricultural sectors?
- What are the top emerging trends in AI and ML in 2022?
- How do I do AI implementation?
- Why is AI Development Platforms important for companies?