We are currently exploring the solution's LLM chat and question-and-answer-based endpoints.
Data Scientist at a tech services company with 1,001-5,000 employees
Something we cannot reproduce with any open-source LLM
Pros and Cons
- "Azure OpenAI is easy to use because the endpoints are created, and we just need to pass our parameters and info."
- "Azure OpenAI will be expensive if you want to implement it as a permanent solution for a customer."
What is our primary use case?
What is most valuable?
The most valuable feature of the solution is the accuracy of ChatGPT. It is something we cannot reproduce with any open-source LLM. Azure OpenAI is easy to use because the endpoints are created, and we just need to pass our parameters and info.
What needs improvement?
Azure OpenAI will be expensive if you want to implement it as a permanent solution for a customer. I have explored Azure OpenAI from a purely LLM perspective. Its endpoints are currently enough for us to communicate with their ChatGPT instance and get results. I don't know if Azure has anything implemented for images, videos, and other endpoints.
For how long have I used the solution?
We have been exploring ChatGPT 3.5 and 4 versions for one and a half years.
Buyer's Guide
Azure OpenAI
December 2024
Learn what your peers think about Azure OpenAI. Get advice and tips from experienced pros sharing their opinions. Updated: December 2024.
823,875 professionals have used our research since 2012.
What do I think about the scalability of the solution?
Around 20 to 50 users were using Azure OpenAI for one of our projects.
How are customer service and support?
Whenever we encounter issues, we try to raise them on the portal, and we get a resolution from there.
How was the initial setup?
Microsoft takes care of the deployment. We just get our instance, and we have to communicate with it.
What's my experience with pricing, setup cost, and licensing?
If you consider the long-term aspect of any project, Azure OpenAI is a costly solution. However, the solution is cheap if you just want to see results or try some POC in the initial stages. This is because you don't need to spin up your instance; you can just consume things and see the results.
What other advice do I have?
Azure OpenAI is a straightforward solution. After configuring it, you will get your endpoints. You then need to call the endpoints and pass the details. Azure OpenAI is a straightforward tool that is implemented in such a way that even a fresher or junior developer can learn to use it easily.
Overall, I rate the solution an eight out of ten.
Disclosure: My company has a business relationship with this vendor other than being a customer: customer/partner
Last updated: May 11, 2024
Flag as inappropriateSoftware Engineer at Xoxzo
With clear documentation in place, the tool helps in the creation of message dashboards
Pros and Cons
- "The most valuable feature of Azure OpenAI stems from the GPT-3.5 models it provides to its users."
- "The fine-tuning of models with the use of Azure OpenAI is an area with certain shortcomings currently, and it can be considered for improvement in the future."
What is our primary use case?
I use Azure OpenAI to create message dashboards for my company.
What is most valuable?
The most valuable feature of Azure OpenAI stems from the GPT-3.5 models it provides to its users. The information that I provide is based on the information I found through research. I have not started to use the solution for the development part.
What needs improvement?
The fine-tuning of models with the use of Azure OpenAI is an area with certain shortcomings currently, and it can be considered for improvement in the future. It would be great if Azure OpenAI could increase the limit of the knowledge of its chatbot. If I have datasets for fine-tuning, the chatbot can only answer the user's queries related to training data, meaning the chatbot would not provide any knowledge to its users from the outside world.
For how long have I used the solution?
I have been using Azure OpenAI for maybe a month.
What do I think about the scalability of the solution?
I work in a company involved in some business related to messaging, where I did not have a reason to think about scalability options provided by the solution.
How are customer service and support?
I have not contacted the solution's technical support yet since I am still involved in some research related to the product.
Which solution did I use previously and why did I switch?
I have experience with LangChain. LangChain uses OpenAI.
How was the initial setup?
The documentation provided by Azure OpenAI is clear enough. Based on my research, I think the product's initial setup phase would be easy.
The solution is deployed on the cloud services from Azure.
Though in my company, we are in the process related to the deployment of Azure OpenAI, it has not been deployed yet.
What other advice do I have?
I want Azure OpenAI since it is the best solution related to language processing.
The only suggestion I can provide to those who plan to use Azure OpenAI is to consider providing the tool with clear prompts. Azure OpenAI is one of the best tools and easy to use.
Sometimes, when I try some prompts, Azure OpenAI fails to understand them. Overall, Azure OpenAI is a really helpful tool.
I rate the overall solution a nine out of ten.
If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?
Microsoft Azure
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Buyer's Guide
Azure OpenAI
December 2024
Learn what your peers think about Azure OpenAI. Get advice and tips from experienced pros sharing their opinions. Updated: December 2024.
823,875 professionals have used our research since 2012.
Co-Founder & Director at AI Momentum
Has a valuable ALM feature, but the dialogue manager should be improved
Pros and Cons
- "The most valuable feature is the ALM."
- "The dialogue manager needs to be improved."
What is most valuable?
The most valuable feature is the ALM. It can execute clarifications against security.
What needs improvement?
The dialogue manager needs to be improved.
For how long have I used the solution?
I have been using Azure OpenAI for six months.
What do I think about the scalability of the solution?
It is a scalable solution.
What other advice do I have?
I would rate the overall solution a seven out of ten.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Last updated: May 15, 2024
Flag as inappropriateProduct Project Manager at Virgosol
Used for translating, researching, and benchmarking products
Pros and Cons
- "Azure OpenAI is useful for benchmarking products."
- "Azure OpenAI should use more specific sources like academic articles because sometimes the source can't be found."
What is our primary use case?
When I write documentation, I use the solution for translating anything and researching.
What is most valuable?
Azure OpenAI is useful for benchmarking products. We can search for all metrics with AI tools and compare our products with other products.
What needs improvement?
The solution’s stability could be improved. Azure OpenAI should use more specific sources like academic articles because I can't find the source.
For how long have I used the solution?
I have been using Azure OpenAI for more than a year.
What do I think about the stability of the solution?
I rate the solution a nine out of ten for stability.
What do I think about the scalability of the solution?
I rate the solution’s scalability a seven out of ten.
How was the initial setup?
The solution’s initial setup is very easy.
What about the implementation team?
I can deploy the solution by myself in a few seconds.
What's my experience with pricing, setup cost, and licensing?
We pay a licensing fee for Azure OpenAI. The solution's pricing is normal worldwide but expensive in Turkey because Turkey's currency is different.
What other advice do I have?
Azure OpenAI provides me with a lot of benefits. It's quick and saves me time.
Overall, I rate the solution an eight out of ten.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Last updated: Apr 30, 2024
Flag as inappropriateCountry Director (Sri Lanka)/ Executive RPA Lead - Asia Region at a tech services company with 51-200 employees
Integrates well with Azure ecosystem, but they could provide better connectivity with external tools
Pros and Cons
- "The product is easy to integrate with our IT workflow."
- "One area for improvement is providing more flexibility in configuration and connectivity with external tools."
What is our primary use case?
We utilize the product for various applications that handle unstructured or semi-structured data, such as question-and-answer systems, chatbots, and text-generation tasks.
What is most valuable?
The platform's most valuable features are its data generation capabilities and ability to retrieve information from large volumes of data. These features enable efficient processing and retrieval of relevant information.
What needs improvement?
While the product is closely linked with several other products offered by Microsoft Azure, especially when building generic AI solutions, some aspects could still be enhanced. One area for improvement is providing more flexibility in configuration and connectivity with external tools.
For how long have I used the solution?
We have been using Azure OpenAI for 5 months.
What do I think about the stability of the solution?
I rate the platform's stability an eight.
What do I think about the scalability of the solution?
The product is highly scalable. It is expensive and suitable for medium enterprises. Once all the components are configured, we can easily accommodate different requirements.
How are customer service and support?
I have had limited interaction with the technical support team but heard of delays in response, likely due to various factors.
How would you rate customer service and support?
Neutral
Which solution did I use previously and why did I switch?
I have previously considered using a different solution before exploring Azure OpenAI. While I haven't utilized ChatGPT extensively, I find OpenAI, particularly in ChatGPT, quite effective. Additionally, many customers prefer the Microsoft platform due to its inherent trust and seamless integration with other Azure services. This trust factor and integration capability make it easier for customers to build solutions that connect various components within the Azure ecosystem, which is perceived as a superior feature.
How was the initial setup?
The initial setup for Azure OpenAI can be complex, as various roles and access-related settings must be configured. This process can be time-consuming, especially for users unfamiliar with the Azure platform.
What's my experience with pricing, setup cost, and licensing?
The platform offers a flexible pricing model which depends on the features and capabilities we utilize.
What other advice do I have?
The product is easy to integrate with our IT workflow. I recommend it to others and rate it a seven out of ten.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Last updated: Apr 30, 2024
Flag as inappropriateASPIRE Managed Service Global Offering Lead at Version 1
Helps to digitalize records and use generative AI on them
Pros and Cons
- "We have many use cases for the solution, such as digitalizing records, a chatbot looking at records, and being able to use generative AI on them."
- "Our customers are worried about data management, ethical, and security issues."
What is our primary use case?
We have many use cases for the solution, such as digitalizing records, a chatbot looking at records, and being able to use generative AI on them.
What needs improvement?
Our customers are worried about data management, ethical, and security issues.
For how long have I used the solution?
I have been working with the solution for the last six months.
What do I think about the stability of the solution?
The tool is stable.
What do I think about the scalability of the solution?
Azure OpenAI is scalable.
How was the initial setup?
The tool's deployment can take weeks to complete.
What other advice do I have?
I rate Azure OpenAI an eight out of ten. Don't focus on the technology, but on the problem you try to solve.
Disclosure: My company has a business relationship with this vendor other than being a customer: partner
Buyer's Guide
Download our free Azure OpenAI Report and get advice and tips from experienced pros
sharing their opinions.
Updated: December 2024
Product Categories
AI Development PlatformsPopular Comparisons
Microsoft Azure Machine Learning Studio
Amazon SageMaker
Google Vertex AI
Hugging Face
TensorFlow
Google Cloud AI Platform
IBM Watson Studio
Replicate
OpenVINO
DataRobot
IBM Watson Machine Learning
Together Inference
GroqCloud Platform
Wit.ai
Buyer's Guide
Download our free Azure OpenAI Report and get advice and tips from experienced pros
sharing their opinions.
Quick Links
Learn More: Questions:
- When evaluating Artificial Intelligence Development Platforms, what aspect do you think is the most important to look for?
- What are the main storage requirements to support Artificial Intelligence and Deep Learning applications?
- What is the most effective AI platform to work with? Does it help if it is also "fun"?
- What are the major Edge AI technology use cases that can be used in the Banking/Finance, Power and Agricultural sectors?
- What are the top emerging trends in AI and ML in 2022?
- How do I do AI implementation?
- Why is AI Development Platforms important for companies?