Our only use case with DevOps was for integration with ReadyAPI.
SDET at a consultancy with 1,001-5,000 employees
Ability to run tests and has automation tools but integration process could be improved
Pros and Cons
- "The most valuable feature is that we can run integrations with DevOps. From a QA perspective and a testing perspective, we can run those tests and integrate automation tools. Then we can run those tests as part of the deployment process. Every time we are deploying something, it automatically runs all the tests."
- "Something that could be improved is the initial setup with the integration of ReadyAPI."
What is our primary use case?
What is most valuable?
The most valuable feature is that we can run integrations with DevOps. From a QA perspective and a testing perspective, we can run those tests and integrate automation tools. Then we can run those tests as part of the deployment process. Every time we are deploying something, it automatically runs all the tests.
What needs improvement?
Something that could be improved is the initial setup with the integration of ReadyAPI.
For how long have I used the solution?
I used this solution for six months.
Buyer's Guide
Microsoft Azure DevOps
October 2024
Learn what your peers think about Microsoft Azure DevOps. Get advice and tips from experienced pros sharing their opinions. Updated: October 2024.
814,649 professionals have used our research since 2012.
What do I think about the stability of the solution?
Stability is fine. I was getting some errors, but that was due to my side of things.
What do I think about the scalability of the solution?
Scalability is fine.
How was the initial setup?
I would rate this solution 6 out of 10.
I did have some issues due to our organization, but it would be different for everyone. My advice is to reach out to support if you have any problems.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Process Manager at a marketing services firm with 501-1,000 employees
User-friendly, good performance, has good support, and connects well with PowerBI
Pros and Cons
- "We are able to generate many different types of reports from Azure."
- "There are certain features, and reporting that can only be used in PowerBI, but not directly in DevOps."
What is our primary use case?
We use this solution for project management and delivery.
What is most valuable?
It is easy to use.
We are able to generate many different types of reports from Azure. It connects well to PowerBI.
The performance is good.
What needs improvement?
They could have more reporting features added to the dashboard. There are certain features, and reporting that can only be used in PowerBI, but not directly in DevOps.
We would like to have the same calculated reports that can be accessed in PowerBI, available in Microsoft Azure DevOps.
For how long have I used the solution?
We have been using Microsoft Azure DevOps for the last two and a half years.
What do I think about the stability of the solution?
Microsoft Azure DevOps is a stable product.
What do I think about the scalability of the solution?
It is easy to scale. We have approximately 250 employees in our organization who use this solution.
How are customer service and technical support?
We have contacted technical support. They provided us with a fast resolution.
Which solution did I use previously and why did I switch?
We are using Azure, and TFS now. We are also planning to migrate to AWS as well.
How was the initial setup?
The installation was easy.
We have an IT team of four to manage and deploy this solution.
What other advice do I have?
I would definitely recommend this solution to others who are interested in using it.
I would rate Microsoft Azure DevOps an eight out of ten.
Which deployment model are you using for this solution?
Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Buyer's Guide
Microsoft Azure DevOps
October 2024
Learn what your peers think about Microsoft Azure DevOps. Get advice and tips from experienced pros sharing their opinions. Updated: October 2024.
814,649 professionals have used our research since 2012.
CTO at Cantier Inc
We use it for all of our development activities, and it is a complete solution with good reliability and scalability
Pros and Cons
- "You get a complete solution with Azure DevOps. You can do everything in one place, starting from requirement gathering until you release the product. It is a reliable, scalable, and handy product."
- "Its testing features are limited and can be improved a little more. They should provide more options from the testing and build perspective. Currently, we have to use a third-party product for testing. It would be great if it has more than one testing tool."
- "They have brought a lot of new collaboration features in the latest version. We haven't used those features, but they should continue to expand it more on the collaboration front so that two developers can look at the code and work at the same time. It will be helpful for working from home."
- "Its UI can be easier and more customer-friendly. The UI can be improved from the project management and agile perspective."
- "Its price can also be reduced. It would be great if they are a little bit more competitive in terms of pricing because many open-source products are currently available in the market."
What is our primary use case?
We are a product company, and we use Azure DevOps for product development. It is our backend platform, and we use it for all of our development activities.
What is most valuable?
You get a complete solution with Azure DevOps. You can do everything in one place, starting from requirement gathering until you release the product. It is a reliable, scalable, and handy product.
What needs improvement?
Its testing features are limited and can be improved a little more. They should provide more options from the testing and build perspective. Currently, we have to use a third-party product for testing. It would be great if it has more than one testing tool.
They have brought a lot of new collaboration features in the latest version. We haven't used those features, but they should continue to expand it more on the collaboration front so that two developers can look at the code and work at the same time. It will be helpful for working from home.
Its UI can be easier and more customer-friendly. The UI can be improved from the project management and agile perspective.
Its price can also be reduced. It would be great if they are a little bit more competitive in terms of pricing because many open-source products are currently available in the market.
For how long have I used the solution?
I have been using DevOps within the last 12 months.
What do I think about the stability of the solution?
It is definitely a reliable solution. That's why we have been using it for quite some time.
What do I think about the scalability of the solution?
It is scalable. There are no issues in terms of scalability. Currently, we have around 100 users. Its usage will definitely increase because a lot of new projects are coming.
How are customer service and technical support?
When migrating from TFS to Azure DevOps, we didn't get great support and response from Microsoft.
How was the initial setup?
Its initial setup was a little complex for us. We had been using TFS for quite some time, and migration was a bit difficult for us. We didn't get great support and response from Microsoft. We had limited resources in terms of support, and that's why it took us longer to figure out how to migrate from TFS.
What's my experience with pricing, setup cost, and licensing?
It has an annual subscription. It can be cheaper for partners. Many open-source products are available in the market, and it would be great if they can be a little bit more competitive in terms of pricing. A lot of startups are looking for an open-source, free, or cheap solution. If they can accommodate such requirements, it will be good for the product in the long run.
What other advice do I have?
I would rate Microsoft Azure DevOps an eight out of ten.
Which deployment model are you using for this solution?
Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Senior Consultant at CMEx
User-friendly with good reporting features assist with managing my test plans, and the support is responsive
Pros and Cons
- "The creation of test plans is valuable and I like the reporting features."
- "I have not been able to use the integration with automation features, such as test management automation, with a framework that is written in Java."
What is our primary use case?
We are a small product team and we do software development. I'm part of the testing team and I use Azure DevOps to manage all of my test activities. This includes my test plan, where I create my test cases, write test scripts, execute them, and publish the results using the dashboards.
What is most valuable?
I like a lot of the features in Azure DevOps.
The creation of test plans is valuable and I like the reporting features that it offers. For example, I like the charts, as well as reporting progress.
The interface is user-friendly.
What needs improvement?
I have not been able to use the integration with automation features, such as test management automation, with a framework that is written in Java. Currently, Azure offers frameworks that are written in C#. I have not found anything in the Microsoft documentation to say that it supports other languages.
For how long have I used the solution?
I have been using Microsoft Azure DevOps for approximately two years.
What do I think about the stability of the solution?
Being a SaaS product, sometimes we experience hangs. However, that is okay because in general, it is very much stable. If there are any outages then I get prior notification of such events.
What do I think about the scalability of the solution?
I have not tried scaling it. In my team, we have approximately 30 people who are using it.
How are customer service and technical support?
For me, the first point of contact is my internal organization and not Microsoft directly. However, if there are any changes that require Microsoft's intervention then there is an intermediate team who coordinates it. The response has been pretty good and I am happy with the support.
Which solution did I use previously and why did I switch?
I have used several tools in the past including Zephyr and the Rational Quality Manager.
How was the initial setup?
The initial setup is pretty straightforward. We needed to set up a Microsoft account, and that gives access to the projects. Basically, the IT department or IT administrators take care of the access.
As a member of the team, once access is provided, I can just start using it. It is plug-and-play, as far as I'm concerned.
What's my experience with pricing, setup cost, and licensing?
It is a subscription model and I only pay for what I use.
Which other solutions did I evaluate?
Very recently, I was doing comparative studies of available test management solutions on the market and I find Azure DevOps to be pretty good.
What other advice do I have?
Overall, this is a good product and I recommend it.
I would rate this solution an eight out of ten.
Which deployment model are you using for this solution?
Public Cloud
If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?
Disclosure: I am a real user, and this review is based on my own experience and opinions.
System engineering project Manager at a healthcare company with 51-200 employees
Good testing, helpful tracking dashboard activity, and test execution
Pros and Cons
- "I really like the Microsoft DevOps survey."
- "I would like to see DevOps have the ability to give us something with a compatibility or traceability matrix."
What is our primary use case?
I am familiar with the VSTS environment, grading tests, plan, and tracking dashboard activity.
In my previous company, we used this solution to create test cases, test reports, test execution, task boards, and we use the dashboard for the product activity.
What is most valuable?
I really like the Microsoft DevOps survey.
What needs improvement?
I would like to see DevOps have the ability to give us something with a compatibility or traceability matrix.
I have never seen a table or a Matrix in DevOps for traceability for either software or hardware upgrades. I am not aware of whether the website has these capabilities.
I had planned to recommend this product to my current company but the traceability is missing and could not consider it.
For how long have I used the solution?
I have been using this solution for three or four years.
What do I think about the stability of the solution?
It has some bugs that we reported and they have been fixed, which is good.
What other advice do I have?
I would rate Microsoft Azure DevOps a nine out of ten.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
XBRL Specialist at a financial services firm with 1,001-5,000 employees
Very stable and provides a nice and integrated environment for working in teams and implementing the DevOps philosophy
Pros and Cons
- "It is easy to use. The shared repository is useful. Everything is in one environment."
- "It is not that intuitive. Sometimes, it is hard to find some of the functions. I would like to have an old-fashioned menu structure to be able to easily find things. Its environment setup is not very good. They should improve the way it is set up for different screens and make it easier to find functionalities and maintain team members."
What is our primary use case?
I am using it as a developer in the agile scrum area.
How has it helped my organization?
It has improved the team cooperation for building, developing, and releasing systems.
What is most valuable?
It is easy to use. The shared repository is useful. Everything is in one environment.
What needs improvement?
It is not that intuitive. Sometimes, it is hard to find some of the functions. I would like to have an old-fashioned menu structure to be able to easily find things. Its environment setup is not very good. They should improve the way it is set up for different screens and make it easier to find functionalities and maintain team members.
For how long have I used the solution?
I have been using this solution for one and a half years.
What do I think about the stability of the solution?
It is very stable. If it doesn't work, it is usually because of network issues.
How are customer service and technical support?
I didn't need support from Microsoft. Any need for support was internally fulfilled by my colleagues.
What other advice do I have?
I would recommend this solution. It is a nice environment for working in teams and implementing the DevOps philosophy. It provides good support for that.
I would rate Microsoft Azure DevOps an eight out of ten.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Lead Technical Consultant (Information Technology) at a construction company with 1,001-5,000 employees
A stable, all-in-one solution that is easy to deploy, but some areas need to be improved
Pros and Cons
- "I like the entire tool because it is a one-stop-solution for DevOps."
- "There are certain areas in Azure DevOps that are better in other products."
What is our primary use case?
We are a manufacturing company and I am a technical consultant who is responsible for managing the software applications that are outsourced for development. In this role, I have gained experience using Microsoft Azure DevOps.
I have also used it as a software developer in companies that I previously worked for.
What is most valuable?
I like the entire tool because it is a one-stop-solution for DevOps.
The Scrum functionality in project management is helpful, as are the code repositories. It has support for pipelines.
What needs improvement?
There are certain areas in Azure DevOps that are better in other products. These are things that I need to more fully explore.
For how long have I used the solution?
I have been working with Azure DevOps for approximately four years.
What do I think about the stability of the solution?
The stability is good and I haven't had any issues with it.
What do I think about the scalability of the solution?
At this time, the majority of our software application development is outsourced so there is not much in terms of DevOps. However, in the future, I am planning to implement DevOps here. Once that happens, I expect that our usage of this solution will increase.
How are customer service and technical support?
I have not needed to contact Microsoft's technical support.
How was the initial setup?
The initial setup is straightforward and easy. It takes very little time to deploy.
What about the implementation team?
I deployed this solution without any help.
What other advice do I have?
Personally, I like this product and it is one that I recommend. That said, based on my experience, I cannot say that it is perfect.
I would rate this solution a seven out of ten.
Which deployment model are you using for this solution?
Public Cloud
If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?
Microsoft Azure
Disclosure: My company has a business relationship with this vendor other than being a customer: Partner
Lead DevOps and Release Engineer-L2 at ITWORX
It's a matter of integration to have only one platform for all your software development life cycle
What is our primary use case?
- Source code management
- Git repository management including a visualizing for the pull requests process
- Build automation
- Continuous integration
- Project management
- Test management
- Release automation
- Deployments automation
- Artifacts management
- Package management
- Agile planning
- Dashboards and reports
- Requirement management
- Work estimation
- Capacity management
- Backlogs and Kanban boards for different teams
- Load test
- Integration test automation and unit test projects with status reports on the test results.
How has it helped my organization?
Azure DevOps helps us to implement all our DevOps practices with a complete end-to-end cycle starting from code commit till the production deployment including continuous feedback.
This enables us to release the silos between the teams and enhance collaboration. Also, it gives us more control on the project delivery lifecycle and to fix the issues more earlier than before as we are aligned and working on one integrated system which can give us reports about any piece of info.
What is most valuable?
- Linking the project teamwork (bugs, tasks, user stories, test cases ) with the code, build, release, delivery
- It's a matter of integration to have only one platform for all your software development life cycle.
What needs improvement?
- Enable more control on Application Insights integration to open different types of work items as this is area still need more enhancements.
- Test management extension is too high to be paid on a monthly basis.
- Test and feedback chrome extension still need more development as they are not very stable.
For how long have I used the solution?
One to three years.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Buyer's Guide
Download our free Microsoft Azure DevOps Report and get advice and tips from experienced pros
sharing their opinions.
Updated: October 2024
Product Categories
Application Lifecycle Management (ALM) Suites Release Automation Enterprise Agile Planning ToolsPopular Comparisons
Red Hat Ansible Automation Platform
OpenText ALM / Quality Center
ServiceNow Strategic Portfolio Management
OpenText ALM Octane
Rally Software
Polarion ALM
Jira Align
Nutanix Cloud Manager (NCM)
Codebeamer
Jama Connect
PTC Integrity
Buyer's Guide
Download our free Microsoft Azure DevOps Report and get advice and tips from experienced pros
sharing their opinions.
Quick Links
Learn More: Questions:
- What Is The Biggest Difference Between JIRA And Microsoft Azure DevOps?
- Which is better - Jira or Microsoft Azure DevOps?
- Which is better - TFS or Azure DevOps?
- What is the biggest difference between Micro Focus ALM Octane and Microsoft Azure DevOps?
- Has anyone tried integrating Azure DevOps with HP ALM?
- MS Azure DevOps vs Jira for test planning and management - which one is the better solution?
- How does Microsoft Azure DevOps compare with GitLab?
- What are your use cases for Microsoft Azure DevOps?
- When evaluating Application Lifecycle Management suites, what aspects do you think are the most important to look for?
- Looking for suggestions - we need a test management and defect tracking tool which can be integrated with an automation tool.
I'd add that the reliability needs improving, there have been a few outages lately, had numerous issues where marketplace modules install but cannot be used and the live updates on running pipelines stop working. As it matures I can see it being a strong competitor