We adopted the SAFe Framework, and more than 10 teams are using the process or workflow template from Azure DevOps for SAFe. Also, we're currently using DevOps for future planning and backlog management following the scrum approach on the team and coordination level. The company plans to extend this with Lean Portfolio Management.
Vice President at a tech services company with 51-200 employees
It's simple to implement the SAFe Framework, but it's not easy to customize like some solutions
Pros and Cons
- "Setting up Azure DevOps was straightforward. It's easy to use the default templates. Everything is under our control, so it's simple to implement new requirements."
- "The portfolio is one area where DevOps has room for improvement. Built-in reporting and visualization also could be better. We're using Power BI and Tableau to compile more complex reports and dashboards. Azure DevOps has some out-of-the-box reporting capabilities, but they're very simple. It's usually okay on the team level, but if you have to run a complex report, it's difficult and insufficient, so we use Power BI as an extension."
What is our primary use case?
How has it helped my organization?
Time to Market: Teams deliver more in less time.
What is most valuable?
Azure Pipeline is the most valuable feature.
What needs improvement?
The portfolio is one area where DevOps has room for improvement. Built-in reporting and visualization also could be better. We're using Power BI and Tableau to compile more complex reports and dashboards. Azure DevOps has some out-of-the-box reporting capabilities, but they're very simple. It's usually okay on the team level, but if you have to run a complex report, it's difficult and insufficient, so we use Power BI as an extension.
Buyer's Guide
Microsoft Azure DevOps
December 2024
Learn what your peers think about Microsoft Azure DevOps. Get advice and tips from experienced pros sharing their opinions. Updated: December 2024.
824,067 professionals have used our research since 2012.
For how long have I used the solution?
I've been using DevOps for about three years.
What do I think about the stability of the solution?
DevOps is very stable.
What do I think about the scalability of the solution?
DevOps is scalable. We have about 65 users working with it, including the product manager, product owner, scrum master developer, tester, line managers, and architects.
How are customer service and support?
We haven't experienced any significant issues so far, but any issues we've had were fixed fast, so I would say I'm very satisfied with the support.
How would you rate customer service and support?
Positive
Which solution did I use previously and why did I switch?
We were using Jira, but we switched to DevOps. It was a strategic decision to reduce the complexity of the toolchains. We wanted a Microsoft solution, so we chose Azure DevOps.
How was the initial setup?
Setting up Azure DevOps was straightforward. It's easy to use the default templates. Everything is under our control, so it's simple to implement new requirements. We did it ourselves in three days. Since we used the default templates, we didn't have to change the standard Azure DevOps services. Two people are responsible for deployment and maintenance: DevOps engineer and Release Train Engineer
What other advice do I have?
I rate Azure DevOps seven out of 10. DevOps isn't so easy. In general, the solution is straightforward and suits our purposes, but it's a little bit tricky to customize the workflow. It's simple to implement the SAFe Framework, but it's not easy to customize compared to Digital.ai Agility. There's a huge gap.
Which deployment model are you using for this solution?
Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
DevOps Engineer at a tech services company with 51-200 employees
Build pipelines are useful, and it is easy to deploy and good for monitoring purposes
Pros and Cons
- "It is good for monitoring purposes. We are using the build pipelines of Microsoft Azure. They are also valuable."
- "We are facing some problems because the capacity can only be measured within a project. It cannot be measured across multiple projects. So, the reporting needs to be enhanced, and there should be more graphs to be able to easily give the upper management insights about all the employees from different departments. It will be helpful for employee management. Currently, the managers over here are using Power BI for insights because the functionality of Azure DevOps Boards is not enough. So, we have to export the data into another visualization tool and get the results."
What is most valuable?
It is good for monitoring purposes. We are using the build pipelines of Microsoft Azure. They are also valuable.
What needs improvement?
We are facing some problems because the capacity can only be measured within a project. It cannot be measured across multiple projects. So, the reporting needs to be enhanced, and there should be more graphs to be able to easily give the upper management insights about all the employees from different departments. It will be helpful for employee management. Currently, the managers over here are using Power BI for insights because the functionality of Azure DevOps Boards is not enough. So, we have to export the data into another visualization tool and get the results.
We would like to have templates for work items. They are available in the Azure DevOps services on the server, but they are not available in the on-prem solution. We are using an on-prem server, and we are using version 2020.1119.
For how long have I used the solution?
I have been using this solution for almost four to five years.
What do I think about the stability of the solution?
It works well. There are no issues.
What do I think about the scalability of the solution?
It is easy to scale. In our organization, some teams are using it, and some teams are not using it. We probably have 80 to 100 people.
How are customer service and support?
Their technical support is good. We haven't faced many issues. As far as I remember, we have had only one issue. We raised a ticket for that, and they resolved the issue.
Which solution did I use previously and why did I switch?
I have also used Jira. We have more control over Jira than Azure DevOps, but we are using Azure DevOps for our technical side because our VMs and build pipelines are on Azure. So, it is better for us to use one solution rather than using multiple solutions.
How was the initial setup?
It is straightforward. It is not that complex.
In terms of maintenance, we only do maintenance when we have new upgrades. Other than that, we don't need to maintain it much. We have optimized the TFS and Azure DevOps database, and we have done indexing and optimized it. It is pretty good.
What other advice do I have?
I would rate Microsoft Azure DevOps an eight out of ten.
Which deployment model are you using for this solution?
On-premises
Disclosure: My company has a business relationship with this vendor other than being a customer: Partner
Buyer's Guide
Microsoft Azure DevOps
December 2024
Learn what your peers think about Microsoft Azure DevOps. Get advice and tips from experienced pros sharing their opinions. Updated: December 2024.
824,067 professionals have used our research since 2012.
Devops Engineer at a manufacturing company with 10,001+ employees
Provides great agile management of projects, is stable with good customer support
Pros and Cons
- "Provides agile management of projects."
- "Reporting across multiple projects could be improved."
What is our primary use case?
We use it for planning, pipeline management and testing, as well as using it as a CI/CD tool.
What is most valuable?
I like the agile management of projects, running stand-ups and the like. The pipeline management feature is great.
What needs improvement?
We'd like to see an improvement in reporting across multiple projects. The same applies to improving program visibility so that project managers can get that pane of glass to assist with their work. It would be a big win for a lot of users as well as a good addition to the tool.
For how long have I used the solution?
We've been using this solution for close to four years.
What do I think about the stability of the solution?
The solution is stable. There are still the occasional issues but on average it's very stable.
What do I think about the scalability of the solution?
The solution is easily scalable because it runs on the cloud and everything is managed by Microsoft. We don't do anything in terms of increasing capacity so when more users are added the increased capacity is automatically managed.
How are customer service and support?
We haven't made a lot of calls to technical support but when we have their response has been good and quick.
How was the initial setup?
We have a DevOps engineer who carried out the implementation for us and I believe it was relatively easy.
What other advice do I have?
I rate this solution eight out of 10.
Which deployment model are you using for this solution?
Public Cloud
If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?
Microsoft Azure
Disclosure: My company has a business relationship with this vendor other than being a customer: partner
Delivery Lead - Agile Coach at a tech services company with 201-500 employees
Scalable, reliable, and useful continuous integration and deployment
Pros and Cons
- "The most valuable features are continuous integration and deployment, and simplicity."
- "The active directory password system needs some improvement because many times the password for the active directory expires before the set time."
What is our primary use case?
I am using the solution to create continuous integration and deployment agents on the server environments. We are also involved in some projects where we create user stories and features created on the solution.
What is most valuable?
The most valuable features are continuous integration and deployment, and simplicity.
What needs improvement?
The active directory password system needs some improvement because many times the password for the active directory expires before the set time. Additionally, in the beginning, when I get the repository and check in my code on the dashboard to see who made changes, it shows that another user made the change that did not. This could be fixed in a future release.
For how long have I used the solution?
have been using the solution for three years.
What do I think about the stability of the solution?
The solution is stable.
What do I think about the scalability of the solution?
I have found the scalability of the solution to be good.
How are customer service and technical support?
I did not contact support but I was able to find all the information I needed on the internet.
How was the initial setup?
The installation is straightforward.
What's my experience with pricing, setup cost, and licensing?
There is a license for this solution.
What other advice do I have?
I have experience with other solutions and with this one, you can add many addons without any difficult configuration. It has all the code and related items together, it is a total package.
I highly recommend this solution to others.
I rate Microsoft Azure DevOps a nine out of ten.
Which deployment model are you using for this solution?
On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Product and Systems Director at SPCM
Great automation capabilities, allows for easy integration with other tools and is quite stable
Pros and Cons
- "The initial setup is very easy."
- "It would be great if I could integrate with a human resource type of software that could control timesheets."
What is our primary use case?
We use the solution to store all our source codes. It's a solution that stores everything. We are an in-house development and we produce a lot of codes.
We also use it to control our development process. We follow some methodologies. Every every team has a different methodology, for instance, Chrome, Agile, et cetera. The whole process from the planning process until we deploy the solution, everything is controlled by DevOps.
What is most valuable?
The solution is very good at automating various aspects of the DevOps process. You can automate almost everything. You don't have any human intervention. It's almost automatic. As long as you finish your code and put it in, the software gets the code and tests it. If it is okay, it will go ahead and integrate it and put it in production without any human intervention. This is excellent.
The tool allows you to connect with many external tools. You can improve the whole process that way. We use a couple of things, however, there is a plethora of things you can put together in your solution.
The initial setup is very easy.
What needs improvement?
Despite the fact that you can automate most of the things, you still have to produce some scripts. There are things that are not very user-friendly. The tasks are achievable, however, it's not easy. You have a lot of steps until you can get the thing automated.
In the past, Microsoft DevOps was integrated with Microsoft Project. Out of the box. Right now, it's no longer that way. That would be interesting to have.
It would be great if I could integrate with a human resource type of software that could control timesheets.
For how long have I used the solution?
I've been using the solution for 15 years now. It's been a while. It's well over a decade of experience.
What do I think about the stability of the solution?
The product is extremely stable. We've used it for 15 years and haven't had any serious issues. There are a few bugs or glitches but nothing tha can comprimses the day to day operation, and they usually fixed in the next release. It doesn't crash or freeze, though sometimes gets a bit slower due to databes overheadd, so maintance has to be done. It's reliable.
What do I think about the scalability of the solution?
We are a small team, and therefore we don't need to scale. However, I've heard both that it grows 10% a year without issue and that it scales very easily and very well. As far as I know, a company can scale it if they need to.
We have between 50 to 70 people using it, including staff and managers, et cetera.
How are customer service and technical support?
I have used technical support a couple of times. Typically, it's good. It's usually a couple of hours and then, they answer you. Nevertheless, you can go to the online site and most of the time you can solve the problems just by reading. They have a lot of documentation available.
That said, when we dealt with them directly, they were pretty fast. I'd say we are satisfied with their level of service.
How was the initial setup?
The initials tup is not complex. It's a very easy, very straightforward process. A company shouldn't have any trouble with implementation. It only takes a couple of hours. It's pretty quick to deploy for DevOps purposes.
What other advice do I have?
We are just a customer.
We intend to move from on-premises to the cloud next year.
I'd recommend this solution. It's a worthwhile investment.
I would rate the solution at a nine out of ten. We've been quite satisfied with it overall.
Which deployment model are you using for this solution?
On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Senior Business Analyst │ Microsoft Power BI & Power BI App Development at a energy/utilities company with 1,001-5,000 employees
Free for up to five users, secure, easy to use, and integrates well with other Microsoft products
Pros and Cons
- "What I like the most about this product is that it's free and it's secure."
- "The user interface could be improved."
What is our primary use case?
We are using Microsoft Azure DevOps for tracking the requirements and tracking the issues.
Any issues that we have, are tracked and logged.
Also, we check the developer's workload.
It can be used for different purposes as well. For example, it can be used by software companies and different software teams for collaboration.
What is most valuable?
What I like the most about this product is that it's free and it's secure.
You can easily assign it.
It integrates well with other Microsoft products, such as Outlook.
If we experience a login issue, it sends a notification to one of my developers and you also receive an email notification, ensuring that there is no way that a developer can miss working on it or miss seeing it in emails.
What needs improvement?
The user interface could be improved.
For how long have I used the solution?
I have been using this solution for approximately two years.
What do I think about the stability of the solution?
It's a stable solution, we have not experienced any issues.
What do I think about the scalability of the solution?
We have not had to scale it, as we have a very small team with only four members who use this solution on a daily basis.
How are customer service and technical support?
We have not had to contact technical support. There hasn't been a need, it's very simple.
If you have any issues, you are sent a link through email, you click on the link to address your specific requirements and close it.
You will receive an email notification to confirm that the case is closed.
Which solution did I use previously and why did I switch?
Previously, we were using Microsoft Excel. We decided to use Microsoft Azure DevOps because it allowed us to assign tasks and get a notification.
How was the initial setup?
The initial setup is simple.
It was easy to deploy and within a day, I was able to learn it and work on it.
What about the implementation team?
I did not use a vendor or an integrator, I did it on my own. It's a Microsoft product and we all use Microsoft.
What's my experience with pricing, setup cost, and licensing?
Microsoft Azure DevOps is free for up to five users and allows you to track a maximum of three projects.
What other advice do I have?
I would recommend this solution. It's a good tool and it's free.
Instead of spending money on premium tools, you can at least start with Microsoft Azure DevOps and then upgrade it slowly.
You can learn how to use this tool in less than a day.
If you have Microsoft 365, this comes with it for free.
It doesn't require any maintenance.
I would rate Microsoft Azure DevOps an eight out of ten.
Which deployment model are you using for this solution?
Private Cloud
If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?
Microsoft Azure
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Software Architect Consultant at a tech consulting company with self employed
Helpful for multi-platform release management, but more flexibility is needed for automated testing
Pros and Cons
- "All of the features related to release management are very good."
- "Better integration with the Linux operating system would be an improvement for this solution."
What is most valuable?
All of the features related to release management are very good. We use release management and dev management, and the dashboard is good. The ability to specify multiple platforms in release management, by using Docker, is valuable.
What needs improvement?
Better integration with the Linux operating system would be an improvement for this solution.
I would like to see more third-party plugins; by comparison, the open source solution, Jenkins, has thousands of plugins available.
The Wiki for this solution is not very good.
There is a problem when you want to run a release pipeline for an organization that needs enhanced security. There is no option to configure a dynamic login for a station that is running the tests. The only solution in the platform is to configure an agent that uses a fixed username and password login. There is no option to change the username or password for the login dynamically. If I want to run multiple tests, with different users, then I cannot do it. When it comes to running tests, it needs an option to use different users or authentications. This is a very important feature that is missing.
For how long have I used the solution?
More than five years.
What do I think about the stability of the solution?
This solution is very stable.
What do I think about the scalability of the solution?
Scalability is not particularly relevant. It depends on what kind of scaling you want to do. Generally, it has very good support for scaling.
There are hundreds of developers using this solution.
How are customer service and technical support?
We only had one issue, and I would rate their technical support at medium, based on that experience. The issue was related to shrinking a database, where it was not working well. It took a long time for Microsoft support to fix the problem.
Which solution did I use previously and why did I switch?
We did not use another solution prior to this one. However, I use other tools in conjunction with Azure DevOps. One of these is Jenkins, for CICD, and I also use the Atlassian Suite.
How was the initial setup?
The initial setup for the latest version was very straightforward. The upgrade was quick and lightweight.
What about the implementation team?
I handled the implementation on my own.
What other advice do I have?
This is a solution that I would recommend.
Azure DevOps is a leading platform, but some things can be better.
I would rate this solution a seven out of ten.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Head of .NET Department at Evozon
Integrates well, scalable, and straightforward setup
Pros and Cons
- "My team likes the integration that Microsoft Azure DevOps has with GitHub and Microsoft Teams. The solution is well integrated with other Microsoft tools in one place, it is very good."
- "Microsoft Azure DevOps could improve by having better integration with other email servers."
What is our primary use case?
Microsoft Azure DevOps is used for source code versioning, issue tracking, documentation storage, and sharing.
What is most valuable?
My team likes the integration that Microsoft Azure DevOps has with GitHub and Microsoft Teams. The solution is well integrated with other Microsoft tools in one place, it is very good.
What needs improvement?
Microsoft Azure DevOps could improve by having better integration with other email servers.
For how long have I used the solution?
I have been using Microsoft Azure DevOps for a few years.
What do I think about the stability of the solution?
Microsoft Azure DevOps is quite stable. When we were configuring some continuous integration pipelines, we had some issues, but it was not a large issue.
What do I think about the scalability of the solution?
The solution is scalable enough for what we use it for, we have small teams of approximately 25 people. It's more than enough right now.
How are customer service and support?
We didn't have many incidents to contact the support about. However, they were decent.
Which solution did I use previously and why did I switch?
I was previously using Jira.
How was the initial setup?
The initial setup is straightforward. The configuration of Microsoft Azure DevOps could be better. The documentation needs to be improved.
What about the implementation team?
The implementation and maintenance of the solution are done by our DevOps department.
What's my experience with pricing, setup cost, and licensing?
We do not pay licenses for this solution.
What other advice do I have?
I would recommend this solution to others.
I rate Microsoft Azure DevOps an eight out of ten.
Which deployment model are you using for this solution?
Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Buyer's Guide
Download our free Microsoft Azure DevOps Report and get advice and tips from experienced pros
sharing their opinions.
Updated: December 2024
Product Categories
Application Lifecycle Management (ALM) Suites Release Automation Enterprise Agile Planning ToolsPopular Comparisons
OpenText ALM / Quality Center
OpenText ALM Octane
Rally Software
Polarion ALM
Nutanix Cloud Manager (NCM)
Jira Align
Codebeamer
Jama Connect
PTC Integrity
Digital.ai Agility
IBM Engineering Rhapsody
Planview AgilePlace
Buyer's Guide
Download our free Microsoft Azure DevOps Report and get advice and tips from experienced pros
sharing their opinions.
Quick Links
Learn More: Questions:
- What Is The Biggest Difference Between JIRA And Microsoft Azure DevOps?
- Which is better - Jira or Microsoft Azure DevOps?
- Which is better - TFS or Azure DevOps?
- What is the biggest difference between Micro Focus ALM Octane and Microsoft Azure DevOps?
- Has anyone tried integrating Azure DevOps with HP ALM?
- MS Azure DevOps vs Jira for test planning and management - which one is the better solution?
- How does Microsoft Azure DevOps compare with GitLab?
- What are your use cases for Microsoft Azure DevOps?
- When evaluating Application Lifecycle Management suites, what aspects do you think are the most important to look for?
- Looking for suggestions - we need a test management and defect tracking tool which can be integrated with an automation tool.