Rally Software Reviews

As a Product Owner/Product Manager on an application team, it was my job to create, prioritize, manage, and accept portfolio capabilities, features, and user stories. The portfolio views and reports were the tools I used the most to do that.

The Agile process my team follows anticipates that requirements and priorities will change from sprint to sprint. Having a real-time view of what has been accomplished, what is in progress, and our backlog, that is easily accessible to all stakeholders, (customers, executives, implementation members, and delivery leads, as well as our staff of multi-discipline Product Owners and Managers) is critical to building and creating a high quality and viable product.

My scrum masters walked through the analysis, development, and testing tasks every day with team members, using the Team Status page to ask each team member (onshore, nearshore and offshore) for status on the prior day’s work and plans for today. As a Product Owner, I monitor User Story status via a Ready To Accept app on my Dashboard for User Stories that are ready to be accepted because all the required tasks are completed.

By using the Portfolio Items page I can adjust priorities and accept completed features from a single page.

It is used as a source of truth on workstream, workstream progress and issue management.

• Bulk priority change of portfolio items
• Portfolio feature
• Dependency reports

In our project, when a feature is completed, we mark it as completed but then don’t want to have it show at the top of the priority list and don’t want to constantly add filters to filter out completed items. So we put the completed items at the bottom of the backlog by changing the priority. There’s no way to do this except one at a time. With thousands of features, this is cumbersome.

There is no good way to get an overall view of feature dependencies except to go to one feature at a time and look at its specific dependencies. The team could have made great use of a report/dashboard of some kind (I failed at coding my own) that gave a larger view of feature inter-dependencies.

We have been using the solution for two years.

Generally, we did not encounter any issues with stability.

There was some slowness noticeable on days of heavy usage by many users (peak usage impact).

I did not use the technical support.

We did not previously use a different solution.

Use relational database concepts to relate items together instead of continuing to use old location-based organization concepts.

Rally Software is typically used for dealing with all the scrum and agile principles and work orders. It keeps track of whatever workers do in the application development lifecycle before release.

The most valuable features of Rally Software are the executive dashboards, ease of use, and many other features. They have encapsulated everything that a GI can do, such as monitoring, maintaining, and then releasing. It's continuous integration and development. 

I have been using Rally Software for approximately six years.

Rally Software is stable.

The scalability of Rally Software is easy to do.

Our team typically handles all of the support for Rally Software. Only when there are some difficulties is when I come in to give assistance.

We have used Jira and Microsoft Excel previously.

I found Jira and Rally Software similar in functionality.

The initial setup of Rally Software is straightforward. In the beginning, there was more hands-on attention needed but after that, we were in operation.

We are always looking for a discount, if the solution was less expensive it would be a benefit.

My advice to others is when you use Rally Software every day, they must be more hands-on. The employees have to have a level of maturity for gaining knowledge of the software. They need to know what it can do, what it can't do, knowing the ins and outs of the software are important.

I rate Rally Software an eight out of ten.

It is used to track any enhancements or new integrations. We have integrations from mainframe systems to RESTful services. We also have a few SOAP integrations. Essentially, we use the feature level of Rally to document what the interface is and then the engineers make the user stories within the feature to represent the tasks that they need to do to complete the interface, which includes everything from making the design document to the activities that they do in IIB, such as deploying the code to production. Our version has probably been updated within the last three months.

It is kind of set up for Scrum or Agile, but we sort of use it more in a kind of hybrid way. It does help build accountability because, during stand-up, you have to see what everybody is doing, why certain things are in red, and why someone is not where he or she is supposed to be.

We use the roadmap features, and we're getting better at using dates to use the roadmap so that we can see if we're on target for work. 

What I don't like about it is that it is really hard to find old work to reference information and use the reporting section of the application in terms of trying to analyze trends. If I am trying to find out which interfaces took this long and I want to compare and measure improvement from one quarter to another quarter, the reporting mechanism within Rally is very troublesome. They have an Excel plugin that you're supposed to use, but you literally have to pull the raw data out before you can do the analysis. You can't do it within Rally, and if you can, it is a secret, and I don't know how to do it. It should have better, easier, and user-friendly reporting without having to use the Excel add-in.

It is very clunky. There is a lot of data in there, but it is not organized in such a way that makes it intuitive. You really have to kind of look for where do you put your documentation or dates. Some customization is available, but it is not plug-and-play like Jira. When I switched from TFS to Jira, I just went and started using Jira, whereas with Rally, you kind of have to really get in and figure out what you need to do before you set stuff up, or you're going to get yourself stuck. You can just start using Jira and be successful.

It is kind of hit and miss. Sometimes, it is really reliable. I'm not sure if the delays that we see intermittently when it hangs up are because we've all gone remote now, and there are different people with different types of remote devices. I don't know if they are because of Rally.

Different teams that I've been with in the same organization use different tools. I have used TFS and Jira. I would go back to Jira or TFS in a minute. I don't find Rally good for scaling what we're doing. A good percentage of this part of my organization does use Rally, but I don't find it conducive to building transparency across the organization. We should either have TFS, Jira, or Rally. However, because of the lack of reporting, Rally won't be suitable and scalable for the whole organization. People want to see and measure what teams are able to do, and if they can't do that quickly, senior leadership is not going to be on board. If every team had to dig as much as I have to dig, it is not scalable.

In terms of users, we have implementation consultants, which is kind of a hybrid role between a BA, a PM, and a QA. We also have engineers, application developers, business analysts, managers, project managers, and directors. We have senior leadership, like AVPs, who periodically go in there and look at stuff randomly, but for the most part, it is usually used by managers and frontline staff like myself. About 80% of teams in our business unit are using Rally. My team has 15, but the number is easily more than that.

I have not had to deal with them.

I would advise others to make sure that they have full training in terms of the connection between features, user stories, and epics. They should also fully understand how to configure it in terms of providing visibility across teams that have to work with each other.

I would rate Rally Software a six out of ten.

We primarily use this solution for agile project management. We use it to work on some of the challenges we have, including test management. 

The product has excellent customizable reports. There are some custom lists that are deployed in the recent version as well, which have proven to be useful to our organization.

The solution is very stable. We haven't had any performance issues in that regard.

We have all the features we need. It's a good product in that sense.

The pricing, for the most part, is reasonable.

The scalability may need to be improved. We'll see within the next three to six months, as we test it.

The product needs to have more integration capabilities.

I've been using the solution for six or seven years or so. It's been a while.

The stability of the solution has been very good so far. We haven't dealt with bugs or glitches. It doesn't crash or freeze. It's very reliable.

I can't really comment on scalability. It seems to be suitable for our needs, however, we haven't tried to scale the product and therefore wouldn't really be able to comment on its capabilities.

We do plan to potentially scale in the next three to six months. At that point, we'll have a better sense of how it will handle an expansion.

I'm not sure how many users are actually on the solution at this time.

I, unfortunately, did not handle the initial setup of the product. Therefore, it would be hard for me to comment on if it was complex or straightforward. I don't have any direct knowledge.

The pricing of the solution is okay. It's reasonable. However, the licensing does increase according to the number of modules. Therefore, it can get expensive.

We are currently using the latest version of the solution right now.

I would rate the solution at a ten out of ten. We've been largely very pleased with its capabilities.

Software development and infrastructure.

Sprint planning and overall work management of the stories and the project lifecycle.

Sprint planning is valuable because it keeps our teams all in the same place in terms of where information is stored. We always know what the status of a project is and anybody can see it.

• Ease of use
• Visibility

As a PMO Manager, I need to be able to look and see what the project status at any time without having to go ask somebody or look for a status report. So, I could go there and see exactly what percentage is complete, what the blockers might be, and just see who is assigned to what, so I can look at resourcing.

It has made our company more organized and it is helping us be more true to the agile principle. When I came to the company, we did not have any agile practices in place. So, it has helped us, because it gives us a framework to put the agile practices in place. 

The integrations with the PPM tool and making sure those two work well together. 

Improved engagement with TFS, because we still used TFS for code management. There is an API between the two. I think that the APR could be easier to set up and the API could be a little more fluid in terms of when the code is checked in. It really relates to how a project is updated based on that.

Stability is better. A couple years ago before CA bought it, we had a lot of problems. Now, we do not have as many problems. So, it has been good.

Scalability is getting better. It used to not be as good, but they are adding some features that make it easier to build portfolio items in.

The problem before was that there were just a lot of little bugs where you create a project in one place and it would not continue to exist in another. Also, there were not very good templates or anything. So, they are improving on that. 

I have not really used the technical support.

We did not have a solution when I started. I picked it because I was familiar with it from a previous company. I actually used it for a couple years before that, as well. I just knew we needed something that we could hit the ground running with pretty quickly.

I was involved in the initial setup and subsequent upgrades. 

I am not really sure how it is now to set up. If you are putting into a GreenField brand new product, I do not know how that would work now. Previously, it was just figuring it out on your own.

Upgrading was pretty straightforward, especially if you are used to using any of the agile tools in the agile practices. Once you get used to some of the unique namings for Agile Central, or formerly Rally, it is pretty straightforward. It is a like-for-like, in terms of what you have learned, in terms of being agile in what you learned on what you are doing on a day-to-day basis. 

The vendors on the shortlist would be TFS's Project Management through Microsoft, ServiceNow's Project Management, and JIRA.

Earlier on, we went a little faster and we did not do a full software evaluation. We actually are doing a tools assessment now. We are going to be looking at replacing CA, possibly, because we want to make sure we have the right tools. We want to make sure that they flow between all the different tool sets that we have. 

It has performed well so far. It has improved over the past couple of years.

For any product, do a full software evaluation and make sure you actually test them side-by-side with like-for-like test cases. Then you know exactly what you are getting yourself into. Otherwise, you build out and realize it might not be the right product for you. So, a full software analysis is important.

Most important criteria when selecting a vendor: Initial support is always important. It is always great when you can have a few free hours to have somebody to come in and help you understand the idiosyncrasies of any software, figuring out exactly what the best way is for it to be set up. Otherwise, you are just trying by trial by error. So, that is important. Also, stability is important.

It's designed around Agile, so it has all of the pieces that match up with the process. For us, at the portfolio management level, we can see everything at one glance, all of the projects, where they're at; and, at the iteration level, we’re able to populate the iteration, and view progress reports on it. We've recently moved all of our defect tracking onto it also - it's nice to be able to pull defects right into sprint plans.

• We're using it to manage the training content development we're doing, so it's kind of a one-off case. It's not your typical agile project, but so far it's working well, and we're able to incorporate most of the agile methodology into our processes. We get all of the transparency that comes with the tool; so we have a clear view of what's happening with all of our projects, what state they're in, and where all the pieces are. Blockers stand out, so they're getting more attention. It's become our single location for project information. Although there's been a bit of a learning curve for the team (more around the processes we're using than with complexity in the product), I've had several team members tell me that it's a good product that they enjoy working with.

I'd like to be able to color code timeboxes, so I have an easy visual way to track the success of sprints. Workflow is not a strength, we've cobbled together our own workflows around changes in State and Ownership.

About a year now. What we're doing in CA Agile Central is pretty stable now, although we still tweak our own internal processes from time to time. Still exploring and learning the wonderful world of Agile.

We weren't involved in it.

It's been extremely stable for as long as we've been using it.

I see no problems with scalability. In addition to what we're doing, I know our Services team and Product Development team are using the product, so I expect scaling is not an issue.

Haven't really used it.

Haven't really used it. Which I like.

Spreadsheets and MS Project. CA Agile Central is designed around Agile methodology, so it was a perfect fit for the processes we wanted to put in place. We couldn't do the things we're doing now with the previous products.

I wasn't involved in setting up the product itself. I jumped in after it was already in use.

Wasn't involved.

The decision to use it came from our development team. The whole development team is using it. Our Services team has been using it for years.

If you're focusing on agile, this is the right product to use. It's built around it. I've tried to do things with MS Project and that sort of thing, and you just can't manage it the same way. It's just not built for the same kind of cycle.

It is a well thought-out solution. It's a great centerpiece for Agile methodology. It works.

I like it because I have several projects, and it keeps me on track for each one. So, I can track each iteration of each project, and see where I'm at and where other people are at, visually. I guess maybe the iteration planning and tracking status is the most valuable feature.

It has helped a great deal in the fact that we are able to take small chunks of data and get them actually moved forward end to end. Previously, we had to wait several months before something would actually be available for the end user. This has helped us to break that and to move forward quickly.

I think I'd like to be able to color-code the words more easily, not just the side. You can change the color on the side, but to actually change the font color would be useful.

Currently, I use an HTML color font to change the title of a user's story or something. If, instead of having to put in the HTML version of it, to make it change the color of the font, and I could easily change the color of the fonts, it would be a lot better.

I have been using the solution for two years.

I think occasionally it will slow down, particularly when we have a lot of users on the same project, especially around stand-up time or whatever, because we're spread out across the country, so we usually do it by phone. So when everybody is on the project at the exact same time, it will slow down a little bit.

Also, if I make a change and somebody else makes a change, you can't retain both changes. It doesn't accept both. The first one who finishes, who hits Enter, Save, Done or whatever, will get the change.

Then, it will warn you. It will say, "Do you want to keep your changes or the other person's changes?" But you don't know what they are changing, and they don't know what you're changing!

It slows down a little bit if you have a lot of information in there. It seems to work really well, however.

I like the personalization of the home screen because I may not want to look at everything, i.e., the same things that other people want to look at. So it's nice to be able to personalize my home screen. I have a lot of stuff on my home screen, and it seems to be able to handle it just fine.

We have an administrator, and I've had to have people added back in because they don't go in there and use it, and get suspended. Then they ask, "How come my name's not in here?" So you have to respond: "Because you never use it."

I haven't really had any help from technical support.

We previously used a different solution. We switched to be able to move more quickly to a resolution. Because the industry changes quickly, we can't still be in development stages on a product that needs to be out in the consumer's hands today. That's why we moved on to something like this where we can actually get things out there quicker.

The setup is very straightforward.

I have no input as far as the cost is concerned. That goes further up the chain than me.

I would definitely say it's a very good solution to have for a company, yes.

• Sprint tracking + Kanban board (Iteration Status app): Informs me how well we are doing in our sprint, and what is the next part to work on.
• Burn-down graph.
• List of stories sorted in priority order.
• Kanban Board to visualize work in progress.
• Sprint planning (Iteration Planning app): Helps me draft plans based on my team’s velocity, and visualize my team’s roadmap for feedback on my team’s priorities for the upcoming sprints (user story level).
• Team sprint capacity management (Team Status app): Useful app to elicit the conversation of how much capacity does each team member have for the upcoming sprint, and calculate whether we are stretching our team members too thin. In addition, we can easily trade tasks from one user to another, as needed.
• Release planning (Release Planning app): Helps me draft plans based on my team’s velocity and visualize my team’s roadmap for feedback on my team’s priorities for the upcoming months or quarters (feature level).
• Portfolio hierarchy (Portfolio Items app): Allows me to define the epic, feature, story breakdown of my team’s work. Also, it allows me to visualize the dependencies between teams.

It provides teams the ability to define, prioritize, and monitor the progress of both their operational and project work. The big win is the fact that we are using the same tool outside of IT. It’s a huge win when your internal customers are also using the same platform for defining, tracking, monitoring progress on their objectives. The non-IT departments that have teams using the tool are marketing, operations, training, and human resources.

Provides portfolio, department, and program managers the ability to define, prioritize, and monitor progress on larger initiatives being delivered by multiple teams.

Make it easier to export information outside the tool for additional data visualizations and metrics. The tool does have a REST API, but that requires us to use a developer. The tool does have CSV exports for everything, but that’s a manual step.

Make it easier to share CA Agile Central information to non-CA Agile Central users. Not everyone in our organization is a licensed CA Agile Central user. Those users who are not licensed and provide work to the users on our platform, have a hard time tracking their work requests.

Provide the ability for team members to customize their custom fields/custom workflows without needing a tool administrator to set it up for them.

Mobile friendliness: It would be nice if we had the ability to view and change the state on assigned tasks from a phone.

CA Agile Central integration is great! Currently, everyone who has an CA Agile Central license has a Flowdock license. Unfortunately, it costs a lot of money to add non-CA Agile Central users to Flowdock. And a messaging platform is useless if you can’t message all your stakeholders within the organization.

There is no ability to easily create a work intake portal where a stakeholder can enter new work, have it routed to the appropriate team, and be able to track the work status. You can buy an integration engine that syncs your ticketing system with CA Agile Central, but again, that’s more money.

I’ve used CA Agile Central for four years.

Once in a while, it has performance problems. Nothing terrible and nothing we have not seen with other SaaS vendors.

We have not had any issues with scalability.

Technical support is fine. They assign a customer success coach that we use for tools training and tips. We are pretty self-sufficient now that we do not have to lean on them very often.

We did have other tools before CA Agile Central and we currently still use other vendors for managing other types of work. The best tool for the job really depends on the type of work you do, the work management methodology the team uses to get work done, and who the team’s stakeholders are.

Setup was easy for team-level usage. It gets more complex as you try to scale up your agile practice. Scaling up only happens when teams agree to portfolio standards such as your work hierarchy and planning cadence.

It is an expensive tool. Bring in a good negotiator. The money is worth it when you are trying to do agile at scale.

We evaluated:

• VersionOne
• JIRA
• Trello
• Smartsheet
• Taiga.io
• Tuleap

The nirvana for all organizations is to implement end-to-end enterprise business agility. It’s a lot easier to do that when you have a tool that allows you to capture all the data you need and systemically roll that up for your enterprise portfolio reporting. CA Agile Central is a tool that enables you to do that. BUT, in order for data to be entered consistently, you really do need an enterprise coach. If you are not implementing agile at scale, I would recommend a cheaper tool that is also mobile-friendly. CA Agile Central is a tool that solves the agile-at-scale challenge, and is still user friendly enough to handle non-IT work loads.