Try our new research platform with insights from 80,000+ expert users
PeerSpot user
Solutions Architect at a tech services company with 501-1,000 employees
Consultant
It's given us the ability to have an editor to see requests and responses, and how to correlate them.

What is most valuable?

Customization and extensions made in Java is valuable because this can help you set elements to improve your results. 

Additionally, it gives you the ability to have an editor where you can see requests and responses, and the way to correlate it. 

Lastly, the possibility to cross data with your servers measure points such as CPU percentage, disk I/O, paging, etc.

How has it helped my organization?

Once we we're doing performance testing for a new system developed in Java, and the people in charge of development wanted to deploy the application as soon as possible for contract requirements, and were proposing to deploy it without performance testing it to gain two weeks. 

We refused to do that and thankfully we did it, because during testing the server launched a CPU page fault error meaning one of the eight CPUs the sun blade had was defective, and needed to be replaced.

What needs improvement?

I can't suggest anything as I haven't used the latest version.

For how long have I used the solution?

I've used it for about eight years.

Buyer's Guide
IBM Rational Performance Tester
November 2024
Learn what your peers think about IBM Rational Performance Tester. Get advice and tips from experienced pros sharing their opinions. Updated: November 2024.
824,067 professionals have used our research since 2012.

What was my experience with deployment of the solution?

We had open many PMRs for problems found in the products, and I'm not sure if all of them have been fixed.

How are customer service and support?

4/5 - customer service is not bad, but many times they said that for an issue found in the product it "works as designed" and in my honest opinion, they were not correct.

Which solution did I use previously and why did I switch?

We chose this product because the client had a full contract with IBM for software services.

How was the initial setup?

It wasn't complex as the documentation is vast.

What about the implementation team?

Implementation was neither a vendor team nor in-house. It was done as a service contract. 

The main advice is to not forget to plan early all the testing cycles, and no matter how pushed you may be, don't give up on testing before deployment to the production environment, as this will save you a lot of money.

Disclosure: My company has a business relationship with this vendor other than being a customer: We are an IBM software partner for services and software sales.
PeerSpot user
it_user302109 - PeerSpot reviewer
Technical Team Leader - Performance Testing Practice at a tech services company with 10,001+ employees
Real User
Its resource utilization is on the high side, but it helped identify performance bottlenecks.

What is most valuable?

Real time view and its inbuilt root cause analysis tools is something which I like the most. This feature is something unique to RPT when compared to other market leading tools like load runner.

How has it helped my organization?

Like any other performance testing tool, this helped us to identify performance bottlenecks in the application prior to the go live. It also helped us to identify and pinpoint the issues in the applications code by using its inbuilt root cause analysis tools.

What needs improvement?

User friendliness can be better, as this is one area where it lacks. More over the connectivity options with other IBM in-house products like Rational Clear Quest, IBM Tivoli and Rational Team Concert can be improved.

For how long have I used the solution?

We've used it for two years.

What do I think about the stability of the solution?

Yes, the tool seems to be unstable/unresponsive sometimes. The resource utilization by the tool itself is on the higher side when compared to other tools in the market.

How are customer service and technical support?

Customer support is above average to excellent.

Which solution did I use previously and why did I switch?

I have used a variety of the tools that are available.

How was the initial setup?

It was straightforward.

What about the implementation team?

It was done in-house, and I would advise you to have more JVM memory allocated for this product than the default amount.

What's my experience with pricing, setup cost, and licensing?

The pricing is similar to Load Runner but the package for virtual user licencing is different. I would recommend this tool for small businesses with only web applications for performance testing.

Which other solutions did I evaluate?

This tool was the only option with the customer withwhom I worked with.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
IBM Rational Performance Tester
November 2024
Learn what your peers think about IBM Rational Performance Tester. Get advice and tips from experienced pros sharing their opinions. Updated: November 2024.
824,067 professionals have used our research since 2012.
PeerSpot user
IBM Rational Consultant at a tech services company with 501-1,000 employees
MSP
I can test more than one performance test type, but it would be better if this tool supported database connections directly.

What is most valuable?

  • Less coding needed
  • Easy to understand
  • Easy integrating it with existing systems
  • I can test more than one performance test type (load testing, stress testing, scalability testing, etc)

What needs improvement?

Overall, all the features have been improved, especially if you need powerful performance testing tools. But, it would be better if this tool supported database connections directly, instead of importing from .csv file

For how long have I used the solution?

I've used it for seven months.

What was my experience with deployment of the solution?

No issues encountered.

What do I think about the stability of the solution?

No issues encountered.

What do I think about the scalability of the solution?

No issues encountered.

How are customer service and technical support?

Customer Service:

8/10.

Technical Support:

8/10.

Which solution did I use previously and why did I switch?

Previously, I used JMeter, because if we are talking about the open version JMeter is nearly perfect in usability and reliability side. But, since the organization changed, I needed the more powerful tools.

How was the initial setup?

It was straightforward.

What about the implementation team?

As a consultant, my client implement this tools.

What's my experience with pricing, setup cost, and licensing?

Now, the price slightly expensive especially if you are in small-medium company, but if you are in a medium-high company, and need the powerful tools with IBM great name, just use it. It would be better if IBM release the 'cheapest' version for the small-medium company.

Disclosure: My company has a business relationship with this vendor other than being a customer: Premier Business Partner
PeerSpot user
it_user323781 - PeerSpot reviewer
Senior Software Specialist for Development Tools with 51-200 employees
MSP
The handling of data correlations has helped us speed up our preparation of complex tests with a lot of security features and certificates in enterprise environments. New versions, though, are buggy.

Valuable Features

The way how tests are presented in the tool, and the possibilities to edit tests and follow depending data using Data Correlation feature.

The Load Schedule has very nice preview, and the new Load Generator as the agent makes planing of testing environment capacity much simpler.

With each new version, the tool gets better and better features.

Improvements to My Organization

The handling of data correlations in the tool has helped us, and sped up our preparation of complex tests with a lot of security features, certificates, generally in enterprise environment. The tool supports Z/OS applications which is very important to our customers, as well.

Use of Solution

I've been using it for over 10 years.

Deployment Issues

Sometimes new versions have bugs.

Stability Issues

With each version, it becomes more and more stable.

Customer Service and Technical Support

IBM has very good support in this area, and an accessible knowledge base, so over 90% of issues can be resolved using the web. If you need it, IBM support for the tool is very fast and useful.

Initial Setup

It depends on the scope, complexity and expected load. After introducing Load Generator Agent, as I already mentioned, setting up environment and capacity planning became simpler.

Implementation Team

We implemented in-house and for our customers, in our lab for performance testing on demand, and we offer consulting services for the tool throughout the world.

Pricing, Setup Cost and Licensing

IBM separately licenses tool and concurrent users (threads), but for this tool, IBM offers the renting of licenses over SaaS programs. Customers can rent licenses for a fixed time (minimum is one month) and use licenses during a projects duration. Licenses over SaaS are much cheaper and the customer gets IBM support.

Other Solutions Considered

We evaluate HP Load Runner and use JMeter. Generating of complex performance test with lot of data correlation was much faster and simpler using Rational Performance Tester. In the case of generating robotic performance testing, we still sometimes use JMeter. For LoadRunner, I would say it is a much more strategic decision when to use the tool.

Disclosure: My company has a business relationship with this vendor other than being a customer: We are an IBM Premier Partner.
PeerSpot user
it_user323631 - PeerSpot reviewer
IT Consultant - Performance Testing at a construction company with 1,001-5,000 employees
Vendor
​It provides the option to collect real-time data using ITM monitoring agents, although reporting needs more customization options in the performance test analyst to build custom reports.

Valuable Features

The Resource Monitoring feature has more flexible options for different OS's such as Windows, Unix and Linux.

Improvements to My Organization

It provides the option to collect real-time data using ITM monitoring agents.

Room for Improvement

Reporting needs improvement to provide more customization options in the performance test analyst to build custom reports. Recent versions like 8.6, and 8.7 has better scalability on user load testing.

When compared to competitors, the reporting module in this version was missing user friendly customization on building report variants such asTransaction Percentile Summary etc. Also, I think time cannot be excluded in the report, and no options to create customized report templates exist for reusability. These are two improvement areas which I can think of and I am not sure if they are rectified in the recent release, since I haven’t got much opportunity to use the latest version recently.

Use of Solution

I've used it for over one year.

Customer Service and Technical Support

Customer Service:

8/10

Technical Support:

8/10

Initial Setup

The initial setup was not difficult and proper instruction guides are provided with sufficient step by step instructions.

Pricing, Setup Cost and Licensing

It's one of the most cost-effective products on the market.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user303027 - PeerSpot reviewer
Performance & Functional Automation Lead at a computer software company with 501-1,000 employees
Vendor
It helps us with test creation and execution, but it needs to support more protocols and setup was complex.

Valuable Features

  • Test Creation
  • Execution

Improvements to My Organization

Helped in improving response times in a few of our transactions.

Room for Improvement

They need to have support for more protocols & frameworks, as well as making it more user friendly.

Use of Solution

We've been using it for six months.

Customer Service and Technical Support

Customer Service:

It's fair.

Technical Support:

It's fair.

Initial Setup

It was complex.

Implementation Team

It was implemented in-house.

Other Solutions Considered

We chose this product because it was a better price than Loadrunner.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
PeerSpot user
Performance Test Lead, Lexus Driver Portal – BRRI Program at a transportation company with 1,001-5,000 employees
Vendor
It has improved our visibility of reporting and simplified performance testing for larger projects/programs, but the installation and configuration processes need improvement.

Valuable Features:

  • Root cause analysis 
  • Provides the response time breakdown at the method level
  • Real time monitoring of CPU
  • Memory
  • Disk utilization

Improvements to My Organization:

It has improved our visibility of reporting and simplifying performance testing for larger projects/programs. Also, it is being used for functional validation as well as for performance regression testing for on going builds/releases.

Room for Improvement:

Installation and configuration processes, and support from IBM all need to be improved.

Use of Solution:

I've used it for six months.

Initial Setup:

Implementation is simple, but exploring the capability of this tools hasn't being marketed as well as LoadRunner/Performance Center 12 has been. More education needs to be provided to users.

Disclosure: My company has a business relationship with this vendor other than being a customer: I am a partner, as is my customer.
PeerSpot user
PeerSpot user
Senior Test Architect at a tech services company with 11-50 employees
Real User
Enables us to run performance tests against the most common application environments

What is most valuable?

The tool supports multiple protocols, such as HTTP, Citrix, and SAP. It enables me, as a consultant, to run performance tests against the most common application environments.

I can manage the complete performance test process from a single interface, which saves me from installing additional software and swapping between applications.

Provides very good user workload modelling functionality, which is important for me to accurately represent real business scenarios when designing my tests.

Very easy to customize and edit tests once recorded with lots of features for renaming, merging, splitting pages, and data driving tests.

Load generation is supported from the cloud via a ‘pay-as-you-go’ model, which removes the need for us to provide additional hardware resources and network bandwidth for large tests.

Resource monitoring of the system under test infrastructure is also supported. This enables me to correlate performance statistics with resource utilization figures during analysis.

How has it helped my organization?

It supports our agile approach not only philosophically but now practically in enabling us to provide performance testing “On Demand” and earlier in the development lifecycle.

This allowed us to act quickly on several occasions where it was crucial to identify and resolve performance bottlenecks with minimal delay.

What needs improvement?

The installation and tool setup can take some time, since this involves several components. A review of the licensing implementation would help here.

There could be better process guidance to help inexperienced testers to follow procedures and navigate the tool.

For how long have I used the solution?

We have been using this for 10 years.

What do I think about the stability of the solution?

There were no issues with stability, although as this is a Java-based tool. You do have to manage the “housekeeping” in terms of garbage collection and heap size optimization when running large load tests or executing tests for an extended period of time.

What do I think about the scalability of the solution?

This tool is very scalable. This is one of its selling points. For large scale tests, i.e., 5000 virtual users and up, it performs very well.

How are customer service and technical support?

When needed, I have found the technical support to be very in terms of speed of response and problem resolution ability.

Which solution did I use previously and why did I switch?

JMeter was used previously, but we found it limited in terms of protocol support, scalability, and lack of support for the entire test process i.e., analysis and reporting.

How was the initial setup?

The installation and tool setup can take some time since this involves several components. A review of the licensing implementation would help here.

What's my experience with pricing, setup cost, and licensing?

This is not the most expensive tool in the market place, but of course, it is not open source.

The cloud load generation option could be a solution for companies not able or willing to invest in an enterprise performance test solution.

I would consider their token licensing option if you are looking into other testing and or development tools since you can optimize license usage by re-using licensees across the Rational tool set.

Which other solutions did I evaluate?

What other advice do I have?

Realize that this tool will require some time and expertise to setup and configure. Make sure that you plan for this.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user