The most valuable features are the API testing, the integration with DevOps and accessibility to people without a lot of technical skill.
QA Expert at a financial services firm with 51-200 employees
QTP Sucks Selenium Rules
I decided to use Selenium because I like the freedom that you get with all the programming languages it supports and because development is usually quicker than any other testing tools I ever used!
I chose Selenium IDE as my first
open source automated tool. And then I worked with Selenium RC. And now
Selenium Webdriver. It's the best testing tool ever!!
I think QTP is sucks. Of course, QTP
fanboys will immediately jump up & down stating that I don't know how
to use QTP. On the contrary, I know exactly what I am talking about. Because
I've been a QTP Engineer for last 6 years. As of this writing, QTP still
does not support Mac OS X, and Linux, heck it still doesn't support Firefox 3.6! Are you
kidding me? Well, apart from HP's snail pace development process, I have other
problems with the tool itself. Like its really retarded scripting engine (which
uses vbscript), which does not provide you any real mechanism to maintain
frameworks. Another example - CreateObject("WScript.Shell") -
what do you think will happen if you used that in QTP? Any programmer who knows
vbscript, will say that it creates a wscript object but she'd be so wrong.
It rather creates a native windows shell automation object. WScript CreateObject()
is simply not supported in QTP as QTP scripting engine overrides WScript.
Let us get one thing straight -
Automation is programming, now let that sink in for a second...again -
automation is programming. If your automation tool does not provide a real good
programming interface, it is not fit for automation. Obviously in my books, QTP
falls way short of that goal. One of the statements I consistenly hear is -
"oh we don't have programmers in our automation team". If you cannot
see the fallacy in that statement, no one can help your team - not even QTP.
And of course, support from HP is bad too. Case in point - few month ago
our team encountered a bug in QTP 10 where it had memory allocation issues
& the workaround offered to us - "restart QTP after every 4 test
case runs". I am not joking.
QTP does few things
really good vis-a-vis record & playback (and they make it real simple
for non technical users). And that also includes support for various enterprise
applications both web based & win32. That means, they have to cover a
lot of territory before they can release something and that explains why
Windows 7 support is still lacking. But in your case, do you need Sharepoint
support on Windows 7? If all you're testing is your own web app, why do you
have to wait for HP to finish support for say Oracle enterprise apps? At this
juncture, the only reason your team is still sticking to QTP is either because
you have no real developers in your QA team and/or you have a lot of test cases
automated in QTP. The later is a pain initially to convert to something else,
but if you plan it out correctly you will save tons of headache in
future.
I could go on & on about all that is wrong with QTP, but this article is not about that. This article is about getting rid of QTP & using alternatives in place of it to achieve a truly cross platform solution. After joining my current company, one of my first goal was to do exactly that. And this article describes what we did & how we did it.
To see a list of hotfixes that I know of see:
http://www.sayem.org/2012/02/qtp-sucks-selenium-rules.html
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Application Delivery CTO – Group Operations and QA at a financial services firm with 10,001+ employees
It is accessible to people lacking technical skill. I would like to see integration with LeanFT.
What is most valuable?
How has it helped my organization?
We can move beyond manual testing without having to go through a whole transformation of an application.
What needs improvement?
I would like to see more integration with LeanFT and use UFT for continuous integration. It's still a closed product. There's still a reasonably large amount that it can do in order to get better.
What do I think about the stability of the solution?
Stability is good.
What do I think about the scalability of the solution?
Scalability is good. I never have seen an issue with the scalability.
What other advice do I have?
When choosing a vendor, find someone who understands your problems. Build a good relationship. Make sure you can influence the product road map. Look at it amongst other tools in the tool chain. Look at LeanFT as well.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Buyer's Guide
OpenText UFT One
January 2025
Learn what your peers think about OpenText UFT One. Get advice and tips from experienced pros sharing their opinions. Updated: January 2025.
831,265 professionals have used our research since 2012.
Project Manager at a tech services company with 1,001-5,000 employees
We're able to automate both Windows and web applications form a single console. The product should evolve to be flexible so one can use any programming language such as Java and C#.
Pros and Cons
- "The ease of record and playback as well as descriptive programming are the most valuable features of UFT (QTP)."
- "The product should evolve to be flexible so one can use any programming language such as Java and C#, and not just VB script."
Valuable Features
The ease of record and playback as well as descriptive programming are the most valuable features of UFT (QTP). Also the feature for automating both Windows and web applications form a single console is not bad.
Improvements to My Organization
My previous organization used UFT extensively for automation more than 500 complex end to end regression tests with considerable savings in time and effort. We were able to achieve that with high degree of reusability.
Room for Improvement
The product should evolve to be flexible so one can use any programming language such as Java and C#, and not just VB script. Also, the dependency of browser windows to be opened on screen in order for the tool to recognize objects is a big deal breaker since most organizations mandate screen locking when leaving the systems unattended. If we can’t leave a test to run attended, the point of automation in itself becomes a question-mark.
Use of Solution
I've been using it for more than 10 years.
Deployment Issues
There were no issues with the deployment.
Stability Issues
We did have a few instances of browser crashing as well as the product crashing. While the product crashing was resolved with 4 GB of memory, the issue with browser crashing still happened with IE 11 and 12 browsers and no resolution was found.
Scalability Issues
UFT is pretty late to support latest versions of IE. Also I have seen a marked decrease in execution speed while the scripts grow.
Customer Service and Technical Support
I have not interacted directly with HP on the product support.
Initial Setup
UFT setup is pretty straightforward.
Implementation Team
We did it in-house.
Pricing, Setup Cost and Licensing
It took about five years to break even. UFT is costly.
Other Solutions Considered
No other options were looked as we went straight ahead into UFT.
Other Advice
Go for the cheaper option of Selenium if your requirement is purely browser based testing. If not, go for UFT.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Managing Director at a tech services company with 51-200 employees
It provides us with service testing, API testing, GUI testing and business process testing, although it needs better compatibility with Chrome and Safari.
What is most valuable?
The most valuable feature to me are the high-end automation frameworks -- linear, hybrid, data-driven, keyword-driven, BPT, and functional decomposition.
How has it helped my organization?
It works with both desktop and web-based applications.
It also provides us with service testing, API testing, GUI testing and business process testing.
What needs improvement?
It needs better compatibility with Chrome and Safari, which would lead to this being a better product.
For how long have I used the solution?
I've used it for six years.
What was my experience with deployment of the solution?
I had no issues with deployment.
What do I think about the stability of the solution?
I've had no stability issues.
What do I think about the scalability of the solution?
We've scaled without issue.
How are customer service and technical support?
Customer Service:
Customer service is excellent.
Technical Support:Technical support is excellent.
Which solution did I use previously and why did I switch?
We didn't use a previous solution.
How was the initial setup?
The installation process of this software is very well organized. Here, all the prerequisites/supporting software are part of setup and it automatically configures your system for the best use during the installation. If in one or more parameters are missing the latest updates, it performs those updates automatically.
What about the implementation team?
We did it in-house, and I was a part of this team. You need to make sure to demonstrate to team members the proper tools for installation so they can follow the various concepts and then arrange for proper training to be given to all users for the best use of it. I believe that a well-trained person/team can solve issues with HP UFT by themselves.
What was our ROI?
It's fast, reliable, and accurate, and should provide ROI.
Which other solutions did I evaluate?
I am aware of other tools on the market, but I found HP UFT best suited to my needs. We, therefore, adopted it.
What other advice do I have?
If one is looking for a software testing tool for functional parameters with an automation approach, they can go for it without any more thinking and discussion. Where there are a few up and coming open source solutions, they have limitations that HP UFT doesn't have.
Disclosure: My company has a business relationship with this vendor other than being a customer: We are a certified training partner to HP Enterprise for their global training needs for HP UFT and other tools.
Neeraj, this is a nice review. Have you had a need to automate any Adobe Flex applications and if so was it successful?
Test consultant at a tech services company with 51-200 employees
You can automate your testing for a lot of different platforms. Scalability is a little difficult as you need to install it on the machines.
Pros and Cons
- "It's not only web-based but also for backend applications; you can also do the integration of the applications."
- "You have to deal with issues such as the firewall and how can the tool talk with the application, i.e., if the application is on a company network and so on. That, of course, is important to figure out."
What is most valuable?
For HPE UFT, you can automate your testing for a lot of different platforms. It's not only web-based but also for backend applications; you can also do the integration of the applications.
How has it helped my organization?
For test automation, it helps to speed up the testing and to speed up the software delivery, especially for HPE UFT because you have lots of test automation tools. Also, if I compare HPE UFT with the HPE QTP solution, then HPE UFT is more user-friendly in its use. You still have to program it, but you don't have to program it all of the time; so for a user who isn't used to working with code, he can do other things in HPE UFT.
What needs improvement?
I'm really looking forward to seeing the HPE StormRunner Functional. If it's possible to do it in a good way from the cloud, and you don't have to install it. I've seen that working for the HR manager and ALM solutions, so it would be very helpful. You have to deal with issues such as the firewall and how can the tool talk with the application, i.e., if the application is on a company network and so on. That, of course, is important to figure out.
For how long have I used the solution?
I have used HPE Unified Functional Testing (UFT) for one and a half years, whereas the HPE QuickTest Professional (QTP) for a couple more years before that.
What do I think about the stability of the solution?
We have to download it, then install it on our own machines and the machines sometimes aren't stable; since we have PDIs, also the UFT isn't stable and I don't know yet where the connection is.
What do I think about the scalability of the solution?
Scalability is a little difficult because you need to have the machines and then, have to install it. It is less scalable than the other products. For example, the HR manager just takes another workspace in the cloud and then, you work.
How is customer service and technical support?
I'm more happy with the SaaS support for the HR manager and ALM than with the off-premises support, that I have to so through for UFT. This is because, often, when I have an issue with UFT, I get slow responses and most of the times, it is in regards to the things that I have already Googled and tried to figure out myself. So, it doesn't always help me.
How was the initial setup?
HPE UFT is quite complex to set up.
What other advice do I have?
I, myself mostly, have experience with the HPE tooling and I haven't been in the position where I could decide what tooling to choose. I'm hired because I have this knowledge but I would say usability of the tools, (i.e., how you can use it) is the most important criteria while selecting a vendor
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Principal Business Analyst at a financial services firm with 1,001-5,000 employees
You get rid of manual testing, which is a huge improvement.
What is most valuable?
Well, you got just automation, basically, that's what you wanted. You get rid of manual testing, which is a huge improvement.
What needs improvement?
Well, I'm not an expert but from a deep technical perspective, it has been odd-neat, except for the small failures we had due to particular environments. I haven't got a good idea though, I'm not deep into it.
For how long have I used the solution?
We have been using the product since 2012. We use both ALM and UFT together, as a team.
What do I think about the stability of the solution?
UFT is stable. Not a problem.
What do I think about the scalability of the solution?
From my experience, UFT is scalable. Our very first project was quite a demanding project. We had a form of testing hosts of around 40 to 60 and we never had to worry about performance or scalability.
How is customer service and technical support?
The technical support is pretty good. It probably depends on the support contract type you have. Our contract works pretty well as we have dedicated support engineers for our product.
They are knowledgeable and responsive. Sometimes you need a little bit more, but then HP help us to find it as they're knowledgeable troubleshooters. So we never had a problem to get issues fixed when we found that particular person. It was very effective I guess.
What other advice do I have?
When considering vendors we look for stability, support and reliability. And that's probably it. So we probably are not going for small vendors.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Test Automation Specialist at a retailer with 1,001-5,000 employees
We were doing quarterly releases as well as maintenance releases, which is quite a lot. So this solution has saved us a lot of effort and expense.
Valuable Features:
It's great to be able to go from one company to another and each one uses UFT similarly. It's also extremely versatile, in that you can pretty much use it with any type of application.
Improvements to My Organization:
It allows us to automate hundreds of test cases that would normally have to be manually tested. The tests are also extremely reliable so it saves a lot of time on analysis. That's really the first and foremost benefit for us. We were doing quarterly releases as well as maintenance releases, which is quite a lot. So this solution has saved us a lot of effort and expense.
Room for Improvement:
The knowledge base for getting started isn't terribly deep, so it requires you to have a bit of programming ability to pick it up and use it.
Deployment Issues:
It's deployed without any issues for us.
Stability Issues:
It's fairly stable, but the problem is that it's not always updated and current. When something new comes up, it takes HP a long time to support it.
Scalability Issues:
Scalability depends on the user. UFT is basically a sandbox and will be as flexible as you make it. So scalability can be high, but there are things that work against it. You're bound by the licensing structure, so in order to get bigger benefits, you have to have multiple copies. If you want to fun multiple simultaneous tests, you have to have the licensing to do that, and that costs a ton of money.
Other Solutions Considered:
A lot of people are moving away from the big intertools. So people look at products all the time, and every time the budget comes up or every time they tell me to cut expenses or every time they get frustrated with it, a lot of the small-time tools and open-source tools get attention. So I've been evaluating those.
Other Advice:
If you're an HP shop, you're probably going to go out and buy it. But I don't think new customers will sign on to replace, for example, Selenium. There are plenty of open-source options, and people who know how to implement UFT already know how to implement open-source codes. So I think that people who are using open source will stick with open source, and people who have significant investment inHP will stick with HP.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Test Manager at a energy/utilities company with 1,001-5,000 employees
It's the only automation technology that our core application, which is a bit special and resistant to automation, supports.
Valuable Features
The core application that we're using in our company is a bit special and resistant to automation. To properly to automate, it needs a plug-in from the software's vendor. The only technology for automation that is supported is UFT, so we're sort of locked into UFT for our core application.
Improvements to My Organization
UFT is the only technology that enabled us to actually automate our core application.
Room for Improvement
It's fine, but we've had to do workarounds for some things.
Deployment Issues
We've had no issues with deployment.
Stability Issues
For us, we started with version 9 of UFT when it was called QTP, QuickTest Pro. For us it worked, though, like the average software, there are issues, but we always had a good ability to provide work arounds. Regardless, it's been pretty stable.
Scalability Issues
We've had no issues with scalability.
Customer Service and Technical Support
We haven't needed much technical support as we can sort it out ourselves.
Initial Setup
Some parts of it were pretty easy to set up. Most of the issues we had were related to organizational stuff, such as managing licenses, etc.
Other Advice
Make sure you take a good look at your approach, such as whether it's keyword driven automation, etc. Make sure you organize things that you're headed in the right direction because once you implement in a certain way, changing direction may be pretty hard. Determine also how you deal with object repositories, how you deal with sharing information, and how important the reusability of scripts is in your project.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Jonas,
Thank you for the quick response and detailed answer. It sounds like a very unique situation.
Buyer's Guide
Download our free OpenText UFT One Report and get advice and tips from experienced pros
sharing their opinions.
Updated: January 2025
Product Categories
Functional Testing Tools Mobile App Testing Tools Regression Testing Tools API Testing Tools Test Automation ToolsPopular Comparisons
Tricentis Tosca
BrowserStack
SmartBear TestComplete
Selenium HQ
Perfecto
Sauce Labs
Worksoft Certify
LambdaTest
Ranorex Studio
ReadyAPI
ReadyAPI Test
OpenText UFT Developer
Parasoft SOAtest
Visual Studio Test Professional
Buyer's Guide
Download our free OpenText UFT One Report and get advice and tips from experienced pros
sharing their opinions.
Quick Links
Learn More: Questions:
- Can JIRA provide integration to SAP automation?
- SAP GUI Testing Tool
- Has any user tried using UFT 12.02 with Windows 10?
- UFT 14 vs UFT 12.54
- Can javascript be used as a scripting language for tests in QTP or is it strictly VB?
- Can QTP calculate the number of pixels on a web page?
- Which product supports Cross Browser Testing: UFT Developer or UFT One?
- How does Micro Focus UFT One compare to Tricentis Tosca?
- Is Oracle Application Testing Suite or Micro Focus UFT One better for automating Oracle Fusion Applications?
- Which product do you prefer: Micro Focus UFT One or SmartBear TestComplete?
One of the downsides of the internet is that it keeps iu-informed and out dated posts around to help propagate the the notion that change doesn't happen. Micro Focus (then HPE) has release LeanFT a few years back which support creating and replaying tests on Mac, Linux, and Windows. And if that wasn't enough, most QTP customers already have access to it. But as they say, "Wait their is more", you can choose to write your tests in Java, C# or Javascript and leverage popular frameworks such as Junit, Nunit, TestNG or even build frameworks such as Maven.
As I like to say #DiscoverTheNew.
And for disclosure, I am a Solutions Architect who has worked for Mercury, HP, HP Enterprise and now Micro Focus and have supported the functional testing tools since WinRunner.