No more typing reviews! Try our Samantha, our new voice AI agent.

CucumberStudio vs SmartBear TestComplete comparison

 

Comparison Buyer's Guide

Executive Summary

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

CucumberStudio
Average Rating
8.0
Reviews Sentiment
7.1
Number of Reviews
12
Ranking in other categories
Rapid Application Development Software (24th), Dynamic Application Security Testing (DAST) (13th)
SmartBear TestComplete
Average Rating
7.6
Reviews Sentiment
6.8
Number of Reviews
76
Ranking in other categories
Functional Testing Tools (8th), Regression Testing Tools (5th), Test Automation Tools (6th)
 

Mindshare comparison

While both are Quality Assurance solutions, they serve different purposes. CucumberStudio is designed for Rapid Application Development Software and holds a mindshare of 0.7%, up 0.1% compared to last year.
SmartBear TestComplete, on the other hand, focuses on Test Automation Tools, holds 6.1% mindshare, up 5.9% since last year.
Rapid Application Development Software Mindshare Distribution
ProductMindshare (%)
CucumberStudio0.7%
Microsoft Power Apps8.3%
ServiceNow5.4%
Other85.6%
Rapid Application Development Software
Test Automation Tools Mindshare Distribution
ProductMindshare (%)
SmartBear TestComplete6.1%
Tricentis Tosca12.0%
OpenText Functional Testing6.3%
Other75.6%
Test Automation Tools
 

Featured Reviews

Walter Wirch - PeerSpot reviewer
Technical Expert at Bertelsmann SE & Co.
Facilitates integration of test scenarios while needing modernization of components
CucumberStudio is primarily used for designing test scenarios and automating testing. We have implemented it in conjunction with our own routines for integration into our infrastructure CucumberStudio aligns with our strategy for data-driven testing. It supports our product owners in designing…
George Mahlangu - PeerSpot reviewer
Automation Tester at Telesure Investment Holdings (TIH)
Record and playback functionality makes it easier to script and create automated tests
Headless testing would be a big improvement. For example, when we run our regression suite, we need to start a virtual machine and run the tests interactively. There isn't a way to run the tests headlessly without logging into the virtual machine. That's the one feature I think would really take TestComplete to the next level. Another feature that would be a valuable addition is that instead of generating MHT files when you enter an incident in Azure DevOps, they should have a way to generate something like an HTML file. MHT files are an outdated technology that requires Internet Explorer to open. With current technologies and Microsoft's updates to Edge, you can end up with MHT files that you can't open. That's a feature they could improve upon. Each tool has its own way of generating reports. Maybe if you go open source with something like the Allure Report and add an Allure Report extension to Azure DevOps, that would provide clearer and nicer reports. I know TestComplete has its own way of implementing alerts, but the issue is that you don't see the screenshots in Allure report when you use it.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"CucumberStudio has a very user-friendly interface."
"The most valuable feature is the re-usability of action words."
"The power of Hiptest is its test cases and campaign management."
"The data table that helps in converting a single script to multiple test cases is very helpful."
"CucumberStudio aligns with our strategy for data-driven testing."
"The best thing is that a person without knowledge about the program can easily understand what happened in our testing process."
"The most valuable feature of CucumberStudio is its use of action words, which allows me to avoid writing test cases from scratch for the most common scenarios."
"The URL is very useful, and it has a very good UI for deploying information of the scenarios created."
"If a user is testing behavioral actions, then SmartBear is a very good product to go to."
"TestComplete is much more flexible, light, and easy to use."
"The automation has improved over time, allowing it to integrate with other external tools for defect tracking."
"We were able to run tests on daily promotions of software so all software was tested every night, making any bugs instantly visible the next morning."
"It is a strong automation tool for desktop, browser, and API testing."
"I used different solution afterwards and I can say there is no other product with such great flexibility."
"The ability to run a whole suite of tests automatically (which we did overnight)."
"It allows us to test both desktop and web applications."
 

Cons

"Yes, it is not stable when you create a data table that includes more than 30 elements, so it can lose your data."
"I would like to see better customer support."
"It needs some improvement when exporting scenarios into automation code, to make it easier to manage the repeatable action words and tests."
"CucumberStudio's API integration could be improved both in terms of reliability and design."
"The reporting and metrics can be improved. E.g.: If we wanted to have metrics across all projects."
"The reporting needs to be improved."
"Copy-pasting something directly from JIRA requires too much modification and formatting."
"Another kind of deployment might be useful, perhaps an option to install the tool in a local deployment."
"The tool sometimes seems a little unstable and crashes sometimes on Windows 10."
"If that engine could better identify more XPaths automatically and make the process more flexible, that would be better."
"LoadComplete could be a little more user-friendly, but is still better than LoginVSI."
"The initial deployment of TestComplete was difficult, but with the assistance of SmartBear technical support, I was able to get it up and running."
"A major part of the product that needs improvement is the licenser."
"It seems to crash once every two to three months."
"The solution needs to extend the possibilities so that we can test on other operating systems, platforms and publications for Android as well as iOS."
"The solution needs Mac OS support. Right now, the solution has only been developed to accommodate Windows OS."
 

Pricing and Cost Advice

Information not available
"The solution's pricing is too high."
"This is a pay-per-use service that is not expensive, and cost-efficient if you have a small team."
"The product is becoming more and more expensive."
"We have a TestComplete 12 license."
"The price of SmartBear TestComplete could be less. The main challenge is when it comes to node-locked. They should use a subscription model, such as a monthly-based subscription or, a quarterly-based subscription. Their floating license is very expensive, and this high price should be reduced or provide, at a minimum, a subscription model."
"Overall, for us, the cost of the TestComplete platform and the three extra modules is around $8,000."
"It is approximately $6,000 a year."
"It costs a few hundred per year, but I am not sure. It is not at all expensive as compared to other tools."
report
Use our free recommendation engine to learn which Rapid Application Development Software solutions are best for your needs.
886,906 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Comms Service Provider
23%
Manufacturing Company
14%
Construction Company
14%
Financial Services Firm
9%
Manufacturing Company
13%
Financial Services Firm
13%
Computer Software Company
10%
Construction Company
6%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
By reviewers
Company SizeCount
Small Business3
Midsize Enterprise3
Large Enterprise4
By reviewers
Company SizeCount
Small Business23
Midsize Enterprise19
Large Enterprise32
 

Questions from the Community

What needs improvement with Hiptest?
CucumberStudio's API integration could be improved both in terms of reliability and design. The API requires data to be sent in a specific format, which takes time to build. Additionally, the repor...
What is your primary use case for Hiptest?
I use CucumberStudio as a test case repository. All of our test cases are stored there. It is also part of our test planning process. For every sprint, we plan the test cases in CucumberStudio and ...
What advice do you have for others considering Hiptest?
For teams following a BDD style software development approach, CucumberStudio is a great collaborative tool that covers all the basic requirements of a test management tool. I would rate CucumberSt...
What do you like most about SmartBear TestComplete?
TestComplete has strong reporting capabilities. The reports they generate are really good.
What is your experience regarding pricing and costs for SmartBear TestComplete?
I am not involved in pricing or licensing; our management team handles these aspects.
What needs improvement with SmartBear TestComplete?
While using SmartBear TestComplete, we are fine with the current capabilities, however, it would be beneficial to improve some performance aspects, especially the image comparison feature. Occasion...
 

Also Known As

Hiptest
No data available
 

Overview

 

Sample Customers

Cisco, Cardinal Health, Intuit, Smartbox, Accenture, Deliveroo
Cisco, J.P. Morgan, Boeing, McAfee, EMC, Intuit, and Thomson Reuters.
Find out what your peers are saying about Microsoft, ServiceNow, Oracle and others in Rapid Application Development Software. Updated: March 2026.
886,906 professionals have used our research since 2012.