Try our new research platform with insights from 80,000+ expert users
Quality Assurance Engineer at a computer software company with 201-500 employees
Real User
Works perfectly with the CUTE application and great for Windows OS, but not other operating systems
Pros and Cons
  • "Complete works perfectly with CUTE. That includes all dialogues, right-click menus, or system dialogues, etc., which are handled well."
  • "The solution needs to extend the possibilities so that we can test on other operating systems, platforms and publications for Android as well as iOS."

What is our primary use case?

I'm currently are trying to apply it to our software application.

We use it for testing Windows applications for CUTE, based on the CUTE framework. For now, that's all we use it for because Complete does not suggest any other options that are appropriate for us. By that, I mean it doesn't seem to work with Mac OS, Android OS, and iOS.

What is most valuable?

I only have experience with Windows, so I find all the best features are for that operating system.

Complete works perfectly with CUTE. That includes all dialogues, right-click menus, or system dialogues, etc., which are handled well.

The solution has a great feature called macro recording. With it, I can make it into a macro in a few of the languages Complete suggests. This is really useful for me, personally.

What needs improvement?

The solution needs to extend the possibilities so that we can test on other operating systems, platforms and publications for Android as well as iOS.

Right now, Complete can test only on native Android and native iOS applications.

For how long have I used the solution?

I've been using the solution for about a month. 

Buyer's Guide
SmartBear TestComplete
October 2024
Learn what your peers think about SmartBear TestComplete. Get advice and tips from experienced pros sharing their opinions. Updated: October 2024.
816,406 professionals have used our research since 2012.

What do I think about the stability of the solution?

This tool is quite stable. I had only one crash, and I sent a report for this crash to technical support. Everything else seems to work perfectly. Aside from the one issue, we haven't had any other problems.

What do I think about the scalability of the solution?

I don't have any experience, unfortunately, with scalability. We use just one instance on one machine so I've never attempted to scale the solution. There's just one user on the platform right now.

I am not sure if our organization will extend its usage in the future. We have a strong need to make this work on other platforms. We may switch to a different tool.

How are customer service and support?

I do have some experience with technical support. I've found a few answers to my issues on Smart BF5. I've also had assistance with the support engineers. So far, I've been satisfied with the level of support I have been able to receive. 

Which solution did I use previously and why did I switch?

I have used other solutions, including ALTA. It has good UI, but I don't know if you are really able to directly compare it to this solution. 

How was the initial setup?

The initial setup is straightforward. We found it simple and not too complex. Our team didn't run into any issues.

For us, deployment took two to three days.

What about the implementation team?

We didn't use an integrator, reseller or consultant for the deployment. We handled the entire process ourselves.

What's my experience with pricing, setup cost, and licensing?

I'm not sure if there are licensing costs involved in the solution. We simply bought the product outright and started using it.

What other advice do I have?

I'm currently working with the latest version of the solution.

My advice to others is to just decide if this tool is usable for your requirements. I spent a lot of time developing some tests, but then I understood that we actually needed more platforms. That's why we will switch to another tool. That's also why it's important to check your organization's requirements. Otherwise, like us, you may need to switch.

I'd rate the solution seven out of ten.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user327474 - PeerSpot reviewer
QA Automation Engineer at a computer software company with 501-1,000 employees
Vendor
We can test our applications manually for a full 48 hours continuously, but it lacks its own log viewer.

What is most valuable?

The opportunity to work with DevExpress and WPF objects.

How has it helped my organization?

  • Approximately, we get new build once per week. So I need to provide smoke testing for it. In case of manual tests execution, it is needed 48 hours (six working days) to smoke it. With TestComplete, we need just eight hours (or even less - if we're using multiple machines)
  • Stability and Stress testing. It is impossible to test our applications manually for 48 hours (two full days) continuously. With TestComplete, it is possible

What needs improvement?

  • Better stability, as sometimes, TestComplete crashes when attempting to delete over 10 logs
  • Support for the latest versions of DevExpress
  • More comfortable XML editor (like in Notepad++)
  • A better script editor. I will be happy, if the TestComplete editor would contain a design like the one in Visual Studio or Eclipse - errors and unusable variables being highlighte, and refactoring opporunities
  • Own log viewer in TestExecute. For now, it is possible to open it only within a browser, which is not very good, because if the log is 2GB or more, it will take 10-20 minuts to open with Internet Explorer

For how long have I used the solution?

I've used it for three years, including, v7, & v9 with TestExecute v9, and it's been in use on the project since 2010.

What was my experience with deployment of the solution?

When we migrated from v7 to v9, we encountered a problem with using recursive code; in DelphiScript recursion was completely broken.

What do I think about the stability of the solution?

Sometimes, TestComplete crashes when attempting to delete over 10 logs.

How are customer service and technical support?

Customer Service:

It's acceptable.

Technical Support:

It's acceptable.

Which solution did I use previously and why did I switch?

I tried Visual Studio 2010 (Coded UI Tests feature). The tool was changed, because TC is cheaper and more acceptable for those apps testing. But for now, this project doesn't use QA automation and I am working in another project

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
SmartBear TestComplete
October 2024
Learn what your peers think about SmartBear TestComplete. Get advice and tips from experienced pros sharing their opinions. Updated: October 2024.
816,406 professionals have used our research since 2012.
reviewer1183092 - PeerSpot reviewer
Senior Test Consultant at a outsourcing company with 51-200 employees
Consultant
Fast, stable, very well organized, and can find and interact with almost everything that exists on Windows
Pros and Cons
  • "It works very fine. It is fast on almost any machine, and it is also very well organized. I like its object mapping and its capability to find and interact with almost everything that exists on Windows."
  • "I didn't use it very heavily. One issue that I found was that there wasn't a quick way or a button to move Visual Basic scripts to TestComplete. We have a lot of such scripts in our organization, and it would be very useful to have some option to easily move these scripts. It is currently possible to convert these scripts to TestComplete, but it is not easy. I have to write some code, but everything is not available immediately."

What is our primary use case?

I used this solution mostly for a proof of concept. We have a lot of desktop applications with a lot of engines and customized framework. I used this solution to prove that it can interact with some old desktop applications or customized framework, where any other tool would not fit. 

What is most valuable?

It works very fine. It is fast on almost any machine, and it is also very well organized. 

I like its object mapping and its capability to find and interact with almost everything that exists on Windows.

What needs improvement?

I didn't use it very heavily. One issue that I found was that there wasn't a quick way or a button to move Visual Basic scripts to TestComplete. We have a lot of such scripts in our organization, and it would be very useful to have some option to easily move these scripts. It is currently possible to convert these scripts to TestComplete, but it is not easy. I have to write some code, but everything is not available immediately.

For how long have I used the solution?

I have been using this solution for maybe one year. 

What do I think about the stability of the solution?

It is very stable and easy going.

What do I think about the scalability of the solution?

I didn't come to that point. In my department, we had two users. 

How are customer service and technical support?

I didn't contact them.

How was the initial setup?

The initial setup was very straightforward. I have a lot of experience and knowledge. Therefore, it was very easy for me to switch to TestComplete, but I am not sure about a new person.

What other advice do I have?

I would definitely recommend this solution. I would rate SmartBear TestComplete an eight out of ten.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user293895 - PeerSpot reviewer
Software Developer at a retailer with 1,001-5,000 employees
Real User
Our biggest problem was the timing between input and responses, but a whole suite of tests could be run automatically.
Pros and Cons
  • "The ability to run a whole suite of tests automatically (which we did overnight)."
  • "We were testing handheld barcode scanners running WindowsCE with many menus of warehouse functions, and our biggest problem was the timing between input and responses."

What is most valuable?

The features of TestComplete that were most valuable to me were:

  • The ability to run a whole suite of tests automatically (which we did overnight)
  • The ability to create test scripts that were easy to modify;
  • The ability to easily review a log of software errors, if any

How has it helped my organization?

It would have been a huge task to have to run the test scripts manually, probably 12 hours straight. We were able to run tests on daily promotions of software so all software was tested every night, making any bugs instantly visible the next morning. It gave us quick confirmation that software changes worked, and without breaking any existing software.

What needs improvement?

We were testing handheld barcode scanners running WindowsCE with many menus of warehouse functions, and our biggest problem was the timing between input and responses. This was because sometimes the Windows PC feeding the scanner script data was faster than the scanner could process it, so we had to constantly tweek the wait times so the script wouldn’t bomb out. I have since used software with a “wait for” function that would wait for a response, but if TestComplete did, we didn’t know about it.

One of the main reasons I was hired was to use TestComplete with green screen applications, which was possible, but not easy. You had to know the exact column and row position of every text line on the screen so you could verify the string being tested and analyze exactly where and what the response would be.

For how long have I used the solution?

I used TestComplete as a QA Automation consultant for about six months.

What was my experience with deployment of the solution?

No

What do I think about the stability of the solution?

No

What do I think about the scalability of the solution?

No

How are customer service and technical support?

Customer Service:

We never needed customer service.

Technical Support:

We never needed technical support.

Which solution did I use previously and why did I switch?

Nothing previous to TestComplete.

How was the initial setup?

That happened before I was hired, so I don't know.

What about the implementation team?

TestComplete was implemented with the help of contract software developers who created the test scripts, which was invaluable to be able to use it for testing, and to use them as templates so we could copy and modify to make new scripts.

What was our ROI?

unknown.

What's my experience with pricing, setup cost, and licensing?

unknown.

Which other solutions did I evaluate?

TestComplete was installed before I was hired, so I know nothing about this.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
PeerSpot user
Sr. Software Quality Consultant at a tech services company with 501-1,000 employees
Consultant
Whereas we did regressions and Smoke manually in the past, we now do automated testing. However, Intellisense demos do not work on methods in the classes.

What is most valuable?

  • Dynamic Find methods - FindChild, FindAllChildren, and FindAll
  • Keys method
  • Project variables
  • Time delay methods
  • aqString methods
  • Intelisense

How has it helped my organization?

Regressions and Smoke was done manually in the past, which has been replaced by Automated Testing.

What needs improvement?

The web testing framework of TestComplete is not very helpful for an Automation Engineer. It requires the same effort as Selenium, and. in most cases, Selenium proves to be a better testing tool for web-based testing.

Web Application Testing has the following issues:

  • Events do not work on Modal Dialog
  • Dynamic Object Capturing is too hard and takes too much time in finding the correct object
  • Intellisense demos do not work on methods in the classes

Similarly, the mobile testing framework of TestComplete is not of much use either. I do not recommend anyone use this tool for web or mobile testing.

For how long have I used the solution?

I have been a user of this tool for five years, including previous versions, on desktop, mobile and the web. I have completed a few major projects with thsi tool and have enhanced numerous test suites created with this tool.

What do I think about the stability of the solution?

There have been quite a few issues. Delay methods are not so dynamic in TestComplete, so if a screen hasn't loaded, and the delay is a static delay, then the test moves forward in script, but the previous operation has not been done, resulting in failure of the whole test one after another.

This also means that TestComplete and TestExecute work in a not so similar manner, causing TestExecute to be practically useless. This happens in the case of HTML5 based web application.

How are customer service and technical support?

Customer Service: Level of customer services is satisfactory. Replies are swift and prompt.
Technical Support: Solutions are scarce. If there is no solution to a problem, the support people will tell you there is no way around it, and then you are stuck. The issues are not resolved in the next releases, mainly because these are not escalated on the backend.

Which solution did I use previously and why did I switch?

SilkTest was being used previously with my previous employer. It was abandoned because it was hard to script and advanced features were not being added.

How was the initial setup?

The previous solution I used was SilkTest, which was being used by my previous employer. It was abandoned because it was hard to script, and advanced features were not being added.

What about the implementation team?

It was done through a vendor. It's better to get it done through vendors, as they are then responsible in the future.

What's my experience with pricing, setup cost, and licensing?

It is not a good idea to choose this tool only if it is being used by others. In our case it is an expensive tool, and we should have exerted the same effort by using Selenium, and would have had better results. It appears that if you have a bif web application built in HTML5 and Jquery, and uses Divs and Modal dialogs, then avoid using TestComplete.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user291057 - PeerSpot reviewer
it_user291057QA Automation Engineer with 501-1,000 employees
Vendor

My experience with the web support in TestComplete matches yours. As such I have implemented all of our web-based automation using Selenium. I am currently using TestComplete for our desktop applications only.

reviewer1199442 - PeerSpot reviewer
Quality Assurance Engineer at a tech vendor with 201-500 employees
Real User
Easy initial setup, good stability and great script recording features
Pros and Cons
  • "The solution helps improve the stability of our product. It also decreases the work of our manual quality assurance engineers."
  • "The solution needs Mac OS support. Right now, the solution has only been developed to accommodate Windows OS."

What is our primary use case?

We primarily use the solution to automate the user interface.

How has it helped my organization?

The solution helps improve the stability of our product. It also decreases the work of our manual quality assurance engineers.

What is most valuable?

The most valuable features are the script recording and the object spy. The solution has the ability to structure text well using different modules.

What needs improvement?

The solution needs Mac OS support. Right now, the solution has only been developed to accommodate Windows OS.

For how long have I used the solution?

I've been using the solution for one year.

What do I think about the stability of the solution?

The solution has impressive stability.

Which solution did I use previously and why did I switch?

There are some unsolved issues working with control drop downs that need to be resolved.

How was the initial setup?

The initial setup is easy. You just have to click and go. It was very fast for me on my desktop, however, I cannot speak to how fast it was on the production server.

What's my experience with pricing, setup cost, and licensing?

Currently, we're evaluating the product, so we have not yet bought a license.

Which other solutions did I evaluate?

Right now, we're in the process of evaluating this product and Squish.

What other advice do I have?

I'm using the desktop version of the solution.

Right now, I'm working with TestComplete, and will compare it to another product called Squish. Once I've compared the two, I'll make recommendations to my customers and our company about whether or not to buy the complete solution.

I'd rate the solution eight out of ten. I'd rate it higher if the solution offered the ability to test on Mac OS.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Test Architect at a tech services company with 1,001-5,000 employees
Real User
Great AI features with good cloud scaling and helpful technical support
Pros and Cons
  • "The initial setup is pretty easy and it's quick to deploy."
  • "If that engine could better identify more XPaths automatically and make the process more flexible, that would be better."

What is most valuable?

The artificial intelligence aspect is very useful for us.

Scaling to a cloud environment is very easy.

Scriptless approaches are very flexible compared to other scriptless automation tools.

The object identification for legacy applications that are very old can still be automated by TestComplete. The object identification is very powerful.

The stability has been good in the latest versions.

Technical support is quite helpful and they have a good community you can look for answers in as well.

The initial setup is pretty easy and it's quick to deploy.

What needs improvement?

We have something called Name Mapping in TestComplete it is the only Name Mapping that is available for TestComplete. If they allowed two Name Mappings, or run Name Mapping in run time, that would be ideal.

TestComplete has its own XPath Identifiers. It auto-identifies the XPath of the application. If that engine could better identify more XPaths automatically and make the process more flexible, that would be better. 

Code analysis would be helpful. If they could give us a code analysis feature, similar to something called Ranorex Coach (which will give us auto-suggestions of how to use certain things), that would be ideal. In Tricentis, they have a feature whenever we identify an element or automate an element, they give a unique identification element that the tool notes when we map. Here, we don't have a feature that can mention the unique object identification kind of stuff. We need to highlight it on screen and then we need to check it. 

For how long have I used the solution?

I've used this product for more than eight years or so.  It's been a while. 

What do I think about the stability of the solution?

The solution is now very stable. Four or five versions previous to the latest, if I recall, in version 10 or 11, it had some issues. However, now it is highly stable. Currently, there's nothing to worry about in terms of the stability of the product.

What do I think about the scalability of the solution?

The solution can be scaled across the cloud. It can be scaled using the automation framework.

How are customer service and technical support?

Technical support is good. Either we can raise a technical support ticket with them, which gets answered in 24 hours or we can use the very good community that they have. Whenever we post a query, we are able to get the answer easily from the community. It's very helpful.

How was the initial setup?

The installation is very simple. In just five minutes we can install it and we don't need to do any settings for resetting - such as, for example, how we do it for Selenium or other tools. We don't require much time to deploy it. In no more than five minutes it is installed and ready to go.

What's my experience with pricing, setup cost, and licensing?

The price is moderate. It's not the cheapest or the most expensive if you compare it with other competitors. It's okay. 

What other advice do I have?

My company is a partner of TestComplete. I am a senior test architect in our organization.

If a company has an ecosystem and they need to automate the web, desktop, or mobile, then TestComplete is the right tool. Even if they need enterprise application automation, it's very easy. On top of that, using a scriptless approach will save a lot of time. However, users are not limited to that. They can use Python, JavaScript, VBScript, or other kinds of options. You can import external Python libraries inside it, which will give additional capabilities to the tool. It's been very useful.

Overall, I would rate it at a nine out of ten.

Disclosure: My company has a business relationship with this vendor other than being a customer: partner
PeerSpot user
reviewer1378161 - PeerSpot reviewer
Sr. Consultant at a computer software company with 51-200 employees
Real User
Good technical support, but the cost of licensing is a little bit high
Pros and Cons
  • "The most valuable features are the desktop and mobile modules."
  • "The licensing costs are a little bit high and should be reduced."

What is most valuable?

The most valuable features are the desktop and mobile modules.

What needs improvement?

The licensing costs are a little bit high and should be reduced.

I would like the ability to automatically distribute web applications to all of the concurrent users.

For how long have I used the solution?

We have been using TestComplete for the past two years. 

What do I think about the stability of the solution?

The stability is good.

How are customer service and technical support?

The technical support is quite good.

How was the initial setup?

The initial setup is not too straightforward and not too complex. I would say that it's okay.

What's my experience with pricing, setup cost, and licensing?

The price varies depending on the plan that you choose. The option we chose was around $2,000 USD.

Which other solutions did I evaluate?

I am currently investigating the differences between TestComplete and TestLeft.

What other advice do I have?

TestComplete is a good product compared to other options that are on the market.

I would rate this solution a seven out of ten.

Which deployment model are you using for this solution?

On-premises
Disclosure: My company has a business relationship with this vendor other than being a customer: Partner
PeerSpot user
Buyer's Guide
Download our free SmartBear TestComplete Report and get advice and tips from experienced pros sharing their opinions.
Updated: October 2024
Buyer's Guide
Download our free SmartBear TestComplete Report and get advice and tips from experienced pros sharing their opinions.