Try our new research platform with insights from 80,000+ expert users
Blaine Anderson - PeerSpot reviewer
Software Development Team Lead at a engineering company with 51-200 employees
Real User
Application performance monitoring solution that integrates with Azure DevOps for continuous integration and deployment
Pros and Cons
  • "The most valuable feature of this solution is its ability to integrate with Azure DevOps for continuous integration and deployment."
  • "This solution could be improved by making it easier to visualize where there is a failure without having to look at it in detail."

What is our primary use case?

We use this solution to log into a website, do MFA authentication and to verify test cases.

What is most valuable?

The most valuable feature of this solution is its ability to integrate with Azure DevOps for continuous integration and deployment. It also frees up manual testing of sites and manual testing of any of our applications. This frees up about 40 hours a week.

What needs improvement?

This solution could be improved by making it easier to visualize where there is a failure without having to look at it in detail. In comparison, Leapwork allows us that visibility and showed us exactly where it failed more easily.

What do I think about the stability of the solution?

This is a stable solution.

Buyer's Guide
SmartBear TestComplete
October 2024
Learn what your peers think about SmartBear TestComplete. Get advice and tips from experienced pros sharing their opinions. Updated: October 2024.
814,649 professionals have used our research since 2012.

How are customer service and support?

Tech support that we have received so far is pretty good. We haven't really needed to use a lot of their tech support.

How would you rate customer service and support?

Positive

How was the initial setup?

The initial setup is pretty straightforward.

Which other solutions did I evaluate?

We evaluated both Leapwork and SmartBear, along with other automated testing solutions. Both products are really good. I like Leapwork because it is easier for people to use but the price was too high per user per year. SmartBear is easy to use as well but Leapwork is not a no-code solution, whereas SmartBear is a low-code solution.

We went with SmartBear mainly because we're also using SmartBear Swagger. We're already utilizing some of SmartBear's technology in-house and its cost per license per year is lower. That was the key factor in why we decided to go with SmartBear over LeapWork.

What other advice do I have?

The advice that I would give would be to make sure you dedicate some time and resources to laying out how you want to structure the test cases first.

I would rate this solution an eight out of ten. 

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Sandhiya T S - PeerSpot reviewer
Sr Solutions Engineer at Lexington Soft
Reseller
Easy to set up with good record and replay features
Pros and Cons
  • "You can record your actions and play them back later."
  • "Right now, the product only supports Windows."

What is our primary use case?

We primarily use the solution for our automating our test scripts.

What is most valuable?

The record and replay aspects of the solution are quite useful for people. With them, you don't have to write any scripts. Basically, you can record your actions and play them back later.

The initial setup is very easy.

What needs improvement?

Right now, the product only supports Windows. We'd like to see it work with other operating systems as well. They should definitely be working with iOS, for example. That should just be a given.

What do I think about the stability of the solution?

The product is quite stable. There are no bugs or glitches. it doesn't crash or freeze. It's reliable. 

What do I think about the scalability of the solution?

The scalability is quite good. If a company would like to expand it, it can do so. 

How are customer service and support?

Technical support is excellent. If you reach out to them, they will get back to you within 24 hours. 

How would you rate customer service and support?

Positive

How was the initial setup?

The implementation process is hassle-free. I'd rate it a five out of five in terms of ease of installation. It's a very simple process. 

The amount of maintenance needed probably depends upon your project and the number of test scripts you have. It is based on the complexity of your application. If it is straightforward, one person can manage it once it is automated. A larger amount of scripts may require a bit more maintenance, however, something that is low to medium is easy to handle. 

What's my experience with pricing, setup cost, and licensing?

While it's my understanding that clients don't seem bothered by the pricing, I can't speak to the actual cost of the product. That said, it is, as far as I know, competitive in the market.

What other advice do I have?

I'm a reseller. I'm not coming from any organization as a consumer who is consuming TestComplete features. Actually, I'm a solution architect who is demonstrating the features of the tool to others.

While I tend to look at client requirements before recommending any solution if it did fit in with a client's need I would definitely recommend the product. It's very reliable. 

I would rate the solution eight out of ten. While there are some gaps, we've been mostly happy with its capabilities. 

Which deployment model are you using for this solution?

On-premises
Disclosure: My company has a business relationship with this vendor other than being a customer:
PeerSpot user
Buyer's Guide
SmartBear TestComplete
October 2024
Learn what your peers think about SmartBear TestComplete. Get advice and tips from experienced pros sharing their opinions. Updated: October 2024.
814,649 professionals have used our research since 2012.
Engineer at Honeywell International Inc.
Real User
Simple to install and use, with efficient scripting, but control IDs are not always recognized correctly
Pros and Cons
  • "When compared to other tools, it is very simple."
  • "During the distribution of our regression test cases, the control IDs are not always recognized correctly."

What is our primary use case?

I work as a tester for a company.

I use TestComplete in SmartBear and the open-source version of SoapUI.

We use TestComplete for our regression test case distribution.

What is most valuable?

For Windows application automation, we use TestComplete, and for API automation, we use SoapUI. When compared to TestComple, I find SoapUI to be extremely useful.

TestComplete is extremely efficient when it comes to scripting. In a single day, you can automate more than 100 test cases. If you write the code, Selenium allows you to automate only 10 to 15 cases.

When compared to other tools, it is very simple.

What needs improvement?

When we try to automate and keep the same script in a few cases, it fails due to control changes. You must have a session open when running in TestComplete, otherwise, your script will fail.

When compared to the competitors, it is a little more complicated.

During the distribution of our regression test cases, the control IDs are not always recognized correctly.

Our frequency control IDs are getting changed. For example, if I develop a script in one mission and then try to deploy the same script in another mission, the script will not be executed properly.

Selenium is more efficient than TestComplete at the point of execution, in my experience.

In terms of execution, attempting to run a script from multiple missions will result in the script being deployed and failing to work in some of the missions.

It would be beneficial if they provided a new open-source library that could be integrated with Selenium. Currently, we must create Java bridge libraries in order to integrate with Selenium. It would be preferable to have a simple APA for consuming the Selenium feature console.

For how long have I used the solution?

I have been working with SmartBear TestComplete for two years.

We've also phased TestComplete, a slightly lower version, and are looking into TestComplete 14, using the trial version.

What do I think about the scalability of the solution?

This solution is used by myself and two other members of the same team.

How are customer service and support?

I have not contacted technical support because I am using the trial version.

How was the initial setup?

The initial setup is very easy.

What's my experience with pricing, setup cost, and licensing?

We have a TestComplete 12 license.

What other advice do I have?

I would rate SmartBear TestComplete a six out of ten.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
PeerSpot user
Senior Consultant at a tech services company with 10,001+ employees
Consultant
Using this solution I am able to process whole pages at once rather than doing everything one by one

What is most valuable?

Valuable for us is the ability to identify objects by using Find methods. I am able to process whole pages at once rather than doing everything one by one.

What needs improvement?

Using object spy can be slow sometimes and seems to require a lot of resources.

For how long have I used the solution?

We have been using the solution for six months.

What do I think about the stability of the solution?

The solution freezes sometimes, but not very often. Sometimes it doesn’t find any objects from the browser and needs to restart the browser or the whole machine. This happens with Internet Explorer.

What do I think about the scalability of the solution?

It is very difficult to have multiple developers when using Name Mapping. You can’t merge all the files and this creates conflicts.

It scales better for multiple users when using pure script, which reduces the amount of files that cannot be merged.

How are customer service and technical support?

Support calls were helpful at the beginning, and I haven’t used the support since then.

Which solution did I use previously and why did I switch?

We used TestPlant eggPlant and are still using it for thick clients where objects are not available. The development speed for TestComplete is faster and more reliable when objects can be seen.

How was the initial setup?

It is easy to install and use.

Which other solutions did I evaluate?

We went through quite a few of them. This product seemed best for usability and recording features.

What other advice do I have?

Test the trial, then go for it. Keyword tests seem viable for straightforward test cases, but to create dynamic architecture you might want to stick only with scripts and drop Name Mapping.

Keyword tests are easy and fast to record, but adding complex logic for them can be tricky and time consuming.

Disclosure: My company has a business relationship with this vendor other than being a customer: We are partners with SmartBear.
PeerSpot user
it_user293901 - PeerSpot reviewer
Principal Software Engineer - Automation at a tech services company with 10,001+ employees
Consultant
Our testing team can spend more time testing new features, but there often are issues with web test execution.

What is most valuable?

  1. Object Browser is the most powerful feature. This has helped me tear apart every single component of the application under test. It's an awesome feature.
  2. Test Editor and Debugger: This has really made my life easy as I can trace memory and stack values very easily.
  3. Data driven testing has been made very easy. I am comfortable using any sort of backend to support data driven testing such as Excel/databases/etc.
  4. It supports using third party DLLs has given me an edge on several occasions.

How has it helped my organization?

Previously, we had to wait for the end-of-sprint to make a stable release. Now, rolling out a release is not a problem. As soon as a build is deployed, the scheduler quickly executes User Acceptance Tests, and verifies that the build is fit to be delivered to the clients.

What needs improvement?

  1. Support for working with COM and ActiveX objects should be more powerful. Currently we have to drill down a lot to find solutions for certain tasks.
  2. Cross browser testing is a bit complex when it comes to scripting. Developers have to take care with it care, or else issues may arise at deployment time.

For how long have I used the solution?

Overall, I have used this for more than two years, including v1040. Currently I have been using it hands on for the last year.

What do I think about the stability of the solution?

There often are issues with web test execution. Web pages often do not load on the first attempt.

How are customer service and technical support?

Customer Service:

Customer server is absolutely robust. The team respond within 12 hours.

Technical Support:

I never needed to use paid technical support as their forum is extremely helpful. The community members respond to issues within 24 hours. It’s really amazing that within the past twelve months, I have never had a technical question I asked remain unanswered.

Which solution did I use previously and why did I switch?

I am an expert on the following:

  • Selenium RC and Servers/Java - but this has multiple limitations
  • IBM Rational Functional Tester - it's expensive, and not as powerful as TestComplete
  • AppPerfect - is not in competition with any of the above, it’s pathetic

How was the initial setup?

It was straightforward. Both the node locked and floating licenses were easily deployed, and now the whole team is using it.

At one point, we had to update the hardware of the servers where the licenses were deployed, and this was very easy. We just disabled the licenses from the account and deployed them onto the upgraded servers.

What about the implementation team?

I did it myself in-house. It’s very simple. No rocket science needed. Just read the manuals and you can do it.

What was our ROI?

We are saving a lot in terms of client satisfaction. We are not yet in a phase where we have savings in terms of a reduced QA team, but our clients are happy that they get bug free software. Moreover, our testing team spends more time testing new features, and we are confident enough at build roll out time that all previously developed modules are stable.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user293901 - PeerSpot reviewer
it_user293901Principal Software Engineer - Automation at a tech services company with 10,001+ employees
Consultant

Yes you are right. Our automation scripts are extensively deep and code coverage has been taken care of. BUT still, we don't blindly rely on the automation. The scripts only verify that build is fit for release but the scripts don't deliver the build. A human cycle for regression gets carried out in cases where needed.

See all 2 comments
Project Manager at a computer software company with 51-200 employees
Real User
Easy to maintain tests, easy to use, and good support and documentation
Pros and Cons
  • "It is very easy to maintain tests with this tool. It covers all necessary items in the test plan. The most painful item in testing is maintenance. When changes occur, the tests should be maintained."
  • "There could be API interfaces with this tool."

What is our primary use case?

It is useful for functional testing, testing backend database, and frontend user interface.

I am using the latest version.

What is most valuable?

It is very easy to maintain tests with this tool. It covers all necessary items in the test plan. The most painful item in testing is maintenance. When changes occur, the tests should be maintained.

It is a very easy-to-use tool. You don't have to be an expert in a specific syntax. You can just use graphical logic. If needed, it also allows you to apply some code. It is very useful from all perspectives.

What needs improvement?

There could be API interfaces with this tool.

For how long have I used the solution?

I have been using this solution for about 10 years.

What do I think about the stability of the solution?

It is very stable. Their tests are running fluently.

What do I think about the scalability of the solution?

We have three testers.

How are customer service and technical support?

I have contacted them, and I got a very fast response and solution. Their support team was very helpful. Every question was answered professionally and quickly.

The help guides are also very useful.

Which solution did I use previously and why did I switch?

I had used a browser tool.

How was the initial setup?

It is very easy to install. It took about one hour to deploy the tool.

What about the implementation team?

I implemented it with the guidance and help of the support team. It can be done by the testing team without any help from a consultant.

What's my experience with pricing, setup cost, and licensing?

It costs a few hundred per year, but I am not sure. It is not at all expensive as compared to other tools.

What other advice do I have?

I would recommend this tool. You don't have to be an expert in this tool to start using it. You can start by using the help guides. It is very easy to understand how to make it work.

I would rate SmartBear TestComplete a 10 out of 10.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Veena-Devi - PeerSpot reviewer
Senior Principal Architect at a tech services company with 11-50 employees
MSP
Top 20
Performs some self-healing and has a feature called OCR (optical character recognition)
Pros and Cons
  • "SmartBear TestComplete performs some self-healing and has a feature called OCR (optical character recognition)."
  • "The learning curve of the solution's user interface is a little high for new users."

What is our primary use case?

SmartBear TestComplete is a web mobile automation solution. SmartBear TestComplete is a low-code automation tool that records and replays your user actions.

What is most valuable?

SmartBear TestComplete performs some self-healing and has a feature called OCR (optical character recognition). The solution supports JavaScript.

What needs improvement?

The learning curve of the solution's user interface is a little high for new users.

For how long have I used the solution?

I have been using SmartBear TestComplete for three years.

What do I think about the stability of the solution?

We haven’t faced any issues with the solution’s stability.

I rate the solution’s stability an eight out of ten.

What do I think about the scalability of the solution?

SmartBear TestComplete is a scalable solution. SmartBear TestComplete is more suited for enterprise businesses.

I rate the solution a seven out of ten for scalability.

How are customer service and support?

The solution's technical support takes a longer time to respond.

How would you rate customer service and support?

Neutral

How was the initial setup?

On a scale from one to ten, where one is difficult and ten is easy, I rate the solution's initial setup a seven out of ten.

What about the implementation team?

The solution's deployment hardly takes six to seven minutes, sometimes even less than five minutes.

What was our ROI?

The solution has sped up automation for us.

What's my experience with pricing, setup cost, and licensing?

The solution's pricing is too high.

On a scale from one to ten, where one is cheap and ten is expensive, I rate the solution's pricing nine and a half out of ten.

What other advice do I have?

The solution handles application changes very well. You can add or modify your existing test cases, which is a good feature. One of the solution's major AI capabilities is self-healing, which supports my test activity. The solution's AI capability increased the accuracy of the element identifier.

I would recommend the solution to other users. Besides the cost, SmartBear TestComplete is a good solution for web and mobile.

Overall, I rate the solution an eight out of ten.

Which deployment model are you using for this solution?

On-premises
Disclosure: My company has a business relationship with this vendor other than being a customer: Reseller
Flag as inappropriate
PeerSpot user
PeerSpot user
Integration Specialist at a financial services firm with 10,001+ employees
Real User
Top 5Leaderboard
Good regressions tool, SoapUI tools, and cross-browser capabilities
Pros and Cons
  • "The most valuable feature of this solution is regression testing tools."
  • "The artificial intelligence needs to be improved."

What is our primary use case?

I use this solution for functionality testing, API testing, and performance testing.

We are moving away from this solution to use Eggplant Functional.

What is most valuable?

The most valuable feature of this solution is regression testing tools.

The SoapUI tools are very good, as well as cross-browser capabilities.

The GUI is very good.

What needs improvement?

There is a problem with usability because the speed decreases, which could be an issue with scalability because of too many hits on the site. It depends on how distributed their systems are, and how well they can handle multiple connections.

The artificial intelligence needs to be improved.

For how long have I used the solution?

I have been using this solution for between six and twelve months.

What do I think about the stability of the solution?

This is a good product in terms of stability.

How are customer service and technical support?

The technical support for this solution is always available. They have an online chat that is quick.

How was the initial setup?

The initial setup of this solution was quite smooth. It was not complicated and within a week it was working. It did not take long.

What about the implementation team?

We performed the implementation in-house.

What's my experience with pricing, setup cost, and licensing?

This is a pay-per-use service that is not expensive, and cost-efficient if you have a small team.

Which other solutions did I evaluate?

We have also been using Eggplant Functional, and the decision has been made to move forward with that solution, instead of SmartBear. It is not for technical reasons. I also find Eggplant to be a little bit pricey.

What other advice do I have?

This product is quite mature, able to compete with other products in the market, and I would highly recommend it. Overall, we're very pleased with the implementation.

My advice to anybody who is considering this solution is to do a PoC and try this solution out. They can always reach out to me for help, and I can assist.

The biggest lesson that I have learned from using this solution is that there is a lot of hard work going on behind the scenes with this tool, to make each customer's journey easier. This tool is simple to implement and easy to use. If you don't have much time to do a lot of reading then it is still easy to take each case and adopt it quickly.

I would rate this solution a nine out of ten.

Disclosure: My company has a business relationship with this vendor other than being a customer: Partner.
PeerSpot user
Buyer's Guide
Download our free SmartBear TestComplete Report and get advice and tips from experienced pros sharing their opinions.
Updated: October 2024
Buyer's Guide
Download our free SmartBear TestComplete Report and get advice and tips from experienced pros sharing their opinions.