HeadSpin vs Perfecto comparison

HeadSpin and Perforce are both solutions in the Mobile App Testing Tools category. HeadSpin is ranked #7 with an average rating of 9.0, while Perforce is ranked #3 with an average rating of 8.3. HeadSpin holds a 2.9% mindshare in MTT, compared to Perforce’s 7.9% mindshare. Additionally, 100% of HeadSpin users are willing to recommend the solution, compared to 88% of Perforce users who would recommend it.

HeadSpin

Read 6 HeadSpin reviews

502 Views
279 Comparison Views

100% willing to recommend

Perfecto

Read 23 Perfecto reviews

1,103 Views
757 Comparison Views

88% willing to recommend

HeadSpin

Perfecto

Comparison Buyer's Guide

Download the report

Executive Summary

We performed a comparison between HeadSpin and Perfecto based on real PeerSpot user reviews.

Find out in this report how the two Mobile App Testing Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI.

To learn more, read our detailed HeadSpin vs. Perfecto Report (Updated: November 2024).

Buyer's Guide

HeadSpin vs. Perfecto

November 2024

Download the complete report

Helped 816,406 peers since 2012

Categories and Ranking

HeadSpin

Ranking in Functional Testing Tools

19th

Ranking in Mobile App Testing Tools

7th

Average Rating

8.0

Reviews Sentiment

7.8

Number of Reviews

Ranking in other categories

Mobile APM (6th)

Perfecto

Ranking in Functional Testing Tools

11th

Ranking in Mobile App Testing Tools

3rd

Average Rating

8.4

Reviews Sentiment

7.9

Number of Reviews

Ranking in other categories

Performance Testing Tools (13th), Test Automation Tools (13th)

Mindshare comparison

As of November 2024, in the Mobile App Testing Tools category, the mindshare of HeadSpin is 2.9%, down from 3.3% compared to the previous year. The mindshare of Perfecto is 7.9%, down from 8.2% compared to the previous year. It is calculated based on PeerSpot user engagement data.

Mobile App Testing Tools

Featured Reviews

Saorabh Singh

Senior Manager - QA at Games24x7

It fulfills everything from automation to manual performance

The most valuable features of the product are the performance parameters it gives us, as well as the seamless connectivity with our automation suites. I am also pleased with the continuous enhancements made to HeadSpin. There have been many features added since we started using the product, and all of them are useful.

Read full review

Roland Castelino

QA Lead at BMO Financial

Its reporting allows us to have a clear view regarding what tests have been executed

The most valuable would be their Live Stream analysis, where I can see the live analysis of all the executions on a single device or multiple devices as well as track them. The live analysis and reporting would be the single most valuable feature. We leverage Perfecto’s reporting and analytics a lot. From the CI Dashboard, it is mainly the status, which is the past, failure count, and time consumption, e.g., how much time did an average test or script take? Along with that, it provides the historical view compared to the previous result, e.g., am I a pass or fail? Also, the stack trace is very important. Whenever a pass occurs, we don't look beyond that. However, whenever a failure occurs, the stack trace information that it gives us is pretty critical for us when figuring out where failures lie. It gives a summary for the pass/fail count, total test count, the historical view, time consumption for each test as well as the total tests, and the stack rate of the failure. Perfecto's analytics are very important since we use them on a daily basis. We run our executions daily. After every execution, we pull information from the Perfecto reporting system and share that with our stakeholders. Having this information accurately reported is pretty important for us, so everybody is aware of the current status of the product. That way, we can evaluate the health of the product or environment against that which has been executed. Therefore, it helps make those real-time decisions and highlights the impact to the business. I found Perfecto to be pretty easy to use while executing against cross-platforms. The main reason is because the same script or test automation where we execute on multiple platforms has minimal changes that I need to do. Also, it is easy for me to set up an execution on one platform, then on another platform, either in parallel or one after the other. Parallel opportunities save me time. Once the execution has been completed across these different configurations, I can always check and compare, e.g., what are the differences and consistencies? We utilize Perfecto’s cloud-based lab to test across devices, browsers, and OSs. I use it occasionally for manual testing. Though, there are other team members who use it more frequently than I do. I use it mainly for executing my automated tests. We have the Perfecto lab, cloud devices, and machines. I can program my test to execute against any of those devices, which gives me more confidence in my product. I can compare and see how my product or application functionally behaves across these different devices and from a UI point of view, which helps me a lot. The device lab is extremely important to our testing operations. We rely on having multiple devices up and running all the time. Whenever we kick off an execution, there are multiple reasons why executions may get triggered: * CodeCommit * A scheduled job. * Might be on-demand by any stakeholder. We need the lab to be available, as we need devices up and running for executions to take place. Also, the devices help since they allow us to have parallel execution, and not just wait for a sequential device to become free and available. Therefore, volume is definitely key. It also gives us an opportunity to compare execution across platforms in that space. It is extremely important to you that the lab provides same-day access to new devices since we analyze that data every single day after execution. Perfecto provides their own framework called Quantum Framework. That is one option. The other option is, if I want to have my own framework, I can have a Java-based Maven project, take a Selenium library, AppiumLibrary, and REST Assured library, and utilize the open-source framework. It is easy for us to connect to Perfecto, no matter what framework we use, as long as it has these core libraries in it. I can design and structure it any way that I want. The execution will happen in Perfecto no matter what since they have support for these tools or libraries. It is pretty neat that way. We are not dependent on using just one particular framework to use Perfecto. While there are still some framework limitations, there is the opportunity to use multiple, different open-source frameworks, then pass the execution to Perfecto. We can use most frameworks, then design and craft it any way that we want, then just pass the execution to Perfecto.

Read full review

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

Pros

"The most valuable feature of HeadSpin it's the integration with other solutions. It is great. I can search for an element or do a quick debugging on the application right on HeadSpin. It's very useful."

"The most valuable feature is that this is the first connected intelligence all-in-one platform."

"It has an interesting feature called AV box testing. A lot of companies that are in the OTT segment don't really understand what their streaming is like. They can't test for streaming quality. There are restrictions where you cannot simulate live streaming. For example, on Netflix, you can't simulate how a movie is being streamed on a remote device. That's why HeadSpin has got this AV box testing feature. It is a patented feature. They send an AV box to your location, and you can test live streaming, which is something that no other company does."

"The most valuable features of the product are the performance parameters it gives us."

"The initial setup of HeadSpin was very easy and user-friendly. It was easy to configure and write a script."

"The technical support is really helpful because we can set up direct calls with them if we want to. We can use Zoom or Google Meet to interact with them directly, and if there is an issue in our system, they will help us by reproducing the issue in their machines and trying to figure out a solution. The support is really smooth, and we like that they're very supportive."

"The most valuable feature is automated testing."

"We are able to offer a quality product that has been tested fully, which improves our customer satisfaction. That is a good thing. It has also reduced our IT infrastructure cost. We don't have to spend a lot on setting up infrastructure, which becomes redundant or obsolete very soon. It helps in offsetting that cost."

"In terms of cross-platform testing, they offer all of it, every device available in the market. It covers real scenarios that mimic production so that we don't miss out on any devices that our clients might be using to run the applications we develop. It's been great and very helpful."

"The most valuable aspect of the solution is that it covers all types of devices on the market allowing you to test different versions of an operating system."

"The number one feature, which if we didn't have out-of-the-box would be missed, is the fact that we have video execution. That gives us the ability to view errors or defects in the progression, from beginning to the end of the video."

"The reporting feature is really tough to find in some of the other products that are competitors. Having your CITB type dashboard, where we can see the test results and see recordings of each test that passed or failed, is probably one of the distinguishing aspects of Perfecto."

"Perfecto has affected our software quality in a good way. It has allowed us to execute on-demand and on-choice. We also track the number of issues that we find in the product. Every single day, we tag the issues that we found. For example, if something was found by automation, that means it was found by a Perfecto execution. Over time, we realized the real value in tracking those numbers. We can see now that we have clearly been finding issues earlier. It has allowed us to catch our defects earlier, thus improving the quality of our applications."

"The CI dashboard tool is very good, as is the Live Stream monitoring. Whenever I want to monitor execution, I can open multiple tabs in Perfecto and it is easy for me to refer to the CI dashboard and the Live Stream."

More Perfecto pros

Cons

"Support and pricing could be improved."

"HeadSpin needs to improve the hardware. With the mobile, the battery life reduces and must be continuously charged."

"If you want to do some testing or check the devices manually or check the application in a particular device manually, it is really laggy. That's a disappointment because sometimes we would like to do manual testing when our local devices are not available."

"They should automate their onboarding. A lot of things are still manual. They can create a video assistant or something like that to completely automate the entire process."

"HeadSpin could improve on the user interface because it is very poor. The checks that are done on the iOS devices are very difficult, but for Android, it runs great. For all iOS devices, the user interface and how it interacts with the device are very poor."

"Sometimes, devices go offline and some features are not functioning on some devices, specifically on iOS."

"It is slow compared to physical device testing. The interactive speed could be improved."

"Its performance should be improved. Anything to speed up the user interface would be a great help. We've had a lot of pain with their migration from a product UI that was based on Adobe Flash to the new product that is based on HTML5. Migrations like that seemed to be very painful and not a real smooth process. We're still sort of recovering from that migration from old technology to new, and we haven't got all the functionality ported over that we used to have on the old UI."

"When using devices on the cloud, it lags quite a bit at times. I know that these are real devices that are being projected on our laptop screens and monitors, but if the speed could be improved, that would be good."

"Going by the dashboard or analytics capabilities that Perfecto or Perforce is looking to offer in its roadmap, it will certainly help if they also cater to executing and enabling decision-making, rather than just focusing on standard testing metrics such as execution, efficiency, and defect rate. These are good metrics, but they don't necessarily enable decision-making for SLTs. Any improvements in the dashboards and reporting tools should focus on metrics or SLAs that can help with decision-making."

"The monitoring features, in particular network traffic monitoring, could be improved."

"The flakiness, or the accuracy, of the test execution can be improved. Also, the responsiveness of their cloud lab could be improved as well."

"We've had a couple of issues lately with videos not loading or browsers dying after some execution, although that happens very rarely."

"We have had some issues with performance, which is something that should be improved."

More Perfecto cons

Pricing and Cost Advice

"We have a yearly license for 16 devices."

"It has a yearly license. There is no other option. It is expensive. There are a lot of other cheaper players in the market, but it is like a Mercedes. You pay an extra premium for it, but you get the benefits. I would love to see them come up with project-based costing. Companies that are low on funds or new-age can do with pricing that is easily digestible. They can give them a pricing model for three months. They can provide a startup package."

"I believe the licensing cost is cheap because it's a total solution, hardware, license and software."

"It's not cheap, but there are a few different packages and different prices for enterprises with different product versions."

"Perfecto is about 30-40% cheaper than Device Anywhere. That was a big reason why we switched. Perfecto also solves some of the issues that we had with Device Anywhere. We have grown by 100% since we started to use Perfecto, and now we have devices roaming. When we look at the competition, we would still stick with Perfecto."

"It's definitely on the higher end of prices for this type of service."

"This is an expensive solution compared to others, by 30% to 40%."

"Perfecto has definitely saved us on the costs and efforts of having to maintain our own virtual test environment. We lost about 20 devices in the past to maintenance and audit. That was a massive loss for us, as a company, because we were giving devices to someone, but don't know whether we would get it back or not. Having those virtual labs, we don't need to worry about these kinds of things. We are easily saving $5,000 to $10,000 a month on device costing."

"Pricing is an area where Perfecto can do a little better. When we obtain additional licenses, we enter into negotiations with them."

"Pricing-wise, it is fine. It is not as expensive as what we used to have in the past from HP, IBM, and others. It is decently priced."

"I am not sure about its pricing, but from our perspective, licensing has been easy. Anytime I have new users or requests for users that want to get added, it's a very simple process. I just give the architectural owner of the product the name and email address, and they're able to easily add a new user. We don't have any issues in regards to getting licenses, but I don't have any insights into pricing."

"Perfecto's price is excellent compared to other products with similar features. It was the lowest of the three we evaluated. We also established a partnership with Perfecto, so they provide discounts when we sell Perfecto projects and licenses to our customers."

More Perfecto pricing and cost advice

See which vendors are best for you

Use our free recommendation engine to learn which Mobile App Testing Tools solutions are best for your needs.

See recommendations

816,406 professionals have used our research since 2012.

Top Industries

By visitors reading reviews

Financial Services Firm

23%

Manufacturing Company

14%

Computer Software Company

12%

Legal Firm

Financial Services Firm

20%

Computer Software Company

17%

Manufacturing Company

Recreational Facilities/Services Company

Company Size

By reviewers

Large Enterprise

Midsize Enterprise

Small Business

No data available

Questions from the Community

Ask a question

Earn 20 points

What do you like most about Perfecto?

Mobile testing is the most valuable feature as it has reduced dependency on physical devices. We are located offshore and we don't have the physical devices, and shipping physical devices after eve...

See all answers

What needs improvement with Perfecto?

It is slow compared to physical device testing. The interactive speed could be improved. And sometimes we have issues with our app not working properly with Perfecto. Even though it is working perf...

See all answers

What is your primary use case for Perfecto?

We use it for manual mobile testing and a little bit of web testing.

See all answers

Comparisons

BrowserStack vs HeadSpin

Compared 25% of the time

Sauce Labs vs HeadSpin

Compared 15% of the time

More HeadSpin Competitors

BrowserStack vs Perfecto

Compared 39% of the time

Sauce Labs vs Perfecto

Compared 23% of the time

Appium vs Perfecto

Compared 12% of the time

AWS Device Farm vs Perfecto

Compared 3% of the time

Katalon Studio vs Perfecto

Compared 3% of the time

More Perfecto Competitors

Product Reports

Buyer's Guide

HeadSpin

November 2024

Download HeadSpin product report

Buyer's Guide

Perfecto

November 2024

Download Perfecto product report

Also Known As

No data available

Perfecto Mobile, Perfecto Web

Learn More

HeadSpin

Perforce

Overview

Headspin is a data science-driven Mobile APM platform that leverages an AI platform to combine global device infrastructure, test automation, machine learning-driven performance, and quality of experience analytics. HeadSpin was founded to answer the demand for a global testing, performance monitoring, and quality of experience (QoE) management platform to assist businesses in ensuring optimal digital experiences across mobile, audio, online, and video delivery channels.

Headspin facilitates seamless collaboration between product managers, SREs, developers, QA/release engineers, and support staff to:

Quicken development times using intelligent automation in test and production.
Optimize digital performance across devices, networks, and apps.
Automate insights discovery with practical, context-aware AI and analytics.

Headspin Features

Headspin has many valuable key features. Some of the most useful ones include:

Global device infrastructure allows end-to-end monitoring and testing with thousands of devices in numerous locations on real carrier and WiFi networks around the world. SDK is not required.
Test automation and APIs integrate into CI/CD workflows to enable functional and performance testing pre and post release. Support for all testing frameworks.
Performance, QoE, and machine learning automatically expose issues and points to underlying root causes across all layers of the stack, from quantifying audio/video quality of experience to code and packet visibility.
Insights-to-actions delivers regression and aggregation insights throughout the digital experience lifecycle. These insights take you from planning and development to troubleticketing and operations. Trending, alerts, and analytics.

More features include:

Hosted Device Cloud
On-prem Device Appliance
Performance & Experience Analytics
Professional Services & Support
Education, Certification & Training

Headspin Benefits

There are many benefits to implementing Headspin. Some of the biggest advantages the solution offers include:

Use data science to identify problems and root cause analysis

Empower QA and DevOps teams with data science insights and test automation

Global teams can work together using remote access

Capture performance and UX issues

Reviews from Real Users

Headspin stands out among its competitors for a number of reasons. Some of these include its easy setup, scalability, and robust customer support. PeerSpot users take note of the advantages of these features in their reviews:

Abhishek M., Associate Vice President at Onnivation, notes, “A lot of companies that are using other solutions do not get access to the kind of metrics that HeadSpin captures…HeadSpin is highly advanced. It has got all the performance structures to provide visibility into how my app is performing in the real world. It also helps to identify the gaps.”

Shiba S., Automation Engineer at GlobalLogic India, writes, “The technical support is really helpful because we can set up direct calls with them if we want to…They support multiple devices. Plus, they support distribution testing.”

Perfecto is a cloud-based mobile app testing tool that is designed to help test applications on different operating systems and devices. The solution lets users automate processes related to advanced test scenarios and access browser versions and devices according to individual requirements. With Perfecto’s smart test execution capabilities, teams can manage testing across web and mobile platforms using a single script, conduct parallel testing for large test suites, and design advanced user-based test scenarios to accelerate app release cycles. The solution is also helpful for IT departments, providing insights into biometrics, device vitals, audio injection, network throttling, packet loss, and rotation data to meet desired end-user conditions that align with business priorities.

Perfecto Features

Perfecto has many valuable key features. Some of the most useful ones include:

Live Stream analysis
Reporting/analytics
Activity dashboard
Action-word testing
Bug tracking
Debugging
BDD & codeless automation
Model-based testing
Real-time monitoring
Role-based permissions
User management
Test failure analysis
Real user simulation

Perfecto Benefits

There are many benefits to implementing Perfecto. Some of the biggest advantages the solution offers include:

Streamlined test creation: When you use Perfecto, test creation is easy for your teams. Testing frameworks, like Appium, allows you to scale automated test scripts without any issues.

Scalable test execution: Perfecto enables you to accelerate your mobile app testing and is elastically-scaled with no single point of failure, so you can get the testing cadence you need. In addition, the solution makes it possible for you to execute tests from within IDEs as well as through CI servers like Jenkins.

Superior application quality for mobile: By using Perfecto, you can maximize continuous testing and shift quality by combining the solution with BlazeMeter. Together, these two solutions can help you measure mobile user experience, produce high-quality test data on demand, and create realistic mock services.

AI-driven test automation dashboards: The solution’s unique dashboards and heatmaps give you high-level visibility with timelines and trends.

Cloud-based lab: Perfecto’s Smart Testing Lab gives you the tools you need to quickly test your mobile app against thousands of permutations.

Reviews from Real Users

Perfecto is a solution that stands out when compared to many of its competitors. Some of its major advantages are that it has fantastic testing, reporting, and automation capabilities.

Roland C., QA Lead at BMO Financial, says, “The most valuable would be their Live Stream analysis, where I can see the live analysis of all the executions on a single device or multiple devices as well as track them. The live analysis and reporting would be the single most valuable feature.”

Andy B., Systems Engineer at a financial services firm, writes, “I really love the interaction it has with mobile devices, the testing capabilities, as well as reporting capabilities that we get from the application. Perfecto is excellent when it comes to executing cross-platform testing.”

A Director, QE Automation & Analytics at a financial services firm, says, “The most valuable feature is cloud-based automation and testing.”

Another PeerSpot reviewer, Kristina B., Product Manager at a manufacturing company, states, “The solution allows us to do seamless cross-platform testing, saves time, and comes with excellent customer service.”

Sample Customers

Zynga, Tinder, Pinterest, Akamai, Microsoft, Airbnb, Jam City, TMobile, Mozilla, CNN, Cognizant, Yahoo!, ebay, Quora, Walmart, Kohls, Telstra

Virgin Media, Paychex, Rabobank, R+V, Discover

Buyer's Guide

HeadSpin vs. Perfecto

November 2024

Free Report: HeadSpin vs. Perfecto

Find out what your peers are saying about HeadSpin vs. Perfecto and other solutions. Updated: November 2024.

DOWNLOAD NOW

816,406 professionals have used our research since 2012.

See our HeadSpin vs. Perfecto report.

See our list of best Mobile App Testing Tools vendors and best Functional Testing Tools vendors.

We monitor all Mobile App Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.