LambdaTest vs Perfecto comparison

LambdaTest and Perforce are both solutions in the Functional Testing Tools category. LambdaTest is ranked #9 with an average rating of 7.8, while Perforce is ranked #11 with an average rating of 8.0. LambdaTest holds a 5.0% mindshare in FT, compared to Perforce’s 5.6% mindshare. Additionally, 96% of LambdaTest users are willing to recommend the solution, compared to 88% of Perforce users who would recommend it.

LambdaTest

Read 25 LambdaTest reviews

3,881 Views
2,631 Comparison Views

96% willing to recommend

Perfecto

Read 23 Perfecto reviews

4,459 Views
3,049 Comparison Views

88% willing to recommend

LambdaTest

Perfecto

Comparison Buyer's Guide

Download the report

Executive SummaryUpdated on Dec 15, 2024

Perfecto and LambdaTest are competitors in the market for testing solutions. Perfecto has an edge with its cloud-based architecture, offering robust automated testing and extensive cross-platform support, while LambdaTest is appreciated for its affordability and integration capabilities.

Features: Perfecto’s major features include cloud-based architecture facilitating scalability through quick device accessibility, detailed reporting, and integration with Appium and Selenium. It also provides support for real devices across multiple OS versions. LambdaTest offers geolocation testing, vast integrations with CI/CD tools, and affordability. It provides real-time testing across numerous browser and OS combinations and supports a range of integrations that increase its utility.

Room for Improvement: Perfecto needs enhancements in iOS native apps performance, better reporting features, and improved speed for cloud-based device access, along with greater AI integration. LambdaTest can improve by adding native mobile app testing, better support for Cypress, and enhancements in dashboards and analytics. Additional real device support and improved speed for automated testing are desired.

Ease of Deployment and Customer Service: Perfecto provides flexibility with public, private, and hybrid cloud options, backed by top-notch technical support rated highly for responsiveness and assistance with automation challenges. LambdaTest predominantly uses a public cloud and is recognized for its consistent customer service. However, technical support quality has room for improvement, with occasional delays in issue resolution reported by users.

Pricing and ROI: Perfecto is generally more expensive, especially with private cloud setups, yet many users find the investment worthwhile due to seamless integration and robust support that yields high ROI through improved test efficiency. LambdaTest is valued for its affordability and cost-effectiveness in large-scale implementations, with competitive pricing and flexible plans that appeal to a wide range of users.

To learn more, read our detailed LambdaTest vs. Perfecto Report (Updated: November 2024).

Buyer's Guide

LambdaTest vs. Perfecto

November 2024

Download the complete report

Helped 824,067 peers since 2012

Categories and Ranking

LambdaTest

Ranking in Functional Testing Tools

9th

Ranking in Test Automation Tools

11th

Average Rating

8.6

Reviews Sentiment

7.1

Number of Reviews

Ranking in other categories

No ranking in other categories

Perfecto

Ranking in Functional Testing Tools

11th

Ranking in Test Automation Tools

13th

Average Rating

8.4

Reviews Sentiment

7.4

Number of Reviews

Ranking in other categories

Performance Testing Tools (13th), Mobile App Testing Tools (4th)

Mindshare comparison

As of December 2024, in the Functional Testing Tools category, the mindshare of LambdaTest is 5.0%, up from 4.9% compared to the previous year. The mindshare of Perfecto is 5.6%, down from 5.8% compared to the previous year. It is calculated based on PeerSpot user engagement data.

Functional Testing Tools

Featured Reviews

Dinesh Saharan

Presales at Net Solutions

The tool reduces the manual effort needed and helps automate certain tasks for users

I won't be able to comment on what could be improved in the solution since I am not the one who handles LambdaTest. It is our company's IT team that takes care of LambdaTest. Improvements on a platform need to happen on a timely basis. If something is perfect, it doesn't mean that it doesn't need to improvise or improve, like in terms of adding new features. There should be some new features coming up or some performance improvisation over a period of time.

Read full review

Roland Castelino

QA Lead at BMO Financial

Its reporting allows us to have a clear view regarding what tests have been executed

The most valuable would be their Live Stream analysis, where I can see the live analysis of all the executions on a single device or multiple devices as well as track them. The live analysis and reporting would be the single most valuable feature. We leverage Perfecto’s reporting and analytics a lot. From the CI Dashboard, it is mainly the status, which is the past, failure count, and time consumption, e.g., how much time did an average test or script take? Along with that, it provides the historical view compared to the previous result, e.g., am I a pass or fail? Also, the stack trace is very important. Whenever a pass occurs, we don't look beyond that. However, whenever a failure occurs, the stack trace information that it gives us is pretty critical for us when figuring out where failures lie. It gives a summary for the pass/fail count, total test count, the historical view, time consumption for each test as well as the total tests, and the stack rate of the failure. Perfecto's analytics are very important since we use them on a daily basis. We run our executions daily. After every execution, we pull information from the Perfecto reporting system and share that with our stakeholders. Having this information accurately reported is pretty important for us, so everybody is aware of the current status of the product. That way, we can evaluate the health of the product or environment against that which has been executed. Therefore, it helps make those real-time decisions and highlights the impact to the business. I found Perfecto to be pretty easy to use while executing against cross-platforms. The main reason is because the same script or test automation where we execute on multiple platforms has minimal changes that I need to do. Also, it is easy for me to set up an execution on one platform, then on another platform, either in parallel or one after the other. Parallel opportunities save me time. Once the execution has been completed across these different configurations, I can always check and compare, e.g., what are the differences and consistencies? We utilize Perfecto’s cloud-based lab to test across devices, browsers, and OSs. I use it occasionally for manual testing. Though, there are other team members who use it more frequently than I do. I use it mainly for executing my automated tests. We have the Perfecto lab, cloud devices, and machines. I can program my test to execute against any of those devices, which gives me more confidence in my product. I can compare and see how my product or application functionally behaves across these different devices and from a UI point of view, which helps me a lot. The device lab is extremely important to our testing operations. We rely on having multiple devices up and running all the time. Whenever we kick off an execution, there are multiple reasons why executions may get triggered: * CodeCommit * A scheduled job. * Might be on-demand by any stakeholder. We need the lab to be available, as we need devices up and running for executions to take place. Also, the devices help since they allow us to have parallel execution, and not just wait for a sequential device to become free and available. Therefore, volume is definitely key. It also gives us an opportunity to compare execution across platforms in that space. It is extremely important to you that the lab provides same-day access to new devices since we analyze that data every single day after execution. Perfecto provides their own framework called Quantum Framework. That is one option. The other option is, if I want to have my own framework, I can have a Java-based Maven project, take a Selenium library, AppiumLibrary, and REST Assured library, and utilize the open-source framework. It is easy for us to connect to Perfecto, no matter what framework we use, as long as it has these core libraries in it. I can design and structure it any way that I want. The execution will happen in Perfecto no matter what since they have support for these tools or libraries. It is pretty neat that way. We are not dependent on using just one particular framework to use Perfecto. While there are still some framework limitations, there is the opportunity to use multiple, different open-source frameworks, then pass the execution to Perfecto. We can use most frameworks, then design and craft it any way that we want, then just pass the execution to Perfecto.

Read full review

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

Pros

"Without a doubt, LambdaTest is one of the big reasons behind our faster deployment and better team collaboration."

"Geolocation testing is as straightforward as ticking checkboxes of browsers, operating systems, and countries."

"Automation and mobile testing have improved our efficiency."

"We use the solution for automation testing and monitoring."

"LambdaTest easily integrates with leading project management, bug tracking, and CI-CD tools like Jira, Asana, Jenkins, Circle CI, and more."

"It's user-friendly and offers valuable features for testing, making it a reliable tool."

"Stability-wise, I have not experienced any downtime or other performance issues."

"The solution is very easy to understand and has a user-friendly UI."

More LambdaTest pros

"There are a whole bunch of things that I like about the solution, but I really love the interaction it has with mobile devices, the testing capabilities, as well as reporting capabilities that we get from the application. The reports are very detailed."

"The quality of our software has improved since we implemented this solution."

"The automated test reporting functionality is the most valuable feature. We use the CI Dashboard. It's very important as it is the main reporting tool for our automated tests."

"I also like the reporting functions. We are constantly downloading these reports and sharing them with our final customers. They help us understand what kind of bugs are happening through the applications. The recording feature is handy because it lets us see a video of the process we run through the pipeline and discover the point at which the automation is breaking."

"It saves on the cost and effort of having to maintain our own virtual testing environment. Even our onshore team is not in the city that we work in, so that helps a lot. Even if we didn't invest a lot in getting multiple devices, having to share those devices would become a hassle."

"We're working in Agile and we need results ASAP. The fact that the lab provides same-day access to new devices is extremely important to us."

"We are able to offer a quality product that has been tested fully, which improves our customer satisfaction. That is a good thing. It has also reduced our IT infrastructure cost. We don't have to spend a lot on setting up infrastructure, which becomes redundant or obsolete very soon. It helps in offsetting that cost."

"The CI dashboard tool is very good, as is the Live Stream monitoring. Whenever I want to monitor execution, I can open multiple tabs in Perfecto and it is easy for me to refer to the CI dashboard and the Live Stream."

More Perfecto pros

Cons

"I think Lambdatest is a valuable tool for our team and things that have room for improvement would be mobile app testing, as it can be an important addition to the tool."

"I've also had some issues with the speed of certain API calls and the rendering of data. For example, when I'm onboarding data, the process can be slow."

"Sometimes, when multiple users use the tool simultaneously, it can slow down, affecting efficiency."

"Responsive testing UI is a bit cluttered, whereas the LT browser is much better to use."

"Mobile application testing will be an added benefit for us if LambdaTest implements this really soon."

"It would be much easier for us to read the test if they provided dashboard analytics."

"I would like to see all of the features available in the freemium plan so that I can test them."

"You cannot perform native-app testing, as they offer simulation for web testing only."

More LambdaTest cons

"There was a discussion about having the capability to export the test results to a certain tool that we use in our project. If that were added it would be great not having to manually take screenshots, put them in a document, and share them on the different test management tools."

"Going by the dashboard or analytics capabilities that Perfecto or Perforce is looking to offer in its roadmap, it will certainly help if they also cater to executing and enabling decision-making, rather than just focusing on standard testing metrics such as execution, efficiency, and defect rate. These are good metrics, but they don't necessarily enable decision-making for SLTs. Any improvements in the dashboards and reporting tools should focus on metrics or SLAs that can help with decision-making."

"The flakiness, or the accuracy, of the test execution can be improved. Also, the responsiveness of their cloud lab could be improved as well."

"We have had some issues with performance, which is something that should be improved."

"I'm hoping they can support on-premises instances. We have been working on a JIRA integration with Perfecto—and I'm extremely impressed that they have that—but at this time they're not supporting onsite JIRA instances, which is what we have."

"I would like to see the inclusion of machine learning features. If we can have that, it will be a better tool."

"We feel that Perfecto is a little slow. If they could improve on that slowness in accessing the app, when we want to click a button, that would be great because we feel the difference. An improvement in the connectivity speed is required."

"One improvement would be speed of execution. If it is an iOS native app, we have noticed that the speed is a bit slower. Perfecto might need to make some improvements in this area."

More Perfecto cons

Pricing and Cost Advice

"The product can be described as an averagely-priced solution."

"The pricing for LambdaTest is affordable, and one of the reasons we implemented it."

"It is free to start, which means you can actually see how it works and then take the decision to buy."

"The pricing could be made cheaper."

"LambdaTest is paid per execution."

"LambdaTest's pricing is cheaper than that of other similar platforms."

"It is affordable as compared to similar SaaS solutions."

"From the customer side, LambdaTest is cheaper for big company usage and works fine as other similar applications."

More LambdaTest pricing and cost advice

"Perfecto is about 30-40% cheaper than Device Anywhere. That was a big reason why we switched. Perfecto also solves some of the issues that we had with Device Anywhere. We have grown by 100% since we started to use Perfecto, and now we have devices roaming. When we look at the competition, we would still stick with Perfecto."

"Although Perfecto is a good product for us to use, it is a bit expensive. It takes management a bit of work to find the appropriate funding for us to keep Perfecto. I imagine there could be some way to make it more accessible."

"Perfecto has definitely saved us on the costs and efforts of having to maintain our own virtual test environment. We lost about 20 devices in the past to maintenance and audit. That was a massive loss for us, as a company, because we were giving devices to someone, but don't know whether we would get it back or not. Having those virtual labs, we don't need to worry about these kinds of things. We are easily saving $5,000 to $10,000 a month on device costing."

"Pricing is an area where Perfecto can do a little better. When we obtain additional licenses, we enter into negotiations with them."

"It's definitely on the higher end of prices for this type of service."

"I am not sure about its pricing, but from our perspective, licensing has been easy. Anytime I have new users or requests for users that want to get added, it's a very simple process. I just give the architectural owner of the product the name and email address, and they're able to easily add a new user. We don't have any issues in regards to getting licenses, but I don't have any insights into pricing."

"Perfecto's price is excellent compared to other products with similar features. It was the lowest of the three we evaluated. We also established a partnership with Perfecto, so they provide discounts when we sell Perfecto projects and licenses to our customers."

"This is an expensive solution compared to others, by 30% to 40%."

More Perfecto pricing and cost advice

See which vendors are best for you

Use our free recommendation engine to learn which Functional Testing Tools solutions are best for your needs.

See recommendations

824,067 professionals have used our research since 2012.

Top Industries

By visitors reading reviews

Educational Organization

43%

Computer Software Company

12%

Financial Services Firm

Retailer

Financial Services Firm

20%

Computer Software Company

17%

Manufacturing Company

Healthcare Company

Company Size

By reviewers

Large Enterprise

Midsize Enterprise

Small Business

Questions from the Community

What do you like most about LambdaTest?

We use the solution for automation testing and monitoring.

See all answers

What is your experience regarding pricing and costs for LambdaTest?

BrowserStack was expensive compared to LambdaTest. We switched to LambdaTest to save money.

See all answers

What needs improvement with LambdaTest?

There is scope for improvement in service account usage, LDAP integration, and adapting new devices and features. Challenges and glitches exist, such as handling notifications dynamically and gaps ...

See all answers

Ask a question

Earn 20 points

Comparisons

BrowserStack vs LambdaTest

Compared 67% of the time

Sauce Labs vs LambdaTest

Compared 20% of the time

Tricentis Tosca vs LambdaTest

Compared 5% of the time

Katalon Studio vs LambdaTest

Compared 2% of the time

Qt Squish vs LambdaTest

Compared 2% of the time

More LambdaTest Competitors

BrowserStack vs Perfecto

Compared 38% of the time

Sauce Labs vs Perfecto

Compared 24% of the time

Appium vs Perfecto

Compared 12% of the time

HeadSpin vs Perfecto

Compared 4% of the time

OpenText UFT One vs Perfecto

Compared 2% of the time

More Perfecto Competitors

Product Reports

Buyer's Guide

LambdaTest

December 2024

Download LambdaTest product report

Buyer's Guide

Perfecto

December 2024

Download Perfecto product report

Also Known As

No data available

Perfecto Mobile, Perfecto Web

Learn More

LambdaTest

Perforce

Overview

LambdaTest is a cloud-based cross browser testing platform that helps enterprises run web automation tests at scale (through parallel testing).

**Selenium Automation Grid and Cypress CLI on LambdaTest**
You can attain better browser coverage by running tests across 2,000+ different browsers, devices, and operating systems online. LambdaTest provides a secure, scalable, and reliable cloud-based Selenium Grid that helps run Selenium tests at a faster pace.
The Cypress CLI on LambdaTest, helps you expand Cypress test coverage to 40+ browser versions across Windows and macOS platforms.
Along with automation testing, you can also perform manual tests, visual UI tests, and real-time tests.

**LT Browser - Responsive Web Testing**
Additionally, LambdaTest also offers LT browser - a path-breaking developer-oriented tool that helps assess the responsiveness of your website. LT Browser eases the task of mobile testing as responsive tests can run against 50+ different device resolutions.
You can also create custom device (or viewports) and test localhost URL without any extensions (or tunnels).

**Key Features of LambdaTest Platform**
1. Selenium Web Testing Automation.
2. Selenium Grid For Mobile Web-Automation Testing.
3. Run Cypress Tests Across 40+ Browser Versions Of Chrome, Firefox, and Edge.
4. Parallel Testing For Faster Go To Market Launch.
5. Continuous Testing with Continuous Integration Tools (e.g. Jenkins, Circle CI, GitLab CI, etc.).
6. Live Interactive Browser Compatibility Testing.
7. Scroll Sync To Test Two Viewports Simultaneously Using LT Browser App.
8. Faster Automated Screenshot Testing.
9. API For Continuous Testing.

Perfecto is a cloud-based mobile app testing tool that is designed to help test applications on different operating systems and devices. The solution lets users automate processes related to advanced test scenarios and access browser versions and devices according to individual requirements. With Perfecto’s smart test execution capabilities, teams can manage testing across web and mobile platforms using a single script, conduct parallel testing for large test suites, and design advanced user-based test scenarios to accelerate app release cycles. The solution is also helpful for IT departments, providing insights into biometrics, device vitals, audio injection, network throttling, packet loss, and rotation data to meet desired end-user conditions that align with business priorities.

Perfecto Features

Perfecto has many valuable key features. Some of the most useful ones include:

Live Stream analysis
Reporting/analytics
Activity dashboard
Action-word testing
Bug tracking
Debugging
BDD & codeless automation
Model-based testing
Real-time monitoring
Role-based permissions
User management
Test failure analysis
Real user simulation

Perfecto Benefits

There are many benefits to implementing Perfecto. Some of the biggest advantages the solution offers include:

Streamlined test creation: When you use Perfecto, test creation is easy for your teams. Testing frameworks, like Appium, allows you to scale automated test scripts without any issues.

Scalable test execution: Perfecto enables you to accelerate your mobile app testing and is elastically-scaled with no single point of failure, so you can get the testing cadence you need. In addition, the solution makes it possible for you to execute tests from within IDEs as well as through CI servers like Jenkins.

Superior application quality for mobile: By using Perfecto, you can maximize continuous testing and shift quality by combining the solution with BlazeMeter. Together, these two solutions can help you measure mobile user experience, produce high-quality test data on demand, and create realistic mock services.

AI-driven test automation dashboards: The solution’s unique dashboards and heatmaps give you high-level visibility with timelines and trends.

Cloud-based lab: Perfecto’s Smart Testing Lab gives you the tools you need to quickly test your mobile app against thousands of permutations.

Reviews from Real Users

Perfecto is a solution that stands out when compared to many of its competitors. Some of its major advantages are that it has fantastic testing, reporting, and automation capabilities.

Roland C., QA Lead at BMO Financial, says, “The most valuable would be their Live Stream analysis, where I can see the live analysis of all the executions on a single device or multiple devices as well as track them. The live analysis and reporting would be the single most valuable feature.”

Andy B., Systems Engineer at a financial services firm, writes, “I really love the interaction it has with mobile devices, the testing capabilities, as well as reporting capabilities that we get from the application. Perfecto is excellent when it comes to executing cross-platform testing.”

A Director, QE Automation & Analytics at a financial services firm, says, “The most valuable feature is cloud-based automation and testing.”

Another PeerSpot reviewer, Kristina B., Product Manager at a manufacturing company, states, “The solution allows us to do seamless cross-platform testing, saves time, and comes with excellent customer service.”

Sample Customers

Bringmax, Totpal, Nethhouse, Integreplanner, Cognizant, Vendisol, Clearscale, Edureka

Virgin Media, Paychex, Rabobank, R+V, Discover

Buyer's Guide

LambdaTest vs. Perfecto

November 2024

Free Report: LambdaTest vs. Perfecto

Find out what your peers are saying about LambdaTest vs. Perfecto and other solutions. Updated: November 2024.

DOWNLOAD NOW

824,067 professionals have used our research since 2012.

See our LambdaTest vs. Perfecto report.

See our list of best Functional Testing Tools vendors and best Test Automation Tools vendors.

We monitor all Functional Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.