Perfecto Reviews

We are using Perfecto to do remote testing on physical devices. 

The device is quite significant for us because we are part of a telecom company and quite a lot of testing is sensitive. We need to have private cloud hosting as well as public cloud hosting. Perfecto gives us both options, and we are using both private as well as public cloud. When a new feature comes out, we cannot just put it on the public cloud for everyone to test. That is why we use a private cloud. We can access it over the internet anywhere in the world, which is very important for us.

We use it to work across multiple teams and departments.

Perfecto plays a very crucial part in our day-to-day test executions. We do a lot of mobile testing, so Perfecto is very useful for us for either manual testing or automation.

It is very important to us that the lab provides same-day access to new devices. We have a very fast-moving, agile team. Therefore, we need access to the lab all the time.

We have a small development team who uses their emulators for development purposes. For testing, we still rely a lot on the actual devices. However, at times, when we launch something, we do use the virtual devices as well. Virtual devices are important when testing, although they don't give the same level of experience as real devices. I can understand that it isn't possible to purchase every single device all the time, especially when you are testing later versions of Android and don't have a virtual device or any version of iOS. We have a couple of native application teams who deploy new applications on those virtual devices all the time, depending on the requirements.

Perfecto helps a lot with productivity overall. We have a distributed team across different geographics. Because people are spread out across different countries, not everyone works at the same time, but whenever they work, they want access to the devices. The only feasible solution is to look at the cloud. Perfecto has come in really handy since it is always up and active. People can access it in their own time and at their own comfort, i.e., anyplace and anywhere. So, it has definitely helped with our fast, agile deliveries over the course of time.

Any testing is good testing. The more you test, the better software quality gets. It has definitely helped.

Recently, the network testing component where we can use Perfecto on devices has been the most valuable feature. There is very little competition out there in this regard. We use it for 4G and 5G testing of launched 5G and 4G brands. So, the network testing can be accessed from anywhere in the world. That is very valuable for us.

Perfecto is very good when it comes to executing cross-platform testing. We have just gotten started on cross-browser testing. We already use Perfecto for the native-application testing on multiple devices. I think now we also use Perfecto for browser-related testing. So, all the cross-browser testing works well. We got a couple of licenses that we use.

We can mostly see usage over time using the device logs. This is what matters the most to us, e.g., what team is using a device for how long.

We use Cypress, and it supports it quite well. We use APM, and it also supports that quite well. We used to use the native quantum framework as well in the past, which was obviously well-supported, but now we have moved onto Cypress and APM. Also, we have Applitools, which is not open source, but a paid proprietary tool.

There could be some improvements done on the interface. At times, there has been a bit of a struggle when finding things on the interface. A UI revamp would be a better option in future. That UI hasn't changed much in a long time, so I think they could just make it a bit better so that people could find stuff easily and intuitively.

We have been using Perfecto for over six years.

It is mostly stable. There could be times when the system or environment is down, then we get notified on those things. They have situations where it is not stable, and we have reached out to the team, saying, "Yeah, it just goes blank at times," or "People are not able to log in." We receive ample support for that. 

Maintenance is required, but we outsource it to a third-party vendor.

The product is pretty scalable. 

Perfecto’s device lab has helped us to scale our operations. We use the public cloud as well as the private cloud. With the public cloud, we can scale up devices very often. Our public cloud is also growing at the moment. This is definitely important to us.

The support that we are getting is really valuable. The technical support is top-notch. There is a dedicated person who takes care of us. We reach out to him, then he reaches out to his team. I would rate the support as seven or eight out of 10.

Positive

Previously, we used to purchase a lot of physical devices for testing. The main constraint was that the team was distributed across the globe. Someone would purchase a solution, then someone else needs to distribute it over to those people, which was a mess. Because Perfecto is on the cloud, we can now have devices in one place and everyone can log into the interface. We can look at their testing or whatever they want to do. That has been a massive update.

I was using Xamarin Test Cloud in the past, which had the same mobile capabilities. We were also using a tool that wasn't as scalable as Perfecto, and that was one of the reasons why we switched.

The initial setup was straightforward. While there is always complexity involved, the rollback mechanism works fine.

Deployment is usually fast. It takes about one night.

Not many people are needed for the deployment. We have a small DevOps team and it takes two to three people tops.

It creates a faster production cycle and is quick to market. Things get deployed earlier because the testing happens on time. We can do a lot of panelization, so a lot of test phases can happen in a panel. People don't have to wait for a device to come to them. They can access multiple devices at the same time and do testing at the same time.

Perfecto has definitely saved us on the costs and efforts of having to maintain our own virtual test environment. We lost about 20 devices in the past to maintenance and audit. That was a massive loss for us, as a company, because we were giving devices to someone, but don't know whether we would get it back or not. Having those virtual labs, we don't need to worry about these kinds of things. We are easily saving $5,000 to $10,000 a month on device costing.

It easily saves us a couple of hours a day, every day, in terms of waiting on the devices, preparing devices, etc.

We are definitely getting benefits out of using Perfecto. That is why we have an ongoing relationship with them.

We use it on the enterprise level. The pricing is reasonable.

We haven't evaluated any other options in five or six years.

Perfecto is doing a very good job. Definitely give it a go. Do some PoCs on your environment with the cloud solution to see if it works for your team. If it does, then definitely give it a go. It is worth the money.

We haven't explored the BlazeMeter component yet. We have had a lot of demos on it and are looking really closely at BlazeMeter.

I would rate Perfecto as seven out of 10. Overall, we are happy, but there is room for improvement.

Our main use case for Perfecto is for our testers to test their mobile or PC applications.

One of the benefits of Perfecto is that it helps us keep our devices up to date with the right OSs, because we test across different mobile OSs. The solution has been instrumental in helping us to keep our devices at the right levels for our testing.

The solution also helps us to eliminate defects. Any application defect is a bad thing. I'm the "application police." If something is wrong with it, I'm going to give you a ticket and ask you to get it fixed. As a bank, we cannot have defects in the applications and Perfecto is instrumental in that process. That's how it helps us, organization-wide. It really stinks if one of our end-users opens up a mobile app, expecting they can do something but they can't because of a problem with the application. Testing with Perfecto, we find those defects and we get the developers to get them fixed before the end-user sees them.

When we retest and they pass, we're achieving the quality results that we're looking for.

And it has saved us tremendously on the effort and the costs of maintaining our own virtual test environment. We don't have to hire so many personnel to take care of those devices. Perfecto has people employed in its lab to physically work on devices when needed. We would have had to do the same thing if we didn't use the solution. As a high-profile bank, hiring an employee includes doing extensive background checks, and those kinds of things cost the company. Using Perfecto saves time, resources, and it saves on physical intervention with the devices. Overall, it results in huge cost savings for our company. 

There are a whole bunch of things that I like about the solution, but I really love the interaction it has with mobile devices, the testing capabilities, as well as reporting capabilities that we get from the application. The reports are very detailed. They provide all of the information needed for the testers and developers to really look at their applications and know if there are any issues or not.

Perfecto is excellent when it comes to executing cross-platform testing. They offer support, and their support is excellent. They're very responsive. With a lot of those cross-platform applications, we have to work together so that we can set up the configurations between the two interfacing applications, but it's very good.

When it comes to reporting, we take a look at how many users are using Perfecto, and for which devices. That helps us to narrow down exactly which devices are being used the most for the applications our teams are testing. I find the reports and the analytics to be extremely helpful. I cross-reference the user reports with the users' lines of business because it's helpful for us to know which users and which lines of business are using Perfecto.

The most widely-used reports are the individual testers' reports. When they run their automation scripts, it gives them a lot of the details about the test run, such as which components passed or failed. And when something fails, it points that out with an error so that the development and testing teams can look at what that error is pointing to.

And the cloud-based device lab is extremely important to our testing operations. The mobile device testing is one of the main things we use Perfecto for, although we do have a couple of teams that use the PC platforms as well. On a scale of one to 10, the importance of the mobile testing is a nine or 10.

Our testers have other means of testing our PC applications. They can test some of those applications from their local machines. They may or may not need access to Perfecto's PC resources, but for mobile devices, we have users who are offshore, and they do not have access to physical mobile devices. Having Perfecto's cloud-based application, users in India can access the cloud and do their testing. It's extremely important for our organization to be able to provide mobile devices for offshore testing.

We mainly use Appium among the open-source technologies that Perfecto supports. A couple of our PC teams may be using Selenium, but for the most part, the mobile users are using Appium, and the integration between Perfecto and Appium is excellent. If there is any issue for our Appium users, a lot of the time it's not on the Perfecto side, it's on our side; usually configuration issues. 

I can't really say anything negative about Perfect, but if we talk about feature enhancement, there are a couple of things that I'm working on with our customer support manager. I'm hoping they can support on-premises instances. We have been working on a JIRA integration with Perfecto—and I'm extremely impressed that they have that—but at this time they're not supporting onsite JIRA instances, which is what we have.

I love the idea that the testers will be able to run either their manual or their automation scripts, and that the test report will automatically go into that team's JIRA instance. That will save some time. The testers won't have to extract the report, save it, and bring it over to their JIRA instances. Then, when the scrum master reviews the test results, if there are questions, they have all of the details from the report right there.

One other enhancement that I've already spoken with them about is that they don't support Android for ADA (Americans with Disabilities Act) testing. They mentioned that they're going to try to begin supporting that later this year.

I have been using it off and on for at least seven to 10 years.

I support our teams and help them with their test environments and mobile device configurations. It meshes perfectly with my job role and what I like to do. Perfecto is my favorite tool.

I would rate the stability of the solution as an 11 out of 10. There has not been one moment that Perfecto has not been accessible. They schedule their maintenance windows during the weekends, and on most weekends, nobody in our company is working. And even on most weekends the platform is up. 

I never receive an email from a user saying, "Hey, Perfecto is down," or that there's a problem. That is not to say it won't happen, but if it happens we will address it at the time. But since I've been using Perfecto, we haven't had any issues like that.

We have open cradles where we can add devices and shift things around as needed. The scalability is 10 out of 10. All we have to do is specify which devices we want, where we want them, and what OSs we need those devices on.

As a ballpark figure, on both of our clouds, there may be 1,100 to 1,200 users.

We're talking about getting a Perfecto ADA demo scheduled. If our teams like how ADA works for them with Perfecto, I anticipate a lot more usage of the application.

Perfecto's support goes above and beyond, with its automation support. We have biweekly meetings with some of Perfecto's support staff and they help us with automation issues. If there is some problem that Perfecto can help with, they are there. Their support is excellent. They're very friendly and great to work with.

From time to time, we may find a URL that needs to be whitelisted or allowed with Perfecto. The support team has been great as far as making sure that IPs are allowed, and that things are up on the Perfecto side for any integration.

Positive

When I started, we were using an in-house solution. Later, I was moved to Perfecto as the admin, and the more I started using Perfecto, the more I really liked it. Using Perfecto, there weren't as many issues as we saw on the other platform. Perfecto is better than our other tools, and I've been trying my best to move others off of other tools they're using and onto Perfecto.

The switch to Perfecto was an internal process. I was an admin on the other solution, and I had to do all the device upgrades to that platform. But there was a security issue with that process and those upgrades were moved to a secure location within our company. We still have the other solution, but we don't let the word out about it too much.

I was not involved in the initial setup, but I was extremely involved with the configuration to comply with our security requirements.

We're accessing Perfecto through private clouds that they host. We have two instances, enterprise and wholesale, and we configure our users here for activation and utilization in both of those clouds. We have an internal solution in which we add the users to Active Directory groups. If a user leaves the company, they're not able to access Perfecto through our clouds. That setup complies with security policies.

Perfecto is only used in our test environment. We cannot place any actual production data outside of our company so we use fictitious data. It's not data about real people or real accounts. Those devices are configured for our test environment only.

I go beyond what the normal Perfecto admin would do. Normally, the admin would just help facilitate the accounts and get users logged in. But I go a step further, because some of our users are unfamiliar with the environments and how to set things up. I help them with their test environments, on our side, for the mobile devices. That's not something Perfecto support would be able to do.

We had to involve a consultant from Perfecto because certain changes were needed on the Perfecto side, as well as on our side, to comply with our security regulations. That worked great. The consultant was great to work with, and we got everything matched up, configured, and working. He was extremely helpful and instrumental in our success in meeting our security requirements. Our security team is happy.

We have another platform that supports some limited ADA testing, but it has been having intermittent issues. Perfecto offers some ADA support and offers pretty much 100 percent uptime. That saves time because testing with the other platform has to wait until those intermittent issues are resolved. Because Perfecto is up, the testing can go on. The other platform can become unavailable for three or four days and that could be brought down to zero if we can use Perfecto for ADA.

There is another team within our company that went off on their own and got an application called BrowserStack. However, my manager and our team are trying our best to get that team to stop using BrowserStack and over to Perfecto. That would also result in cost savings for our company by saving the cost of that platform. From my comparison of BrowserStack and Perfecto, I like Perfecto a lot better because of the UI, reports, and everything else.

I've seen a lot of new functionality added over the years, a lot of performance and speed enhancements, and I think the product is very good. It's one of the top solutions for device simulation and for users to perform testing. I'm very happy with it and I really like the product a whole lot. It's a very good application.

Perfecto is doing everything that I need it to do, and I enjoy using it. Sure, we have a few open issues, but we're seeing timely updates.

We are using it to test the digital application that we are building. It is an insurance application. It is a web application that we test on multiple browsers and mobile devices. It is not a mobile native app.

We are an insurance company. As we expand the feature set or offerings that we have for our customers, we have to ensure that we are catering to the gamut of users. More and more people are becoming digital savvy, and they are using multiple devices to access applications online and on the road. So, we need to test our application on all possible devices that people may use. Even though it is not a mobile application, people do use mobiles for accessing web applications.

We have been using a competing product. We encountered some challenges in that competing solution in the cross-browser area. Perfecto has certainly brought positive change. We no longer have the defects or issues we were encountering earlier. It has been great from that aspect.

We use Perfecto’s cloud-based lab to test across devices, browsers, and OSs. It is very important for us. It saves the effort and the cost of investing in all different devices, which can become obsolete very soon. Continuous maintenance is not needed, and there is a single platform to access everything. All these benefits don't just make it cost-effective but also make things administratively light. It is very useful for us.

They provide same-day access to new devices, but we didn't require that. The majority of our tests focus on the in-market version. So, we haven't used it, but that's a good capability to have.

Perfecto’s device lab has helped us to scale our testing operations. One good thing is that you just need an email address, and you can share it with anyone. It is very prompt.

We are able to offer a quality product that has been tested fully, which improves our customer satisfaction. That is a good thing. It has also reduced our IT infrastructure cost. We don't have to spend a lot on setting up infrastructure, which becomes redundant or obsolete very soon. It helps in offsetting that cost.

It certainly has brought more capabilities to our coordinating teams. We are able to cater to different testing asks from the business and IT teams, and we are able to meet some of the key areas that our enterprise testing strategies are requiring us to do.

It is very important for scaling our testing. Investing in all different devices and then managing them, when it is not your primary job as a company, is not easy. Using virtual devices is certainly something that we can easily do at an enterprise level.

It affects our software quality. Our solutions are now tested for compatibility and accessibility. In the Ontario region where we are operating, accessibility is mandated by the government. It has also made us compliant with the accessibility requirements.

The inventory of browser options with the latest versions is valuable. There are various iOS and Android options. They are useful to us. We are using its cross-browser capability. It is certainly helpful for us. We have CrossBrowser for Mobile. We use Edge as our enterprise browser, but we know people use Chrome, Safari, and other browsers. We test our application through those browsers.

We also like some of the plugins and integrations that Perfecto has.

Going by the dashboard or analytics capabilities that Perfecto or Perforce is looking to offer in its roadmap, it will certainly help if they also cater to executing and enabling decision-making, rather than just focusing on standard testing metrics such as execution, efficiency, and defect rate. These are good metrics, but they don't necessarily enable decision-making for SLTs. Any improvements in the dashboards and reporting tools should focus on metrics or SLAs that can help with decision-making.

My team and I started using Perfecto a couple of months ago. It has been about three months, but different units in our organization have been using Perfecto and various other tools. 

It is on the cloud. So, it is available anytime. Its stability is very good.

It is positive. We haven't noted any challenges so far.

So far, so good. We haven't created an official service ticket yet, but the inquiry and the follow-up seem to be good. 

Positive

We used SmartBear. There were certain challenges that were noted by the users of the tool. The testers on my team and on the vendor's team noted a few challenges. The tool was showing some issues that we couldn't see on the actual mobile device or browser. There were some false red flags that the tool was throwing. Sometimes, the UI controls were not clickable. We had to invest a lot in defect analysis and resolution. So, we started looking at alternatives, and we started to evaluate Perfecto. 

In terms of the overall usage in the testing space, we have very limited use of Perfecto. We still rely on major enterprise tooling sets. As we transform our IT services, at least in the area where we have identified its use, it has brought positive change.

Perfecto hasn't helped to speed up our testing efforts. We were using a similar tool, and the testing effort has been the same as before.

I was not involved in its setup.

It has saved us the costs and efforts of having to maintain our own virtual test environment, but I don't have the metrics. We haven't done an ROI yet. At the end of the year, we might undertake that exercise.

When assessing the cost of our investment in the solution against the benefits we receive from it, we start at an equal playing field because we had another tool previously. However, the cost of investing in this tool to do testing to catch defects before going live would be six times less than the cost of finding defects and fixing them in production. We will use that as a benchmark. We will also consider the effort that it has taken for us to execute test cases specifically on devices and browsers. Those will be the basis for us to calculate the ROI.

Pricing-wise, it is fine. It is not as expensive as what we used to have in the past from HP, IBM, and others. It is decently priced.

It came through recommendations from other teams that were using it. So, we started with a trial. We used BitBar, and we also used CrossBrowser for Mobile.

Even though we are not using a lot of integrations, we do like some of the plugins and integrations that Perfecto has. Essentially, the tool is not integrated into our entire testing life cycle. 

With BitBar, we did not see a direct Jira plugin. So, the scope of use may be limited, or we may have not explored that integration. Perfecto seems to have that integration, and based on the documentation I had from the team, it seems that it is also well integrated with the Jira life cycle, which is valuable to me as a QE Manager.

I would advise specifically identifying the use cases that you want to try with the solution. The range of offerings that Perfecto is planning to bring to the market seems good. There is a lot of innovation happening in the space of test data management and usability and accessibility testing. If you are not looking at spending a lot of licensing money on enterprise tools, Perfecto is certainly good for starting small and then scaling up at the enterprise level. 

Perfecto supports open-source technologies, such as Selenium and Appium among others, but we are not using these capabilities. Based on my theoretical understanding and assessment of other tools, the range seems really impressive. Their roadmap is also impressive. It is good to see the integrations and collaboration it has with most of our testing tools. That's really impressive. 

They are certainly a good provider of services and solutions. We do not use Perforce BlazeMeter with Perfecto, but its collaboration with BlazeMeter excites me. I'm happy about that.

We don't leverage Perfecto's reporting and analytics capability, and we also don't use it for cross-platform testing.

Based on the size of the solution offering and the way they operate, I would rate it a nine out of ten. 

We have a cross-section of mobile devices and web devices, and we use those for browser compatibility and device compatibility testing, as well as functional testing of several apps and websites. So, we have testers that pull up the appropriate device, whether it's an Android or iPhone, and validate that all the functionality of the app or website is working as expected.

It is hosted by Perfecto. They take care of all the hosting.

Benefit-wise, by being able to share all the devices across 800+ users, we get a much better cross-section of testing across a wide platform of devices versus having to buy one or two phones for each tester. To be able to share a pool of devices is a huge saving. It is also a huge benefit to be able to test on a wide variety of devices. So, it saves us from having bugs go out that would only be found on, for instance, two versions back of OS or a device that's not really common but is used by our customers. If our app is having trouble running on a Google Pixel 5, we're going to find it because we have access to a wide variety of devices in our Perfecto cloud.

The reporting feature is really tough to find in some of the other products that are competitors. Having your CITB-type dashboard, where we can see the test results and see recordings of each test that passed or failed, is probably one of the distinguishing aspects of Perfecto. We also recently started using SSO for login which has streamlined our onboarding process and improved security.

Its performance should be improved. Anything to speed up the user interface would be a great help. On the admin side, it would be useful to be able to filter/sort any page with a list of items and export it to a CSV file.  

In the web testing area, we discovered when you select Windows 10 or 11, the VM is running a version of Windows server that emulates the desktop experience. We would like to have the ability to run on the actual desktop version of Windows 10 and Windows 11.

I have been using this solution for six years.

I would give it pretty high marks. It doesn't have a hundred percent uptime, but it is pretty good. I would probably rate it a four or a four and a half out of five.

Its scalability is very good. We're a fully agile organization, so most of the users are testers, but we also have developers, product owners, and maybe a handful of business analysts who use it. It is currently being used extensively by a team of 800+ users. 

I commend their tech support. Their support is very efficient, very helpful, and very personalized. They just go above and beyond. I never had any complaints about their tech support. I am definitely satisfied with their support.

Positive

The initial setup was done before my arrival at the company.  But since then I have been an administrator and have found it to be easy to manage the device pool and user base. 

There are four of us who do the admin for Perfecto. Mainly, it is a liaison with Perfecto on a routine basis. We don't do any updates to the software since it is all in their hands. We're paying for software as a service. So, our main duties are adding users, troubleshooting problems that our testers encounter, and managing which devices are going into the cradles. I and the team of three others are responsible for those admin duties. Everyone is a tester.

ROI can be measured in terms of the number of mobile devices we DON'T have to purchase since we can share our device pool across 800+ users. It also provides a solution for our offshore testers who otherwise would not be able to test on a mobile device since we cannot issue company phones to our offshore sites. Aside from that, the ROI is the broader coverage we gain by maintaining a device pool that has a mix of devices that closely matches what our customers are using, as well as a range of OS versions that allow us to test against versions N, N-1 and N-2 of IOS and Android.

The pricing is competitive when you compare apples to apples. We have seen cases where comparisons are made between the cost of public cloud vs private cloud. Private cloud is more expensive but it is required in some cases where security is of utmost importance. I advise taking advantage of Perfecto's Black Belt service. The personalized service you get is worth the extra cost.  Perfecto's support team is amazing. We normally get same-day resolution of issues we report, and in some cases, they are resolved within the hour. Consider this when looking at price and comparing against other tools.

We continually evaluate test tools for use by our QA team. In the past, we have reviewed SauceLabs, BrowserStack, Kobiton, and others. We believe we get the best value from our investment in Perfecto.

I would recommend trying it. Go through the trial period. I would imagine that anyone who does so would compare it favorably to the competition. It may not be the lowest-cost product out there, but you get a lot of value from the tech support and from the feature set that is out there.

I would rate it an eight out of ten. It is a great solid product for mobile testing and web testing. It has got great features, and we've utilized pretty much all of them.  We use it heavily for both manual/exploratory testing as well as automation testing.  

We use it to test the mobile apps that we develop.

The Perfecto device lab has allowed us to run tests on multiple devices at the same time and across multiple platforms as well. That increases the efficiency of our testing and saves money, time, and effort. It would take us six times longer to do what we now do.

We are also able to run tests without needing to monitor them. It delivers comprehensive testing that we otherwise wouldn't be able to achieve.

In addition, it has allowed us to maintain high app quality. By testing the app thoroughly, which Perfecto allows us to do, we get that high quality.

The automated test reporting functionality is the most valuable feature. We use the CI Dashboard. It's very important as it is the main reporting tool for our automated tests.

Another important feature is being able to manually control a device.

When it comes to executing cross-platform testing, we only use two platforms, but it's still pretty good.

We also utilize Perfecto’s cloud-based lab to test across devices, browsers, and OSs, and that is really important as well. The lab provides us with same-day access to devices.

The flakiness, or the accuracy, of the test execution can be improved. Also, the responsiveness of their cloud lab could be improved as well.

I have been using Perfecto for a year and three months.

It's stable most of the time but we do come across bugs and we have to reach out to support.

It's very scalable, although it's unlikely we will increase our usage of the solution.

It is used across at least 10 teams in our organization. 

We get pretty good response times and I have someone I can contact very quickly if I have a problem.

Positive

We did not have a previous solution

It took us about three months to realize the benefits, from the time of deployment.

It's a pretty fair investment.

It's definitely on the higher end of prices for this type of service.

Look at the cost of the product and check its feasibility in the context of your projects, and what you want to use it for.

The maintenance involved with the solution can be done by one person and the main duty is to ensure that the scripts are running correctly.

We need to test a certain bank's application on different devices, mobile and web. We're using Perfecto to set up devices on the cloud, and that way, the whole distributed team can use it and test different devices.

The Perfecto device cloud has helped us to scale our testing operations. We can do much more testing than we did previously. Business has picked up, and the latest version of OSs needs to be tested. That would not have been possible if we had physical devices and had to give them out to the whole team. And that would involve a lot of cost. Having shared devices makes it much easier for the business.

People from all over the world can use it at the same time. It's not for a particular location. That's most valuable. Their cloud-based lab to test across devices, browsers, and OSs is the main part of it. People from offshore and onshore can access the devices. We can open everything on our system so we don't have to go looking for physical devices.

It saves on the cost and effort of having to maintain our own virtual testing environment. Even our onshore team is not in the city that we work in, so that helps a lot. Even if we didn't invest a lot in getting multiple devices, having to share those devices would become a hassle.

And same-day access to new devices is quite important. When OSs are updated or something new comes onto the market, upon our request, we can have new devices installed on the cloud and have access to them. We don't have any wait time and that's great.

Overall, it has helped massively to speed up our testing efforts and not just from a device point of view. Over the last two years, the performance of the Perfecto tool has picked up as well. It's much more real-time now, compared to what it was when I started.

Also, when I started using it, we did not have the web capabilities and we used to test only on mobile. We had Android and iOS, and that was great, but around 2020, they added web functionality as well, with Windows and Mac devices on the Perfecto cloud. It's great having everything together on one platform.

We use Perfecto's reporting and analytics for automation testing. Obviously, we need to see what the results are for whatever tests we perform from an automation perspective. Reporting results to our business team plays a huge role.

One other feature is the screenshots that Perfecto has. If I'm testing something and I want to take a screenshot, it's just a click away. That makes it much easier to record all the results.

There was a discussion about having the capability to export the test results to a certain tool that we use in our project. If that were added it would be great not having to manually take screenshots, put them in a document, and share them on the different test management tools.

I've been using Perfecto since 2018.

Stability-wise, it's fine. There have been no unforeseen outages.

There is a huge possibility to scale it up. It depends on our project environment if we actually need to, but scalability-wise it is quite good.

We have a huge team of around 100 people who are using it, but it's distributed across teams. It's not like everyone uses it at once. We have a certain number of devices available and we are only able to use those devices.

Their technical support is very good. They immediately respond to our queries and try to resolve them in the best way possible. Obviously, there are times when they need more information from us, but when they have the full information, it's quite fast.

Positive

I wasn't involved in the deployment, but there is maintenance required from time to time. That's mostly on a ticket basis. If we need something done, we raise a ticket with Perfecto support and they help us do it. It's not like we get regular maintenance notifications. It's on-demand maintenance.

In terms of Perfecto's effect on our software quality, it's neutral. It does improve our software, but there's no direct impact from Perfecto on our quality.

My advice about Perfecto is "the earlier the better." I haven't looked into competitors of Perfecto, but from my experience, this is one of the best tools.

We need to test our mobile automation by using iOS as well as Android for a lot of our use cases. 

We have a couple of use cases where the Perfecto team supports us, e.g., where single sign-on will move from the mobile app to the browser app, and then come back to the mobile app. 

The finger signature is one of our main use cases required for testing, and it is supported by Perfecto.

It provides the simulator and emulator that we are using in our project for testing.

It improves our product quality by testing multiple times and integrating Perfecto into our CI/CD pipelines.

We are continuously doing testing on different environments, devices, and platforms. It executes  seamlessly on multiple devices without having any connectivity issues. It has been really helpful for us to test on cloud devices.

It has a lot of features as well as 24/7 support. Everything is captured on their website.

The QR code automation for mobile is something that we have trained on using Robot Frameworks, which has not been supported well. We have used Perfecto to automate the QR code automation, which provides a very good value to us. It records the image file injection. This is a very good feature where you can inject the image and test it with the QR code, which is one of the main advantages of using Perfecto.

Currently, we are moving to the cloud. The performance and automation testing are very good. We compared the physical devices with the Android simulation, and its physical devices gave us better performance than the Android simulation.

The cloud and cloud mobile are very good features. They provide us with better performance.

Perfecto's reporting and analytics are very useful for us, and what we can see from Live Stream is really awesome. There are no delays at all. Whatever we are seeing in the mobile, the same thing will show in the Live Stream tool. It provides insights in the pie chart as well as the history and trends. So, you can go through it and find the number of tests executed, the pass/fail cases, etc. They have a report library that gives data about all the executions, including details of the history. 

The time stamp helps us out a lot by providing the duration for the previous execution and the current execution. So, there are a lot more reporting configuration tools, which helps us. Also, we can export this particular report and give it to anyone for review.

The lab has been very helpful for us when pushing API or image files. Anything you can push into the repository, we can test it. It is seamless. We can test it through cloud devices, which is very useful for us. 

It supports a lot of open-source technologies. We have been using Quantum Framework for more than eight years, which has been really helpful. Perfecto supports Quantum Framework, and this is where we can get Selenium as well as APM functionalities, which is really helpful for us. 

They have in-built functionalities, which are very useful for us, e.g., loading the APK and applications. We can also switch contacts from mobile to web and web to mobile. Those are all really helpful for us when implementing the new functionalities into Perfecto by using Selenium as well as the APM.

Previously, we used the cradle. Every time the mobile was blocking it, we would have to ask Perfecto to provide another one. That took a lot of time away from us. 

We have been using Perfecto for eight to 10 years.

It has good device stability as well as the support from their team. Devices aren't going down.

Scalability-wise, it is great. Devices are always available. 

If we need devices, we can just send a request to Perfecto.

We have 300 to 400 devices in Android and 300 to 400 devices in iOS.

Whenever we have a doubt about mobile device testing, we just go to the Perfecto site and what we need will be there. For example, we were facing some issues when scrolling down. So, we went to the Perfecto site and found that particular solution.

You just need to create a ticket for Perfecto, and most things will be immediately addressed. Complex solutions are also available on the Perfecto website.

I would rate the support team as eight out of 10.

Positive

We were using the simulator and the emulator with Robot Framework, which was very slow compared to our current solution. It did not support many functionalities so we were struggling with the QR code automation and finger signature. When we switched to Perfecto, they helped us implement those testing functionalities and supported our entire end-to-end testing.

Earlier, we were using Perfecto cradle and GigaFox. Perfecto cradle and GigaFox, had higher maintenance costs and Wi-Fi issues. For example, during the pandemic when we were looking into devices, the issues were because of battery heat. It would buzz and need to be replaced. Sometimes, it would be down because of the Wi-Fi. 

Once Perfecto started utilizing the cloud, we didn't need to worry about anything, saving us on costs. We didn't need to keep an eye on devices because Perfecto took care of it, giving a more efficient way to save. Also, the performance is awesome, which helps us a lot. We don't need to babysit the devices anymore.

It used to take 18 minutes in the simulator and emulator to test our applications. Perfecto takes around nine minutes. Our testing time was reduced starting from our first POC. Performance-wise, Perfecto has been awesome. Test-wise, it also provides seamless execution. 

We have approached many solutions, like Sauce Lab and Kobiton. Comparatively, Perfecto is a good product. Feature-wise, finding the element is very easy compared to other devices. It has Object Spy, where we can go through a device to find and identify locators.

We are using Perfecto cloud with iOS and Android devices. It is pretty fast compared to GigaFox and Kobiton, which we have also used in the cloud. Comparatively, Perfecto gives us more performance while doing testing. So, we have done multi-level, multi-device testing for both Android as well as iOS, and it has very good performance compared to the cradle solution. The cloud is the best one.

We are planning to do performance testing by using BlazeMeter and other tools, then we can do the load testing through mobile devices. We are hoping to start using this within a month.

I would rate it as nine to 10 (out of 10) because the solution is scalable and stable. It also has support, which is important.

We have a website as well as a mobile app, Android and iOS. We do a lot of functional, UI-related testing. And we have automated a lot of test cases through Perfecto, and we have even started to automate mobile now.

Perfecto's device lab has helped us to scale our testing and it has made testing easier for us. We've been able to run our regression testing. We have hundreds of test cases, the majority of which are mobile-related, and we use Perfecto for them.

We've also been able to get our testing done a lot faster, especially during COVID when we weren't going to the office and didn't have our physical devices. We ended up using and being dependent on Perfecto a lot.

We have access to 15 or 20 devices. Even if some of them are being used by other testers, I can utilize another one. That was not stopping my testing when I was doing manual testing. That has helped us a lot

And for automation, we run our jobs at night when these devices are not being used by manual testers. Just the fact that we can automate our tests on Perfecto and run our jobs and have test results in the morning has given us a lot of flexibility and has helped a lot.

We've been able to automate test cases that are mobile-related. That's helping a lot with our automation. Obviously, you can't automate on a physical device, it's something that we do on a virtual machine. The fact that we can automate on mobile, Android and iOS, is working well for us.

We use the CI Dashboard. Perfecto's analytics are very important because that is where we have our test results, which we later input into Jira as well.

We use the device lab in our testing operations and mobile is one of the things we use. We have multiple devices, about 20, including Android and iOS. That's what we are running our automated test cases on. The device lab is extremely important because we are doing our automatic test cases and even our manual testing there. We don't have physical devices. We go into the Perfecto website and use all the mobile devices available on the cloud.

Also, we're working in Agile and we need results ASAP. The fact that the lab provides same-day access to new devices is extremely important to us.

We are mostly using Selenium and we are slowly putting our hands on Appium as well. That's working out well for us too.

When using devices on the cloud, it lags quite a bit at times. I know that these are real devices that are being projected on our laptop screens and monitors, but if the speed could be improved, that would be good. For example, if I open up a Google Pixel on my laptop, using Perfecto, just navigating on Google Pixel is quite slow. Improving on that would help us a lot.

I've been doing manual testing with Perfecto for a while, but I started automation a few months ago. That's when I really got to work with Perfecto properly.

My main area of concern when it comes to improvement of the solution is that it lags often. If that could be improved, then it would make our testing a lot faster and more efficient. Apart from that, I'm pretty happy with Perfecto. It's going in the right direction.

It's definitely scalable. For mobile testing, if Perfecto gets faster then we can utilize it in our bigger test cases. We do have some data-related test cases that really slow it down. If Perfecto can find a way to handle that, it can definitely grow with us.

The technical support gets back to us within a few days. I have not used it that much and I don't have complaints, nor have I heard complaints. My team lead is the one who uses the technical support more often, and he's quite happy with it.

Positive

It's a great tool for running functional, UI-related test cases. But I would give a heads-up about the speed that the mobile devices run at on our laptops or monitors, because it can slow us down a bit.

But in the bigger picture, it helps us because, obviously, even when doing manual testing, you're not going to be testing on your own personal devices. With a lot of people working from home, you cannot give cell phones to everyone to test on. Overall, it definitely helps.