Perfecto Reviews

We are mainly using it for automated testing for some devices that we're not able to have physically. We are also using the Perfecto service to do manual testing.

We deploy builds daily, and we have an automated pipeline that goes directly to Perfecto. We do it on a daily basis.

If anyone who doesn't have company-issued devices wants to do testing of our mobile application, we can always provide them access to Perfecto, and they can play around with the app there. That has been really nice.

We recently set up a couple of test cases for automated testing. Being able to run them automatically and being able to see the success and failure rate of those runs every day has saved us a lot of time. It has also been helpful in identifying issues, and it has also been helpful in terms of the timeframe and being able to find them a lot sooner.

It works well when it comes to executing cross-platform testing. I would give it a positive rating in that regard. We're able to test on Android and iOS devices pretty seamlessly.

We are utilizing Perfecto's cloud-based lab to test across devices, browsers, and/or OSs. The device lab is very important for our testing operations. If we have issues with the devices being offline, we wouldn't be able to run our automated tests. 

Perfecto's device lab has helped us to scale our testing operations. Currently, our company doesn't issue Android devices to us. I have an iOS device that's company-issued on which I can do manual testing. For Android testing, we've been leveraging the Android device in Perfecto. It is pretty important, and it has been helping us to determine what our baseline is with the Android builds. Because we're not able to physically see it, having it in Perfecto is super helpful.

It has saved us the cost and effort of having to maintain our own virtual test environment. It is hard to quantify in dollars, but in time, it has probably saved up to 100 hours, not more than that. As we build out our test suite more, it would save us even more time. Running those automated tests running as compared to someone manually testing the application and finding issues would definitely save time. Being able to find issues a lot quicker results in us being able to fix them a lot quicker.

It has helped to speed up our testing efforts, and it has also affected our software quality. It has improved the quality of our software due to us being able to find and fix the bugs a lot sooner.

Manual testing is definitely valuable. The insights feature is also valuable. I just started looking into that to get more data around the results of the testing. I'm looking to explore that one a bit more, but definitely, the manual testing and the insights are the top ones.

Their team is really great to work with. They're very flexible, and they always show care. They prioritize our work, our company, and our working relationship. I appreciate the ad hoc sessions that they schedule to provide help with troubleshooting, provide the information that we're looking for, or do a demo of a new feature that they have. They're always willing and very quick to get that scheduled for us. I appreciate that a lot.

If we could run an accessibility test in Perfecto against builds, it would help us a lot. Currently, that's a very manual process for us. We haven't found a tool that can do accessibility scans for iOS and doesn't depend on engineering effort. Having a feature related to that would be really awesome for us.

I've been using Perfecto for about a year and a half.

We have had some issues in terms of our environment, and it's hard to say whether it's because of Perfecto, or it is actually our app build that is introducing some of those errors that we have to maintain. So, overall, I would rate Perfecto a seven out of ten because sometimes, we also have lagging with some of the devices. We get error messages, but we're not quite sure what's causing them. However, whenever we do submit tickets for them for support, they're resolved pretty quickly. So, I would rate it a seven out of ten for stability.

We have an end-to-end (E2E) environment that we deploy for testing in Perfecto. Currently, it just supports our product team, which has about 10 people. In the Credit organization or department, we're the only mobile team. The web team, with about 50 people, is evaluating using Perfecto, but currently, our product team is the only one that I'm aware of in our organization. In the main organization, there is another app team that uses Perfecto. They use it a ton more than we do just because their product is much bigger. Their team roughly has 200 people.

There is a ton of potential for scalability because the other team that uses it is huge as compared to ours. They use it pretty heavily. They run thousands of tests a day, and I'm able to see their metrics as well. So, it definitely has a huge capability for scaling.

Their support is amazing. We have a technical consultant from Perfecto with whom we work. Whenever we need help with troubleshooting, he's very responsive over email. He is also very responsive in terms of scheduling a working session with the engineering team. It is easier to troubleshoot that way. Their customer support is great. I would rate them a ten out of ten.

Positive

We didn't have anything else in place before.

I wasn't involved in its deployment. In terms of maintenance, across the enterprise, I'm sure everyone has their own scenarios, but in our product team, we do have to have maintenance. We run into scenarios a lot where there are issues with our end-to-end environment, and we have to invest some time to make sure that everything is running as expected.

It is not a scheduled maintenance per se. Usually, if we have a line of sight to some updates that are coming from Perfecto, we can account for them, but a lot of the time, they are the changes within the app, which as such wouldn't be considered as maintenance. So, we do have to maintain it, but it is not scheduled maintenance, and we do have to put in effort just to make sure everything is running. Usually, just a pair of engineers do that, and it's more on an ad-hoc basis as opposed to on a scheduled basis.

We started seeing its benefits in the last three months. Last year, we were still doing a lot of the initial setup, and we weren't utilizing it as much for testing, but this year, we are getting a lot more usage out of it. It is just because of the way the team has been working. It is not a limitation of the tool.

I am not sure about its pricing, but from our perspective, licensing has been easy. Anytime I have new users or requests for users that want to get added, it's a very simple process. I just give the architectural owner of the product the name and email address, and they're able to easily add a new user. We don't have any issues in regards to getting licenses, but I don't have any insights into pricing.

I personally didn't evaluate other options. This is our enterprise tool. When they selected it, they did evaluate other options, but it was done way before we got the tools. So, I'm not sure what the other options were.

Perfecto has a lot of taped demos and webinars and informative videos to help you discover the features of the tool. They are very good to get more familiar with how to use it and how to find the best features that work for your team. I would also recommend working closely with their account management team. Their customer support has also been very helpful. When we get stuck and we don't really know which direction to go, we have a contact, as opposed to just trying to figure it out ourselves. It is always easier to just talk to someone from their team to get a more clear direction. So, the informational videos that they offer as well as leaning on the actual representative from the company to help you define the best use of the tool for each product are the way to go.

At this time, we are leveraging Perfecto's reporting and analytics very lightly. We're just using the default dashboards that come with the tool. We're just getting into having more useful data and using it more. I expect to be doing more with that. These analytics will be important for us because we'll be able to understand our failure versus pass rate for a lot of the automated testing. We won't be able to understand why those failures are occurring, of course, but at least, it will give us an indication of fixes that we need to address which might have got missed with manual testing.

Perfecto's cloud-based lab provides same-day access to new devices, but it is not too important for us. It depends on what the time window is. Usually, we get it within a week of our original request, and that seems to work fine for us. So far, we haven't had an immediate need to have the device available on the same day.

Perfecto supports a range of open-source technologies, but I don't have enough experience with that. Currently, we're using Appium by default, and I don't know if that's a limitation of Perfecto or an industry limitation.

I would rate Perfecto an eight out of ten.

We have seven servers in this environment running 4,000 different tests, so the load is distributed across these servers. Perfecto is used in this automated testing environment and helps ensure that the client's operations are running smoothly in production every day. We simulate a real person interacting with the app, to guarantee that it will work in the production environment like they need to work for the final customer.

Perfecto helps us sell automation projects to our clients. The main concern is how to buy, maintain, and administer all the devices. Now that people are working remotely, we also need a way to share devices among testing teams.

Perfecto helps our operations in that. Since the start of the pandemic, we haven't been able to work in the office, and we can't send real devices to the testers' houses. Thanks to the Perfecto platform, we can sell automated testing services again, overcoming those problems.

We are testing on the latest, most costly iPhones per example, so Perfecto enables us to test different versions of OS, and devices and to have many tests running in parallel. These features are essential for our clients, who will buy blocks to run the automation or test manually, so they don't need to buy the devices for testing.

Perfecto helps us scale our operations when we need to test multiple kinds of devices simultaneously. Real devices are ideal, but virtual devices are always available. We prefer real ones, but we use virtual devices when real ones are unavailable.

It also saves us money because the cost of each license is 10 times lower than what we would spend to maintain infrastructure here in Brazil. We would need to pay for the devices, buy licenses for the software required to administer the connections remotely, and hire a person specializing in these technologies. Perfecto is a game-changer for us, we save at least $10,000 monthly.

Perfecto speeds up our testing by reducing the setup time. The devices are always there, and it takes just a few minutes to supply access to the analysts. We saw improvements in our operations, and Perfecto has tools to inspect the elements to help us decide the best selector for each interaction on the automation. It saves us a lot of time, I estimate it saves us 14 to 20 hours a week and implementing testing takes half the time with Perfecto. 

It improves the quality of our client's software. I work for a consulting firm specializing in quality assurance software testing. It helps us achieve the testing metrics and execute the test. The performance is always outstanding, so it helps us maintain the highest standards when we test our client's software.

The most valuable feature is the ability to automate testing on real devices. We use Perfecto to test various mobile devices, like phones and tablets. We can use Perfecto to test across multiple platforms. We use it on the website to do manual testing and testing on all of the platforms I've seen before. We also use it through the CI servers, such as Jenkins and Azure DevOps, using authentication tokens to authenticate the process we are running. It also works with mobile operating systems, such as Android and iOS over the web testing tool.

I also like the reporting functions. We are constantly downloading the reports and sharing them with our final customers. They help us understand what kind of bugs are happening through the applications. The recording feature is handy because it lets us see a video of the automation that we run through the pipeline and discover the correct point at which the automation is breaking.

There is a dashboard where we can download those reports and see the results of our latest runs. We can do many kinds of filters and use some custom ones. The dashboard is fantastic compared to other tools I have used before. The analytics are crucial, too. We use QA analytics every day here in our operations. We use this feature to access the devices and see which ones are available for testing. 

The physical devices can be shared on the cloud, but sometimes a device is unavailable because another person already uses it. A tester can log on, select one of the available devices for manual testing, and later use the tools to automate the test. 

Perfecto's support for a broad range of open-source tools is critical because that is what we primarily use. In cases where we are using open-source tools, we use a lot of frameworks that rely on Python and Java. We also use Ruby-based technologies with Selenium or Appium as an intermediary. They always support us when it comes to implementing a new automated testing suite and provide many examples of how we can do it with each framework and language. They have excellent documentation and lots of models on their GitHub page too.

Sometimes, when the automated tests sync up or we have to debug remotely, we cannot interact directly with the device. We can interact with the code in the debugging tool, but we cannot directly click on the element on the screen or send other kinds of inputs to the device. This is possible with other tools. 

Also, it would be nice if there were some kind of API to get a list of available devices. Currently, we have to look at the web interface to see the available devices, but the pipelines can't do it on their own there. We always need to do this manually, so it would be better if this feature was automated.

I've been using Perfecto for about eight or nine months. 

Perfecto is stable. We never had an issue with availability.

The only scalability issue that we have, is that we always need to check manually if the devices are available. Our contract with most clients is for 10 to 12 slots, and it's already available. It still scales enough for our purposes. 

I rate Perfecto support a ten out of ten. They've done more than one call with my team and helped the people here until the problem was solved. After the issue was addressed, they followed up with us about the process to see if the automation was stable. 

They are always available for calls and provide guidance when we implement client services. We work as consultants here, so we use it in various contexts and many different lines of business. I had an issue two months ago when I was trying to set up the Ruby automation to interact with Perfecto, and it had some bug that interrupted the automation to work. They did a small diagnosis and solved the problem in a couple of hours.

Positive

We didn't use any other solution before this one, but we did do some research and testing with other platforms, and Perfecto was selected over the others.

Setting up the Perfecto component was straightforward. We only need to point to the remote URL and supply the authentication code. We have VPS Ubuntu servers and set up automation with Python code. We run it on a pipeline using Jenkins that runs the code over the devices on Perfecto Cloud. 

We can do the deployment of new automation code in an hour or less for both platforms (Android or iOS). We receive the apps from the developers, upload the applications to Perfecto and update the scripts from GitHub on our servers. We're currently setting up the platforms manually, but we plan to automate this kind of deployment.

We handle all the daily maintenance without any help from Perfecto. We mostly upload a new version of the software twice per month and use the automation scripts daily.

An in-house team with some support from the Perfecto team helped with the first operation. Now we can do it all by ourselves.

In terms of value, I rate Perfecto a nine out of ten. It's the best deal that we found. We know that we are getting the best prices from our partnership with Perfecto.

Perfecto's price is excellent compared to other products with similar features. It was the lowest of the three we evaluated. We also established a partnership with Perfecto, so they provide discounts when we sell Perfecto projects and licenses to our customers. 

We've tried Saucelabs and BrowserStack, but the prices were higher. Every dollar counts because the dollar is much stronger than our currency. Price is a decisive factor for Brazilian operations. Perfecto also has local staff in Brazil who can speak Portuguese. They helped us teach our analysts how they use the tool, and most of them don't speak English.

I rate Perfecto a nine out of ten. They always have room for improvement, but Perfecto is our best option compared to other players in the market. If you plan to implement Perfecto, I recommend considering if you constantly need to check whether devices are available. I would reconsider using Perfecto if you need to do this multiple times per day.

If you're comfortable running a test that points to a single device and only looking for it once daily, you can go ahead with Perfecto. This is the only issue that I feel the need to raise with other people.

We need to test our mobile automation by using iOS as well as Android for a lot of our use cases. 

We have a couple of use cases where the Perfecto team supports us, e.g., where single sign-on will move from the mobile app to the browser app, and then come back to the mobile app. 

The finger signature is one of our main use cases required for testing, and it is supported by Perfecto.

It provides the simulator and emulator that we are using in our project for testing.

It improves our product quality by testing multiple times and integrating Perfecto into our CI/CD pipelines.

We are continuously doing testing on different environments, devices, and platforms. It executes  seamlessly on multiple devices without having any connectivity issues. It has been really helpful for us to test on cloud devices.

It has a lot of features as well as 24/7 support. Everything is captured on their website.

The QR code automation for mobile is something that we have trained on using Robot Frameworks, which has not been supported well. We have used Perfecto to automate the QR code automation, which provides a very good value to us. It records the image file injection. This is a very good feature where you can inject the image and test it with the QR code, which is one of the main advantages of using Perfecto.

Currently, we are moving to the cloud. The performance and automation testing are very good. We compared the physical devices with the Android simulation, and its physical devices gave us better performance than the Android simulation.

The cloud and cloud mobile are very good features. They provide us with better performance.

Perfecto's reporting and analytics are very useful for us, and what we can see from Live Stream is really awesome. There are no delays at all. Whatever we are seeing in the mobile, the same thing will show in the Live Stream tool. It provides insights in the pie chart as well as the history and trends. So, you can go through it and find the number of tests executed, the pass/fail cases, etc. They have a report library that gives data about all the executions, including details of the history. 

The time stamp helps us out a lot by providing the duration for the previous execution and the current execution. So, there are a lot more reporting configuration tools, which helps us. Also, we can export this particular report and give it to anyone for review.

The lab has been very helpful for us when pushing API or image files. Anything you can push into the repository, we can test it. It is seamless. We can test it through cloud devices, which is very useful for us. 

It supports a lot of open-source technologies. We have been using Quantum Framework for more than eight years, which has been really helpful. Perfecto supports Quantum Framework, and this is where we can get Selenium as well as APM functionalities, which is really helpful for us. 

They have in-built functionalities, which are very useful for us, e.g., loading the APK and applications. We can also switch contacts from mobile to web and web to mobile. Those are all really helpful for us when implementing the new functionalities into Perfecto by using Selenium as well as the APM.

Previously, we used the cradle. Every time the mobile was blocking it, we would have to ask Perfecto to provide another one. That took a lot of time away from us. 

We have been using Perfecto for eight to 10 years.

It has good device stability as well as the support from their team. Devices aren't going down.

Scalability-wise, it is great. Devices are always available. 

If we need devices, we can just send a request to Perfecto.

We have 300 to 400 devices in Android and 300 to 400 devices in iOS.

Whenever we have a doubt about mobile device testing, we just go to the Perfecto site and what we need will be there. For example, we were facing some issues when scrolling down. So, we went to the Perfecto site and found that particular solution.

You just need to create a ticket for Perfecto, and most things will be immediately addressed. Complex solutions are also available on the Perfecto website.

I would rate the support team as eight out of 10.

Positive

We were using the simulator and the emulator with Robot Framework, which was very slow compared to our current solution. It did not support many functionalities so we were struggling with the QR code automation and finger signature. When we switched to Perfecto, they helped us implement those testing functionalities and supported our entire end-to-end testing.

Earlier, we were using Perfecto cradle and GigaFox. Perfecto cradle and GigaFox, had higher maintenance costs and Wi-Fi issues. For example, during the pandemic when we were looking into devices, the issues were because of battery heat. It would buzz and need to be replaced. Sometimes, it would be down because of the Wi-Fi. 

Once Perfecto started utilizing the cloud, we didn't need to worry about anything, saving us on costs. We didn't need to keep an eye on devices because Perfecto took care of it, giving a more efficient way to save. Also, the performance is awesome, which helps us a lot. We don't need to babysit the devices anymore.

It used to take 18 minutes in the simulator and emulator to test our applications. Perfecto takes around nine minutes. Our testing time was reduced starting from our first POC. Performance-wise, Perfecto has been awesome. Test-wise, it also provides seamless execution. 

We have approached many solutions, like Sauce Lab and Kobiton. Comparatively, Perfecto is a good product. Feature-wise, finding the element is very easy compared to other devices. It has Object Spy, where we can go through a device to find and identify locators.

We are using Perfecto cloud with iOS and Android devices. It is pretty fast compared to GigaFox and Kobiton, which we have also used in the cloud. Comparatively, Perfecto gives us more performance while doing testing. So, we have done multi-level, multi-device testing for both Android as well as iOS, and it has very good performance compared to the cradle solution. The cloud is the best one.

We are planning to do performance testing by using BlazeMeter and other tools, then we can do the load testing through mobile devices. We are hoping to start using this within a month.

I would rate it as nine to 10 (out of 10) because the solution is scalable and stable. It also has support, which is important.

We are using it to test the digital application that we are building. It is an insurance application. It is a web application that we test on multiple browsers and mobile devices. It is not a mobile native app.

We are an insurance company. As we expand the feature set or offerings that we have for our customers, we have to ensure that we are catering to the gamut of users. More and more people are becoming digital savvy, and they are using multiple devices to access applications online and on the road. So, we need to test our application on all possible devices that people may use. Even though it is not a mobile application, people do use mobiles for accessing web applications.

We have been using a competing product. We encountered some challenges in that competing solution in the cross-browser area. Perfecto has certainly brought positive change. We no longer have the defects or issues we were encountering earlier. It has been great from that aspect.

We use Perfecto’s cloud-based lab to test across devices, browsers, and OSs. It is very important for us. It saves the effort and the cost of investing in all different devices, which can become obsolete very soon. Continuous maintenance is not needed, and there is a single platform to access everything. All these benefits don't just make it cost-effective but also make things administratively light. It is very useful for us.

They provide same-day access to new devices, but we didn't require that. The majority of our tests focus on the in-market version. So, we haven't used it, but that's a good capability to have.

Perfecto’s device lab has helped us to scale our testing operations. One good thing is that you just need an email address, and you can share it with anyone. It is very prompt.

We are able to offer a quality product that has been tested fully, which improves our customer satisfaction. That is a good thing. It has also reduced our IT infrastructure cost. We don't have to spend a lot on setting up infrastructure, which becomes redundant or obsolete very soon. It helps in offsetting that cost.

It certainly has brought more capabilities to our coordinating teams. We are able to cater to different testing asks from the business and IT teams, and we are able to meet some of the key areas that our enterprise testing strategies are requiring us to do.

It is very important for scaling our testing. Investing in all different devices and then managing them, when it is not your primary job as a company, is not easy. Using virtual devices is certainly something that we can easily do at an enterprise level.

It affects our software quality. Our solutions are now tested for compatibility and accessibility. In the Ontario region where we are operating, accessibility is mandated by the government. It has also made us compliant with the accessibility requirements.

The inventory of browser options with the latest versions is valuable. There are various iOS and Android options. They are useful to us. We are using its cross-browser capability. It is certainly helpful for us. We have CrossBrowser for Mobile. We use Edge as our enterprise browser, but we know people use Chrome, Safari, and other browsers. We test our application through those browsers.

We also like some of the plugins and integrations that Perfecto has.

Going by the dashboard or analytics capabilities that Perfecto or Perforce is looking to offer in its roadmap, it will certainly help if they also cater to executing and enabling decision-making, rather than just focusing on standard testing metrics such as execution, efficiency, and defect rate. These are good metrics, but they don't necessarily enable decision-making for SLTs. Any improvements in the dashboards and reporting tools should focus on metrics or SLAs that can help with decision-making.

My team and I started using Perfecto a couple of months ago. It has been about three months, but different units in our organization have been using Perfecto and various other tools. 

It is on the cloud. So, it is available anytime. Its stability is very good.

It is positive. We haven't noted any challenges so far.

So far, so good. We haven't created an official service ticket yet, but the inquiry and the follow-up seem to be good. 

Positive

We used SmartBear. There were certain challenges that were noted by the users of the tool. The testers on my team and on the vendor's team noted a few challenges. The tool was showing some issues that we couldn't see on the actual mobile device or browser. There were some false red flags that the tool was throwing. Sometimes, the UI controls were not clickable. We had to invest a lot in defect analysis and resolution. So, we started looking at alternatives, and we started to evaluate Perfecto. 

In terms of the overall usage in the testing space, we have very limited use of Perfecto. We still rely on major enterprise tooling sets. As we transform our IT services, at least in the area where we have identified its use, it has brought positive change.

Perfecto hasn't helped to speed up our testing efforts. We were using a similar tool, and the testing effort has been the same as before.

I was not involved in its setup.

It has saved us the costs and efforts of having to maintain our own virtual test environment, but I don't have the metrics. We haven't done an ROI yet. At the end of the year, we might undertake that exercise.

When assessing the cost of our investment in the solution against the benefits we receive from it, we start at an equal playing field because we had another tool previously. However, the cost of investing in this tool to do testing to catch defects before going live would be six times less than the cost of finding defects and fixing them in production. We will use that as a benchmark. We will also consider the effort that it has taken for us to execute test cases specifically on devices and browsers. Those will be the basis for us to calculate the ROI.

Pricing-wise, it is fine. It is not as expensive as what we used to have in the past from HP, IBM, and others. It is decently priced.

It came through recommendations from other teams that were using it. So, we started with a trial. We used BitBar, and we also used CrossBrowser for Mobile.

Even though we are not using a lot of integrations, we do like some of the plugins and integrations that Perfecto has. Essentially, the tool is not integrated into our entire testing life cycle. 

With BitBar, we did not see a direct Jira plugin. So, the scope of use may be limited, or we may have not explored that integration. Perfecto seems to have that integration, and based on the documentation I had from the team, it seems that it is also well integrated with the Jira life cycle, which is valuable to me as a QE Manager.

I would advise specifically identifying the use cases that you want to try with the solution. The range of offerings that Perfecto is planning to bring to the market seems good. There is a lot of innovation happening in the space of test data management and usability and accessibility testing. If you are not looking at spending a lot of licensing money on enterprise tools, Perfecto is certainly good for starting small and then scaling up at the enterprise level. 

Perfecto supports open-source technologies, such as Selenium and Appium among others, but we are not using these capabilities. Based on my theoretical understanding and assessment of other tools, the range seems really impressive. Their roadmap is also impressive. It is good to see the integrations and collaboration it has with most of our testing tools. That's really impressive. 

They are certainly a good provider of services and solutions. We do not use Perforce BlazeMeter with Perfecto, but its collaboration with BlazeMeter excites me. I'm happy about that.

We don't leverage Perfecto's reporting and analytics capability, and we also don't use it for cross-platform testing.

Based on the size of the solution offering and the way they operate, I would rate it a nine out of ten. 

We need to test a certain bank's application on different devices, mobile and web. We're using Perfecto to set up devices on the cloud, and that way, the whole distributed team can use it and test different devices.

The Perfecto device cloud has helped us to scale our testing operations. We can do much more testing than we did previously. Business has picked up, and the latest version of OSs needs to be tested. That would not have been possible if we had physical devices and had to give them out to the whole team. And that would involve a lot of cost. Having shared devices makes it much easier for the business.

People from all over the world can use it at the same time. It's not for a particular location. That's most valuable. Their cloud-based lab to test across devices, browsers, and OSs is the main part of it. People from offshore and onshore can access the devices. We can open everything on our system so we don't have to go looking for physical devices.

It saves on the cost and effort of having to maintain our own virtual testing environment. Even our onshore team is not in the city that we work in, so that helps a lot. Even if we didn't invest a lot in getting multiple devices, having to share those devices would become a hassle.

And same-day access to new devices is quite important. When OSs are updated or something new comes onto the market, upon our request, we can have new devices installed on the cloud and have access to them. We don't have any wait time and that's great.

Overall, it has helped massively to speed up our testing efforts and not just from a device point of view. Over the last two years, the performance of the Perfecto tool has picked up as well. It's much more real-time now, compared to what it was when I started.

Also, when I started using it, we did not have the web capabilities and we used to test only on mobile. We had Android and iOS, and that was great, but around 2020, they added web functionality as well, with Windows and Mac devices on the Perfecto cloud. It's great having everything together on one platform.

We use Perfecto's reporting and analytics for automation testing. Obviously, we need to see what the results are for whatever tests we perform from an automation perspective. Reporting results to our business team plays a huge role.

One other feature is the screenshots that Perfecto has. If I'm testing something and I want to take a screenshot, it's just a click away. That makes it much easier to record all the results.

There was a discussion about having the capability to export the test results to a certain tool that we use in our project. If that were added it would be great not having to manually take screenshots, put them in a document, and share them on the different test management tools.

I've been using Perfecto since 2018.

Stability-wise, it's fine. There have been no unforeseen outages.

There is a huge possibility to scale it up. It depends on our project environment if we actually need to, but scalability-wise it is quite good.

We have a huge team of around 100 people who are using it, but it's distributed across teams. It's not like everyone uses it at once. We have a certain number of devices available and we are only able to use those devices.

Their technical support is very good. They immediately respond to our queries and try to resolve them in the best way possible. Obviously, there are times when they need more information from us, but when they have the full information, it's quite fast.

Positive

I wasn't involved in the deployment, but there is maintenance required from time to time. That's mostly on a ticket basis. If we need something done, we raise a ticket with Perfecto support and they help us do it. It's not like we get regular maintenance notifications. It's on-demand maintenance.

In terms of Perfecto's effect on our software quality, it's neutral. It does improve our software, but there's no direct impact from Perfecto on our quality.

My advice about Perfecto is "the earlier the better." I haven't looked into competitors of Perfecto, but from my experience, this is one of the best tools.

We have a cross-section of mobile devices and web devices, and we use those for browser compatibility and device compatibility testing, as well as functional testing of several apps and websites. So, we have testers that pull up the appropriate device, whether it's an Android or iPhone, and validate that all the functionality of the app or website is working as expected.

It is hosted by Perfecto. They take care of all the hosting.

Benefit-wise, by being able to share all the devices across 800+ users, we get a much better cross-section of testing across a wide platform of devices versus having to buy one or two phones for each tester. To be able to share a pool of devices is a huge saving. It is also a huge benefit to be able to test on a wide variety of devices. So, it saves us from having bugs go out that would only be found on, for instance, two versions back of OS or a device that's not really common but is used by our customers. If our app is having trouble running on a Google Pixel 5, we're going to find it because we have access to a wide variety of devices in our Perfecto cloud.

The reporting feature is really tough to find in some of the other products that are competitors. Having your CITB-type dashboard, where we can see the test results and see recordings of each test that passed or failed, is probably one of the distinguishing aspects of Perfecto. We also recently started using SSO for login which has streamlined our onboarding process and improved security.

Its performance should be improved. Anything to speed up the user interface would be a great help. On the admin side, it would be useful to be able to filter/sort any page with a list of items and export it to a CSV file.  

In the web testing area, we discovered when you select Windows 10 or 11, the VM is running a version of Windows server that emulates the desktop experience. We would like to have the ability to run on the actual desktop version of Windows 10 and Windows 11.

I have been using this solution for six years.

I would give it pretty high marks. It doesn't have a hundred percent uptime, but it is pretty good. I would probably rate it a four or a four and a half out of five.

Its scalability is very good. We're a fully agile organization, so most of the users are testers, but we also have developers, product owners, and maybe a handful of business analysts who use it. It is currently being used extensively by a team of 800+ users. 

I commend their tech support. Their support is very efficient, very helpful, and very personalized. They just go above and beyond. I never had any complaints about their tech support. I am definitely satisfied with their support.

Positive

The initial setup was done before my arrival at the company.  But since then I have been an administrator and have found it to be easy to manage the device pool and user base. 

There are four of us who do the admin for Perfecto. Mainly, it is a liaison with Perfecto on a routine basis. We don't do any updates to the software since it is all in their hands. We're paying for software as a service. So, our main duties are adding users, troubleshooting problems that our testers encounter, and managing which devices are going into the cradles. I and the team of three others are responsible for those admin duties. Everyone is a tester.

ROI can be measured in terms of the number of mobile devices we DON'T have to purchase since we can share our device pool across 800+ users. It also provides a solution for our offshore testers who otherwise would not be able to test on a mobile device since we cannot issue company phones to our offshore sites. Aside from that, the ROI is the broader coverage we gain by maintaining a device pool that has a mix of devices that closely matches what our customers are using, as well as a range of OS versions that allow us to test against versions N, N-1 and N-2 of IOS and Android.

The pricing is competitive when you compare apples to apples. We have seen cases where comparisons are made between the cost of public cloud vs private cloud. Private cloud is more expensive but it is required in some cases where security is of utmost importance. I advise taking advantage of Perfecto's Black Belt service. The personalized service you get is worth the extra cost.  Perfecto's support team is amazing. We normally get same-day resolution of issues we report, and in some cases, they are resolved within the hour. Consider this when looking at price and comparing against other tools.

We continually evaluate test tools for use by our QA team. In the past, we have reviewed SauceLabs, BrowserStack, Kobiton, and others. We believe we get the best value from our investment in Perfecto.

I would recommend trying it. Go through the trial period. I would imagine that anyone who does so would compare it favorably to the competition. It may not be the lowest-cost product out there, but you get a lot of value from the tech support and from the feature set that is out there.

I would rate it an eight out of ten. It is a great solid product for mobile testing and web testing. It has got great features, and we've utilized pretty much all of them.  We use it heavily for both manual/exploratory testing as well as automation testing.  

We have a website as well as a mobile app, Android and iOS. We do a lot of functional, UI-related testing. And we have automated a lot of test cases through Perfecto, and we have even started to automate mobile now.

Perfecto's device lab has helped us to scale our testing and it has made testing easier for us. We've been able to run our regression testing. We have hundreds of test cases, the majority of which are mobile-related, and we use Perfecto for them.

We've also been able to get our testing done a lot faster, especially during COVID when we weren't going to the office and didn't have our physical devices. We ended up using and being dependent on Perfecto a lot.

We have access to 15 or 20 devices. Even if some of them are being used by other testers, I can utilize another one. That was not stopping my testing when I was doing manual testing. That has helped us a lot

And for automation, we run our jobs at night when these devices are not being used by manual testers. Just the fact that we can automate our tests on Perfecto and run our jobs and have test results in the morning has given us a lot of flexibility and has helped a lot.

We've been able to automate test cases that are mobile-related. That's helping a lot with our automation. Obviously, you can't automate on a physical device, it's something that we do on a virtual machine. The fact that we can automate on mobile, Android and iOS, is working well for us.

We use the CI Dashboard. Perfecto's analytics are very important because that is where we have our test results, which we later input into Jira as well.

We use the device lab in our testing operations and mobile is one of the things we use. We have multiple devices, about 20, including Android and iOS. That's what we are running our automated test cases on. The device lab is extremely important because we are doing our automatic test cases and even our manual testing there. We don't have physical devices. We go into the Perfecto website and use all the mobile devices available on the cloud.

Also, we're working in Agile and we need results ASAP. The fact that the lab provides same-day access to new devices is extremely important to us.

We are mostly using Selenium and we are slowly putting our hands on Appium as well. That's working out well for us too.

When using devices on the cloud, it lags quite a bit at times. I know that these are real devices that are being projected on our laptop screens and monitors, but if the speed could be improved, that would be good. For example, if I open up a Google Pixel on my laptop, using Perfecto, just navigating on Google Pixel is quite slow. Improving on that would help us a lot.

I've been doing manual testing with Perfecto for a while, but I started automation a few months ago. That's when I really got to work with Perfecto properly.

My main area of concern when it comes to improvement of the solution is that it lags often. If that could be improved, then it would make our testing a lot faster and more efficient. Apart from that, I'm pretty happy with Perfecto. It's going in the right direction.

It's definitely scalable. For mobile testing, if Perfecto gets faster then we can utilize it in our bigger test cases. We do have some data-related test cases that really slow it down. If Perfecto can find a way to handle that, it can definitely grow with us.

The technical support gets back to us within a few days. I have not used it that much and I don't have complaints, nor have I heard complaints. My team lead is the one who uses the technical support more often, and he's quite happy with it.

Positive

It's a great tool for running functional, UI-related test cases. But I would give a heads-up about the speed that the mobile devices run at on our laptops or monitors, because it can slow us down a bit.

But in the bigger picture, it helps us because, obviously, even when doing manual testing, you're not going to be testing on your own personal devices. With a lot of people working from home, you cannot give cell phones to everyone to test on. Overall, it definitely helps.

We use it to test the mobile apps that we develop.

The Perfecto device lab has allowed us to run tests on multiple devices at the same time and across multiple platforms as well. That increases the efficiency of our testing and saves money, time, and effort. It would take us six times longer to do what we now do.

We are also able to run tests without needing to monitor them. It delivers comprehensive testing that we otherwise wouldn't be able to achieve.

In addition, it has allowed us to maintain high app quality. By testing the app thoroughly, which Perfecto allows us to do, we get that high quality.

The automated test reporting functionality is the most valuable feature. We use the CI Dashboard. It's very important as it is the main reporting tool for our automated tests.

Another important feature is being able to manually control a device.

When it comes to executing cross-platform testing, we only use two platforms, but it's still pretty good.

We also utilize Perfecto’s cloud-based lab to test across devices, browsers, and OSs, and that is really important as well. The lab provides us with same-day access to devices.

The flakiness, or the accuracy, of the test execution can be improved. Also, the responsiveness of their cloud lab could be improved as well.

I have been using Perfecto for a year and three months.

It's stable most of the time but we do come across bugs and we have to reach out to support.

It's very scalable, although it's unlikely we will increase our usage of the solution.

It is used across at least 10 teams in our organization. 

We get pretty good response times and I have someone I can contact very quickly if I have a problem.

Positive

We did not have a previous solution

It took us about three months to realize the benefits, from the time of deployment.

It's a pretty fair investment.

It's definitely on the higher end of prices for this type of service.

Look at the cost of the product and check its feasibility in the context of your projects, and what you want to use it for.

The maintenance involved with the solution can be done by one person and the main duty is to ensure that the scripts are running correctly.