Try our new research platform with insights from 80,000+ expert users
reviewer1963890 - PeerSpot reviewer
Associate Software Engineer at a financial services firm with 10,001+ employees
Real User
Allows us to run tests on multiple devices at the same time, across multiple platforms, increasing testing efficiency
Pros and Cons
  • "The automated test reporting functionality is the most valuable feature. We use the CI Dashboard. It's very important as it is the main reporting tool for our automated tests."
  • "The flakiness, or the accuracy, of the test execution can be improved. Also, the responsiveness of their cloud lab could be improved as well."

What is our primary use case?

We use it to test the mobile apps that we develop.

How has it helped my organization?

The Perfecto device lab has allowed us to run tests on multiple devices at the same time and across multiple platforms as well. That increases the efficiency of our testing and saves money, time, and effort. It would take us six times longer to do what we now do.

We are also able to run tests without needing to monitor them. It delivers comprehensive testing that we otherwise wouldn't be able to achieve.

In addition, it has allowed us to maintain high app quality. By testing the app thoroughly, which Perfecto allows us to do, we get that high quality.

What is most valuable?

The automated test reporting functionality is the most valuable feature. We use the CI Dashboard. It's very important as it is the main reporting tool for our automated tests.

Another important feature is being able to manually control a device.

When it comes to executing cross-platform testing, we only use two platforms, but it's still pretty good.

We also utilize Perfecto’s cloud-based lab to test across devices, browsers, and OSs, and that is really important as well. The lab provides us with same-day access to devices.

What needs improvement?

The flakiness, or the accuracy, of the test execution can be improved. Also, the responsiveness of their cloud lab could be improved as well.

Buyer's Guide
Perfecto
December 2024
Learn what your peers think about Perfecto. Get advice and tips from experienced pros sharing their opinions. Updated: December 2024.
824,067 professionals have used our research since 2012.

For how long have I used the solution?

I have been using Perfecto for a year and three months.

What do I think about the stability of the solution?

It's stable most of the time but we do come across bugs and we have to reach out to support.

What do I think about the scalability of the solution?

It's very scalable, although it's unlikely we will increase our usage of the solution.

It is used across at least 10 teams in our organization. 

How are customer service and support?

We get pretty good response times and I have someone I can contact very quickly if I have a problem.

How would you rate customer service and support?

Positive

Which solution did I use previously and why did I switch?

We did not have a previous solution

How was the initial setup?

It took us about three months to realize the benefits, from the time of deployment.

What was our ROI?

It's a pretty fair investment.

What's my experience with pricing, setup cost, and licensing?

It's definitely on the higher end of prices for this type of service.

What other advice do I have?

Look at the cost of the product and check its feasibility in the context of your projects, and what you want to use it for.

The maintenance involved with the solution can be done by one person and the main duty is to ensure that the scripts are running correctly.

Disclosure: PeerSpot contacted the reviewer to collect the review and to validate authenticity. The reviewer was referred by the vendor, but the review is not subject to editing or approval by the vendor.
PeerSpot user
reviewer1322280 - PeerSpot reviewer
Regional Head Customer Experience at a financial services firm with 10,001+ employees
Real User
Good automated testing, but the price and performance could be better
Pros and Cons
  • "The most valuable feature is automated testing."
  • "We have had some issues with performance, which is something that should be improved."

What is our primary use case?

We write applications for mobile devices and we use Perfecto Mobile to test them. We set up automated tests, although we perform manual tests in some cases.

What is most valuable?

The most valuable feature is automated testing.

What needs improvement?

We have had challenges while using this product.

The main problem has to do with OTP. OTP comes on the SIM but there is no SIM card in the cloud, so it makes it a big challenge for us. It is available in development but because we don't have the OTP API exposed, we don't have it in production.

We have had some issues with performance, which is something that should be improved.

The price of Perfecto Mobile should be lowered.

For how long have I used the solution?

I have been using Perfecto Mobile for more than a year.

What do I think about the stability of the solution?

We experience some device hangs, as well as other performance-related issues.

What do I think about the scalability of the solution?

It is not auto-scalable. We have dedicated devices that we use for testing our applications. There is an option for scalability but we aren't using it.

How are customer service and technical support?

We have had contact with technical support and they are good. We have no issues with them.

How was the initial setup?

The initial setup is not easy because the networking team is in the bank and the network is secure. It took a lot of time to get approval, receive access, and then set it up properly. 

What about the implementation team?

We had to engage the Perfecto team to assist with deployment.

What's my experience with pricing, setup cost, and licensing?

This is an expensive solution compared to others, by 30% to 40%.

What other advice do I have?

This is a product that I would recommend. However, we have complaints about both cost and performance.

I would rate this solution a six out of ten.

Which deployment model are you using for this solution?

Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Perfecto
December 2024
Learn what your peers think about Perfecto. Get advice and tips from experienced pros sharing their opinions. Updated: December 2024.
824,067 professionals have used our research since 2012.
reviewer904560 - PeerSpot reviewer
Prin IT Bus Systems Analyst at a healthcare company with 10,001+ employees
Real User
Scales quickly and easily for multiple devices, but web application testing needs improvement
Pros and Cons
  • "One of the good things about Perfecto is the scalability that it provides."
  • "It does well for mobile testing, but when it comes to the web aspect, it is lagging a little bit in terms of execution."

What is our primary use case?

We are application developers and we use Perfecto to ensure that our applications are working on a variety of devices. We have a need to support a broad range of mobile devices, which Perfecto is able to assist with.

What is most valuable?

One of the good things about Perfecto is the scalability that it provides. We are able to quickly scale up the devices. We can choose Android devices, web-based applications, or whatever we need, and we can scale up quickly and easily.

What needs improvement?

We bought this solution because it is supposed to be proficient at both web and mobile testing. It does well for mobile testing, but when it comes to the web aspect, it is lagging a little bit in terms of execution. Specifically, if it is a native app then it does really well. But, with a hybrid, or it is a native mobile web app, it seems to be lagging.

For how long have I used the solution?

We have been working with Perfecto for approximately two years.

What do I think about the stability of the solution?

I have not experienced any stability-related issues.

What do I think about the scalability of the solution?

The scalability is very good. We have four to five people using it at the moment, and we have five or six concurrent licenses. At peak, we have five people using it.

There are three or four teams of approximately eight people each who use it, and the time is shared based on their needs. We may expand this in the future but for now, we art set.

How are customer service and technical support?

I have not interacted directly with their technical support. We have a team that deals with them.

Which solution did I use previously and why did I switch?

We also use UFT Mobile.

How was the initial setup?

The initial setup seemed to be straightforward.

What about the implementation team?

We used a vendor partner and they completed most of the setup.

The team looked like they have been doing it as part of their service and they were able to complete it pretty quickly.

What other advice do I have?

I would rate this solution a seven out of ten.

Which deployment model are you using for this solution?

Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
reviewer1934418 - PeerSpot reviewer
Automation Consultant at a consultancy with 10,001+ employees
Real User
We can execute tests in multiple browsers through Quantum framework, but test history should be extended
Pros and Cons
  • "The CI dashboard tool is very good, as is the Live Stream monitoring. Whenever I want to monitor execution, I can open multiple tabs in Perfecto and it is easy for me to refer to the CI dashboard and the Live Stream."
  • "We feel that Perfecto is a little slow. If they could improve on that slowness in accessing the app, when we want to click a button, that would be great because we feel the difference. An improvement in the connectivity speed is required."

What is our primary use case?

We use it to automate regression test cases for the mobile app of our application. We use Android and iOS for execution, in both English and French. We also use the solution to execute tests in different browsers.

How has it helped my organization?

It has really helped us speed up our testing process. We are able to execute tests overnight and see the results quickly.

Our devices are in the Perfecto cloud and that's extremely important because we have monthly releases and a lot of OS upgrades in our mobile application. We always have to validate our app for both forward and backward compatibility, as well as in the browser, to make sure that all the features of the application are working. Perfecto facilitates delivering the product on time, through the cloud devices, so that there is no impact to our end-users. That's extremely important for us.

The Perfecto lab also provides same-day access to new devices, which is another very important aspect. If we want to do some tests to make sure the features work in the latest Android 11 version, we don't have to contact the Perfecto team and ask them to provide us with access to that particular device. We can get that access and execute tests against the devices.

What is most valuable?

The CI dashboard tool is very good, as is the Live Stream monitoring. Whenever I want to monitor execution, I can open multiple tabs in Perfecto and it is easy for me to refer to the CI dashboard and the Live Stream. 

It's also very user-friendly. I can see and locate any issues that come in and it's easy to see which test case has failed. Under the Perfecto job name, if you click on it, it will show how many passed, how many failed and due to what issues, such as "element not found" or "object not found" or a Java error.

It also has video recording with the screenshots which is really good.

Another very good feature is the cross-platform testing. We are able to execute in multiple browsers and multiple Chrome, Safari, and Microsoft Edge versions. We have the capability in Perfecto to develop scripts. We just need to capture the capabilities of the different browsers and update them in our Quantum framework and we are able to execute. It's very easy. 

There is an option in Perfecto to capture the capabilities using the tool itself. If we want to run it in, let's say, a particular Android device, we can capture it from there and put it into the code and we can update the information and execute.

The range of open-source technologies that Perfecto supports is really good. I don't see any issue in using Perfecto for that.

In terms of its reporting and analytics, whenever I'm doing any execution for a new release, I just put in my release number and it's easy for me to look for what happened in the test case execution I ran for the previous month's release. I can easily locate it and I can get the information.

In addition, I can schedule the devices I need in Perfecto and I can block those devices so that other users on the team do not try accessing them.

What needs improvement?

The reporting can be improved due to the scrolling you need to do. We have an option for filtering and generating reports, but we are limited to three months of history. After that, we are no longer able to see the information. If they would maintain the history for a minimum of two years, that would be helpful.

Another issue is that sometimes, when we have to locate a button through physically accessing a mobile app, versus through Perfecto, we feel that Perfecto is a little slow. If they could improve on that slowness in accessing the app, when we want to click a button, that would be great because we feel the difference. An improvement in the connectivity speed is required.

For how long have I used the solution?

I have been using Perfecto since 2019.

What do I think about the scalability of the solution?

I would rate the scalability as an eight out of 10.

How are customer service and support?

I work closely with my Perfecto vendor and he is very supportive. Every time there is a new update he will share it with us and get our feedback to help enhance the tool.  They help update the core into the Quantum framework. We have had some key, latest, knowledge-sharing sessions with their team regarding these new updates.

We also have the Perfecto support portal, where we'll raise incident tickets. If, for example, a device is not working, it's not connecting, or a tool is not supporting what we're doing, we will raise a defect ticket. We can indicate the severity and wait for updates from the Perfecto customer solution team.

In terms of objects, we had some challenges initially and we told our point of contact about them. They updated the solution as a result. Also, sometimes we were not able to access iOS devices. Every time we wanted to go to iOS devices, we had to trust the app, otherwise the lab would not be launched. And we had some challenges accessing the iOS app from the Quantum framework. We worked with the Perfecto team and we got solutions to those issues.

That process is ongoing. We ask them about whatever ideas we have for them to improve. One of the ideas I asked about is because there are a lot of things we need to export into ALM Test Lab. It would be great if Perforce could create a plugin that could be added to the Perfecto portal so that we could just provide the ALM URL domain name and password to connect it to Perfecto. Right now, we need to write code to integrate it with ALM and export the results once the execution is done. An integration with Jira would also help.

How would you rate customer service and support?

Positive

Which solution did I use previously and why did I switch?

I have not used any other tool for a long time.

How was the initial setup?

I wasn't involved in the initial setup but there is some ongoing script maintenance involved.

What other advice do I have?

It's user-friendly, adaptable, extendable, and scalable. We are able to understand everything through the UI. They just need to enhance it further to adopt the kinds of changes we would like to see.

Disclosure: PeerSpot contacted the reviewer to collect the review and to validate authenticity. The reviewer was referred by the vendor, but the review is not subject to editing or approval by the vendor.
PeerSpot user
reviewer1042698 - PeerSpot reviewer
Responsible for Test Management at a tech services company with 10,001+ employees
Real User
Stable, easy initial setup, and offers coverage of various mobile devices and operating systems
Pros and Cons
  • "The most valuable aspect of the solution is that it covers all types of devices on the market allowing you to test different versions of an operating system."
  • "It would be ideal if there was a complete integration with other test management tools and other applications like HPLM, Micro Focus, or Microsoft Azure."

What is our primary use case?

We primarily use the solution as a mobile testing tool.

What is most valuable?

The most valuable aspect of the solution is that it covers all types of devices on the market allowing you to test different versions of an operating system.

What needs improvement?

I looked at the solution a year ago. I'm not sure what functionalities were lacking or need improvement, but I do find it to be a good tool.

It would be ideal if there was a complete integration with other test management tools and other applications like HPLM, Micro Focus, or Microsoft Azure.

For how long have I used the solution?

I worked with the solution for one year.

What do I think about the stability of the solution?

Once we had an open session and during the next entry, we had difficulties re-entering the tool. This only happened once or twice, but no more than that.

What do I think about the scalability of the solution?

The scalability is very easy to handle.

How are customer service and technical support?

The current version of the solution is very stable, so we've never had to contact technical support.

Which solution did I use previously and why did I switch?

We use both Perfecto Mobile and Mobile Center. Our customers dictate which tools we use. 

How was the initial setup?

The initial setup is easy, especially with the cloud version, which is what we use.

What about the implementation team?

My colleagues handled the setup phase and we had a center dedicated to mobile, but I am unsure if we solicited any outside help.

What other advice do I have?

We use the cloud deployment model.

The solution itself is fairly broad in scope meaning you don't need to implement other solutions.

While Mobile Center is a little difficult to install, Perfecto Mobile is simpler for both setup and training.

I would rate the solution eight out of ten. It's the best tool, but it can still be updated to be even better.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
PeerSpot user
Associate - Projects at a tech services company with 10,001+ employees
Real User
It offers cloud-based architecture for manual testing, along with integration with Appium and Selenium.

What is most valuable?

  • Cloud-based architecture for manual testing
  • Performance testing & automation of browsers, mobile devices and gadgets
  • Enhanced reporting with video recording and proper steps
  • Wind tunnel
  • Appium + Selenium integration
  • Best-ever tool for RWD apps
  • Parallel execution of almost any browsers, mobile devices and gadgets

How has it helped my organization?

It has saved hours of manual testing time, costs and efforts. It's pretty much the best tool that has a repository of all the execution status, apps and information, which can be available in any part of the world.

What needs improvement?

Ability to use/automate Windows/iOS/Linux environment would be a great feature to add in cloud.

Increasing local deployment of cloud devices/resources worldwide would be even better.

For how long have I used the solution?

I have used it for two years.

What was my experience with deployment of the solution?

No issues.

What do I think about the stability of the solution?

No issues.

What do I think about the scalability of the solution?

No issues.

How are customer service and technical support?

Customer Service:

Customer service is 100%.

Technical Support:

Technical support is 100%.

Which solution did I use previously and why did I switch?

We used Perfecto + UFT and then switched to Appium + Perfecto as it gives more flexibility and better control.

How was the initial setup?

Initial setup was simple. Perfecto took care of all the setup.

What about the implementation team?

Perfecto made it look easy.

What's my experience with pricing, setup cost, and licensing?

Go for private cloud as it has unlimited hours of testing and the most availability of devices.

Which other solutions did I evaluate?

We evaluated multiple open-source and commercial tools, but Perfecto helped our needs by providing secured connection over cloud, as we use VPN.

What other advice do I have?

Perfecto has a highly active community so just blend with it. Completing their certifications would give a bright overview about their products and it helps to get better at the tool.

Disclosure: My company has a business relationship with this vendor other than being a customer:
PeerSpot user
it_user173214 - PeerSpot reviewer
Test Lead at a tech services company with 10,001+ employees
Consultant
Due to the cloud-based model, devices available in any geographical area can be accessed and used. In iOS, it needs improvements with some limitations.

What is most valuable?

The cloud features are the most valuable.

How has it helped my organization?

Due to the cloud-based model, devices available in any geographical area can be accessed and used.

What needs improvement?

In iOS, it needs improvements with some limitations.

For how long have I used the solution?

I've been using it over a year.

What was my experience with deployment of the solution?

There have been no issues with the deployment.

What do I think about the stability of the solution?

There have been no issues with the stability.

What do I think about the scalability of the solution?

There have been no issues with the scalability.

How are customer service and technical support?

Customer Service:

It's been 100%.

Technical Support:

It's been 100%.

Which solution did I use previously and why did I switch?

No previous solution has been used.

How was the initial setup?

It was straightforward to implement.

What about the implementation team?

We used an in-house team with help from the vendor.

Which other solutions did I evaluate?

No other solutions were used.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user