Try our new research platform with insights from 80,000+ expert users
Quality Assurance Lead at ZX-Ventures
Real User
Good stability and interesting at a device level with the capability to automate processes
Pros and Cons
  • "So far, the stability has proven to be quite good."
  • "The testing process is difficult. I need to prove the complete competency of the tool, and I am finding that challenging."

What is our primary use case?

I am part of the QA team. I am implementing this solution. Right now, we are also trying to implement this solution in order to gather results in the testing process.

We have several stores around the world, more specifically around Latin America. We are trying to automate many tasks for the mobile applications that we are building. We are also trying to automate many web tasks in order to upload items to the tool.

What is most valuable?

The device level of the platform is the most valuable aspect for our team.

So far, the stability has proven to be quite good.

The solution seems to have interesting automation capabilities that we still need to understand. 

What needs improvement?

The testing process is difficult. I need to prove the complete competency of the tool, and I am finding that challenging. 

For how long have I used the solution?

Right now, we are in the initial phases when it comes to actually using the product. We are testing some tools in order to implement them in the future. We are in a very early stage.

Buyer's Guide
Sauce Labs
January 2025
Learn what your peers think about Sauce Labs. Get advice and tips from experienced pros sharing their opinions. Updated: January 2025.
832,138 professionals have used our research since 2012.

What do I think about the stability of the solution?

While we are still in the early testing phase, from what I have seen so far, I can say the solution is quite stable. There are no bugs or glitches. It doesn't crash or freeze. The performance appears to be very good.

That said, we still need more time to really dig into its capabilities. 

How are customer service and support?

We've been in touch with technical support as we've run into some issues and we want to better understand how the product will work in practice. We've been in touch to try to get a hold of someone that can walk us through a customer journey so that we have the knowledge we need to use the full potential of the product. We're still working on making this happen.

How was the initial setup?

The solution has not been implemented fully yet. We are still trying to uncover if this is the right solution for our company. We seem to need assistance with support and with the setup process before it will actually go live. We're not far enough into the process to really discuss the deployment and if it is difficult, or complex, or very straightforward. Those details are still to be determined. 

What other advice do I have?

I'd rate the solution at an eigh tout of ten overall. 

We had an issue in the past and we're looking further into the issue.  

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Works at Infosys Technologies Ltd
Real User
It allowed us to scale mobile testing across the globe

What is our primary use case?

Mobile application testing.

How has it helped my organization?

Yes, it allowed us to scale mobile testing across the globe.

What is most valuable?

Cloud availability.

What needs improvement?

More physical devices.

For how long have I used the solution?

One to three years.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Sauce Labs
January 2025
Learn what your peers think about Sauce Labs. Get advice and tips from experienced pros sharing their opinions. Updated: January 2025.
832,138 professionals have used our research since 2012.
PeerSpot user
Sr. Performance Test Engineer at a tech services company with 201-500 employees
Consultant
Allows us to off-load our local environments using the SauceCloud.
Pros and Cons
  • "The most valuable feature is the ability to easily test multiple browsers and versions, as well as off-loading our local environments using the SauceCloud."
  • "Running tests in the SauceCloud can take longer than running in a local environment."

What is most valuable?

The most valuable feature is the ability to easily test multiple browsers and versions, as well as off-loading our local environments using the SauceCloud.

How has it helped my organization?

We're able to utilize the local server space more efficiently now that we utilize the SauceCloud for regression runs that have typically been resource-intensive.

What needs improvement?

Running tests in the SauceCloud can take longer than running in a local environment.

For how long have I used the solution?

I have been using it for six months or so.

What was my experience with deployment of the solution?

We have not encountered any deployment issues.

What do I think about the stability of the solution?

We have not encountered any stability issues. SauceCloud is great.

What do I think about the scalability of the solution?

We have not encountered any scalability issues. SauceCloud handles all of this for us!

How are customer service and technical support?

Customer Service:

I have not directly communicated with customer service.

Technical Support:

I haven't had to use technical support; documentation is great. I can usually find an answer online if needed.

Which solution did I use previously and why did I switch?

We previously used a locally scaled Selenium stack.

How was the initial setup?

There were some issues with our firewall and the tunnel for the SauceCloud. But we were able to overcome the hurdles fairly quickly.

What about the implementation team?

An in-house team implemented it.

What was our ROI?

Currently, the biggest return has been in the ability to re-purpose local environments, previously dedicated to regression testing. Also, freeing up the engineers to work on other tasks while Sauce handles the regression across multiple browsers.

What's my experience with pricing, setup cost, and licensing?

We have an enterprise account; it has worked great for our needs.

Which other solutions did I evaluate?

We didn't find anything that directly compared to Sauce Labs.

What other advice do I have?

It's a great tool!

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
PeerSpot user
Web Producer at a tech company with 10,001+ employees
Real User
Valuable for the multitude of devices and browser/OS combinations they provide for real device testing.

What is most valuable?

Sauce Labs is valuable to my job for the multitude of devices and browser/OS combinations they provide for real device testing. I am able to eliminate the part where I have to find a human with that device or browser and have them test (potentially not even do that correct), and do the testing quickly at my desk. It also allows Selenium script testing which eliminates more human error.

How has it helped my organization?

It has improved our organization by testing our website on more devices and browsers that what our company currently owned. We were able to test on the newest browsers without installing them on our computer, or testing the newest OS without having to update our mobile devices.

What needs improvement?

It would be nice if they could ask for the URL and what browser/OS I want to test in, but not just one combination, I want the ability to start up 10 concurrently at a time. I would also like to put in a username and password before the launch of the test so it will auto put those in all on 10 instead of going into 10 tabs and having to put the same information over and over again.

For how long have I used the solution?

Our company has been using SL for almost 2 years now in my department, and several more years in other departments.

What do I think about the stability of the solution?

Initially there was some stability issues with IE9 combos but have since been resolved. They have excellent customer service.

How are customer service and technical support?

Customer service is top notch. When you report a bug or inquire about something they get back to you with a plan of action, not just "ok we will let our team know". It's refreshing having a company that wants to work better for its customers.

Which solution did I use previously and why did I switch?

Previously we used BrowserStack, but since they couldn't comply to our legal terms we were able to find Sauce Labs and are better for it.

How was the initial setup?

Sauce Labs was very easy to use for it's basic needs, but using Sauce Connect was very confusing. I am a technical person, but the documentation needs to be a little more "dummy" friendly for nonprogrammers. This sites documentation is really more geared for the software engineer rather than the Qa Engineer in my opinion.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
PeerSpot user
Software Engineer at a philanthropy with 51-200 employees
Vendor
Fast, massively parallelizable browsers, user-and-keyboard friendly interface, and nice toolset for making CI/CT happen

Valuable Features:

Ability to run many different browsers and tests in parallel. This has allowed us to keep our total test times under 25 minutes (even as we've continually added hundreds more tests and up to 10 browsers) and run tests more often—decreasing the time from bug introduction to detection.

Being able to test mobile devices (iOS, Android, and different browsers on each device) has helped us catch tricky mobile-specific bugs in the past.

We've also found the web-based review features (video playback, step-by-step screenshots, "click to manually take over test", full logs) and API handy for diagnosing failing tests and looking back at the result and timing history.

We also found Sauce Labs to be more flexible than alternatives during the setup phase—if you go just one parallel instance over the limit, for example, I noticed they won't instantly fail your tests like another major provider does, which saved a lot of time and frustration when getting parallel tests set up to start.

Improvements to My Organization:

We now find most browser-specific breakages before they hit production. This lets us push code out knowing it won't break in specific browsers, letting us be bolder in making larger changes across our codebase, frontend to backend.

We are now getting our Sauce Labs tests integrated with our CircleCI tests using Sauce Connect, which should dramatically decrease the time-to-issue discovery and save us time tracking down bugs once our tests catch them.

Room for Improvement:

Finding ways to debug our flakier tests is an ongoing pain for us (we've fought with our own tests' flakiness across all different providers, often e.g. due to some test steps using implicit rather than explicit waits). We could always use more insights in to the causes of different failures, common advice when a failure type is detected, or more detailed guidance on best practices for test runner setup.

Disclosure: My company has a business relationship with this vendor other than being a customer: While Sauce Labs is an infrastructure partner with Code.org (see https://code.org/about/partners and https://code.org/about for more on Code.org's non-profit mission), this review reflects my unbiased personal experience and opinions formed evaluating and using the service—if it wasn't great, we wouldn't be using it!
PeerSpot user
PeerSpot user
Software Developer Trainee at a tech services company with 10,001+ employees
Consultant
We can fire thousands of events to devices and run all our tests in the cloud, but the 7-days scheme should be removed.

What is most valuable?

The temporary storage they are giving is just awesome. You can run all your tests in the cloud on one powerful platform.

How has it helped my organization?

I was just surfing to know about monkey runner and selenium tools, I encountered this cool tool and boom. Thousands of events can be fired easily to your device. Purchasing it would be worth it.

What needs improvement?

None as of now. Soon I will be purchasing ( if my Director approves :P) then i can honestly tell you. The 7-days scheme should be removed.

For how long have I used the solution?

2 weeks

What was my experience with deployment of the solution?

No. The configuration of server explained properly.

What do I think about the stability of the solution?

No.

What do I think about the scalability of the solution?

No. The most famous selenium integration is enough to show off your scalability.

How are customer service and technical support?

Customer Service:

4.8 out of 5

Technical Support:

4.5 out of 5

Which solution did I use previously and why did I switch?

No.

How was the initial setup?

Somewhat complex in terms of configuring server.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user174360 - PeerSpot reviewer
Sr. QA Automation Engineer with 51-200 employees
Vendor
Video recording feature is tremendously helpful. It helps me debug and find defects quicker.

What is most valuable?

  • They have a video recording feature which I find tremendously helpful. It helps me debug and find defects quicker. When I see something fails, it shows me the video of the failed part, the video playback feature is amazing.
  • Easy to setup.
  • Very responsive. Get back within the same day – overall great company.

How has it helped my organization?

My company was doing manual testing, I came in and built a framework using Sauce Labs; now it takes less than an hour for regression testing. Easy integration, increased the amount of codes that go out. I used to have to write the tests and perform manual tests; Sauce Labs, has changed all that.

What needs improvement?

Documentation is pretty extensive, but at an advanced level could be a bit better. But they are always helpful. Besides that everything is great, they help out right away, so nothing is a big deal.

For how long have I used the solution?

About three and a half years.

What was my experience with deployment of the solution?

No issues with deployment.

What do I think about the stability of the solution?

No issues at all with the product's stability.

What do I think about the scalability of the solution?

Very good, highly scalable product.

How are customer service and technical support?

Customer Service:

They are amazing. Always get back to me, follow up, everything is amazing.

Technical Support:

They are amazing. Always get back to me, follow up, everything is amazing.

Which solution did I use previously and why did I switch?

Previously I used my own virtual environment – had to create and manage it on my own, now I don’t have to worry, infrastructure, setup, anything, Sauce Labs does it all for me.

How was the initial setup?

Straightforward for me.

What about the implementation team?

I implemented in-house.

What was our ROI?

In terms of value, we increased our release cycle to twice a week as opposed to once every two weeks – so its doubling productivity.

Which other solutions did I evaluate?

I did. I looked at BrowserStack. Did not have video-playback, which is tremendous for finding bugs and code.

What other advice do I have?

I think its excellent and everyone should get it – I recommend it to everyone. No brainer. Nothing else like it out there right now.

Disclosure: PeerSpot contacted the reviewer to collect the review and to validate authenticity. The reviewer was referred by the vendor, but the review is not subject to editing or approval by the vendor.
PeerSpot user
it_user174462 - PeerSpot reviewer
Sr. Engineering Manager at a tech services company with 51-200 employees
Consultant
After moving more tests to Sauce, the team was able to reduce testing time from 30 days to 3 days.

We attempted to host and run an in-house Selenium grid in 2012, but we had several failures and false positives that arose from our unstable Selenium grid versus their code. While some failures were due to normal challenges associated with a grid running hundreds of nodes, others were due in part to low familiarity with Windows, since our company’s primary focus was UNIX and Linux that year.

After initially experimenting with Sauce Labs, I automated a handful of tests. I couldn’t believe it. I didn’t have to manage Windows boxes, browser versions, and security settings for Windows machines. Because virtually no one on my team had Windows experience at the time either, I knew Sauce would be well received.  

In a startup environment, often everyone reinvents the wheel with their favorite tool, and then you have to support multiple tool chains. We found no backlash when it came to Sauce, however. Every developer and QA person said, ‘this is amazing.’ Within a week everyone was using Sauce. I turned off our Selenium grid and deleted the VM that it was running on. After moving more tests to Sauce, the team was able to reduce testing time from 30 days to 3 days, a time savings of over 99%.

Our test and development environments are highly automated. QA testing is complicated because of its large matrix of supported operating systems. We use 400 to 600 UNIX, Linux, and Windows VMs to run more than 1,000 UI tests in parallel. In addition to these VMs, we use 20 machines from Sauce to run 20 test suites in parallel continuously with Jenkins, a popular CI system. We use Sauce Connect to work behind our secure firewall, and Sauce is the final check for quality across all browsers.

I do not want my team spending time on browser or image maintenance. It’s too expensive and it changes too quickly. I love that Sauce handles that for us. 40 engineers currently use their Sauce Labs account. Our large team finds the video debugging tool extremely helpful as it aids communication. With Sauce, we experienced an epiphany. It works right out of the box by recording video so we don’t have to look at log files. It helps us debug instantly.

Sauce immediately allowed my team to scale our testing from literally the day we rolled it out. It also allows me to access browsers I hadn’t thought about using previously, such as Safari and older versions of Internet Explorer, which would have required the team to manage infrastructure they were not equipped to do. We’re not browser savvy. Avoiding this, thanks to Sauce, is a huge win.

To achieve the same results in-house we get by using Sauce, we’d need to employ several systems engineers to set up and maintain the grid, for a total cost of approximately a half million annually in headcount. Lastly, avoiding the hassle of managing unfamiliar systems has helped retain top engineering talent within my team. If you tell your team of UNIX and Linux people they’ll have to maintain Windows systems for IE use, that could be an issue for some folks. So I think I saved people from leaving because Sauce handles this for us. Sauce allows me to deliver a robust and sophisticated UI testing infrastructure with very little work.

Disclosure: PeerSpot has made contact with the reviewer to validate that the person is a real user. The information in the posting is based upon a vendor-supplied case study, but the reviewer has confirmed the content's accuracy.
PeerSpot user
Buyer's Guide
Download our free Sauce Labs Report and get advice and tips from experienced pros sharing their opinions.
Updated: January 2025
Buyer's Guide
Download our free Sauce Labs Report and get advice and tips from experienced pros sharing their opinions.