Sauce Labs Reviews

Being a cloud based testing grid is really the key feature. But inside the product the killer features for us was the new CI dashboard of test results, and the recording of bugs into JIRA.

We are small. Most small dev teams do not consider testing as much. But this is exactly why we needed sauce. Quality was priority from day one. And with only developers the only solution was automated testing, and a test grid we did not have to manage ourselves. We choose Sauce because of it's popularity, but also because they have a good relationship with the market and show their interest in helping the market get better with test automation.

I would like to see it work directly with Azure Web Apps so that we do not have to have a separate step to run tests, or setup complex flows in Jenkins.  

Because our application front-end runs one Azure Websites which is a PaaS solution, we do not have server access and this makes it challenging for use to work with some external tools. I would like to see sauce labs have a direct integration with Azure Web App slots. This way we would not have to make the test runs a manual step. Currently we initiate tests manually and if they pass we do a manual promotion from an Azure Web Slot. We could integrate Jenkins or other release automation tool, but this would be additional overhead on top of what Azure provides out of the box. Another way to do this, instead of a direct integration with Azure. Is if their was a way to run tests in Sauce upon ever commit of a specific branch in GitHub. This way we could have a branch just for automation, and would not need to involve Azure Web App slots at all.

Using Jenkins to call Selenium tests running from Serenity BDD with Gradle. It is very easy to get tests going in this manner.

It makes my life much easier. 

Maintaining many environments for test is a bear. These guys make it so easy with their CI integration that you can have tests going in after a few hours.

There have been various times throughout the last month or so where the service has gone down during business hours. This has impacted a release or two, so it is definitely less than ideal. Increasing uptime would be a good focus.

Over the last month or so, there have been times the service was unavailable at less than ideal times.

Now that we have an enterprise license, we no longer have to worry about minutes each month!

Ability to quickly spin up VMs to test combinations of browsers and operating systems is a must.  

This service allowed me to get tests running within an hour of signing up!

This service has enabled several employees here to schedule tests and shift left with CI, which offers reliability and minimizes variability.

Getting accurate pass/fail results when running TestNG scripts in parallel by class is a challenge but after some work we figured out a solution.  I have also heard some complaints about lag when spinning up VMs but it is so much faster than the alternative that I don't mind.

The combination of OS platforms, platform versions, browsers and browser versions support on VMs.

Cross browser and cross platform testing on our test case scenarios.

A little clarity on documentation when integrating with third party APIs will help the users. Take for example, when a high-level language like Gherkin comes into the picture- how should users handle it?

I've used it for four months.

No issues with deployment.

No issues with stability.

Yes, the parallelization is not possible now when cucumber and junit are used together.

Haven't had the need to interact with them.

Haven't had the need to call them.

We weren't previously using a different solution.

Straightforward since the cloud based examples were clear.

Implemented in-house.

Working on open sourcing an API based on Sauce Labs support that can benefit both the parties and the community in general.

Our monthly cost as of now is $149/month for a small team.

No, we used local machines by installing different versions of browsers and platforms. I am now trying to promote this idea of using Sauce Lab across my company moving forward.

Testing a browser-based application. We have a hotel booking site which is used across a wide variety of platforms. Starting out, we are mainly used for manual checks. However, we are in the process of getting automation.

Testing across multiple devices and environments is now possible to do quickly and effectively.

Being able to test on real devices is a big deal. 

Sometimes pasting text while using "text object" does not seem to work, and it slows down testing times quite a bit.

Previously, we only had four test devices, and it usually took awhile to even track them down. We often were not able to duplicate reported issues with the tools we had.

• Parallel run
• Real device testing

Fast automation.

Playback needs improvement.

For two years.

No issues.

No issues.

No issues.

Their customer service is excellent.

Their technical support is excellent.

No.

The initial setup is straightforward.

The implementation was done in-house.

It is good.

No.

Cross browser/OS testing and mobile testing.

We work on a complex SaaS web application which has lot of regression testing. If we were to run all our tests on different browsers/different OS combinations, we would need lot of new infrastructure and VM's. But with Sauce labs, we were able to use Remote WebDriver and connect to their VM's which have all the combinations we are looking for.

We still see simulators for a few mobiles in their VM's, we want to test on real devices. 

Sauce has all of the wanted features, from just about any major OS, any major browser, and different resolutions. I can't imagine how complicated it is to support such a vast array but they seem to have done it. A client has an issue on FF on 1920x1080? No problem. I can spin up a VM instance and instantly confirm the issue. This helps us bring a new responsive web experience to users and quickly fix strange issues that would literally require a server farm to have each version of every OS!

A more clean, lean, and bug-free site! We know our site works on mobile. We know our site looks good on Safari 8 1280x1024. We know android phones display the website perfectly. It makes sure that the user doesn't get a bad experience which is crucial these days.

I don't really know of any, I wish everything life was a bit cheaper, so maybe that? I honestly have no complaints. They did all of the hard work so our lives are easier and the users get a better experience every time.