Try our new research platform with insights from 80,000+ expert users

Sauce Labs vs SonarQube Server (formerly SonarQube) comparison

 

Comparison Buyer's Guide

Executive Summary

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

Sauce Labs
Average Rating
8.8
Reviews Sentiment
7.2
Number of Reviews
113
Ranking in other categories
Functional Testing Tools (10th), Test Automation Tools (15th)
SonarQube Server (formerly ...
Average Rating
8.0
Reviews Sentiment
7.5
Number of Reviews
113
Ranking in other categories
Application Security Tools (1st), Static Application Security Testing (SAST) (1st), Software Development Analytics (1st)
 

Mindshare comparison

While both are Quality Assurance solutions, they serve different purposes. Sauce Labs is designed for Functional Testing Tools and holds a mindshare of 6.9%, down 7.8% compared to last year.
SonarQube Server (formerly SonarQube), on the other hand, focuses on Application Security Tools, holds 26.4% mindshare, down 27.4% since last year.
Functional Testing Tools
Application Security Tools
 

Featured Reviews

Joel Alonzo - PeerSpot reviewer
Metrics about testing across the company are easily accessible, and it's easy to get teams up and running
Multi-domain SSO is a big concern for us right now, especially as we've been merged into a larger company. I suddenly have teams coming from 20 different domains, and because the main master Sauce Labs account is locked down to one SSO domain, there are teams that can't run a test right now. I've heard they're working on a solution and they've been very communicative with us about it. A solution to that would help us a lot. The other issue is that when you're behind a corporate proxy and inside a corporate network, it's a nightmare in general. And the problem that we've come up against over and over again is that a lot of our network staff don't want to open up giant CIDR blocks to internal traffic. Opening it up to one endpoint which is Sauce Labs, through a little API is perfectly fine. That's one IP address and it's no big deal. But for their virtual machines they have one jump box and that jump box contains an entire CIDR block that changes each time the tunnel starts up. In other words, if every call went into one IP and that got bounced back to a load balancer or net gateway, that would help a lot too. When I go to the network team and say, "Hey, we're using a product, a piece of software, and I need an entire CIDR block opened," the first and almost eternal response to that will be "absolutely not." Getting things set up and running is always going to be a bit of a struggle within any corporate environment. Most of that is not Sauce Labs' fault, but the things I just mentioned are things they could do to help deal with that struggle.
Wang Dayong - PeerSpot reviewer
Easy to integrate and has a plug-in that supports both C and C++ languages
The product provides false reports sometimes. It also fails to understand the context of the code. It reports that a line of code has issues without considering its relation with the previous line. The product should improve the report quality. While it asks us to improve the code quality, it would be good if it also suggests how to improve the quality.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"From an infrastructure support perspective, the number of VMs, browsers installations and versions that we would be maintaining without Sauce Labs would be a lot. This includes not only the infrastructure costs, but also the maintenance costs and people's time. The labor cost associated with maintaining all of that would be considerably high. In terms of efficiency, having concurrent VMs with various browser combinations available has allowed us to run multiple executions by all our teams."
"Sauce Lab analytics helped us to get detailed knowledge on test cases execution and logs."
"The Failure Analysis feature is really important for us, one of the most important aspects. What is the root cause? Is it because we have a defect or is it that we have a test case that we need to fix or modify? The Failure Analysis is one of the main functionalities that I am exploring all the time in Sauce Labs... The Failure Analysis helps us to discover which test cases we need to work on."
"The custom capabilities that can be provided to Sauce Labs VMs during automated testing sessions are a valuable option for experimental or niche testing."
"Live device testing. As we all know, It's really hard and challenging to find/purchase many real devices to test because it will be costly and not all the team can be able to purchase all of the devices out there. We used to have a lot of real devices under our labs. However, it is really time-consuming to maintain those devices and make sure they are up to date with the testing requirements."
"It runs on the cloud, so you don't have physical setups to run all of this."
"Supplying devices to a testing team of possibly close to one thousand testers and developers is a great undertaking but Sauce Labs has made this very easy and a welcomed solution."
"One of the most valuable features is that we do not have to have the cross-platform testing vehicles in-house. Sauce Labs gives us the ability to test across platforms and that really helps give us confidence in our products."
"It is very good at identifying technical debt."
"Can tweak rules and feed them into our build pipelines."
"It's a great product. If you are in a hurry and just want to focus on the functional requirements of any kind of project, SonarQube is highly helpful. It enables the developers to code securely. SonarQube has a Community edition, which is open source and free. There are also three proprietary or paid versions: Enterprise edition, Data Center edition, and Developer edition."
"The customizable dashboard and ability to include results and coverage from unit test and other static analysis code tools."
"Using SonarQube benefits us because we are able to avoid the inclusion of malware in our applications."
"It is a very good tool for analysis despite its limitations."
"I like that it has a better dashboard compared to Clockwork. It's also stable."
"The product is simple."
 

Cons

"Sauce Labs can include new technologies like generative AI capabilities."
"There have been various times throughout the last month or so where the service has gone down during business hours."
"When we were in development, it was a bit of a pain because we have onshore and offshore development. One of our development shops is in India, and we were running tests over there. When some of the users tried to log in, it was slow for them or we didn't have enough licenses. That was during the core development before we even launched."
"Overall, I think Sauce Labs provides us with a valuable tool and resource. As far as what could be improved, I would say the overall test execution time. Some of the calls take a bit longer than I expect, for example in web browser tests; while the execution time isn't obnoxious, it could be improved so that overall tests/test suites finish faster."
"On a rare occasion, I will come into a ticket where a customer will have reached out to me after reaching out to Sauce Labs, saying, "Sauce Labs doesn't understand what I am going through. They are not being very helpful." So, I try to do clean up there. Outside of those extremely rare occasions, I have only had one or two of those support issues."
"Another feature that could still be improved on is more error clarity. Sometimes when running automated scripts the test will fail on the device side instead of the script and errors only show a 500 try again message instead of a detailed script that could of a been a timeout error from the code."
"I would like to see improved network connectivity and it should allow playback for native apps."
"Running tests in the SauceCloud can take longer than running in a local environment."
"SonarQube could be improved by implementing inter-procedural code analysis capabilities, allowing for a more comprehensive detection of defects and vulnerabilities across the entire codebase."
"It would be better if SonarQube provided a good UI for external configuration."
"Dynamic scanning is missing and there are some issues with security scanning."
"SonarQube's detail in the security could be improved. It may be helpful to have additional details, with regards to Oracle PL/SQL. For example, it's neither as built nor as thorough as Java. For now, this is the only additional feature I would like to see."
"I have found this solution creates more noise than competitors."
"SonarQube needs to improve its ease of use, integration with third-party platforms, and scalability."
"In terms of analysis and findings, other tools provide more in-depth insights and detailed steps to mitigate or handle issues."
"We have tens of millions of code to be analyzed and processed. There can be some performance degradation if we are applying Sonar Link to large code or code that is complex. When the code had to be analyzed is when we ran into the main issues. There were several routines involved to solve those performance issues but this process should be improved."
 

Pricing and Cost Advice

"We pay for a specific number of VMs."
"​Now that we have an enterprise license, we no longer have to worry about minutes each month!​"
"The number of concurrent VMs that Sauce Labs provides depends on your purchase license level."
"Go ahead please. Try it at a smaller scale."
"It could be less like pay-per-use with a lower rate."
"We have an enterprise account; it has worked great for our needs."
"The pricing is definitely on the higher end, and there are other options that are more cost-effective."
"With respect to pricing, they did a bundled discount because we went with Sauce Labs for both mobile and browser. They were very competitive on pricing and provided a bundle discount for us as a larger customer."
"I use the full trial version of SonarQube."
"SonarQube is an open-source product that can be used free of charge."
"We are using the community version of the solution and we plan on purchasing licenses for the upgraded version soon. There is a limitation on how many lines of code can be scanned and this is why we are going to purchase a license for an increased amount."
"I requested this license for one million lines of code and they accepted this."
"I was using the Community Edition, which is available free of charge."
"SonarQube price is a little bit higher than Kiuwan's. Kiuwan also gives a little bit of flexibility in terms of pricing."
"We did not purchase a license (required for C++ support), but this option was considered."
"The free version of SonarQube does everything that we need it to."
report
Use our free recommendation engine to learn which Functional Testing Tools solutions are best for your needs.
830,824 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
19%
Computer Software Company
15%
Manufacturing Company
6%
Retailer
6%
Financial Services Firm
17%
Computer Software Company
15%
Manufacturing Company
13%
Government
6%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

What do you like most about Sauce Labs?
It has significantly enhanced our testing accuracy by approximately 50%.
What needs improvement with Sauce Labs?
Sauce Labs can include new technologies like generative AI, which can reduce the human effort in writing test cases. For example, in my current project, we reduced the time it took to complete user...
What is your primary use case for Sauce Labs?
I work as an automation engineer using Selenium WebDriver with Java, and API automation using Rest Assured with Java. I have also worked with Docker integration on AWS. Additionally, I have experie...
Is SonarQube the best tool for static analysis?
I am not very familiar with SonarQube and their solutions, so I can not answer. But if you are asking me about which tools that are the best for for Static Code Analysis, I suggest you have a look...
Which gives you more for your money - SonarQube or Veracode?
SonarQube is easy to deploy and configure, and also integrates well with other tools to do quality code analysis. SonarQube has a great community edition, which is open-source and free. Easy to use...
How would you decide between Coverity and Sonarqube?
We researched Coverity, but in the end, we chose SonarQube. SonarQube is a tool for reviewing code quality and security. It helps to guide our development teams during code reviews by providing rem...
 

Also Known As

No data available
Sonar
 

Learn More

 

Interactive Demo

Demo not available
 

Overview

 

Sample Customers

Salesforce.com, Mozilla, Zendesk, Puppet Labs, Twitter, Bank of America, Eventbrite, Bleacher Report, Okta, Intuit, Travelocity, Sharecare, CapitalOne.
Information Not Available
Find out what your peers are saying about Tricentis, OpenText, BrowserStack and others in Functional Testing Tools. Updated: December 2024.
830,824 professionals have used our research since 2012.