Our company is a customer of Selenium and I work in QA.
Assistant QA Manager at Techment
Purely API so integration is possible with any tool; web scraping is a key feature
Pros and Cons
- "Ability to integrate with every other tool."
- "Could have additional readability and abstraction."
What is our primary use case?
What is most valuable?
One of the most valuable features of this solution is Web Scraping although overall I think every single feature of Selenium is valuable because it's purely API so we can integrate it with any other tool.
What needs improvement?
In terms of improvement, I think there could be additional readability and abstraction in the solution, similar to the way other frameworks function. The solution could possibly use a more generic framework with more machine learning. If the community or IT companies had the budget, they might be able to work on that but it would definitely improve the solution, particularly in areas such as image comparison and image recognition. Machine learning capability would enable a self-healing capability in terms of locators. Selenium is not a magician, you need to provide instructions in order for it to identify any element in the web. That would really be an advantageous feature. Jason Arbon, CEO at test.ai, demonstrated this in Appium, which derives from Selenium.
I'd also like to see a one-click install package. For now, I have to use TestNG, then Java, and then build them back. That could be simplified.
For how long have I used the solution?
I've been using this solution for almost five years.
Buyer's Guide
Selenium HQ
October 2024
Learn what your peers think about Selenium HQ. Get advice and tips from experienced pros sharing their opinions. Updated: October 2024.
816,406 professionals have used our research since 2012.
What do I think about the stability of the solution?
It's a pretty stable solution but we have to be careful and make sure we're using what has been released. We need to know which version to use and make sure it's the latest one so we know it will be stable.
What do I think about the scalability of the solution?
We are a small setup so have four or five users in the company. I've worked in bigger companies where thousands have used the solution on a daily basis, so it's very scalable.
It's not the solution that deals with scalability, it's the cloud or a virtual system that enables scaling. If there are 1,000 test cases that I want to commute in an hour, then sometimes the reports can be messy.
How are customer service and support?
We use Selenium forums most of the time and we get most of our answers from there. There are multiple people online providing answers. Selenium does provide a service but we don't use it because we are self-sufficient in that respect.
Which solution did I use previously and why did I switch?
I have used Coded UI from Microsoft, which I believe will be deprecated some time this year. That was a very good solution. Before that, I also used HP QTP. Both of those are easier solutions than Selenium but also quite expensive.
How was the initial setup?
The very first setup several years ago was quite complex, nowadays it is simple. Generally we use Maven, so it is simply importing and doing the setup. If I already know the settings, it can be deployed within half an hour. It depends on the system configuration so there can be issues sometimes. Setup can easily be done internally and if there are good community people there could be a one-stop solution layer where installation is one click. Maintenance is only required when there are updates or API changes.
What other advice do I have?
The solution requires good understanding of Python, Pearl or Java and it's important to use the documentation. It would take a few hours of watching video sessions or reading the documentation to get started. It also helps to have an understanding of how API works, the architecture and how Selenium interacts with browsers. Having the background helps to design something with more features.
I would rate this solution an eight out of 10.
Which deployment model are you using for this solution?
Hybrid Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Software Engineer at a financial services firm with 1,001-5,000 employees
Open-source and flexible but it needs more information in regards to some testing
Pros and Cons
- "The solution is very flexible; there are different ways of using it. It's open-source and has a lot of support on offer."
- "The solution does not offer up enough information in regards to personality testing."
What is our primary use case?
We primarily use the solution for automation testing.
How has it helped my organization?
Nowadays we are using the solution to allow old solutions to run through it. This way, we don't need to go check functionalities created previously. We just run the automation. In just one click you run the automations through. It saves a lot of time and allows us to focus on other things.
What is most valuable?
The solution is very flexible; there are different ways of using it. It's open-source and has a lot of support on offer.
It's excellent for analysis automation testing.
You can use the solution on many different browsers as well.
What needs improvement?
The solution need to offer up much more information in regard to performance testing using selenium.
For how long have I used the solution?
I've been using the solution for eight months.
What do I think about the scalability of the solution?
The solution is very scalable. You just have to have an understanding of how you are going to use it before you proceed. We do plan to increase usage in the future.
How are customer service and technical support?
Technical support is very good; I'd rate it seven or eight out of ten.
Which solution did I use previously and why did I switch?
We also use ReadyAPI alongside Selenium. We're working to integrate the two to have an overall more powerful performance.
How was the initial setup?
The initial setup was straightforward, however, it does depend on what the organization's requirements are. Deployment can take up to one or two months.
What's my experience with pricing, setup cost, and licensing?
The solution is open-source; you don't have to pay a licensing fee.
What other advice do I have?
We're using the on-premises deployment model.
It is an open-source solution and you are able to build vertically. There is also lots of support pertaining to Selenium such as videos on YouTube. It's very easy to integrate on different platforms.
The solution is constantly being updated and advanced; it's very reactive and in a constant state of change.
I'd rate it seven out of ten.
Which deployment model are you using for this solution?
On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Buyer's Guide
Selenium HQ
October 2024
Learn what your peers think about Selenium HQ. Get advice and tips from experienced pros sharing their opinions. Updated: October 2024.
816,406 professionals have used our research since 2012.
Independent Consultant/Owner at a tech consulting company with 51-200 employees
It has the ability to test on all of the major web browsers.
What is most valuable?
The ability to test on all of the major web browsers.
How has it helped my organization?
I’ve used Selenium in multiple ways of the years. In one case I was working on a web site that got updated once a week. Mostly by others. Every week we would find out that a page changed that we were not expecting because we had changed included content, not knowing it was appearing on another page. I convinced management to allow me to write a script that went to each page on the production site and compare the page to the stage site. I reported the changes to management so that if they didn’t know about them, they were aware of the change.
On another site, we used Selenium to do basic application level testing. Just about the time I would start to think I was wasting my time, the test would reveal a problem that needed to be addressed.
What needs improvement?
Can’t think of anything I would change.
For how long have I used the solution?
I've used it for at least five years.
What was my experience with deployment of the solution?
There's never been an issue with deploying it.
What do I think about the stability of the solution?
As the various browsers change, tests stop working. But that can hardly be blamed on Selenium. Every problem I've ever had has always been answered by “Get the most recent version of Selenium.”
What do I think about the scalability of the solution?
I've never had a problem scaling the tests.
How are customer service and technical support?
It is open source, I don’t think this applies. The documentation could use some work but there are books that fill this hole.
Which solution did I use previously and why did I switch?
I had used TestComplete at one point a very long time ago. What I didn’t like about TC is that it was a complete development environment, which I didn’t really like. Selenium gives me the ability to write my test using the programming environment I am already familiar with.
How was the initial setup?
The initial setup is pretty straightforward, but when you branch into using the Selenium Grid, things do get a bit more complex. It is all pretty easy now that I know how.
What about the implementation team?
I implemented it myself using search engines and trial and error.
What's my experience with pricing, setup cost, and licensing?
It’s free. And relatively easy to get setup.
What other advice do I have?
Learn how to use the “Page Model” approach to creating tests. If you code direct to the Selenium API and don’t using the Page Model, as things change in your web application, it will become more and more difficult to update your test to reflect the changes.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
QA Lead at a tech company with 501-1,000 employees
It allows us to verify user flows effectively and very easily. I can use any web browser to assert user flows.
Valuable Features
It allows us to verify user flows effectively and very easily. I can use any web browser to assert user flows.
Improvements to My Organization
It's helped us get good coverage with functional regression tests, reducing the reduction of manual effort to sign off on every release. We can now do so in just one day to sign off a regression test as compared to 4 day before we had automated tests.
Plus, as the regression runs are invoked on every commit, the tool has also reduced the number of issues introduced by regressions and has highlighted the regression issues on every commit/push. This allows us to get very early fixes and reduces the risks associated with changes and releases.
Room for Improvement
Overall, there aren't any areas for improvement. However, there are some things you have to do make make effective use of the tool. Make sure the language you select to work with is the same as the language your applications is developed in. Also, make sure you use Selenium Grid to get the test and suites to run in parallel.
Deployment Issues
We've had no issues with deployment.
Stability Issues
Stability has been fine for us.
Scalability Issues
It scales without issue.
Customer Service and Technical Support
Customer Service:
It's open source, so there's no customer service.
Technical Support:It's customer service, so we provide our own technical support.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Automation Lead - Robotic Process Automation at a financial services firm with 501-1,000 employees
There is a lot of community support available but it needs standardized frameworks to build automation
Pros and Cons
- "I like that it is a robust and free open source. There is a lot of community support available, and there are a lot of developers using them. There's good community support."
- "There should be standardized frameworks to build automation."
What is most valuable?
I like that it is a robust and free open source. There is a lot of community support available, and there are a lot of developers using them. There's good community support.
What needs improvement?
In terms of improvement, there should be standardized frameworks, which do not exist. Currently, you have to first sit down and look inward. This function is provided by some tools like Katalon.
There should be standardized frameworks to build automation.
For how long have I used the solution?
I have been using Selenium for five to six years.
We also use Sauce Labs. We do testing on various versions of browsers, and various operating systems for Android and Apple. So Sauce Labs provided that capability, where we can easily scale up our testing to test on various versions.
What do I think about the scalability of the solution?
The scalability and stability are quite good. It is easily scalable. With a few pieces of code, it's scalable.
How are customer service and technical support?
We have interacted on the Selenium forums a couple of times but never contacted the technical support.
Which solution did I use previously and why did I switch?
We also use Sauce Labs.
How was the initial setup?
We set up the entire framework around how the tests would be and different class structures. Then we evaluated how to construct labs and how to title execution and stuff like that. It took us good four to five months of two or three people working on it, to set up a robust framework.
What other advice do I have?
If you are using it for the automation test, automation is generally good. If you have an experienced developer, it will be really good to deploy the open-source frameworks for Selenium.
I would rate it a seven out of ten.
Not a ten because they don't come loaded with the frameworks or different framework options. You have to build it from scratch. The build-in comes with a lot of networks and libraries and stuff. You still need to build that framework before you start writing the code
They try to come up with new features. I think they're in a very good space.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Project Engineer at Mathworks India Pvt Ltd
We started automating the browser and have done load testing for light applications.
Pros and Cons
- "Selenium web driver - Java."
- "Handling frames and windows needs to be improved."
What is most valuable?
Selenium web driver - Java.
How has it helped my organization?
As traditional load testing we use some expensive tools available in the market, but with the help of Selenium we started automating the browser and done load testing for light application.
What needs improvement?
Handling frames and windows needs to be improved.
For how long have I used the solution?
I've been using it for one year.
What was my experience with deployment of the solution?
No issues encountered.
What do I think about the stability of the solution?
No issues encountered.
What do I think about the scalability of the solution?
No issues encountered.
How is customer service and technical support?
9/10
How was the initial setup?
Straightforward by using Selenium IDE.
What about the implementation team?
We did an in-house implementation, doing our R&D over the internet.
What was our ROI?
Hot tool in market. Makes thing easier to use and implement. Demand increases cost.
What's my experience with pricing, setup cost, and licensing?
Since it is an open source. It is free to use. However my company see it as the future of load testing.
What other advice do I have?
You'll have a lot to do when automating many different applications. Just practice.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Test Automation Project Lead at a tech services company with 1,001-5,000 employees
It has good support to extend and integrate with other automation tools like Jmeter & OWASP ZAP.
Valuable Features:
- It's open source tool (cost effective)
- More Test Coverage through Multiple browser support(Chrome,FF,IE9,10,11,Opera,Safari and Edge(recently)
- Scalable to extend and integrate with other Automation tools like Jmeter & OWASP ZAP, thus enable team to perform Fuctional, NonFunctional test(Performance, Security)
- Can be integrated with CI tools like Jenkins
- Can be integrated with builder tools like Maven & ANT
- Can be extended to cloud environments (sauce labs)
- Multiple platform support like windows, Linux and MAC
- Can be used with different Automation frameworks like TDD,BDD and Hybrid
- Remote script execution possible with Grid & node setup
- Less Turnaround time with Parallel Executions
- Easy to Learn & Mastering
- Huge user community base and support
- Support for version control tools like SVN and Git
- Headless Browser support using HTMLUnit & PhantomJS drivers
Improvements to My Organization:
It is an awesome tool to use with great ROI, we have been using this tool extensively in most of our projects to reduce the manual regression efforts and to prevent production defects. Another beauty of this tool is to extend and integrate with other functional & non functional tools(Jmeter, OWASP ZAP, Appium ..etc.)
Recently we have implemented the Extended Reporting to support rich reporting structure with Charts,Dashboards that would be easy for stakeholders to Analyze and arrive at decisions.
Room for Improvement:
Compatibility issues with newer versions of browsers (IE & Firefox) and latest server versions, but this can be addressed with some workarounds.
Handling Windows based dialogs (or) performaning Non browser action can bit challenging, so far we are using AutoIT tool to perform this.
Rather QTP or any other Commercial tools, Selenium expects more Techinical(Prograaming) expertise, but other end this feature makes selenium more flexible
Deployment Issues:
We had compatibility issues with some newer versions of browsers.
Stability Issues:
We've had no issues with stability.
Scalability Issues:
We've had no issues with scalability.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Lead Automation Architect at a retailer with 1,001-5,000 employees
We are now able to execute 3000 test cases in less than one hour.
What is most valuable?
- Videos of test cases
- Scalable multi threading test execution
How has it helped my organization?
We are now able to execute 3000 test cases in less than one hour. This is a great milestone for us.
What needs improvement?
It needs more support for mobile devices and also on testing web services.
For how long have I used the solution?
I've used it for four years.Videos of test cases + Scalable multi threading test execution.
What was my experience with deployment of the solution?
We've had no issues with deployment.
What do I think about the stability of the solution?
We've had no issues with stability.
What do I think about the scalability of the solution?
We've had no issues with scalability.
How are customer service and technical support?
It's open source and therefore there is no customer support.
Which solution did I use previously and why did I switch?
We used a different product that was not open source. We wanted to use open source.
How was the initial setup?
It was not too complex, however, it would be complex for someone who doesn't know much about automation.
What about the implementation team?
I implemented it through an in-house team. My advice would be to foresee all the problems that you might run in to in the future and design the framework based on that.
What other advice do I have?
Make sure you get the set-up right initially.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Buyer's Guide
Download our free Selenium HQ Report and get advice and tips from experienced pros
sharing their opinions.
Updated: October 2024
Popular Comparisons
Tricentis Tosca
OpenText UFT One
BrowserStack
SmartBear TestComplete
Sauce Labs
BlazeMeter
Worksoft Certify
LambdaTest
Ranorex Studio
Testim
ReadyAPI
OpenText UFT Developer
Parasoft SOAtest
Visual Studio Test Professional
Oracle Application Testing Suite
Buyer's Guide
Download our free Selenium HQ Report and get advice and tips from experienced pros
sharing their opinions.
Quick Links
Learn More: Questions:
- How do I choose between Selenium HQ and Eggplant Digital Automation Intelligence?
- Cross-Platform Automated Testing Tool
- Anyone have a good example of a Test Automation Business Case?
- When evaluating Functional Testing Tools, what aspect do you think is the most important to look for?
- SOAtest vs. SoapUI NG Pro?
- What is the best automation tool to test dynamic data?
- Tosca Testsuite Version 10.0
- What is the best tool for SAP testing?
- Do you have an RFP template for Testing Tools which you can share?
- What are some common causes for software failure?