Qualibrate vs k6 Open Source comparison

"The tool's big advantage is that it is more performance-test oriented for experienced testers who know what they are doing. In a normal working setup, performance engineers frequently work with DevOps and development teams. For these teams, k6 Open Source's syntax is much simpler and easier to understand and apply in the working process."

"The standout feature of k6 is its strong focus on API performance testing."

"It is the principle functionality that we're leveraging, which really can be defined as recordings and playbacks. So, you record the scripts that you want to execute and you also want to be able to playback. So, these are the features that we are largely leveraging. There are flows and scenarios, and they are the design aspects that fit within the playback and the recording solution. For me, they are the core of Qualibrate, and that's what we're using."

"The most valuable feature is that it's user-friendly."

"The widget's ease of use is the most valuable, which means it allows you or business people to record the automated test scripts. In most cases, it is really good because it is the business people who actually know how the system is being used. The simplicity of the design is valuable, where you can record your transactions, then create your automated scripts. You can automate it at the same time, and the automation features are cool."

"What Qualibrate makes very easy to do is to record a process flow. Within five minutes you have a clear document produced by Qualibrate. Instead of using Word, and copying and pasting pictures into it from printscreens, within five minutes what you have was easy to make and it's easy for users to use."

"We use the solution’s Test Planning & test Execution Scheduling features, and they are very important. They are easy to work with. We use SAP Solution Manager, and Qualibrate works with it, enabling us to manage all our tests, taking them from Solution Manager directly into Qualibrate."

"One area where k6 could improve is by introducing a GUI similar to JMeter."

"Not everything in SAP works well with Qualibrate. There is a development tool called xpath and you have to program it. We always thought it wouldn't be necessary to program it with Qualibrate, that everything could be solved by Qualibrate without programming, but you have to program some things. Using xpath is more complicated, and not easy for everybody. It would be helpful if there were a no-code solution for this."

"What could be improved would be the intuitiveness of the reporting engine. It does have reporting, i.e., a dashboard, but it is preconfigured, predefined KPIs and datasets. That could be improved because the datasets don't have descriptions, so you really need to know what you're doing. Whereas, it would be great if it could have more descriptions and be easy to build your own KPIs."

"What I would really like to see is if you are running scripts in Qualibrate, and there is a defect, then you can have it automatically raise a defect in your own ticketing system."

"We had an issue with SAP when using PDF forms. That was something that was not supported by Qualibrate, but we solved that issue by choosing another solution. That was the only wish we had with Qualibrate."

"There is a module that we would like to have. We would like Qualibrate to design a requirements module so that we can design our testing, our flows, and our scenarios based on our actual requirements. Right now, we're doing that, but we're having to do it outside of Qualibrate. For example, in Excel, we might have a list of 50, 60, or 70 different requirements and combinations of tests that need to be executed, and since that module doesn't exist in Qualibrate, we're doing it offline. We have already vocalized that wishlist to them, and they have acknowledged it, but I have no idea when they're going to get around to deploying something like that. It is probably number one on our list."

"Automated testing is not cheap. But other companies, for example, Panaya, required a minimum of 10 licenses. Qualibrate allowed us to start small, with three licenses, with a price that was competitive within the market."

"Qualibrate is realistically priced. I can't compare it because I haven't looked at other tools, but I think it is good. What I like is you can simply add new users, if you want. It has a license model that comes with different types of users, which I think makes sense."

"We signed a three-year contract and the pricing is in line with our expectations."

"I compared the prices of the 15 solutions we looked at. Qualibrate was the most valuable because it could be integrated with SAP Solution Manager."

"We probably have 10 licenses, but I don't know what are the costs or anything like that."