What is our primary use case?
I use ReadyAPI for API testing. We have microservices, and we are using it for the API testing on them.
How has it helped my organization?
We are using it for testing. We test all the API calls. Without it, we cannot release anything. It helps us find issues with the implemented APIs.
What is most valuable?
It can create stress tests very fast, and some features help you do it fast.
It has nice things, like making data-driven testing that is fairly quick and easy to do.
The solution is stable.
Its basic pricing is fair.
It's scalable.
What needs improvement?
I don't like how they don't have a clear way to manage tests between multiple projects. You cannot have a massive project with all the tests. With multiple projects, you have to get the API created all over again, and I'm not aware of any other solution in case you're using an APIX where you have to define that in all the projects that you are using. That's kind of a pain. You have to keep defining it, and only then can you use it. I like to break up the projects into something that's manageable. However, it makes that a little challenging.
Sometimes, in trying to make creating tests faster, there are issues. It makes it easier to search and replace variables or anything if I'm writing it and using, say, any of the programming languages. However, with this one, it is very hard. You cannot search for a specific test. Any of those things are impossible. That is one of the big issues that I don't like. I'd often wish I could transition to something like Python or things like that.
In the next release, I would like to see a way by which we can share the code between multiple projects. Each project is an XML file. I cannot use code more than once unless I go and manually copy the code I create in one project into a different one. I'm not aware of any better way to do that.
The solution can be a little pricey.
For how long have I used the solution?
I've used the solution for over six years.
What do I think about the stability of the solution?
The stability is very good. There are no bugs or glitches. We haven't seen it crash or freeze.
What do I think about the scalability of the solution?
Our system is quite scalable. We have many things that handle auto-scaling groups, which scales quite well. We have quite a bit of devices, millions of devices, and each time it scales very well. There's no problem with it. We have never had problems due to an area that didn't allow us to scale.
There may be 50 million devices talking to our cloud. It's quite sizeable.
I'm not sure if there are plans to increase usage.
We are currently servicing ourselves and our customers well. I'm not aware of any plans to increase. I'm not aware of any growth plans.
How are customer service and support?
We are supporting the solution. Our engineers are supporting everything, so there is no separate support group or outside assistance.
If our team needs help, we get it through SMartBear. It's proper. You have to write to them and wait for a reply. It's not bad. With support, we have gone for a single-user license, so given that this is the best they can do, it could be better in that we could pay more and get more service. I wish I could have someone to talk with just to figure out how I can solve some of the problems I've had.
I haven't had any user group meetings or anything like that. They don't do any of those things. Occasionally they will have a webinar that might cover an aspect of the solution. Sometimes you're so busy you don't have time to go to those things.
Which solution did I use previously and why did I switch?
We've always used this solution. We started by using this product.
How was the initial setup?
Everything is deployed on AWS. There is a deployment engineer who's doing the deployment. I don't know too much about it. We don't use anything like CD, CI/CD, or anything like that since we don't have the people to do those things. It's all manual. We have just one person (that's an architect) that handles deployment and maintenance.
Each deployment could take anywhere from 15 minutes to a half hour.
What was our ROI?
In terms of ROI, in our situation, I'm the only one using it. It helps me for my purposes and this is precisely what we are using it for, for API testing, which actually helps us find issues. I'm not sure what the ROI would be.
What's my experience with pricing, setup cost, and licensing?
Desktop licensing is not bad. However, if you go higher than that, they're a little pricey, I would say.
For each license, they charge the same amount, which is less than $1,000 for each desktop license.
What other advice do I have?
I'm a customer and end-user.
I'm using an installed version. It's installed on my desktop. We're using the most up-to-date version.
I'd advise potential new users to look at many other tools. Do some detailed analysis of things like Postman and those other tools too, and then if you have more technical experts, try Python or others, including JavaScript-based ones. See which would be best. Consider how you would use it as well. That way, you'll be picking the right tool.
I'd rate it five out of ten.
Disclosure: I am a real user, and this review is based on my own experience and opinions.