Postman vs Runscope comparison

"The most valuable feature of this solution is Collections."

"Postman is easy to use and enables us to test all possible API testing scenarios."

"The solution collects scenarios and allows for testing SOAP API, REST API and API automation at the same time."

"I like that it is very easy to use. I also like the automation feature."

"We can also submit requests multiple times and it allows us to capture the response each time by using utility scripts."

"Postman uses the DRY framework of JavaScript and that framework is easy and a good way to put assertions on responses."

"The environment variables are a valuable feature because I can easily switch them and see all the developments in different cycles and stages."

"The user-interface is very good."

"We have the ability to populate environment variables using scripts. This allows us to keep the configuration mostly dynamic and avoid a lot of manual updates when something changes."

"It helps us verify that production deployments do not break the features our customers use."

"It is a cloud-based environment for building and executing tests, which allows me to focus on building, running, and reviewing test results."

"This solution has improved our responsiveness to issues in both production and non-production environments. Through integration with Slack, our development and DevOps teams are quickly aware of issues related to new changes deployed to non-production environments, which tightens our feedback loop during testing. Through integration with PagerDuty, our DevOps resources are able to reduce the adverse impact of a given production issue."

"We can receive an email and slack notifications if tests are failing/passing."

"Tests are per-step configurable with script capabilities and support for token-based authentication using variables. Configurable test frequency and integration with both Slack and PagerDuty for alerting our DevOps team are also important. General use of the dashboard by multiple team members is also valuable."

"We utilize modular tests based on environment variables. These have saved QA a lot of time when setting up our back-end automation."

"The schedule is definitely the most valuable. Also, being able to check the JSON attribute values is helpful. We always check the attributes. Finally, the notifications are helpful as well."

"Postman needs more advanced data-driven testing."

"The solution is quite complex partly because the UI needs simplification."

"Should have a more improved easy-to-use interface."

"There is no support for the testing of the SOAP APIs."

"It would be better if we could integrate programming languages like .NET, Java, and JavaScript. It could also be more user-friendly."

"We cannot see transaction times in the product."

"The performance needs to be improved."

"I have display issues in my Windows that need to be fixed."

"We would like the ability to configure Runscope behavior when a given test has its schedule modified. That is, in a non-production environment, we often need to pause a test (either by removing it from the schedule or adjusting its frequency) and this results in the automatic kick-off of this test in all other environments. We would like the ability to simply pause a test for a specific shared environment without causing additional tests to be started."

"the built-in editor for the scripts can be improved a lot. Instead of making such a basic editor, maybe include a little more so it is easier to look at things and debug."

"Navigation can be a little tricky when changing run environments and switching between test run results and editing the tests. It would be nice if you could switch the environment for all tests in a Bucket to run, rather than having to change each test environment."

"There are not many options for scalability."

"I would like to see easier integration and display of test results so that the data could be shared via a dashboard within our company. (Some integration is possible, provided you use one of the supported platforms)."

"It would be nice to be able to generate API documentation."

"We would like to have an improved ability to share a set of tests across different environments (e.g., dev, stage, and prod)."

"Needs the ability to create code which runs before and after API tests."

"We are currently using the free version, but we have plans to buy a license."

"The solution is free for individuals, but for companies that use it across the organization, you have to pay per user."

"This solution offers a free version."

"We do not pay any money for Postman."

"The solution has a licensing fee which might be prohibitive."

"This tool is open-source and free to download and use."

"It is free."

"This is an open source solution."

"Having the different plans organized by team size, buckets, and requests per billing period works for our needs. Larger companies may need to take a close look at these elements."

"The price for the product is very reasonable for a team of more than four to five members."

"Runscope pricing is unbeatable"

"Pricing is fair."