Postman vs Runscope comparison

"The solution is open-source and does the work required for day-to-day API testing activities."

"Postman is open-source and free to use."

"The API testing features are valuable."

"What is most valuable for me is that we can create and share collections between the team members."

"The user-interface is very good."

"It's easy to see different versions of responses."

"The most valuable features of the solution are that it is easy to use and user-friendly."

"This product deserves an eight out of ten."

"When it's a problem on our side, the server is down, or there is a lack of memory, the first thing to break is the API, because the calls can't be processed. So we know exactly at that moment because we receive notifications, and we can take action. It doesn't only notify us of the type problem, but it also links it to our servers."

"It uses JavaScript which is easy."

"The feature of automatically executing tests at a predefined time interval is great as we can be continuously testing our end-points before and after builds are deployed."

"Valuable features include: Being able to add tests as sub-tests in a parent test for regression testing; notifications for tests that pass/fail; being able to customize expected results with assertions; being able to set tests to run daily."

"The schedule is definitely the most valuable. Also, being able to check the JSON attribute values is helpful. We always check the attributes. Finally, the notifications are helpful as well."

"You can run it off the cloud and against different data centers. That's one of the plus points for most people for this product, as opposed to some other solutions."

"This solution has improved our responsiveness to issues in both production and non-production environments. Through integration with Slack, our development and DevOps teams are quickly aware of issues related to new changes deployed to non-production environments, which tightens our feedback loop during testing. Through integration with PagerDuty, our DevOps resources are able to reduce the adverse impact of a given production issue."

"Tests are per-step configurable with script capabilities and support for token-based authentication using variables. Configurable test frequency and integration with both Slack and PagerDuty for alerting our DevOps team are also important. General use of the dashboard by multiple team members is also valuable."

"One of the features that is missing in Postman is reporting; it's very basic."

"If there is any way to have a record and playback feature through UI, as we do in Selenium and IDEs such as Eclipse, it would be great."

"The solution has some user interface difficulties when conducting environment collections."

"Integration should be improved with our continuation system because we use Azure DevOps separately."

"The solution could be more user-friendly."

"We'd like to see some better UI in newer versions."

"I would like to see improvements in the maintenance of the scripts and their collections. It is really painful that the user cannot drag and drop. It was also painful to create the standard suite of operations for the product. I am not sure if this is improved in the tool’s latest versions. The maintenance of the complex scenarios prompted us to use the solution only for unit testing. In the future, we may switch to the k6 framework."

"One of the primary challenges with Postman is handling authentication issues, especially relating to tokens and passwords."

"Currently, we can only schedule to the nearest five minutes, one hour, two hours, etc. If we could set up the exact time that we want it to run, that would be good because sometimes we have one service that crosses another service."

"Needs the ability to create code which runs before and after API tests."

"If triggering test bucket via trigger API, there is no option to see if the tests which were triggered passed or failed."

"The initial setup included a lot of repetitive manual work."

"There are not many options for scalability."

"I would like to see easier integration and display of test results so that the data could be shared via a dashboard within our company. (Some integration is possible, provided you use one of the supported platforms)."

"It would be nice to be able to generate API documentation."

"File upload is a big part of the products that we test. The lack of file upload in Runscope requires us to still use UI (Selenium) automated tests for these scenarios."

"Its price is moderate as compared to other competitors. The version that we are using is not open source, so it is not free."

"We are using the free version that is available."

"The solution is free for individuals, but for companies that use it across the organization, you have to pay per user."

"We are currently using the free version, but we have plans to buy a license."

"Postman is an open-source product. It is free to download from Google."

"The solution has moderate pricing."

"Unlike APIs, the solution does not require a license."

"It is free."

"Pricing is fair."

"The price for the product is very reasonable for a team of more than four to five members."

"Runscope pricing is unbeatable"

"Having the different plans organized by team size, buckets, and requests per billing period works for our needs. Larger companies may need to take a close look at these elements."