Postman vs Runscope comparison

"The solution is stable."

"In Postman, we have an option to directly import a call, make it a Postman collection, and execute it in a batch. This feature is very useful. It saves a lot of time. The manual effort is also reduced when we can just pick it in a Postman collection and then run and execute it to get the results."

"The most valuable features of the solution are that it is easy to use and user-friendly."

"The developers put the API in a common workspace which is a nice feature. It makes things much easier and faster to start testing."

"It is beneficial to have flexibility, especially with API chaining."

"We use it for REST API testing. Feature-wise, it is pretty lightweight. It is pretty fast, and we don't have to do a lot of things. We can just simply go and post our endpoint, and it gives different kinds of authorizations. We usually use authentication 2.0, which is the most common industry practice. So, it has the support for authorization through 2.0."

"It is easy to install, as well as to learn, particularly for new users, even if they are not developers."

"It is nice to have different workspaces. You have your personal workspace, and then you have a team workspace. In general, I like its UI. It is quite cool."

"You can run it off the cloud and against different data centers. That's one of the plus points for most people for this product, as opposed to some other solutions."

"Environment initial variables allow our team to run tests against multiple environments on the fly."

"The feature of automatically executing tests at a predefined time interval is great as we can be continuously testing our end-points before and after builds are deployed."

"Valuable features include: Being able to add tests as sub-tests in a parent test for regression testing; notifications for tests that pass/fail; being able to customize expected results with assertions; being able to set tests to run daily."

"It has a relatively simple user experience."

"It is a cloud-based environment for building and executing tests, which allows me to focus on building, running, and reviewing test results."

"Tests are per-step configurable with script capabilities and support for token-based authentication using variables. Configurable test frequency and integration with both Slack and PagerDuty for alerting our DevOps team are also important. General use of the dashboard by multiple team members is also valuable."

"The schedule is definitely the most valuable. Also, being able to check the JSON attribute values is helpful. We always check the attributes. Finally, the notifications are helpful as well."

"The request encryption could be one thing on which they can work a little bit. If we don't want to expose our production data but we still want to test our APIs on the production data, there should be a way to do that. It is not only with Postman. I think no tool in the market is doing that right now."

"The scalability of the solution can be improved."

"The main improvement needed is better integration with test management and other tools to allow a common dashboard for all testing metrics and details."

"Should have a more improved easy-to-use interface."

"Reporting can be better. If you have bigger APIs, it takes time."

"There needs to be more flexibility surrounding the testing of SOAP APIs."

"We do the implementation of Postman and give support. We had to use two engineers for the implementation, one senior and one junior for the process."

"I have display issues in my Windows that need to be fixed."

"Reliability. I would like to see more money invested in disaster recovery testing of the application. The product should be hosted across several AWS regions so if there are issues with an EC2 instance in a particular region, the whole application won't be affected. Once or twice a year there are issues with AWS that causes the reliability of the application to suffer."

"The initial setup included a lot of repetitive manual work."

"If you forget to set the default environment during test creation, you have to go through every test and make sure that it is set to the environment that you prefer if using shared environments. If there was an option to force all tests within a bucket into a specific environment with one click, this would save a lot of time."

"One thing that can be improved is the logging. Sometimes, when we have an error, we don't know how to find more information about the problem that has happened. Sometimes, it just returns something like "that gateway." More information would be a way to improve it."

"File upload is a big part of the products that we test. The lack of file upload in Runscope requires us to still use UI (Selenium) automated tests for these scenarios."

"I would like to see easier integration and display of test results so that the data could be shared via a dashboard within our company. (Some integration is possible, provided you use one of the supported platforms)."

"Currently, we can only schedule to the nearest five minutes, one hour, two hours, etc. If we could set up the exact time that we want it to run, that would be good because sometimes we have one service that crosses another service."

"It would be nice to be able to generate API documentation."

"We use the open-source version. They introduced a new licensing model where your company must subscribe to their services if you're using it for business purposes. However, I think they charge too much if you're only using the basic features. It limits what your organization can do if you're not a paying customer."

"The solution is open-source and free."

"I rate the product's price a nine or ten on a scale of one to ten, where one is cheap, and ten is very expensive. Postman is an expensive tool for Turkey."

"The solution has moderate pricing."

"This solution offers a free version."

"We are currently using the free version, but we have plans to buy a license."

"Unlike APIs, the solution does not require a license."

"It is free."

"The price for the product is very reasonable for a team of more than four to five members."

"Pricing is fair."

"Runscope pricing is unbeatable"

"Having the different plans organized by team size, buckets, and requests per billing period works for our needs. Larger companies may need to take a close look at these elements."