Try our new research platform with insights from 80,000+ expert users
PeerSpot user
QA at a financial services firm with 10,001+ employees
Real User
Provides support for a variety of protocols including JSON.

What is most valuable?

1. Parasoft SOA test tool is very good for webservices automation.

2. It provides support for a variety of protocols including JSON.

3. It also provides multiple language support, such as Jython, Phython, Java, Ruby, and Javascript, whichever the tester is comfortable to plug and play with.

4. It is more user friendly when compared to other webservice automation tools.

5. This tool provides a variety of data sources including bean wizard and writable data source.

How has it helped my organization?

1. In our project we have to work with multiple tools like FTP, Database, Web services and Java. Parasoft is a bundle of these tools. With just one click I can access any utilities mentioned above. Currently it's saving lots of my time.

2. Parallel run is one of the significant features of Parasoft which saves more effort in my current project by executing the same regression package in different environments in parallel. 

3. Parasoft Console logs are very detail and precise. It helps us to to understand the issue quickly and easily. A normal QA person can understand the logs. 

What needs improvement?

1. We face issues when working with datasource. In my project we used a CSV file as an input test data files. However when the test data file (CSV) is empty then Parasoft stops abruptly. A workaround we found is to fill some dummy data into the datasource (CSV). We filed a case with Parasoft support about this issue. 

2. Parasoft has lots of limitation when integrating with ALM. We tried with a VAPI script, however it did not work as we expected. I personally feel this is the area to improve in order to compete with the other tools on the market. 

3. We noticed that our project workspace is sometimes corrupted without any reason. Without backups it creates lots of issues. It needs more focus in this area by giving the valid reason for the corruption.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user653586 - PeerSpot reviewer
Senior Consultant at a transportation company with 10,001+ employees
Vendor
We use the product to test the interfaces of back-end services, simulating different points of sale.
Pros and Cons
  • "Every imaginable source in the entire world of information technology can be accessed and used."
  • "Enabling/disabling an optional element of an XML request is only possible if a data source (e.g., Excel sheet) is connected to the test. Otherwise, the option is not available at all in the drop-down menu."

What is most valuable?

SOAtest is, at its base, a collection of tools that can be combined to generate test scenarios.

Input data can be gathered from any possible source from web GUIs, databases, Excel, and files and is used in SOAP/REST tools and web browser tools. The output of those tests can be saved in files and databases.

Every imaginable source in the entire world of information technology can be accessed and used.

The following features are particularly valuable to us:

  • Generating SOAP/REST requests
  • Validating responses against WSDL
  • Scripting parts of an XML request
  • Accessing DBs with JDBC
  • Jenkins Continuous Integration
  • Regression test automation
  • Modular scenario setup

How has it helped my organization?

Our tests are run nightly on every environment using Jenkins CI.

We moved from the Waterfall/V-model to Agile a couple of years back. With SOAtest, we are able to test features in every sprint, quickly and efficiently.

We use SOAtest to test the interfaces of maybe a dozen back-end services, simulating multiple, different points of sale. For example, a customer web shop, a sales agent application, sales machines, or mobile apps.

Service interfaces are continually integrated and updated within SOAtest. We test most front-end features first with manual tests, and then integrate them with validations into SOAtest scenarios.

Before using SOAtest, we had a huge delay in acceptance testing due to the amount of manual regression tests that we had to do.

What needs improvement?

Sadly, almost everything needs improving. Don’t get me wrong, the tool is very powerful and immensely useful for day-to-day usage. But certain things are missing or are set up in a way that makes it unnecessarily complicated. Here are some examples:

  • Replacing part of an XML request by script requires a variable in the scenario folder. This variable needs to be prepared before the SOAP request tool with the partial XML to be replaced in the request. This variable can then be set to replace a subtree of the XML request. It would be easier if we could directly set a script in the SOAP request tool as a replacement.
  • Enabling/disabling an optional element of an XML request is only possible if a data source (e.g., Excel sheet) is connected to the test. Otherwise, the option is not available at all in the drop-down menu.
  • True parallel testing is currently impossible.
  • There is a separate product ‘Load Test’ that has parallelism built in. But this is only to multiply a scenario with all test cases by a number of users executing all test cases. In a future release, there should be the option of running all test cases of a single test run in parallel to speed up testing.
  • To build a modular scenario, you can reference test suite files and execute the test tools contained therein. But every test contained in the referenced test suite file will be executed, as it is set up in the test flow logic of this scenario.
  • Sadly, there is no way to setup single operations of a web service and then combine those operations into a scenario. This is how SoapUI does it.
  • SOAtest is a plug-in for Eclipse. But actually, it comes bundled with its own Eclipse and several other Eclipse plug-ins like PyDev. Although this ensures compatibility of all contained tools, it also means that every part is a little out of date. For example, PyDev is available as v4.5.5, which means you get Python v2.5.2.
  • You can manually upgrade to a newer version, but this means every installation using your scenarios, and especially scripts, must be updated as well.

For how long have I used the solution?

  • We have been using v9.10 for about six months.
  • We have used SOAtest itself for around five years (since v9.3).

What do I think about the stability of the solution?

We had a stability issue, but Parasoft support was always very helpful in finding a solution or a workaround.

How are customer service and technical support?

I would give the technical support a rating of 10/10, or even 20/10!

No matter the problem, from simple user errors to complicated Eclipse issues, the support team is always quick to respond and is very good at what they do.

If you actually encounter some issue in which the first or second level support really can’t fix in a couple of minutes, then the third level support will dig deep and come up with amazing ways to help you.

There is a user driven support forum where you can get help and examples from other users.

Which solution did I use previously and why did I switch?

We did not use another solution previously. We do use SOAtest and SoapUI in parallel:

  • SoapUI is used as freeware by developers for single/simple SOAP requests.
  • SOAtest is used by the testing team to build extremely complex scenarios.

How was the initial setup?

Installation is easy and straightforward, as is the initial scenario building. SOAtest gives you the ability to choose how complex you want to build your scenarios.

The simplest level of usage is a full graphical view of requests and responses, storing values in data bank tools for use in later SOAP/REST request and SQL tools.

The more intricate levels consist of scripting in several available languages and really revealing the beauty of SOAtest.

The documentation guides you through several examples and helps enormously with the initial steps of building your test scenarios.

Which other solutions did I evaluate?

We evaluated SmartBear SoapUI.

What other advice do I have?

  • Learn XML as well as XPath.
  • Learn Jython, a variation of Python running in the JRE. It gives you the option to import Java classes into your scripts and use the latest Java improvements, but without the type safe limitations and language complexity of Java.
  • Implement your scenarios from the beginning with continuous integration in mind. For relative paths everywhere, abstraction in SOAtest environments etc., use a version control system to save and version your scenarios and scripts.
  • Take a short course (less than one day) from the Parasoft support team to familiarize your test team members with the product very quickly.
Disclosure: PeerSpot contacted the reviewer to collect the review and to validate authenticity. The reviewer was referred by the vendor, but the review is not subject to editing or approval by the vendor.
PeerSpot user
Buyer's Guide
Parasoft SOAtest
November 2024
Learn what your peers think about Parasoft SOAtest. Get advice and tips from experienced pros sharing their opinions. Updated: November 2024.
816,406 professionals have used our research since 2012.
PeerSpot user
Vice President at a financial services firm with 1,001-5,000 employees
Real User
SOATEST - Good solution for increasing efficiencies

Valuable Features

  • Tool offers easy ability to rapidly set up functional test scenarios
  • The tool interface is very user friendly and the user guide is a great help
  • Tool allows custom scripting and integrates well with most frequently used Source Control tools
  • Utilizing features that support Data Driven testing and E2E has increased efficiencies drastically

Use of Solution

5 Years. I have used the tool mostly for Web Service Testing.

Customer Service and Technical Support

Customer Service:

ParaSoft offers a great customer service, its a great combination along with a good product.

Technical Support:

Excellent and very approachable!

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
PeerSpot user
Senior Test Automation Lead at a tech services company with 10,001+ employees
Real User
Test are developed without scripting by using inbuilt utilities.

Valuable Features:

1. All the tests has been developed without scripting/coding by using Parasoft inbuilt utilities.
2. Event Monitor, FTP Client and Web Methods tools are mostly used in my project

Improvements to My Organization:

It improved my project ROI in various portions of the testing life cycle.

Room for Improvement:

1. The Parasoft reporting feature needs to be more effective in terms of status graphical representation. Parasoft report doesn’t provide graphical representation, meaning summary of report which indicate - how many test scenarios passed or failed, basically the management is expecting this kind overall summary report. So far, the Parasoft report will be prepared manually and sharing with other stakeholders. 


2. I personally feel that 50% of Parasoft features are provided by SoapUI free of cost. However, not all the webservices protocols.SoapUI is an open source tool that supports most protocols such as SOAP, REST, HTTP, JMS, AMF, and JDBC. From a business perspective, why should a company invest money on Parasoft licensing which has a high cost

3. We cannot use the WebUI testing in full mode and we need more focused improvements in that area. I tried to use Parasoft for functional testing (web testing), such as clicking a button and selecting a value from a dropbox, but I figured out that the tool is mostly built for web service automation and User Interface automation. For instance, HPE UFT is a tool with a bundle of features(web service automation and functional automation). I know Parasoft supports basic WebUI automation but with limitations.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
PeerSpot user
Consultant at a tech services company with 10,001+ employees
Real User
SOATest is a reliable Middleware test automation tool

What is most valuable?

XML assertions, XML data bank, various tools available internallly

How has it helped my organization?

Achieved testing middleware services and automating them with the features in SOATest. API testing is made easy. Automation and regression test suite was achieved without the need to write much code.

What needs improvement?

Performance of the tool

For how long have I used the solution?

5 years

What was my experience with deployment of the solution?

No

What do I think about the scalability of the solution?

Performance issues if there are too many sessions open on your system.

How are customer service and technical support?

Customer Service:

Good

Technical Support:

Good

Which solution did I use previously and why did I switch?

No

How was the initial setup?

Easy

What about the implementation team?

Knowledgeable

What was our ROI?

Web services and API test automation was made simple without writing much code.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user660015 - PeerSpot reviewer
Service Oriented Architecture at a insurance company with 1,001-5,000 employees
Real User
Allowed us to build a large library of repeatable automated tests. The platform can become unstable as the memory usage increases.

What is most valuable?

Automated execution and chaining of test validators is the most valuable feature; it is easily extensible via the built-in custom scripting API.

How has it helped my organization?

It has allowed us to build a large library of repeatable automated tests that are able to be quickly executed on demand. This builds a solid foundation for future initiatives expanding into a more continuous integration and the agile methodology adoption.

What needs improvement?

Memory Management suffers when using solutions other than the data repository for managing the test cases.

For how long have I used the solution?

I have used this solution for about three to four years.

What do I think about the stability of the solution?

The platform can become unstable as the memory usage increases. For example, we use Excel spreadsheets for managing test cases, so the size of these test cases must be tightly controlled.

What do I think about the scalability of the solution?

Scaling tests beyond a certain point can trigger issues with Memory Management, but good design practices usually indicate a need to break up a test before it would reach that point.

How is customer service and technical support?

Technical support from Parasoft has been excellent.

How was the initial setup?

The setup was straightforward. It was very easy to set up a test scenario that consumed assets in our web service layer and to run validation against the results. The tool itself allows for some more complex chaining of components within a test scenario, so familiarizing yourself with the tool enough to get more creative in your test setups can be more complex.

What's my experience with pricing, setup cost, and licensing?

If you plan on using a floating-license model, plan on a buffer of at least 10 user tokens between the maximum allocated by your license and the expected usage for the tool.

Which other solutions did I evaluate?

I looked at SoapUI NG Pro.

What other advice do I have?

Keep your test scenarios small and focused rather than trying to cover an entire web service with one scenario.

Disclosure: PeerSpot contacted the reviewer to collect the review and to validate authenticity. The reviewer was referred by the vendor, but the review is not subject to editing or approval by the vendor.
PeerSpot user
it_user664629 - PeerSpot reviewer
Senior testspecialist at a government with 10,001+ employees
Vendor
The Browser Playback tool records and plays back web scenarios for testing.
Pros and Cons
  • "The testing time is shortened because we generate test data automatically with SOAtest."
  • "During the process of working with SOAtest and building test cases, the .TST files will grow. A negative side effect is that saving your changes takes more time."

What is most valuable?

The most valuable features are the Browser Playback tool for recording and playing web scenarios (Web UI testing), and the messaging client for sending SOAP calls and for validating responses.

How has it helped my organization?

The testing time is shortened because we generate test data automatically with SOAtest.

What needs improvement?

During the process of working with SOAtest and building test cases, the .TST files will grow. A negative side effect is that saving your changes takes more time. The bigger the .TST file, the more time it costs. Sometimes a few seconds! An option is to split up the file into separate files, but often that’s no realistic option because you want to keep the test suites together.

TST-file is the container file in which all testsuites and teststeps are stored. It often happens that you have to change a teststep and want that change to be saved. Saving your teststep in an almost empty container (with only one testsuite and a few teststeps) will go very fast (within 1 second). Saving your step in a container with multiple testsuites and teststeps takes a lot more time. In my case sometimes five seconds.

What do I think about the stability of the solution?

Sometimes SOAtest hangs, but that is very sporadic. It could be caused by the stability of the environment of the customer in general.

What do I think about the scalability of the solution?

We haven’t had any scalability issues.

How are customer service and technical support?

The technical support in the Netherlands is very good. Questions about the tool are almost answered within a day. When needed, a Parasoft consultant joins the project for one day or more.

Which solution did I use previously and why did I switch?

We used SoapUI for testing web services. In our case, the advantage of using Parasoft SOAtest is the use of the datasheet; with one message, you can loop through your datasheet and check all your data.

How was the initial setup?

The setup was done by another team of the company and was out of our scope.

What's my experience with pricing, setup cost, and licensing?

The products of Parasoft have the name; they’re expensive. I think it would be a great step to decrease the price of the licenses. A possible consequence could be getting more users and more familiarity in the Netherlands and around the world.

Which other solutions did I evaluate?

I have experience with a lot of other products, but when I started with this job (Dutch Government) three years ago, the product, SOAtest, had already been bought by the company.

What other advice do I have?

Invest a lot of research time into what your exact needs are. After that, select some test tools to compare all the options. In my opinion, Parasoft has so many possibilities that it must have a place on your shortlist!

Disclosure: PeerSpot contacted the reviewer to collect the review and to validate authenticity. The reviewer was referred by the vendor, but the review is not subject to editing or approval by the vendor.
PeerSpot user
PeerSpot user
Performance and Fault-tolerance Architect with 1,001-5,000 employees
Real User
Top 5
​It provides easy handling of RESTful API's, but more scalability is needed, especially when testing in elastics/cloud platforms.

What is most valuable?

  • API support for JSON and REST payload
  • Virtualization
  • Complete visibility of all the conditions, circumstances, and influences surrounding and affecting the testing of software servers and environment

How has it helped my organization?

It provides easy handling of RESTful API's and figuring out exact API scalabilty, responses, and failed API's, returning code captured by the fault injections.

What needs improvement?

More descriptive reports are needed.

For how long have I used the solution?

I've used it for six months.

What was my experience with deployment of the solution?

No issues encountered.

What do I think about the stability of the solution?

No issues encountered.

What do I think about the scalability of the solution?

No issues encountered, however, more scalability is needed, especially when testing in elastics/cloud platforms.

How are customer service and technical support?

Customer Service:

8/10.

Technical Support:

9/10.

Which solution did I use previously and why did I switch?

We previously used JMeter and were offered better support from Parasoft. As well as this, the reports and user friendliness of SOAtest helped us make the decision to switch.

How was the initial setup?

It's very easy to set up and doesn't take much time. You don't need installation expertise to set it up.

What about the implementation team?

We used a vendor team from Parasoft themselves who were very good.

What was our ROI?

It's 100%.

What's my experience with pricing, setup cost, and licensing?

The price is a little expensive in terms of users.

Which other solutions did I evaluate?

We evaluated JMeter as well, which was our existing product.

What other advice do I have?

Even validate SOASTA tool too.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user3396 - PeerSpot reviewer
it_user3396Team Lead at Tata Consultancy Services
Top 5Real User

Cool review