We've found TBox to be valuable for scanning applications and automating test cases. In newest version, time of scanning the application has been reduced immensely. Also, there is a lot of ways to identify controls that doesn't have unique IDs, and that process is more stable than before.
Test Analyst at a tech services company with 501-1,000 employees
Organized and easy to use testing tool, with options for fast automation and easy maintenance, also with tendency to improve greatly with every next release
What is most valuable?
How has it helped my organization?
TOSCA is quite organized by itself, so it helps us do our job more efficient and quicker.
What needs improvement?
The ability to create more complex TestCases with "If" and "While" loops (now it provides IF, DO and WHILE statements, but they can't really be implemented the way we are used to use those loops).
For how long have I used the solution?
I've used the latest version for about three to four months, though TOSCA in general for more than a year-and-a-half.
Buyer's Guide
Tricentis Tosca
December 2024
Learn what your peers think about Tricentis Tosca. Get advice and tips from experienced pros sharing their opinions. Updated: December 2024.
831,265 professionals have used our research since 2012.
What was my experience with deployment of the solution?
N/A
What do I think about the stability of the solution?
Some issues with stability, but those are minor errors. Some errors happen without obvious reasons, or they're not obvious to me yet.
What do I think about the scalability of the solution?
N/A
How are customer service and support?
Customer Service:
N/A
Technical Support:Generally, the support is good, but they give too many generic answers. Sometimes the problem is more direct and it requires deeper and longer thinking. That could be a bit improved.
How was the initial setup?
Something in the middle. It's not really for somebody who is not passionate about testing. It's great for somebody who thinks about all the aspects of the TestCase.
What other advice do I have?
Great tool for testing, but only when used by an educated tester or by somebody who's gone through the whole course and had at least a little bit of practice. It's worth it.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
DevOps Engineer at a financial services firm with 501-1,000 employees
The UI-based interface is used for building modules and turning modules into test cases.
What is most valuable?
The most valuable feature is the UI-based interface for building modules and turning modules into test cases.
How has it helped my organization?
It greatly accelerated regression testing cycle via automated regression.
What needs improvement?
Upgrading from one version to another requires maintenance and rework in existing scripts. This is too much for my taste.
For how long have I used the solution?
We have been using this since 2013.
What do I think about the stability of the solution?
There were no issues with stability.
What do I think about the scalability of the solution?
We had to do extensive customization on top of their CI/Distributed Execution engine in order to integrate this into our Continuous Delivery pipeline.
How are customer service and technical support?
Technical support is excellent.
Which solution did I use previously and why did I switch?
This was my first automated testing tool.
How was the initial setup?
The initial setup can be quite complex and training is required.
What's my experience with pricing, setup cost, and licensing?
It's not cheap, but you get what you pay for.
Which other solutions did I evaluate?
We evaluated several other options which included all the most popular automated testing tools.
What other advice do I have?
Be sure you are ready to support it earnestly with training and focus. If you do that, then it is worthwhile.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Buyer's Guide
Tricentis Tosca
December 2024
Learn what your peers think about Tricentis Tosca. Get advice and tips from experienced pros sharing their opinions. Updated: December 2024.
831,265 professionals have used our research since 2012.
SAP TAX COE at a tech company with 10,001+ employees
The Risk Management feature is one we are seeing as very valuable in our environment.
Valuable Features
While we started implementation with a focus on testing automation, the Risk Management feature is one we are seeing as very valuable in our environment, allowing us to better focus on critical testing.
Improvements to My Organization
It has allowed us to have a highly reusable Regression Test suite. We have already been able to run it for an SAP upgrade and plan on using it on a regular basis (weekly) going forward.
Room for Improvement
The record and play is still a new feature and while SAP has been added to the latest version, it is still lacking usefulness for common repository setups.
Use of Solution
We've been using it for about 8 months
Deployment Issues
We've had no issues with deployment.
Stability Issues
We've had no issues with stability.
Scalability Issues
We've had no issues with scalability.
Customer Service and Technical Support
Customer Service:
We have had great customer service so far. Support has been responsive and helpful.
Technical Support:Technical support has been pretty responsive so far. They have provided solutions to most of our challenges and provide work arounds when no solutions were available.
Other Advice
The tool is very different than other testing tools and it is important to explain some of these different to all the stakeholders to ensure they really understand the benefits at their level.
By that I mean that a tester might see benefit in the ease of automation but a business user will see benefit in the risk coverage visualization, for example.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
QA Expert at a healthcare company with 501-1,000 employees
Great tool but I think it will take a few more years to mature & grow
After working on TOSCA for 18 months this is what I think:-
(Note: this is my personal opinion and not that of the company I work for)
There is no such thing as "No Coding skills required". Even TOSCA has some custom vb script files that come with the installation that allow you to do certain automation tasks. Also you can create your own vb script files and associate them to modules within TOSCA for further customisation.
My understanding of test automation is keeping your test scenarios in the centre and wrap your automation tool around it. TOSCA shakes this basic understanding of mine to the core. It's either the TOSCA way or the highway :)
I do not consider myself an expert TOSCA userit makes it easy simply because I do not know how to create custom controls in TOSCA (yet). May be future improvement in HELP files might help here.
The only benefit I have seen is the ease the maintenance of existing test automation scripts. Because the way TOSCA binds the tests with objects, test data sheet and so on when the time comes for maintenance it is really easy.
Concept wise - TOSCA is an great tool. A tool that promises no coding skills required. A tool that talks about moving away from conventional test automation methodology of object driven test automation towards model based test automation. But I think it is still a bit further away from reality and will take a few more years to mature & grow on its own.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Senior Automation Consultant at a tech services company with 201-500 employees
Reporting is well managed and there is no requirement to build a framework around it.
Pros and Cons
- "This tool has test data management capability along with test management."
- "ScratchBook execution needs to be improved as Tosca crashes multiple times."
What is most valuable?
Tosca is a model based component tool and also quite flexible in terms of the customization required for most of the applications, if objects are not recognized. It allows manual testers to pick up automation, because it is a scriptless tool. Reporting is well managed within Tosca and there is no requirement to build a framework around it.
How has it helped my organization?
We are only using Tosca for our test automation. It helps the business testers to get involved and be a part of automation. It helps us define the right coverage by defining the scope in the test case design section. This tool has test data management capability along with test management.
What needs improvement?
- Objects re-scanning (recognizing the objects again)
- Providing features to highlight the objects
- The user guide/help document needs to be improved for better understanding of the tool and its features.
- ScratchBook execution needs to be improved as Tosca crashes multiple times.
For how long have I used the solution?
I have been using Tosca for the past two years.
What do I think about the stability of the solution?
If the Tosca repository becomes huge in size, then you might face performance issues. Tosca crashes many times and the best practice is to keep saving your work frequently to avoid re-work.
What do I think about the scalability of the solution?
There were no scalability issues.
How are customer service and technical support?
Technical support is available via chat or by raising an incident. They are often able to resolve minor issues. It takes really long to resolve major issues and we have to wait for them.
Which solution did I use previously and why did I switch?
I have been working on different test automation tools and I was introduced to Tosca because of the technology that it supported for our applications. The current test automation tool was unable to provide a solution for our .NET Windows-based application, which Tosca provided out-of-the-box.
How was the initial setup?
The initial setup was not very complex. The Tricentis team provided support in terms of setting up the project and assisting during the initial days to get us used to the tool.
What's my experience with pricing, setup cost, and licensing?
It is an expensive tool compared to other test automation tools. It has a lot of advantages over other tools. They provide different types of licensing like cloud, Node locked, and floating licenses.
Which other solutions did I evaluate?
We did Proof of Concept with other automation tools, such as UFT and TestPartner, but we found Tosca to be a better tool.
What other advice do I have?
I would definitely recommend this tool. It is user friendly, once you get used to it, and it is easy to implement. You might have to struggle initially to understand Tosca and its approach.
Disclosure: My company has a business relationship with this vendor other than being a customer: Yes, our company has a business relationship and is an Partner of Tosca wherein the employees of our company get different benefits like free certifications, free trial licenses for training purposes.
Software Engineer Associate at a tech services company with 10,001+ employees
A model based automation tool and doesn't require an explicit framework.
What is most valuable?
Tosca Testsuite is a model based automation tool and it doesn't require an explicit framework, unlike other automation tools.
How has it helped my organization?
Tosca very efficiently helps us manage the time taken for automation, its very user-friendly and easy to work with.
What needs improvement?
I feel that the Tosca tool should be improved for handling Siebel applications. My team has tried the automation for a few different types of applications with Tosca. One of them was a Siebel application. We faced the most difficulties in the automation of that Siebel application. Tosca doesn't handle Siebel applications as well as it handles other platform applications. We had to try a lot of workarounds to complete the automation. That was one issue we faced when we worked with Tosca.
For how long have I used the solution?
Almost 10 months.
What was my experience with deployment of the solution?
There are very minor issues. They can be easily resolved.
What do I think about the stability of the solution?
Tosca Testsuite is very reliable and stable.
What do I think about the scalability of the solution?
Not much. I Haven't faced any such issues until now.
How are customer service and technical support?
The support team of Tricentis is really excellent. The support portal and the support teams work and help is really appreciated.
Which solution did I use previously and why did I switch?
I prefer TOSCA over other tools.
How was the initial setup?
The initial setup was not that easy or not that complex. I can say it was moderate.
What about the implementation team?
It was in-house.
What other advice do I have?
TOSCA Testsuite is a very good automation tool. It supports a wide variety of application automation. This tool provides a very efficient way of automation and also it is compatible with many other tools involved in the testing process like Quality Center, etc.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Technical Tester at a tech services company with 501-1,000 employees
Tbox automates complex test scenarios and it's helped us keep track of test execution and coverage.
Valuable Features:
I mostly use the TOSCA Commander to create test cases. I also utilize the Tbox feature to automate complex test scenarios. Lastly, I find the requirements linking very useful in analysis after a release (i.e. test coverage, etc.).
Improvements to My Organization:
The product is very useful in keeping track of test execution and coverage. This is because it has a feature called Execution List which shows resources and the test cases they have executed. There is also a tab for Requirements where the test cases can be linked.
So, by combining those two together, you will be able to see which test cases are mapped to requirements, and if they have been executed. You will also see the number of passed and failed test cases. It is very easy to use once you know all the features. It barely crashes and recovers gracefully most of the time.
Room for Improvement:
The product, at times, does not recognize objects, especially in web applications. It would be good to have that fixed in the next version. As a work around, you have to use the feature called TBox which allows you to scan complex objects.
Use of Solution:
I have been using it for more than six months.
Deployment Issues:
No issues encountered.
Stability Issues:
No issues encountered.
Scalability Issues:
No issues encountered.
Initial Setup:
The initial setup was hassle free. Although, it would be great if the documentation for the initial set up would include more screenshots and a troubleshooting section.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
TBox is not a workaround. It's alternative engine to classic HTML engine.
Per my experience problems with Web automation are related with use of correct locators (IDs) and correct steering. Sometimes applications themselves are not automation friendly
Senior Manager of QA at a tech services company with 501-1,000 employees
Very rich automation/test management framework but consider the coding needed to integrate with your application
Recently, I was asked a set of questions regarding my experience with TOSCA. Here are the questions and my answers:
General info:
Is there any need for coding or scripting? Based on my research, I expect that the module is created when scanning has been finished. But some users commented that coding or scripting is needed.
- Depends on the application and technology you are trying to automate. TOSCA has a lot of engines (HTML, .NET, Java, Webservices, etc.) with control library's that can be used out of the box. For something that is not covered by these engines (like a custom java widget) you will need to code for steering.
Are control statements like if/then/else and loops supported?
- Loops are not directly supported. If/then/else are supported for templates (data driven test cases).
Test case organization:
Is it possible to group test steps and according to our needs include/exclude particular test groups?
- Yes
Is it possible to rearrange test steps once they are created?
- Yes
Is it possible to perform multiple execution for test steps and test groups?
- Yes
Is there a possibility to create some variables whose values can be adjusted in some of the test steps?
- Yes. In TOSCA variables are called "buffers"
Is possible to add references in a test to some other test?
- It's possible to organize test steps in the library and reuse them in TC's. For other kinds of references you are free to create custom fields (to store path to other TC for example).
Is it possible to modify verdicts, for example, if a test fails that is declared as passed?
- Yes
Is a test progress view supported? Is it possible to stop/start a test on an error or some other event?
- Yes. You can define different behavior on an error (for example requesting a manual action to continue).
Is it possible to schedule tests? This is useful to have when night runs are executed
- You can trigger TOSCA execution using the TOSCA API from cmd line using windows scheduled jobs.
When some test step fails in some test group, how is that reflected to the corresponding test group? Does the parent test group also fail?
- The parent test groups are organized as "Business execution lists". If one TC fails, Business execution list will also fail.
Logging:
Is it possible to filter results?
- Yes
How is logged data is stored?
- Execution results stored in a TOSCA repository (local or shared (DB))
Is it possible to export logs/results?
- Yes. You can print repository content to various formats (excel, PDF, jpg, etc.)
Other:
How does TOSCA work with the command line?
- The TOSCA API offers all operations in the cmd as the TOSCA Commander shell. Run TC's, Create TC's, print report, everything...
Is it possible to configure test speed? For example, to insert some delay when GUI is slow.
- Yes, there are multiple settings and options to play with the speed.
Is there any possibility to explore a linux system with TOSCA? Maybe via putty or WinSCP?
- I don't have experience with TOSCA and LInux. Theoretically TOSCA can run external applications. We have created integration of TOSCA and JUnit tests for our needs.
When a test is created on one system, can it be easily transferred to another system? For example, when I create a test, I want to deliver it to another colleague who is working on another machine. Or does he have to create it on his own machine?
- You can use multi-user repository, which has checkin/checkout operations like SVN or CVS. You can also export your TC's or other TOSCA objects to file and import to other local/shared repository.
In the end, what is your opinion/experience about TOSCA?
- Overall impression about TOSCA is quite positive - it's a very rich automation/test management framework. In the right hands it can be used for creation of a really powerful and complex solution. There are many more features that are useful for automation but there can really be a need for some coding effort to integrate with your application - this needs to be considered.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
My review was done for the older version of TOSCA.
Currently we work with version 8.4.0 and this tool has advanced a lot.
Tricentis added many useful features and TOSCA has become once of most mature automation tools I worked with.
If/then/else and loops supported, plugin for Continuous Integration exists now, JUnit test results can be imported into TOSCA, test data service allows to setup distributed execution, etc.
Buyer's Guide
Download our free Tricentis Tosca Report and get advice and tips from experienced pros
sharing their opinions.
Updated: December 2024
Product Categories
Functional Testing Tools Mobile App Testing Tools Regression Testing Tools API Testing Tools Test Automation ToolsPopular Comparisons
OpenText UFT One
BrowserStack
SmartBear TestComplete
Selenium HQ
Perfecto
Sauce Labs
BlazeMeter
Worksoft Certify
LambdaTest
Ranorex Studio
ReadyAPI Test
ReadyAPI
OpenText UFT Developer
Parasoft SOAtest
Buyer's Guide
Download our free Tricentis Tosca Report and get advice and tips from experienced pros
sharing their opinions.
Quick Links
Learn More: Questions:
- Tosca Testsuite Version 10.0
- Cost of TOSCA Testsuite?
- Is anyone using Tosca for Non Functional Testing?
- Does anyone know which CI/CD tools integrate with Tricentis Tosca?
- Looking for documents about TOSCA Testsuite
- What are the benefits of Tosca?
- Is Panaya Test Dynamix better than Tricentis Tosca?
- Tosca Testsuite with Selenium WebDriver
- How does Micro Focus UFT One compare to Tricentis Tosca?
- Do we require a separate license for DEX in Tosca?
Bhavana, can you provide any insight from the workarounds you had to perform when completing the automation?