UiPath Test Cloud Reviews

I have been developing automations with UiPath Test Suite for about three years. In my role as a solution architect, I make sure test automation is integral to every project I handle.

What I really like about UiPath Test Suite is its ability to ensure that any changes made do not affect other functionalities. Its automated execution when a different package changes and using different test cases defined in an Excel file are particularly useful. Test automation allows me to manage complex processes without overloading servers. It integrates well with other processes.

We use the UiPath Test Suite to perform regression testing on the third-party vendor systems that we rely on. When a new update is received from the vendor or we make any configuration changes, the regression tests we created with UiPath Test Suite help identify any potential issues.

Automating our regression testing with Test Suite saves our QA Analysts many hours of testing whenever we receive vendor updates, or we make configuration changes. We receive vendor updates monthly and quarterly. QA analysts no longer need to perform end-to-end regression tests and can concentrate their manual testing efforts on testing the new functionality.

Our automated regression tests have found problems with new vendor releases almost immediately, while manual testing might have taken a couple of weeks to find the same issues. We are finding the issues faster so we can open tickets with the vendor, who can then fix them and send us a new release. Under manual testing, it could be a couple of weeks before we would find the bug, and then we would have to open a ticket, wait for the vendor to fix it, and then deploy the fix, which could delay the release to production. This way, as soon as the bug is found, we open a ticket with the vendor and then simply run the test again when they provide a new version.

The best thing about Test Suite and UiPath in general is that they are easy enough for business users to use. Our QA analysts, who are not technical, have been trained to use Test Suite to automate regression testing because the tool is easy enough for them to use. UiPath has excellent training resources, including free training resources on its website. As a result, we are no longer paying expensive developers to create the regression tests. Instead, the QA analysts can automate regression testing themselves.  

UiPath is used for a couple of workflow-related activities. We use it for onboarding and other HR tasks. When an employee comes to the organization, we use UiPath to validate their details or whether the employee ID has been created. After verification, it will trigger an email to the IT department to configure a desktop based on the employee category. Once it's approved, we close that ticket. We use it as a ticketing process checking mechanism. In a few areas, we are also using it for testing. We execute some of the test cases through UiPath. 

We use UiPath Test Suite to decrease the time to market, which means reducing the test cycle time and for attended execution. We had 10 to 15 people using it in the previous version, but now we only have three users at my current organization. 

UiPath Test Suite saves time by improving our efficiency. We generally run the scripts at night, and it auto-triggers at a specific time.  It's very fast compared with Selenium scripts. 

It requires a little bit less maintenance compared to Selenium. For example, suppose some scripts are failing due to object recognition. It takes more time to fix in Selenium than the hypothesis. In Selenium, I need to check the object and create it directly. With UiPath, everything is drag and drop. It takes five to 10 minutes to change some properties in Selenium, but I can do it in two or three minutes in UiPath. 

The solution reduces the cost. A functional test case takes about 10 to 15 minutes, but an automated test case takes five to seven after we develop the script. 

Historically, we have used the UiPath Test Suite to perform regression testing during third-party web-hosted application upgrades. When a new version of our platform is released, we leverage the product to execute our standard test scenarios and verify the stability of the new release, ensuring that no existing workflows or integrations are negatively impacted.

UiPath Test Suite's versatility is a major advantage. It can be applied to a wide range of technologies, from web-based applications to desktop software, all within a single platform. This is in contrast to other solutions that might be more specialized for a single platform and require switching providers for testing on different ones. Having everything in one toolkit provides significant benefits, especially in terms of its adaptability to various use cases.

UiPath Test Suite helps free up staff for other projects. The biggest advantage is the significant reduction in manual regression and testing time. For us, this translates to being able to focus on higher-value activities, such as planning the rollout of new updates and assessing their impact on specific workflows or end users.

When used effectively, UiPath Test Suite can significantly reduce maintenance overhead. Testing often becomes a burdensome activity, but with test automation, organizations can achieve greater test coverage with less time and effort. This translates to gains on the maintenance side in several ways. Firstly, it allows for embedding more rigor and variety into the testing process efficiently, ensuring that only high-quality code is released into production. Secondly, it leads to fewer defects and more stable code, making it easier to maintain and reducing the need for frequent bug fixes or minor enhancements over time.

UiPath Test Suite helps us significantly reduce our overall testing costs. We've observed reductions in testing time ranging from 50 to 75 percent. This is the most significant benefit, considering the traditionally long testing cycles that are dramatically shortened thanks to the suite.

We use UiPath Test Suite to test the workflows designed in UiPath Studio.

UiPath Test Suite helps to automate our web applications and desktop applications. It is easy to automate tests from a wide range of technologies.

UiPath Test Suite helps to test the automation of the application that we have created. We can check whether we are getting the expected results.

Previously, we used to do manual testing by running the processes one by one and making a note of each test case. By using UiPath Test Suite, we have a test framework. In that framework, we can use some conditions. Based on the conditions, we can check whether the workflow is executed successfully or not. The UiPath Orchestrator also has a feature to get a screenshot of the error message.

UiPath Test Suite has definitely saved costs and time. I do not have the metrics, but in general, manual testing of a normal process would take us about 5 days, and with UiPath Test Suite, we can complete the same in three days.

I worked on a project for a bank that involved mortgage facilities for leasing motor vehicles. Clients approach the bank for financing, providing details about their needs. The process is divided into groups, with each group handling specific tasks. I implemented UiPath test cases to simulate the process, including customer registration, bank response, mortgage eligibility, and more. These test cases are executed in a long-running fashion and are currently operational.

In UiPath Test Suite, we create test cases in Studio and then publish them to Orchestrator. The publishing process allows us to disable unnecessary test cases, reducing the overall project size. After publishing, test cases are organized into Test Suites in Orchestrator. These suites can be executed in batches, allowing for daily testing and monitoring.

The Test Suite manager in Orchestrator provides a dashboard with a pie chart showing test case success and failure rates. This tool helps analyze test results and identify areas for improvement. While the Test Suite manager is primarily for checking and inspection, it also allows for editing, reading, and running test cases.

By dividing large processes into smaller parts, UiPath Test Suite becomes a valuable tool for testing and quality assurance.

UiPath Test Suite has helped automate various applications, including Microsoft Office, web applications, Citrix environments, and PDF documents. I used Microsoft Office primarily for the bank to send and receive client emails. For web testing, I employed JavaScript-based web applications. For Citrix automation, I executed tasks like logging in, logging out, and navigating to Java-based applications within the Citrix environment. Additionally, I incorporated PDF automation into application loops. Beyond these, I utilized Microsoft Active Directory to retrieve recipient names, such as customer names, within the Citrix environment. This involved recalling and obtaining the customer retail ID in a loop.

If I create a process in RE Framework within UiPath, which is typically used for complex processes, I find it beneficial for large-scale applications, especially in banking. Previously used for smaller processes, RE Framework now excels at breaking down complex processes into stages. In UiPath Test Suite, we can easily move the steps from our RE Framework process into tasks or test cases. While the RE Framework is larger, it offers a structured approach, making it ideal for processes that require frequent updates due to market changes, which often occur in the banking domain.

The UiPath Test Suite Manager in Orchestrator provides a dedicated dashboard for tracking and analyzing process success rates. This eliminates the need for end users to contact developers or team leads for status updates. By accessing the dashboard through the Orchestrator tenant URL, users can easily view the success rate for their processes and identify any failed steps or exceptions. This saves time and facilitates long-term process reviews and performance analysis.

In my experience, when we work in the office, we utilize a Microsoft Azure dashboard if the company has the license to track incidents and tasks. Daily, we review these items on the dashboard. UiPath Test Suite is a valuable tool that allows us to pre-categorize and plan our work. For instance, a large project might be divided into three-month phases, with the first month dedicated to creating test cases. This structured approach helps streamline our daily tasks. Additionally, UiPath's reusable components can significantly reduce development time. While the Azure dashboard is essential for daily task management, UiPath Test Suite provides a more strategic overview, ensuring our efforts align with the project's timeline. This saves us 75 percent of the time.

UiPath Test Suite integrates seamlessly with other solutions like ServiceNow and Microsoft Azure. ServiceNow primarily handles incident management. While UI automation might not be ideal for end-users in this context, API integration provides a more effective solution. To integrate with ServiceNow, I used a dedicated API endpoint, which I received with credentials. I employed Postman as a manual step to verify the correct retrieval of API data. Unlike the UI-based details in ServiceNow, API integration directly accesses backend data. I also integrated with Microsoft Azure using API calls for most applications. Similarly, integrating UiPath Test Suite with AI and ML solutions often relies on API calls.

As a success metric, I'm unsure how to present this best. Each month, we report on test case execution. Given a specific number of test cases, we track the bot's execution time. If a test case takes longer than expected, we investigate ways to optimize it. This is a regular process. While I'm not directly involved in development, I understand that UiPath's default execution time is 30 seconds, but actual times may vary. By running tests repeatedly, we can determine the actual time and identify areas for improvement. We aim to reduce complexity by addressing technical, application, and business exceptions. When presenting to clients, we demonstrate how we've reduced test case execution time from, for example, ten seconds to five or even two seconds. This is a crucial indicator of our success.

We swiftly recognize the advantages of the UiPath Test Suite. If we're executing a business process in Orchestrator, similar to how we run Test Suite, the latter operates in sets. For example, considering mortgage as a process name would encompass ten test cases. Once we align this process with our modern folder and proceed to the test tools, aligning and running it ensures all test cases are grouped under a single test set. This allows for immediate results, minimizing the time required. It will depend on our coding approach and development methodology. UI-based processes might take longer, while background automation generally requires less time. Within half an hour, we can anticipate receiving the answer. In fact, for minimal processes, results can be obtained within seconds.

UiPath's data management features provide a convenient way to store and manage credentials, files, and data. Credentials are securely stored in the UiPath storage bucket and can be accessed by the orchestrator as needed. This eliminates the need for large-scale data storage solutions like OneDrive or Gmail Drive. Additionally, data management allows us to upload and store various file types, including Excel, text, and credential-based files. For output data, we can leverage the orchestrator queue to track and manage its status. While Excel and queues are commonly used, we can also store data in shared paths or as standard text files or credentials files. In summary, UiPath offers a cloud-based storage solution, along with queue management, to efficiently handle data storage and management within our automation processes.

Recently, I completed an automation project using RPA to create a coded workflow. I entered a prompt into UiPath Autopilot, which automatically generated all necessary tests in the studio as coded elements using AI. I then executed and tested these tests, significantly reducing the time required for manual processes. By becoming proficient in prompt engineering and refining our approach, we can streamline automation and achieve greater efficiency.

Mobile applications are growing in popularity every day, so we need to perform regression tests whenever we add new functionality to our mobile app to ensure that the existing functionalities are still working and that there are no unintended effects from the new feature. To do this, we test one version earlier of the app in every release. We focus on testing the current functionalities. If we find anything broken, we inform our development team and they will fix it before we release the new package. Regarding automation, we have four or five manual testing mandates. UiPath Test Suite is our most useful tool for test automation.

Currently, we only use UiPath Test Suite for our mobile application regression tests, but we plan to add our Internet banking and core banking regression tests in the near future.

We are currently using UiPath for our RPA ecosystem. We saw a demo and decided to purchase it, so I cannot compare it to other technologies. However, our paysite is very strong, and our experience with RPA development in UiPath Test Suite has been easy to manage.

It is faster out of the box than manual testing. It also allows us to run tests after working hours, which is easy to manage because we can schedule them, for example, at 10 p.m. on weekdays. This makes it very easy to manage these types of tests. Additionally, we have four or five mandates in each sprint, and we run these tests automatically.

UiPath Test Suite has helped free up our analysis team's time by saving them about five mandates per week. Previously, they had to run manual testing, but now they can focus on testing new features and analyzing new projects each week.

Test Suite has reduced our maintenance by 25 percent. It has helped reduce our TCO by four mandates each month.

We achieved time to value after three months, once we reached 100 scenarios and the solution became efficient.

I am currently working on API automation for a SAP application. We work on the processes for the finance team and the supply chain team. We mostly focus on test cases and test management. 

Test Manager is helpful for tracking process steps. We can see which step is failing. There is automation, test management, continuous integration, and continuous deployment.

We also have test reports, orchestrator integration, UiPath Studio, API testing, test execution, performance testing, and unit testing. These are the useful features available in UiPath Test Suite.