TrueTest™
Today, regression testing is a hamster wheel...
... and test coverage has big blindspots.
Take the pain of regression testing off your plate
True usage visibility
Instant tests
Zero maintenance
Coverage without blindspots
Everything is easier on the Katalon Platform
Frequently Asked Questions
What types of applications does TrueTest support?
For now, TrueTest supports web applications only.
What is required to install and setup TrueTest?
Part of the setup for TrueTest involves installing an AI agent as part of the application under test. The installation is done by adding a lightweight Javascript code snippet to the <HEAD> element of the application under test (AUT). The code snippet can be installed via Google Tag Manager, but you can also use another method of your choice.
Will TrueTest affect the performance of the application?
Today, we’ve already got dozens of customers that are using TrueTest in mission-critical applications with enterprise-scale demands.
To ensure our AI Agent does not cause any impacts on the performance of the AUT, we have conducted several performance tests on our own platform, mostly in the form of various page load tests and spike tests.
Based on those tests, we’ve concluded that there is no negative impact on performance, but if you’ve got questions or concerns, we’re happy to share the results of our tests and discuss how we’ve built the agent to be as lightweight and risk-free as possible.
TrueTest tracks user activity in production to generate test cases, but can teams also use TrueTest in a staging environment, or just in production?
The easiest and most common approach is for TrueTest to just be used in production to cover regression testing. During development, testers can manually test the relevant new features, and once those features are released into production, TrueTest then updates and expands the library of regression tests.
But we do have some customers that are also installing TrueTest in their test environment, which allows them to then have PMs, business analysts, and testers act as users so that TrueTest can generate new tests based off their activity in staging.
In the future, we’ll consider making the application graph-editable so that the testers can add more states and transitions for new features, then regenerate flows and test cases combining new and existing features.
How does TrueTest work alongside the rest of Katalon’s platform?
TrueTest is automatically integrated with the rest of Katalon’s platform by default, so you can view and edit tests in Studio, you can execute tests via Runtime Engine and TestCloud, and within TestOps you can view reports and analytics, plan and schedule tests, and orchestrate your overall testing program.
TrueTest cases can be exported for use in another platform, but using within the Katalon platform is certainly recommended for a comprehensive, seamless testing experience.
How does TrueTest handle end-users potentially sensitive data? What else should we know about Security and Privacy?
Protecting user privacy is incredibly important to us. TrueTest fits within the rest of Katalon’s Security and Privacy policies, and is covered by our SOC2 and ISO27001 certifications.
Because the TrueTest AI Agent tracks user interactions to generate test cases and build a user journey map, we understand that some of this data may be sensitive and could pose privacy concerns. To address this, we have implemented robust data filtering mechanisms to remove sensitive information before processing the data.