Generating test data with many permutations and combinations for a wide variety of test cases is a common need in software testing.
To properly do this, an organization needs a quick and easy way to set up variances in the generated data.
A GenRocket user could theoretically generate permutations for their test cases by making changes at the Template Domain Level by altering the Domain Loop Count. However, this is not how GenRocket was designed. Changing the Template Domain Loop Count will impact the Loop Count of every user of that same Domain. So, for example, if user #1 specifies a Loop Count of 10,000 on the User Domain then user #2 will also have 10,000 users generated for the User Domain even if tester #2 only wants 10 users generated.
GenRocket solves this by allowing the Loop Count to be set at the Scenario Domain level. So each tester can create different Scenarios for a Domain that contain different Loop Counts and their changes do not impact any other tester. What's the drawback of this approach? None other than the time it could take a tester to create all of the different variations needed for their test cases. That is where Test Data Cases comes in...
The Test Data Cases feature was developed to speed up the process of creating Test Data Cases with many variations (Loop Counts). And like the benefit of the Scenario Domain described above, these Test Data Cases do not impact any other user's Test Data Cases.
Please take a minute to view the following video showing how Test Data Cases work in GenRocket:
The following concepts are key to this feature:
- Test Data Case Set - A testing suite consisting of Test Data Categories with their own Test Data Cases, which can be used to test the validity of synthetic data used for your system.
- Test Data Category - Defines the type of testing that will be performed and can contain one or more Test Data Cases to meet your specific needs.
- Test Data Case- Defines the Domains and Loop Counts to be generated when the Test Data Case Set is run with the Scenario or Scenario Chain and the database is populated.
How Do Test Data Case Sets Work?
A Test Data Case Set may be created for any version of a Project and consist of defined Test Data Categories and Test Data Cases using the Domains, Receivers, and Scenarios or Scenario Chains set up for the Project.
A user can set up their own Test Data Case Set for testing purposes without affecting others who may be using the same information to generate their own data.
The following apply when creating any created Test Data Case Set:
- A Project (or Project Version) can have multiple Test Data Case Sets.
- A Test Data Case Set may have multiple Test Data Categories with their own Test Data Cases.
- A Test Data Category may have multiple Test Data Cases.
- A Test Data Case may have one or multiple Domains with their own defined Loop Counts.
When setting up a Test Data Case Set for a Project, it will need to have the following minimum configuration:
- 1 Test Data Category
- 1 Test Data Case
Once a Test Data Case Set has been set up, it can be downloaded and ran with any Scenario or Scenario Chain within the Project containing all or some of the Domains used to configure the Test Cases. The defined Receivers will be used to generate the output data.
The following example shows a Test Data Case Set created and set up for the TestDataCases Project Version 1.0. This Project has 4 domains:
For this example, the Unit Test Data Category has been selected and 5 Test Data Cases have been created using the four Domains listed above.
For each Test Data Case, the Loop Count for one Domain has been changed within the Test Data Case Set to achieve different combinations of synthetic test data.
All other Domains in the Test Data Case Set are using the global.DomainName.loopCount. A preview of what will be generated can be seen to the right of the Test Data Categories and the run command can be found at the bottom of the screen.
To see a step-by-step instruction for the example above with a Load Test Category and a Test Data Case as well, please see: Test Data Case Set Example: Unit and Load Testing.
To learn more about setting up and configuring Test Data Cases for a Project, please see the following pages:
- How to Access and View Test Data Case Sets for a Project
- How to Create a New Test Data Set
- Creating and Managing Test Data Categories
- Creating and Managing Test Data Cases
- How to Download and Run a Test Data Case Set with a Scenario
- How Do I Change the Name of a Test Data Case Set?
- Viewing Test Data Case Set Reports
- How to Lock and Unlock Test Data Case Sets
- How to Delete a Test Data Set from a Project