Description

The G-Migration+ platform intelligently queries a subset of data from a source database, replaces sensitive data values with synthetically generated data values, and inserts the data subset into an identical destination database using the same format and data model. Additionally, G-Migration+ provides the ability to augment and insert a richer data set within the destination database.


Important: GenRocket does not use the conventional masking approach to safeguard private information. Instead, it uses Synthetic Data Replacement, SDR to replace sensitive data with synthetically generated data that can be controlled.


Synthetic Data Replacement, SDR replaces sensitive data values with synthetically generated values before insertion into the destination database. Production data remains safe on the source database during this process. You choose what tables and columns SDR will be performed on before data migration. For more information about SDR, click here.


What Subscription Tiers Have Access to G-Migration+?

G-Migration+ is available with the following GenRocket editions: 

  • Professional Edition
  • Enterprise Edition
  • Premium Edition
  • Unlimited Edition 


What Databases are Supported for G-Migration+?

The following databases are currently supported for intelligent data migration:

  • MySQL
  • MSSQL
  • PostgreSQL
  • Oracle
  • DB2


Important: The data migration can only be performed between the same database types. For example, a MySQL database to a MySQL database.


Sensitive Data Remains Untouched on the Production Database

With G-Migration+, your sensitive data remains untouched and safely on your production database. Three processes occur during data migration: 

  1. Non-sensitive data is obtained from the production database using queries.
  2. Synthetic data is generated and merged with the non-sensitive data within each specified table and column.
  3. Merged data is then inserted into the testing database using the same data model and format. 


Why should you use G-Migration+?

G-Migration+ provides the following benefits for achieving a testing objective: 

  • Sensitive data values are replaced with synthetically generated values before insertion.
  • Provides potential to augment and insert a richer data set into the destination database for testing.
  • Ability to only grab the needed information for the testing objective rather than large amounts of unnecessary data.


When should you use G-Migration+? 

G-Migration should be used to meet the following needs:

  • Migrate a subset of data where sensitive data values are replaced using SDR.
  • Migrate a subset of data from a production database with only non-sensitive data values.
  • Migrate an entire database where sensitive data values are replaced using SDR.


How does G-Migration+ Work?

TABLE OF CONTENTS


Prerequisite 1: Install GenRocket Runtime

GenRocket Runtime must be installed on the machine where data migration will be performed. For more information, use the links provided below:  



Prerequisite 2: Source Database and Destination Database Property Files

For GenRocket to perform a data migration, configuration files must be present to connect to the source and destination databases via JDBC. You will need to create a source.properties and a destination.properties file on your local computer with the appropriate database connection information. 


These files can be placed within a sub-directory and must be present to connect to each database during the data migration. For more information on how to create these configuration files, click here.


Step 1: Access the G-Migration+ Platform

  • Create or select an existing Test Data Project. If multiple versions exist, you will also need to select a Project Version.

  • Next, expand the Self Serve Menu Options drop-down menu and select G-Migration+.


Step 2: Create a New G-Migration+ Configuration

Each Data Migration will have its own parameter configuration. The G-Migration+ Configuration will need to be created and configured with your source and destination database information.


  • Click the Create G-Migration Config button.



  • Use the menus and input fields to configure each item for your G-Migration Configuration. Click the Save button once finished.


Step 3: Import the Database Schema into G-Migration+

The database schema will need to be imported to perform Data Migration and/or Synthetic Data Replacement (SDR). A database schema can be created using the genrocket -xts command. Once created, you can choose the file and import it into G-Migration+. To learn more about XTS files and how to create them, click here

  • Click the Import Table Schema button.



  • Click Choose File, browse to the Table Schema file, and select it. Click the Save button once finished.



  • Click OK to close the dialog window. You will receive email notifications for when this process has started and once the process has finished. 


    Note: You can also refresh and watch the Queue information in the top right corner of the G-Migration+ dashboard. When a Table Schema is being imported, you will see a number other than zero beside Waiting Queue Process.



Step 4: (Optional) View the Imported Table Schemas

The imported Table Schema can be viewed by clicking on the Show Table Schema button within the dashboard.



Click on a table on the left to view its schema. Once finished, click the Close button.


Step 5: Select Tables and Columns for Synthetic Data Replacement (SDR)

One or multiple tables containing sensitive data values can be selected for SDR. Once the tables have been selected, you will be able to select individual columns that require SDR. A Scenario will be created for each table with sensitive data values.

  • Click the Manage Tables button.



  • Select each Table that contains sensitive data values by clicking on the checkboxes. Click the Save button.



    Note: Please note that you can select all tables for Data Migration and SDR at the same time.

  • Select each Column that contains sensitive data values by clicking on the checkboxes. Click the Save button.


  • The completed configuration will appear as shown below:


Step 6: Select a Table for Data Migration

Select a table for data migration. Data will be inserted into the destination database for the selected table along with all related table information to maintain referential integrity based on the imported Table Schema. 


For this example, let's say a data subset of Customer Table records with a state of DC will need to be inserted into the destination database. Only related records for the other tables users in the department, role, address, and orders tables will be part of the data subset. This maintains referential integrity when the data subset is inserted into the destination database. 

To set up this example, follow the steps below: 

  • Click the Manage Tables button.


  • Select a Table for the data migration and click the Save button.


    Note: Please note that you can select all tables for Data Migration and SDR at the same time.

  • Click the Cancel button if there are no sensitive columns for the selected table.


  • Click the Edit (Pencil) icon to add a Test Data Case and/or Where Clause.


  • Please note that only a Where Clause will be added in this example. Type in the Where Clause and click the Save button. For this example, "state = 'DC'" has been entered.



  • The completed configuration will appear as shown below:


Step 7: (Optional) Make Test Data Design Changes before the Data Migration

Before running the data migration, you can replace Generators and/or change Generator Parameter configurations for any created Scenario. Additionally, Test Data Cases can be designed and used to meet specific testing needs. 


Step 8: Download the G-Migration+ Configuration File, Scenarios, and Test Data Cases

The G-Migration+ Configuration File, all Scenarios, and any Test Data Cases will need to be downloaded to perform the data migration. A Download (Cloud) Icon is provided for each of these items within the dashboard. 



Step 9: Run the Command Line in a Terminal or Command Window

After downloading all items mentioned in Step 8, you will need to use the following command line in a Command or Terminal Window.


genrocket -gmigp <G-Migration+ Name>.gredb