Description

The AvroSegmentMergeReceiver merges different segments created by the SegmentDataCreatorReceiver to generate complex nested Avro output. 


This article will show how to generate a complex, nested Avro file within the GenRocket web platform.


Step 1 - Create a Project in the GenRocket web platform

For this example, a Project titled "AvroDemo" has been created with a default Project Version.


To create a new project, click on the New Project button within the Projects pane. For detailed steps on how to create a Project, please click here.



Step 2 - Import the JSON File

Avro has a JSON-like data model and can, therefore, be present as JSON. Each JSON object can be represented as a GenRocket Domain. Each GenRocket Domain will generate a segment of data for that Domain only. All the segments are then merged into a single Avro file using the AvroSegmentMergeReceiver with the help of a Merge Domain.


To set up the Project, you can import a JSON file with the required segments for generating the Nested Avro File Format. Complete the following steps to import the JSON file: 

  • Click on the New Domain menu within the Project Dashboard.


  • Select the Import from JSON option.


  • Click on the Choose File button. Browse to the location of the file and select the file.



  • Choose Avro for the Output File Format and click the Save button.


This will create all the Domains needed to generate the Nested Avro File, including the Merge Domain required to merge the individual segments. 


A Scenario will be automatically created for each Domain in the Project and a Scenario Chain will be created to run all Scenarios in sequence to generate the required data. 



A Configuration File will also be created during the import process, which the Merge Domain requires. 



Note: It may take a few minutes for the Domains, Scenarios, Scenario Chain, and Configuration File to be automatically created. 


Step 3 - Download the AvroConfig.xml File

Select the Configuration Management tab within the Project Dashboard and then click on the Download (Cloud) icon to download the AvroConfig.xml file to your computer. 



Place the AvroConfig.xml file in a Config folder within your resource output directory. 



Step 4 - Download the Scenario Chain

Click on the Download (Cloud) icon within the Scenario Chains pane to download the Scenario Chain to your local computer. 


Step 5 - Run the Scenario Chain

Note: Ensure GenRocket Runtime and these Jars have been updated before running the Scenario: Engine Jar and Receiver Jar. For more information on how to update GenRocket Jars, click here.


You must run the following command line in a Command Window or Terminal Session. 


genrocket -r <ScenarioChainName>.grs


<ScenarioChainName> should be replaced with the actual name of the Scenario. The command for this example would appear as shown below: 


genrocket -r Avro1ScenarioChain.grs


Step 6 - View Generated Files

This example will generate 1 Nested Avro file titled "AVRO-1.avro". An Avro Viewer will be necessary to view the generated file. One can be accessed by clicking here. 



You can drag and drop the file into the viewer or click on the Choose Files button to browse to your files and make a selection.



The file will appear as shown below in the viewer: