Description

The BigQueryReceiver makes use of the BigQuery APIs to make requests to the BigQuery system to populate the data. This Receiver passes the generated data in the payload of request in JSON format. The BigQuery API request requires authorization, therefore BigQueryReceiver needs a property file having information that helps to authorize.


Parameters

The following parameters can be defined for the RealtimeTestReceiver. Items with an asterisk (*) are required.  

  • projectName*- Defines the name of the BigQuery project.
  • dataSetName*- Defines the name of the Dataset within the Project.
  • tableName* - Defines the name of the table that needs to be populated with data within the dataset of the project.
  • configPath* - Defines the location of the configuration file which contains properties that provide the BigQuery authorization information.
  • configSubDir* - Defines the name of the subdirectory with configPath where the configuration file exists.
  • configName* - Defines the name of the configuration file.
  • responseOutput*- Defines where do we want to see the response output. 
    • appendFile, singlefile, noFile
  • responsePath* - Defines the location where the response file will be saved.
  • responseName* - Defines the name of the response file.
  • logRequestCount* - Defines the number of requests that are executed before logging a message to the console.
  • batchCount - Defines the number of requests that will be batched together and send simultaneously.


Property Keys

Each Domain Attribute will have defined the following property keys

  • columnName - Enables the user to define a different name for the Attribute.
  • include- Defines if the value of the Attribute should be added to output or not.



Configuration File

The BigQueryReceiver must read from a configuration file to read the properties required for Authroization.


The format of the configuration file is as follows:


clientSecret=<clientSecret>
clientId=<clientId>
redirectURI=<redirectURI>
refreshToken=<refreshToken>