You can't use this until you register with us!



s3 mysql loader nomnomdata


Description

Used for setting up a mysql database for nomnom loading and then loading data tables into it.


Purchasing Options



Available Actions

Initialize Database

Initialize a mysql database to allow tracking of loaded data.


Variables

target_db required

Database where you want to run the script on.


Register Dataset

Register a data_table on a mysql database. This allows NomNomData to load the data_table into an initialized database.


Variables

Metadata Info
metadata required

Metadata location your data is coming from. We support a few types and generally companies only have a few of these.

data_table required

Data table that you want to load into your mysql database. As identified from your metadata catalog.

data_table_uuid required

UUID of the Data table that you want to load into your mysql database. As identified from your metadata catalog.


MySQL Info
target_db required

Database where you want to run the script on.

target_table required

Table name you want to load into specified via the notation schema_name.table_name. To specify special characters in table name you need to quote the table_name. Note special characters in table names is not recommended.


Load Data Table

Load a data_table into a mysql database. Only allowed after a data_table has been registered on an initialized database.


Variables

Metadata Info
metadata required

Metadata location your data is coming from. We support a few types and generally companies only have a few of these.

data_table required

Data table that you want to load into your mysql database. As identified from your metadata catalog.

data_table_uuid required

UUID of the Data table that you want to load into your mysql database. As identified from your metadata catalog.


MySQL Info
target_db required

Database where you want to run the script on.

target_table required

Table name you want to load into specified via the notation schema_name.table_name. To specify special characters in table name you need to quote the table_name. Note special characters in table names is not recommended.


S3 Info
aws_connection

AWS Credentials with access to the s3 bucket where the data table lives. Should also have access to a temp directory.

s3_temp_space

Path to a location where the s3 credentials have write access and read access. Needs to be in the same region/account/bucket where the mysql files live. If left blank the sytem will use the temp path defined in the aws connection if one exists.


Loading Options
path_filter

RegEx of filter to apply for loading files. Can use <YYYY> sytax to load time ranges for current dates


Register & Load

Verifies registration and load a data_table into a mysql database. Only allowed after a database has been initilized initialized database.


Variables

Metadata Info
metadata required

Metadata location your data is coming from. We support a few types and generally companies only have a few of these.

data_table required

Data table that you want to load into your mysql database. As identified from your metadata catalog.

data_table_uuid required

UUID of the Data table that you want to load into your mysql database. As identified from your metadata catalog.


MySQL Info
target_db required

Database where you want to run the script on.

target_table required

Table name you want to load into specified via the notation schema_name.table_name. To specify special characters in table name you need to quote the table_name. Note special characters in table names is not recommended.


S3 Info
aws_connection

AWS Credentials with access to the s3 bucket where the data table lives. Should also have access to a temp directory.

aws_iam

AWS IAM Credentials with access to the s3 bucket where the data table lives. Should also have access to a temp directory.

s3_temp_space

Path to a location where the s3 credentials have write access and read access. Needs to be in the same region/account/bucket where the mysql files live. If left blank the sytem will use the temp path defined in the aws connection if one exists.


Loading Options
path_filter

RegEx of filter to apply for loading files. Can use <YYYY> sytax to load time ranges for current dates