You can't use this until you register with us!



aws redshift database nomnomdata


Description

Used for running sql queries on a redshift cluster. Uses an external mysql database to connect to in order to track status of executions.


Purchasing Options



Available Actions

Run SQL Steps

Execute sql steps as stored in the tracking database


Variables

target_db required

Database where you want to run the script on.


sql_steps required

SQL Steps to be run. SQL Steps separated by a ;. Ranges are allowed. To learn more about ranges visit ...


Parameter Info
user_params

If in your sql you use any parameters then you need to create a parameter list here. To use ranges visit ...

user_range

Used to create a sliding window of data to be processed Json formatted. Documentation here...


Export Data Native

Execute sql steps as a data export from a redshift cluster


Variables

target_db required

Database where you want to run the script on.


sql_steps required

Single step to be run. Treated as one statement regardless of ;


S3 Info
aws_connection

AWS Credentials with access to the s3 bucket where the data table lives. Should also have access to a temp directory.

aws_iam

AWS IAM Credentials with access to the s3 bucket where the data table lives. Should also have access to a temp directory.

s3_bucket

S3 Bucket where you want to unload the data to.

s3_path required

Path to a location where data files will be exported


File/Formatting Options
file_name required

Name of the file that will be placed on s3.

append_date required

If specified will append the date of the execution at the end of the filename. Example... name-YYYYMMDDHHMMSS.

delimiter

Delimiter you want to use to separate columns. Default is tab delimited

compression

Compression options currently supported by redshift. Default is gzip.

add_quotes

Add quotes around all columns that are generated.

null_as

The string you want to indicate a null value. Default is empty space AKA empty space.

escape

Escape character used to preceed special characters

allow_overwrite

Overwrite files with the same name

parallel

If true exports files in parallel. Produces files equal to the number of nodes specified. Default is True

max_size

Max file size any individual file can be. The limit is 6.2 GB. Specify as number + [GB/MB]. Example 3.1 GB

encrypted

Specify if you want to encrypt files that are exported


Parameter Info
user_params

If in your sql you use any parameters then you need to create a parameter list here. To use ranges visit ...

user_range

Used to create a sliding window of data to be processed Json formatted. Documentation here...