Skip to content
This repository has been archived by the owner on Apr 30, 2021. It is now read-only.

Pathgather/postgres_to_redshift

 
 

Repository files navigation

PostgresToRedshift

This gem copies data from postgres to redshift. It's especially useful to copy data from postgres to redshift in heroku.

Build Status

Installation

Add this line to your application's Gemfile:

gem 'postgres_to_redshift'

And then execute:

$ bundle

Or install it yourself as:

$ gem install postgres_to_redshift

Usage

Set your source and target databases, as well as your s3 intermediary.

export POSTGRES_TO_REDSHIFT_SOURCE_URI='postgres://username:password@host:port/database-name'
export POSTGRES_TO_REDSHIFT_TARGET_URI='postgres://username:password@host:port/database-name'
export S3_DATABASE_EXPORT_ID='yourid'
export S3_DATABASE_EXPORT_KEY='yourkey'
export S3_DATABASE_EXPORT_BUCKET='some-bucket-to-use'

postgres_to_redshift

Optional flags:

# Optional debug flag if you'd like the copy job to only warn on Redshift loading errors
# (instead of exiting) and keep going.
export WARN_ON_LOADING_ERROR='true'

Contributing

  1. Fork it ( https://github.com/kitchensurfing/postgres_to_redshift/fork )
  2. Create your feature branch (git checkout -b my-new-feature)
  3. Commit your changes (git commit -am 'Add some feature')
  4. Push to the branch (git push origin my-new-feature)
  5. Create a new Pull Request

About

Copies postgres databases to redshift

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Ruby 88.6%
  • Shell 11.4%