Skip to content

SteveScott/db-safegraph

 
 

Repository files navigation

db-safegraph

Note:

  • if you are a programatic user, checkout our sample notebooks under examples. Open In Colab
  • If you are a desktop user and prefer to access data through a desktop GUI app, please check out cyber duck

Instructions

  1. Install dependencies
pip3 install -r requirements.txt
  1. Install cli autocomplete
./sg --install-completion
  1. Run a recipes (when you hit TAB there should be a list of available recipe names, autocomplete is availble here)
./sg run [TAB]

Note: type ./sg --help to get a list of available comamnds

Usage: sg [OPTIONS] COMMAND [ARGS]...

Options:
  --install-completion  Install completion for the current shell.
  --show-completion     Show completion for the current shell, to copy it or
                        customize the installation.

  --help                Show this message and exit.

Commands:
  run    Running an Athena recipe in the ./recipes folder
  setup  Install minio and set up the accounts we need
  sync   Syncing a safegraph data source, under the ./_sync folder

Resources

About

SafeGraph ETL

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 74.4%
  • Shell 24.8%
  • Dockerfile 0.8%