bugfix(#28): fixed make prod bug

[samuelimoisili]

Added a docker compose file to fix make prod postgrest startup issue.

Closes #28

[andrablaj]

I managed to reproduce @mrjones-plip's bug locally on the main branch.

If I run make prod on this PR's branch (after running CHT locally with the docker helper), I get the following error in the dbt container:

Unable to connect! could not translate host name "postgres" to address: Name or service not known

[samuelimoisili]

@andrablaj You'll to setup a PostgreSQL database and update the following environment variables:

DBT_POSTGRES_HOST=
DBT_POSTGRES_USER=
DBT_POSTGRES_PASSWORD=
POSTGRES_DB=
POSTGRES_TABLE=
DBT_POSTGRES_SCHEMA=
POSTGRES_SCHEMA=

[mrjones-plip]

@andrablaj - I'm waaaay behind on my mail/slack/todo queue - removing myself as a reviewer to unblock.

[njogz]

Unassigning myself as a reviewer for now since I am away today and on Monday

[andrablaj]

@samuelimoisili, following up here with some items from our 1:1 discussion:

• I didn't see any mention in the documentation about installing PostgreSQL as a prerequisite to run cht-sync. Can you please add that step in the README?
• You mentioned having a docker-compose file for setting up PostgreSQL locally. Can you please share it in the repo with instructions on how to use it and how it reflects in the .env file variables?

Thanks!

[njogz]

Is this PR still relevant given you do away with the makefile in this PR?

[samuelimoisili]

@njogz Yes, it is relevant. It introduces a new docker-compose file.

[andrablaj]

🎆 Awesome, I managed to run make prod successfully locally, with the latest CHT run via docker helper. Great job!

Nevertheless, the documentation needs updates as I needed to perform extra steps to have this running correctly.

1. Content of .env:

# project wide: optional
COMPOSE_PROJECT_NAME=pipeline

# postgrest and pogresql: required environment variables for 'gamma', prod and 'local'
POSTGRES_USER=root
POSTGRES_PASSWORD=supercoolpassword
POSTGRES_DB=data
POSTGRES_TABLE=couchdb
POSTGRES_SCHEMA=v1

# dbt: required environment variables for 'gamma', 'prod' and 'local'
DBT_POSTGRES_USER=dbt_user
DBT_POSTGRES_PASSWORD=supercoolpassword
DBT_POSTGRES_SCHEMA=dbt
DBT_POSTGRES_HOST=yourIP
CHT_PIPELINE_BRANCH_URL=https://github.com/medic/cht-pipeline.git#main

# couchdb and logstash: required environment variables for 'gamma', 'prod' and 'local'
COUCHDB_USER=medic
COUCHDB_PASSWORD=password
COUCHDB_DB=medic-users-meta
COUCHDB_HOST=yourCHThost
COUCHDB_PORT=yourCHTport
COUCHDB_SECURE=false

# superset: required environment variables for 'gamma', 'prod' and 'local'
SUPERSET_PASSWORD=password
[email protected]

2. Run make prod
3. Run docker-compose -f docker-compose.postgres.yml -f docker-compose.yml up postgres.

I think it's worth mentioning that the user can skip step 3 if they have a local instance of postgreSQL, and update .env accordingly.

[andrablaj]

[medic-ci]

🎉 This PR is included in version 1.0.0 🎉

The release is available on GitHub release

Your semantic-release bot 📦🚀