Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Init profiles worker with member affiliations update #1962

Merged
merged 17 commits into from
Jan 8, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
17 commits
Select commit Hold shift + click to select a range
80fba34
Init profiles worker with member affiliations update
loicsaintroch Dec 13, 2023
fb203fd
Fix pnpm lock file
loicsaintroch Dec 13, 2023
afb7c54
Merge remote-tracking branch 'origin/main' into improvement/async-mem…
loicsaintroch Dec 18, 2023
a71c600
Merge remote-tracking branch 'origin/main' into improvement/async-mem…
loicsaintroch Dec 19, 2023
2d7600a
Remove soon-to-be deprecated tests
loicsaintroch Dec 19, 2023
bcfaf0b
Merge remote-tracking branch 'origin/main' into improvement/async-mem…
loicsaintroch Jan 2, 2024
0590769
Merge remote-tracking branch 'origin/main' into improvement/async-mem…
loicsaintroch Jan 2, 2024
84f6aae
Fix worker options in profiles worker
loicsaintroch Jan 2, 2024
2fac97a
Merge remote-tracking branch 'origin/main' into improvement/async-mem…
loicsaintroch Jan 3, 2024
a9ad85e
Merge remote-tracking branch 'origin/main' into improvement/async-mem…
loicsaintroch Jan 3, 2024
44cdb2d
Change workflow reuse policy for async updates
loicsaintroch Jan 3, 2024
48eb920
Merge remote-tracking branch 'origin/main' into improvement/async-mem…
loicsaintroch Jan 3, 2024
3788897
Merge remote-tracking branch 'origin/main' into improvement/async-mem…
loicsaintroch Jan 3, 2024
b4627b1
Fix async execution after transaction commit
loicsaintroch Jan 5, 2024
f73966e
Merge remote-tracking branch 'origin/main' into improvement/async-mem…
loicsaintroch Jan 5, 2024
888766d
Make linter h
loicsaintroch Jan 5, 2024
023f608
Merge remote-tracking branch 'origin/main' into improvement/async-mem…
loicsaintroch Jan 8, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
43 changes: 43 additions & 0 deletions .github/workflows/lf-production-deploy-new.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -27,6 +27,10 @@ on:
description: Deploy emails-worker service?
required: true
type: boolean
deploy_profiles_worker:
description: Deploy profiles-worker service?
required: true
type: boolean
deploy_members_enrichment_worker:
description: Deploy members-enrichment-worker service?
required: true
Expand Down Expand Up @@ -182,6 +186,27 @@ jobs:
id: image
run: echo "IMAGE=${{ steps.image-builder.outputs.image }}" >> $GITHUB_OUTPUT

build-and-push-profiles-worker:
runs-on: ubuntu-latest
if: ${{ inputs.deploy_profiles_worker }}
outputs:
image: ${{ steps.image.outputs.IMAGE }}
defaults:
run:
shell: bash
steps:
- name: Check out repository code
uses: actions/checkout@v2

- uses: ./.github/actions/build-docker-image
id: image-builder
with:
image: profiles-worker

- name: Set docker image output
id: image
run: echo "IMAGE=${{ steps.image-builder.outputs.image }}" >> $GITHUB_OUTPUT

build-and-push-members-enrichment-worker:
runs-on: ubuntu-latest
if: ${{ inputs.deploy_members_enrichment_worker }}
Expand Down Expand Up @@ -378,6 +403,24 @@ jobs:
image: ${{ needs.build-and-push-emails-worker.outputs.image }}
cluster: ${{ env.CROWD_CLUSTER }}

deploy-profiles-worker:
needs: build-and-push-profiles-worker
runs-on: ubuntu-latest
if: ${{ inputs.deploy_profiles_worker }}
defaults:
run:
shell: bash

steps:
- name: Check out repository code
uses: actions/checkout@v2

- uses: ./.github/actions/deploy-service
with:
service: profiles-worker
image: ${{ needs.build-and-push-profiles-worker.outputs.image }}
cluster: ${{ env.CROWD_CLUSTER }}

deploy-members-enrichment-worker:
needs: build-and-push-members-enrichment-worker
runs-on: ubuntu-latest
Expand Down
60 changes: 60 additions & 0 deletions .github/workflows/lf-staging-deploy-profiles-worker.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,60 @@
name: LF Staging Deploy Profiles Worker

on:
push:
branches:
- 'lf-staging/**'
- 'lf-staging-**'
paths:
- 'services/libs/**'
- 'services/apps/profiles_worker/**'

env:
DOCKERHUB_USERNAME: ${{ secrets.DOCKERHUB_USERNAME }}
DOCKERHUB_PASSWORD: ${{ secrets.DOCKERHUB_PASSWORD }}
CROWD_CLUSTER: ${{ secrets.LF_STAGING_CLUSTER_NAME }}
CROWD_ROLE_ARN: ${{ secrets.LF_STAGING_CLUSTER_ROLE_ARN }}
AWS_ACCESS_KEY_ID: ${{ secrets.LF_AWS_ACCESS_KEY_ID }}
AWS_SECRET_ACCESS_KEY: ${{ secrets.LF_AWS_SECRET_ACCESS_KEY }}
AWS_REGION: ${{ secrets.LF_AWS_REGION }}
SLACK_CHANNEL: deploys-lf-staging
SLACK_WEBHOOK: ${{ secrets.LF_STAGING_SLACK_CHANNEL_HOOK }}

jobs:
build-and-push:
runs-on: ubuntu-latest
outputs:
image: ${{ steps.image.outputs.IMAGE }}
defaults:
run:
shell: bash

steps:
- name: Check out repository code
uses: actions/checkout@v2

- uses: ./.github/actions/build-docker-image
id: image-builder
with:
image: profiles-worker

- name: Set docker image output
id: image
run: echo "IMAGE=${{ steps.image-builder.outputs.image }}" >> $GITHUB_OUTPUT

deploy-profiles-worker:
needs: build-and-push
runs-on: ubuntu-latest
defaults:
run:
shell: bash

steps:
- name: Check out repository code
uses: actions/checkout@v2

- uses: ./.github/actions/deploy-service
with:
service: profiles-worker
image: ${{ needs.build-and-push.outputs.image }}
cluster: ${{ env.CROWD_CLUSTER }}
43 changes: 43 additions & 0 deletions .github/workflows/production-deploy-new.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -27,6 +27,10 @@ on:
description: Deploy emails-worker service?
required: true
type: boolean
deploy_profiles_worker:
description: Deploy profiles-worker service?
required: true
type: boolean
deploy_members_enrichment_worker:
description: Deploy members-enrichment-worker service?
required: true
Expand Down Expand Up @@ -182,6 +186,27 @@ jobs:
id: image
run: echo "IMAGE=${{ steps.image-builder.outputs.image }}" >> $GITHUB_OUTPUT

build-and-push-profiles-worker:
runs-on: ubuntu-latest
if: ${{ inputs.deploy_profiles_worker }}
outputs:
image: ${{ steps.image.outputs.IMAGE }}
defaults:
run:
shell: bash
steps:
- name: Check out repository code
uses: actions/checkout@v2

- uses: ./.github/actions/build-docker-image
id: image-builder
with:
image: profiles-worker

- name: Set docker image output
id: image
run: echo "IMAGE=${{ steps.image-builder.outputs.image }}" >> $GITHUB_OUTPUT

build-and-push-members-enrichment-worker:
runs-on: ubuntu-latest
if: ${{ inputs.deploy_members_enrichment_worker }}
Expand Down Expand Up @@ -378,6 +403,24 @@ jobs:
image: ${{ needs.build-and-push-emails-worker.outputs.image }}
cluster: ${{ env.CROWD_CLUSTER }}

deploy-profiles-worker:
needs: build-and-push-profiles-worker
runs-on: ubuntu-latest
if: ${{ inputs.deploy_profiles_worker }}
defaults:
run:
shell: bash

steps:
- name: Check out repository code
uses: actions/checkout@v2

- uses: ./.github/actions/deploy-service
with:
service: profiles-worker
image: ${{ needs.build-and-push-profiles-worker.outputs.image }}
cluster: ${{ env.CROWD_CLUSTER }}

deploy-members-enrichment-worker:
needs: build-and-push-members-enrichment-worker
runs-on: ubuntu-latest
Expand Down
60 changes: 60 additions & 0 deletions .github/workflows/staging-deploy-profiles-worker.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,60 @@
name: Staging Deploy Profiles Worker

on:
push:
branches:
- 'staging/**'
- 'staging-**'
paths:
- 'services/libs/**'
- 'services/apps/profiles_worker/**'

env:
DOCKERHUB_USERNAME: ${{ secrets.DOCKERHUB_USERNAME }}
DOCKERHUB_PASSWORD: ${{ secrets.DOCKERHUB_PASSWORD }}
CROWD_CLUSTER: ${{ secrets.STAGING_CLUSTER_NAME }}
CROWD_ROLE_ARN: ${{ secrets.STAGING_CLUSTER_ROLE_ARN }}
AWS_ACCESS_KEY_ID: ${{ secrets.AWS_ACCESS_KEY_ID }}
AWS_SECRET_ACCESS_KEY: ${{ secrets.AWS_SECRET_ACCESS_KEY }}
AWS_REGION: ${{ secrets.AWS_REGION }}
SLACK_CHANNEL: deploys-staging
SLACK_WEBHOOK: ${{ secrets.STAGING_SLACK_CHANNEL_HOOK }}

jobs:
build-and-push:
runs-on: ubuntu-latest
outputs:
image: ${{ steps.image.outputs.IMAGE }}
defaults:
run:
shell: bash

steps:
- name: Check out repository code
uses: actions/checkout@v2

- uses: ./.github/actions/build-docker-image
id: image-builder
with:
image: profiles-worker

- name: Set docker image output
id: image
run: echo "IMAGE=${{ steps.image-builder.outputs.image }}" >> $GITHUB_OUTPUT

deploy-profiles-worker:
needs: build-and-push
runs-on: ubuntu-latest
defaults:
run:
shell: bash

steps:
- name: Check out repository code
uses: actions/checkout@v2

- uses: ./.github/actions/deploy-service
with:
service: profiles-worker
image: ${{ needs.build-and-push.outputs.image }}
cluster: ${{ env.CROWD_CLUSTER }}
Loading
Loading