Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add ArangoDB #104

Merged
merged 1 commit into from
Jul 22, 2024
Merged

feat: add ArangoDB #104

merged 1 commit into from
Jul 22, 2024

Conversation

michalc
Copy link
Member

@michalc michalc commented Jul 11, 2024

(Optionally) adds Arango to Data Workspace

ECS

Includes Arango ECS service connecting to the main ECS cluster.
ArangoDB instance run using EC2 to allow for Elastic Block Storage to attach to ArangoDB instances when spun up (auto-scaling group). There is a load balancer to connect the Data workspace tools to the ArangoDB instance.

EBS

The EBS volume mounts to /data directory within the instance, and the ArangoDB container task definition mounts the instance's /data directory to /var/lib/arangodb3 directory within the container (as this is where data is stored in an Arango database).

Connecting to ECS

As the Arango EC2 instance is in a private subnet and the Datasets VPC does not have access to the internet, VPC Endpoints were used too allow the EC2 insrtance to connect to ECS. The endpoints were placed in the Datasets VPC (which did require DNS hostnames to be enabled) and policies were created and attach to the endpoints to restrict access to only the Arango instance.

@michalc michalc requested a review from a team as a code owner July 11, 2024 12:53
@michalc michalc force-pushed the feat/arango branch 9 times, most recently from a218781 to ff2c3e8 Compare July 15, 2024 11:07
infra/ecs_main_arango.tf Outdated Show resolved Hide resolved
infra/vpc.tf Show resolved Hide resolved
infra/ecs_main_arango.tf Outdated Show resolved Hide resolved
infra/ecs_main_arango.tf Outdated Show resolved Hide resolved
infra/ecs_main_arango.tf Outdated Show resolved Hide resolved
infra/main.tf Show resolved Hide resolved
infra/security_groups.tf Outdated Show resolved Hide resolved
infra/security_groups.tf Outdated Show resolved Hide resolved
infra/security_groups.tf Outdated Show resolved Hide resolved
infra/security_groups.tf Outdated Show resolved Hide resolved
infra/security_groups.tf Outdated Show resolved Hide resolved
infra/security_groups.tf Outdated Show resolved Hide resolved
infra/security_groups.tf Outdated Show resolved Hide resolved
infra/security_groups.tf Outdated Show resolved Hide resolved
infra/security_groups.tf Outdated Show resolved Hide resolved
infra/security_groups.tf Outdated Show resolved Hide resolved
infra/security_groups.tf Outdated Show resolved Hide resolved
infra/security_groups.tf Outdated Show resolved Hide resolved
infra/security_groups.tf Outdated Show resolved Hide resolved
infra/security_groups.tf Outdated Show resolved Hide resolved
infra/vpc.tf Outdated Show resolved Hide resolved
infra/vpc.tf Outdated Show resolved Hide resolved
infra/vpc.tf Outdated Show resolved Hide resolved
infra/vpc.tf Outdated Show resolved Hide resolved
infra/vpc.tf Outdated Show resolved Hide resolved
infra/vpc.tf Show resolved Hide resolved
@michalc michalc force-pushed the feat/arango branch 10 times, most recently from 66c3f88 to 1f8fb9e Compare July 22, 2024 21:02
(Optionally) adds Arango to Data Workspace

Includes Arango ECS service connecting to the main ECS cluster.  ArangoDB
instance run using EC2 to allow for Elastic Block Storage to attach to ArangoDB
instances when spun up (auto-scaling group). There is a load balancer to
connect the Data workspace tools to the ArangoDB instance.

The EBS volume mounts to /data directory within the instance, and the ArangoDB
container task definition mounts the instance's /data directory to
/var/lib/arangodb3 directory within the container (as this is where data is
stored in an Arango database).

As the Arango EC2 instance is in a private subnet and the Datasets VPC does not
have access to the internet, VPC Endpoints were used too allow the EC2
insrtance to connect to ECS. The endpoints were placed in the Datasets VPC
(which did require DNS hostnames to be enabled) and policies were created and
attach to the endpoints to restrict access to only the Arango instance.

Co-authored-by: Isobel Daley <[email protected]>
Co-authored-by: Zayn-6point6 <[email protected]>
Co-authored-by: Michal Charemza <[email protected]>
Co-authored-by: Ares Galamatis <[email protected]>
Co-authored-by: Peter Woodcock <[email protected]>
Co-authored-by: Mohizur Khan <[email protected]>
@michalc michalc merged commit cb04641 into main Jul 22, 2024
1 check passed
@michalc michalc deleted the feat/arango branch July 22, 2024 21:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant