Use DoltLab in a server without Internet access

[marceloavilaoliveira]

Hi,

We are using DoltLab 2.3.0 in a server without Internet access and when DoltLab tries to create a job we receive the following error:

creation of job failed after 5 retries: final error:
Error response from daemon:

Get "https://public.ecr.aws/v2/": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

Is it possible to use DoltLab in a server without access to public.ecr.aws? Is there a way to workaround this issue?

Thanks a lot.

[coffeegoddd]

Hey @marceloavilaoliveira,

I believe the workaround for being able to use the DoltLab service images i.e. public.ecr.aws would be to use docker image save to store them on a usb drive, then load them with docker image load.

[marceloavilaoliveira]

Hi @coffeegoddd,

The docker workaround did not work as expected. To resolve the issue we had to allow the access to the following URLs:

• public.ecr.aws
• api.github.com
• eventsapi.dolthub.com

This was not our original desire but the application seems to be working now.

[coffeegoddd]

@marceloavilaoliveira Ah, thanks for the update on this. I believe our plan is to support full offline (no egress required) for DoltLab Enterprise only. Tracking issue here #95

[coffeegoddd]

@marceloavilaoliveira may I ask how you found the need to allow access api.github.com? From my investigation/testing I'm not able to reproduce the need to allow access to that url. It is used in DoltHub, but should not be required for DoltLab.

[coffeegoddd]

@marceloavilaoliveira DoltLab v2.3.3 is out now and supports running without egress traffic allowed on the host.

To do so you need to disable usage metrics by setting metrics_disabled: true in the installer_config.yaml, this will stop calls to eventsapi.dolthub.com.

I found that running dolt version from within the Jobs was calling to api.github.com, and this has been removed.

Finally, we now provide the service images to download, so they do not need to be pulled from public.ecr.aws. For DoltLab v2.3.3, download this zip file.

Unzip the file on your DoltLab host. Inside you will see tar files for each service DoltLab depends on. For example, this is the doltlabapi service tar: dolthubapi-server-v2.3.3.tar.

For each file, run the docker load command to load the image onto the DoltLab host:

docker load < dolthubapi-server-v2.3.3.tar

After load the images, you will be able to see them in the output of docker image ls -a.

Finally, start DoltLab, and it will be able to use the images.

Closing this issue for now, please reach out if you encounter any more issues.

[marceloavilaoliveira]

Hi @coffeegoddd

Sorry for the delay in responding, we really had busy days from our side.

Thanks a lot for your support, we'll try to follow your recommendations.

Best regards.