Skip to content

Latest commit

 

History

History
137 lines (98 loc) · 3.55 KB

CUDA.md

File metadata and controls

137 lines (98 loc) · 3.55 KB
Raw

CUDA-based Julia docker stack

GPU accelerated, multi-arch (linux/amd64, linux/arm64/v8) docker images:

Images available for Julia versions ≥ 1.8.5.

Build chain

The same as the Julia docker stack.

Features

glcr.b-data.ch/cuda/julia/ver:*-devel serves as parent image for glcr.b-data.ch/jupyterlab/cuda/julia/base.

Otherwise the same as the Julia docker stack plus

Table of Contents

Prerequisites

The same as the Julia docker stack plus

  • NVIDIA GPU
  • NVIDIA Linux driver
  • NVIDIA Container Toolkit

ℹ️ The host running the GPU accelerated images only requires the NVIDIA driver, the CUDA toolkit does not have to be installed.

Install

To install the NVIDIA Container Toolkit, follow the instructions for your platform:

Usage

Build image (ver)

latest:

stage 1

docker build \
  --build-arg BASE_IMAGE=ubuntu \
  --build-arg BASE_IMAGE_TAG=22.04 \
  --build-arg CUDA_IMAGE=nvidia/cuda \
  --build-arg CUDA_VERSION=12.6.2 \
  --build-arg CUDA_IMAGE_SUBTAG=runtime-ubuntu22.04 \
  --build-arg JULIA_VERSION=1.11.1 \
  --build-arg PYTHON_VERSION=3.12.7 \
  -t cuda/julia/ver \
  -f ver/latest.Dockerfile .

stage 2

docker build \
  --build-arg BUILD_ON_IMAGE=cuda/julia/ver \
  --build-arg CUDNN_VERSION=8.9.7.29 \
  --build-arg CUDNN_CUDA_VERSION_MAJ_MIN=12.2 \
  --build-arg LIBNVINFER_VERSION=10.6.0.26 \
  --build-arg LIBNVINFER_CUDA_VERSION_MAJ_MIN=12.6 \
  --build-arg CUDA_IMAGE_FLAVOR=runtime \
  -t cuda/julia/ver \
  -f cuda/latest.Dockerfile .

version:

stage 1

docker build \
  --build-arg BASE_IMAGE=ubuntu \
  --build-arg BASE_IMAGE_TAG=22.04 \
  --build-arg CUDA_IMAGE=nvidia/cuda \
  --build-arg CUDA_IMAGE_SUBTAG=[cudnn8-]runtime-ubuntu22.04 \
  -t cuda/julia/ver:MAJOR.MINOR.PATCH \
  -f ver/MAJOR.MINOR.PATCH.Dockerfile .

stage 2

docker build \
  --build-arg BUILD_ON_IMAGE=cuda/julia/ver:MAJOR.MINOR.PATCH \
  --build-arg CUDA_IMAGE_FLAVOR=runtime \
  -t cuda/julia/ver:MAJOR.MINOR.PATCH \
  -f cuda/MAJOR.MINOR.PATCH.Dockerfile .

For MAJOR.MINOR.PATCH ≥ 1.8.5.

Run container

self built:

docker run -it --rm \
  --gpus '"device=all"' \
  cuda/julia/ver[:MAJOR.MINOR.PATCH]

from the project's GitLab Container Registries:

docker run -it --rm \
  --gpus '"device=all"' \
  IMAGE[:MAJOR[.MINOR[.PATCH]]]

IMAGE being one of

See Notes for tweaks.