installing the RHEL-AI api-server via script

[Gregory-Pereira]

cc @nerdalert and @vishnoianil, will need to start testing this on a RHEL-AI box

[nerdalert]

Some thoughts back. Will approve it and you can add the requested changes on a followup or just push it to this since its net new code.

shell-check is failing as well before you merge.

I think we should add the ability to download the binary instead of the user having to build it. I'd rather not have to install go etc and reboot etc. We can figure out where to host it etc. Ty!

[nerdalert]

Lets build it here plx:

go build -o ilab-api-router

[nerdalert]

Pop a sudo in front of the rpm-ostree.

sudo rpm-ostree install gcc glibc-devel

Can we test if those are already installed? rpm-ostree will throw an exit 1 if the package is already installed.

[nerdalert]

Console a message that the system needs to reboot and to re-run the script after it boots.

[nerdalert]

Let's set the default taxonomy ENV in the script to $HOME/.local/share/instructlab/taxonomy/. If that path doesn't exist then prompt the user etc. They can override the default if they define one but Im not really worried about any other path than the default atm. We can set it in the api-server as a default as well as needed for simplicity.

[nerdalert]

Lets add a section/function to install go for the user. We don't want them having to figure that out if we aren't providing a binary to download. I tested this on rhel ai.

Here is a quick script you can crib from:

#!/bin/bash

set -e

GO_VERSION="1.23.5"
GO_ARCHIVE="go${GO_VERSION}.linux-amd64.tar.gz"
GO_URL="https://go.dev/dl/${GO_ARCHIVE}"
INSTALL_DIR="$HOME/.go"
PATH_EXPORT="export PATH=\$PATH:${INSTALL_DIR}/bin"

# Check if Go is already installed
if command -v go >/dev/null 2>&1; then
    echo "Go is already installed: $(go version)"
    exit 0
fi

for cmd in curl tar; do
    if ! command -v "$cmd" >/dev/null 2>&1; then
        echo "Error: '$cmd' is not installed. Please install it and retry."
        exit 1
    fi
done

echo "Downloading Go ${GO_VERSION}..."
curl -LO "$GO_URL"

mkdir -p "$INSTALL_DIR"

tar --strip-components=1 -C "$INSTALL_DIR" -xzf "$GO_ARCHIVE"

rm "$GO_ARCHIVE"

# Export PATH in current shell
export PATH="$PATH:${INSTALL_DIR}/bin"
echo "Go bin directory added to PATH for the current session."

# Add PATH export to ~/.bashrc if not already present
grep -qxF "$PATH_EXPORT" "$HOME/.bashrc" || echo "$PATH_EXPORT" >> "$HOME/.bashrc"
echo "Go bin directory added to PATH in ~/.bashrc."

# Verify
go version

[nerdalert]

Pop in --vllm. There is support for llama-cpp. It is currently the default and should probably be flipped but it doesn't hurt to make it explicit either way ¯\(ツ)/¯

./ilab-api-router  --taxonomy-path /var/home/cloud-user/.local/share/instructlab/taxonomy/ --cuda --rhelai --vllm