Lumpiasty

0 Followers · 0 Following

• Joined on 2025-02-08

Repositories

3

Projects Packages Code Public Activity Starred Repositories

llama-swap (unified-vulkan-test)

Published 2026-05-31 02:22:48 +00:00 by Lumpiasty

Installation

Pull the image from the command line:

docker pull gitea.lumpiasty.xyz/lumpiasty/llama-swap:unified-vulkan-test

Digest

sha256:33532c8467aa7605a9f434ed32740a48108e3647331c02102029102dc8668fb8

For more information on the Container registry, see the documentation.

Images

Digest	OS / Arch	Size
b5100fdfae	linux/amd64	784 MiB

Image Layers ( linux/amd64)

LABEL org.opencontainers.image.description=CachyOS - Arch-based distribution offering an easy installation, several customizations, and unique performance optimization. - v3 optimized Packages

COPY / / # buildkit

CMD ["/usr/bin/bash"]

ENV PATH=/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin

RUN /bin/sh -c pacman -Syu --noconfirm && pacman -S --noconfirm --needed mesa vulkan-icd-loader vulkan-radeon vulkan-intel gcc-libs openssl zstd curl python python-numpy uv && pacman -Scc --noconfirm && uv pip install --system --break-system-packages sentencepiece # buildkit

ARG BACKEND=vulkan

ARG LLAMA_COMMIT_HASH=unknown

ARG WHISPER_COMMIT_HASH=unknown

ARG SD_COMMIT_HASH=unknown

ARG IK_LLAMA_COMMIT_HASH=unknown

ARG RUN_UID=0

RUN |6 BACKEND=vulkan LLAMA_COMMIT_HASH=unknown WHISPER_COMMIT_HASH=unknown SD_COMMIT_HASH=unknown IK_LLAMA_COMMIT_HASH=unknown RUN_UID=0 /bin/sh -c if [ "$RUN_UID" != "0" ]; then groupadd --system --gid $RUN_UID llama-swap && useradd --system --uid $RUN_UID --gid $RUN_UID --home /app --no-create-home --shell /bin/false llama-swap; fi && mkdir -p /etc/llama-swap/config && chown -R ${RUN_UID}:${RUN_UID} /etc/llama-swap # buildkit

WORKDIR /app

COPY /install/bin/whisper-server /usr/local/bin/ # buildkit

COPY /install/bin/whisper-cli /usr/local/bin/ # buildkit

COPY /install/lib/ /usr/local/lib/ # buildkit

COPY /install/bin/sd-server /usr/local/bin/ # buildkit

COPY /install/bin/sd-cli /usr/local/bin/ # buildkit

COPY /install/lib/ /usr/local/lib/ # buildkit

COPY /install/bin/llama-server /usr/local/bin/ # buildkit

COPY /install/bin/llama-cli /usr/local/bin/ # buildkit

COPY /install/bin/ /usr/local/bin/ # buildkit

COPY /install/bin/llama-swap /usr/local/bin/ # buildkit

COPY /install/llama-swap-version /tmp/ # buildkit

RUN |6 BACKEND=vulkan LLAMA_COMMIT_HASH=unknown WHISPER_COMMIT_HASH=unknown SD_COMMIT_HASH=unknown IK_LLAMA_COMMIT_HASH=unknown RUN_UID=0 /bin/sh -c echo '/usr/local/lib' > /etc/ld.so.conf.d/usrlocal.conf && ldconfig # buildkit

COPY config.example.yaml /etc/llama-swap/config/config.yaml # buildkit

RUN |6 BACKEND=vulkan LLAMA_COMMIT_HASH=unknown WHISPER_COMMIT_HASH=unknown SD_COMMIT_HASH=unknown IK_LLAMA_COMMIT_HASH=unknown RUN_UID=0 /bin/sh -c echo "llama.cpp: ${LLAMA_COMMIT_HASH}" > /versions.txt && echo "whisper.cpp: ${WHISPER_COMMIT_HASH}" >> /versions.txt && echo "stable-diffusion.cpp: ${SD_COMMIT_HASH}" >> /versions.txt && echo "ik_llama.cpp: ${IK_LLAMA_COMMIT_HASH}" >> /versions.txt && echo "llama-swap: $(cat /tmp/llama-swap-version)" >> /versions.txt && echo "backend: ${BACKEND}" >> /versions.txt && echo "build_timestamp: $(date -u +%Y-%m-%dT%H:%M:%SZ)" >> /versions.txt # buildkit

RUN |6 BACKEND=vulkan LLAMA_COMMIT_HASH=unknown WHISPER_COMMIT_HASH=unknown SD_COMMIT_HASH=unknown IK_LLAMA_COMMIT_HASH=unknown RUN_UID=0 /bin/sh -c mkdir -p /models && chown ${RUN_UID}:${RUN_UID} /models # buildkit

WORKDIR /models

USER 0

ENTRYPOINT ["llama-swap"]

CMD ["-config" "/etc/llama-swap/config/config.yaml" "-listen" "0.0.0.0:8080"]

Labels

Key	Value
org.opencontainers.image.description	CachyOS - Arch-based distribution offering an easy installation, several customizations, and unique performance optimization. - v3 optimized Packages

Details

Container

2026-05-31 02:22:48 +00:00

3

OCI / Docker

Versions (2) View all

unified-vulkan-b9222 2026-05-31

unified-vulkan-test 2026-05-31