Lumpiasty

0 Followers · 0 Following

• Joined on 2025-02-08

Repositories

4

Projects Packages Code Public Activity Starred Repositories

llama-swap (unified-vulkan-parakeet-2026-07-06-rootless)

Published 2026-07-06 21:15:06 +00:00 by Lumpiasty

Installation

Pull the image from the command line:

docker pull gitea.lumpiasty.xyz/lumpiasty/llama-swap:unified-vulkan-parakeet-2026-07-06-rootless

Digest

sha256:4077c86cef5e94bf481d909d757b5675cf3d81df3227de8101a23472df40ed28

For more information on the Container registry, see the documentation.

Images

Digest	OS / Arch	Size
bc3855e8c4	linux/amd64	343 MiB

Image Layers ( linux/amd64)

ARG RELEASE

ARG LAUNCHPAD_BUILD_ARCH

LABEL org.opencontainers.image.version=24.04

ADD file:8c609c85109d07bf47cf268a175b3be8bbe34fc0c41d15d99b090d099f4dc837 in /

CMD ["/bin/bash"]

ENV DEBIAN_FRONTEND=noninteractive

ENV PATH=/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin

RUN /bin/sh -c apt-get update && apt-get install -y --no-install-recommends libgomp1 libvulkan1 mesa-vulkan-drivers python3 curl ca-certificates && rm -rf /var/lib/apt/lists/* # buildkit

ARG BACKEND=vulkan

ARG LLAMA_COMMIT_HASH=f36e5c348bc8795c34f9a038e58876e7a8423d4d

ARG WHISPER_COMMIT_HASH=6fc7c33b4c3a2cec83e4b65abd5e96a890480375

ARG SD_COMMIT_HASH=bb84971129d2a094ab8051c6feed5406d3b4409d

ARG IK_LLAMA_COMMIT_HASH=n/a

ARG PARAKEET_COMMIT_HASH=70e097883a994f45e15f6195140487986c408864

ARG RUN_UID=0

RUN |7 BACKEND=vulkan LLAMA_COMMIT_HASH=f36e5c348bc8795c34f9a038e58876e7a8423d4d WHISPER_COMMIT_HASH=6fc7c33b4c3a2cec83e4b65abd5e96a890480375 SD_COMMIT_HASH=bb84971129d2a094ab8051c6feed5406d3b4409d IK_LLAMA_COMMIT_HASH=n/a PARAKEET_COMMIT_HASH=70e097883a994f45e15f6195140487986c408864 RUN_UID=0 /bin/sh -c apt-get update && apt-get install -y --no-install-recommends python3-numpy python3-sentencepiece python3-pip && rm -rf /var/lib/apt/lists/* # buildkit

RUN |7 BACKEND=vulkan LLAMA_COMMIT_HASH=f36e5c348bc8795c34f9a038e58876e7a8423d4d WHISPER_COMMIT_HASH=6fc7c33b4c3a2cec83e4b65abd5e96a890480375 SD_COMMIT_HASH=bb84971129d2a094ab8051c6feed5406d3b4409d IK_LLAMA_COMMIT_HASH=n/a PARAKEET_COMMIT_HASH=70e097883a994f45e15f6195140487986c408864 RUN_UID=0 /bin/sh -c if [ "$RUN_UID" != "0" ]; then groupadd --system --gid $RUN_UID llama-swap && useradd --system --uid $RUN_UID --gid $RUN_UID --home /app --shell /sbin/nologin llama-swap; fi && mkdir -p /etc/llama-swap/config && chown -R ${RUN_UID}:${RUN_UID} /etc/llama-swap # buildkit

WORKDIR /app

COPY /install/bin/whisper-server /usr/local/bin/ # buildkit

COPY /install/bin/whisper-cli /usr/local/bin/ # buildkit

COPY /install/lib/ /usr/local/lib/ # buildkit

COPY /install/bin/sd-server /usr/local/bin/ # buildkit

COPY /install/bin/sd-cli /usr/local/bin/ # buildkit

COPY /install/lib/ /usr/local/lib/ # buildkit

COPY /install/bin/llama-server /usr/local/bin/ # buildkit

COPY /install/bin/llama-cli /usr/local/bin/ # buildkit

COPY /install/bin/llama-tts /usr/local/bin/ # buildkit

COPY /install/bin/ /usr/local/bin/ # buildkit

COPY /install/bin/parakeet-cli /usr/local/bin/ # buildkit

COPY /install/bin/parakeet-server /usr/local/bin/ # buildkit

RUN |7 BACKEND=vulkan LLAMA_COMMIT_HASH=f36e5c348bc8795c34f9a038e58876e7a8423d4d WHISPER_COMMIT_HASH=6fc7c33b4c3a2cec83e4b65abd5e96a890480375 SD_COMMIT_HASH=bb84971129d2a094ab8051c6feed5406d3b4409d IK_LLAMA_COMMIT_HASH=n/a PARAKEET_COMMIT_HASH=70e097883a994f45e15f6195140487986c408864 RUN_UID=0 /bin/sh -c pip install uv --break-system-packages # buildkit

COPY /install/bin/llama-swap /usr/local/bin/ # buildkit

COPY /install/llama-swap-version /tmp/ # buildkit

RUN |7 BACKEND=vulkan LLAMA_COMMIT_HASH=f36e5c348bc8795c34f9a038e58876e7a8423d4d WHISPER_COMMIT_HASH=6fc7c33b4c3a2cec83e4b65abd5e96a890480375 SD_COMMIT_HASH=bb84971129d2a094ab8051c6feed5406d3b4409d IK_LLAMA_COMMIT_HASH=n/a PARAKEET_COMMIT_HASH=70e097883a994f45e15f6195140487986c408864 RUN_UID=0 /bin/sh -c ldconfig # buildkit

COPY config.example.yaml /etc/llama-swap/config/config.yaml # buildkit

RUN |7 BACKEND=vulkan LLAMA_COMMIT_HASH=f36e5c348bc8795c34f9a038e58876e7a8423d4d WHISPER_COMMIT_HASH=6fc7c33b4c3a2cec83e4b65abd5e96a890480375 SD_COMMIT_HASH=bb84971129d2a094ab8051c6feed5406d3b4409d IK_LLAMA_COMMIT_HASH=n/a PARAKEET_COMMIT_HASH=70e097883a994f45e15f6195140487986c408864 RUN_UID=0 /bin/sh -c echo "llama.cpp: ${LLAMA_COMMIT_HASH}" > /versions.txt && echo "whisper.cpp: ${WHISPER_COMMIT_HASH}" >> /versions.txt && echo "stable-diffusion.cpp: ${SD_COMMIT_HASH}" >> /versions.txt && echo "ik_llama.cpp: ${IK_LLAMA_COMMIT_HASH}" >> /versions.txt && echo "parakeet.cpp: ${PARAKEET_COMMIT_HASH}" >> /versions.txt && echo "llama-swap: $(cat /tmp/llama-swap-version)" >> /versions.txt && echo "backend: ${BACKEND}" >> /versions.txt && echo "build_timestamp: $(date -u +%Y-%m-%dT%H:%M:%SZ)" >> /versions.txt # buildkit

RUN |7 BACKEND=vulkan LLAMA_COMMIT_HASH=f36e5c348bc8795c34f9a038e58876e7a8423d4d WHISPER_COMMIT_HASH=6fc7c33b4c3a2cec83e4b65abd5e96a890480375 SD_COMMIT_HASH=bb84971129d2a094ab8051c6feed5406d3b4409d IK_LLAMA_COMMIT_HASH=n/a PARAKEET_COMMIT_HASH=70e097883a994f45e15f6195140487986c408864 RUN_UID=0 /bin/sh -c mkdir -p /models && chown ${RUN_UID}:${RUN_UID} /models # buildkit

WORKDIR /models

USER 0

ENTRYPOINT ["llama-swap"]

CMD ["-config" "/etc/llama-swap/config/config.yaml" "-listen" "0.0.0.0:8080"]

USER root

RUN /bin/sh -c groupadd --system --gid 10001 llama-swap && useradd --system --uid 10001 --gid 10001 --home /app --shell /sbin/nologin llama-swap && chown -R 10001:10001 /etc/llama-swap /models # buildkit

USER 10001

Labels

Key	Value
org.opencontainers.image.version	24.04

Details

Container

2026-07-06 21:15:06 +00:00

0

OCI / Docker

Versions (7) View all

unified-vulkan-parakeet-2026-07-06-rootless 2026-07-06

unified-vulkan-parakeet-2026-07-06 2026-07-06

unified-vulkan-parakeet-2026-06-12-rootless 2026-06-12

unified-vulkan-parakeet-2026-06-12 2026-06-12

unified-vulkan-parakeet-2026-06-09 2026-06-10