davidtio

0 Followers · 0 Following

• Joined on 2025-12-24

Repositories

3

Projects Packages Public Activity Starred Repositories

dtllamas (latest)

Published 2026-03-19 12:26:17 +00:00 by davidtio

Installation

Pull the image from the command line:

docker pull gitea.dtio.app/davidtio/dtllamas:latest

Digest

sha256:1563528f48dfe283b1027d45d357ac0fce15c0cc1859ff97f042fe2a58b670af

For more information on the Container registry, see the documentation.

Image Layers

ARG RELEASE

ARG LAUNCHPAD_BUILD_ARCH

LABEL org.opencontainers.image.ref.name=ubuntu

LABEL org.opencontainers.image.version=24.04

ADD file:1ae27d2ef4369361104b699712f3897141e394785df5d193d67b44626f57eb87 in /

CMD ["/bin/bash"]

WORKDIR /app

/bin/sh -c apt-get update && apt-get install -y --no-install-recommends python3.12 curl libgomp1 libvulkan1 mesa-vulkan-drivers && rm -rf /var/lib/apt/lists/* && ln -s /usr/bin/python3.12 /usr/local/bin/python && ln -s /usr/bin/python3.12 /usr/local/bin/python3 && ln -sf /sbin/ldconfig /usr/local/bin/ldconfig 2>/dev/null || true

COPY dir:782ab1dc36a2fb0f0a6f955c788acc0c14d328b5ec44102a2426204ddfc54de2 in /opt/venv

ENV PATH="/opt/venv/bin:/usr/local/bin:/usr/bin:/bin"

ENV LD_LIBRARY_PATH="/usr/local/lib/llama:/usr/local/lib:${LD_LIBRARY_PATH}"

COPY multi:54f154b87322ba515d45570aff4585759062f217fd45cf8b234e572ac34feb90 in /usr/local/lib/

COPY multi:8682a84ad647a653a68edd20e21552ec48586e823aa7f3dd468655ac444b680b in /usr/local/lib/

COPY multi:ce8e727bd774cf2e2fa6f531ee51e791ada42b45a4de975e75fdd416f1b9b30c in /usr/local/lib/

COPY multi:0c90e0c1640f752fd32e420c2ef9e9689dbbdd454e9f962ab38a28731de675e2 in /usr/local/lib/

COPY multi:60e375b3be94e3f3b7232b68498f28eaa2799a1995348583bb72f44905f305a0 in /usr/local/lib/

COPY multi:1782b1cc7fb087de94e72464bc4daf12912804d7c64dbe0233127511efb381be in /usr/local/lib/

/bin/sh -c ldconfig

COPY file:9a0a8b330747fd87f67caa1196ef74cbfb578128c0673eaf25dabfc4818c2eb0 in /usr/local/bin/llama-server-cuda

COPY dir:b967637a4883e94cb10c0f3c7b6a78373ad3a500d71c640620c953e897a85360 in /usr/local/lib/llama/cuda/

COPY file:221d981a7815ff49c0ef17ac530438273cea4eba1c599a30caf152f4dfd7367c in /usr/local/bin/llama-server-vulkan

COPY dir:4b230be51e0bb78e4b5f6b941ee911ff379cea9d2a32a07762cfc25195174135 in /usr/local/lib/llama/vulkan/

/bin/sh -c printf '#!/bin/bash\nif [ -e /dev/dri/renderD128 ]; then\n export LD_LIBRARY_PATH=/usr/local/lib/llama/vulkan:${LD_LIBRARY_PATH}\n exec /usr/local/bin/llama-server-vulkan "$@"\nelse\n export LD_LIBRARY_PATH=/usr/local/lib/llama/cuda:${LD_LIBRARY_PATH}\n exec /usr/local/bin/llama-server-cuda "$@"\nfi\n' > /usr/local/bin/llama-server && chmod +x /usr/local/bin/llama-server

/bin/sh -c echo "/usr/local/lib/llama/cuda" > /etc/ld.so.conf.d/llama-cuda.conf && echo "/usr/local/lib/llama/vulkan" > /etc/ld.so.conf.d/llama-vulkan.conf && ldconfig

COPY multi:27805a726277dd425bca7cbd3db60f3ebbdc74368aa788c09ae2e550d688226d in ./

/bin/sh -c chmod +x start.sh

COPY dir:3f29c69557122acaee19751d0da10bc0a9aaf164976ec892f120df3b8d279674 in ./templates/

/bin/sh -c mkdir -p /app/models

VOLUME ["/app/models"]

EXPOSE 8080

HEALTHCHECK --interval=30s --timeout=10s --start-period=120s --retries=3 CMD curl -f http://localhost:8080/health || exit 1

CMD ["/app/start.sh"]

Labels

Key	Value
io.buildah.version	1.33.7
org.opencontainers.image.ref.name	ubuntu
org.opencontainers.image.version	24.04

Details

Container

2026-03-19 12:26:17 +00:00

0

OCI / Docker

linux/amd64

2.3 GiB

Versions (1) View all

latest 2026-03-19