All packages

llama_cpp_sdk

First concrete self-hosted inference backend for llama.cpp, owning llama-server boot specs, readiness probes, stop semantics, and endpoint publication through self_hosted_inference_core.
llama_cpp_sdk Nerves compatibility badge

Maintained on Hex by nshkrdotcom

Memory: last toolchain build peaked at 303 MiB of 2 GiB

Latest version
0.1.0
Last run
27 days ago
Checks
5

This package compiles cleanly for all tested hardware using Nerves.

What does Nerves compatibility mean?

Nerves builds Elixir firmware for embedded devices such as the Raspberry Pi and BeagleBone. This site adds each Hex package to a fresh Nerves project and builds firmware for a set of common boards, the targets listed below.

A package that compiles for every target is very likely to work on a device. A failure usually comes from native code (C, Rust or Zig) that does not cross-compile, or from something the build expects on a desktop machine. It does not prove the package is unusable: a fix may be a configuration change away.

Target / check Status Firmware size Run
host
host
pass —
llama_cpp_sdk-0.1.0-1792967937210
nerves_system_mangopi_mq_pro
0.17.1
from the Aug 26, 2026 build
pass 25798053
llama_cpp_sdk-0.1.0-1792967937210
nerves_system_rpi0_2
2.2.1
pass 37752204
llama_cpp_sdk-0.1.0-1792967937210
nerves_system_rpi4
2.1.1
from the Aug 26, 2026 build
pass 42129893
llama_cpp_sdk-0.1.0-1792967937210
nerves_system_x86_64
1.34.1
from the Aug 26, 2026 build
pass 29535089
llama_cpp_sdk-0.1.0-1792967937210

Add this badge to your README

It updates itself as llama_cpp_sdk's compatibility is reassessed.

llama_cpp_sdk Nerves compatibility badge
Markdown
HTML