All packages

llama_cpp_ex

Elixir bindings for llama.cpp — run LLMs locally with Metal, CUDA, Vulkan, or CPU acceleration.
llama_cpp_ex Nerves compatibility badge

Maintained on Hex by nmaroulis

Memory: last firmware build peaked at 303 MiB of 4 GiB

Latest version
0.8.71
Last run
4 days ago
Checks
10

This package did not compile cleanly for all tested hardware. It may still work with Nerves. See the per-target results below.

What does Nerves compatibility mean?

Nerves builds Elixir firmware for embedded devices such as the Raspberry Pi and BeagleBone. This site adds each Hex package to a fresh Nerves project and builds firmware for a set of common boards, the targets listed below.

A package that compiles for every target is very likely to work on a device. A failure usually comes from native code (C, Rust or Zig) that does not cross-compile, or from something the build expects on a desktop machine. It does not prove the package is unusable: a fix may be a configuration change away.

Target / check Status Firmware size Run
host
host
pass —
llama_cpp_ex-0.8.71-1794964029928
x86_64
nerves_system_bbb
2.31.2
View log
fail —
llama_cpp_ex-0.8.71-1794964029928
x86_64
nerves_system_mangopi_mq_pro
0.18.2
View log
fail —
llama_cpp_ex-0.8.71-1794964029928
x86_64
nerves_system_qemu_aarch64
0.5.2
View log
fail —
llama_cpp_ex-0.8.71-1794964029928
x86_64
nerves_system_rpi0
2.2.2
View log
fail —
llama_cpp_ex-0.8.71-1794964029928
x86_64
nerves_system_rpi0_2
2.2.2
View log
fail —
llama_cpp_ex-0.8.71-1794964029928
x86_64
nerves_system_rpi4
2.2.2
View log
fail —
llama_cpp_ex-0.8.71-1794964029928
x86_64
nerves_system_rpi5
2.2.2
View log
fail —
llama_cpp_ex-0.8.71-1794964029928
x86_64
nerves_system_trellis
0.6.3
View log
fail —
llama_cpp_ex-0.8.71-1794964029928
x86_64
nerves_system_x86_64
1.35.2
pass 35140356
llama_cpp_ex-0.8.71-1794964029928
x86_64

Add this badge to your README

It updates itself as llama_cpp_ex's compatibility is reassessed.

llama_cpp_ex Nerves compatibility badge
Markdown
HTML