All packages

bumblebee_quantized

4-bit quantized LLM inference with LoRA adapters for Apple Silicon
bumblebee_quantized Nerves compatibility badge

Maintained on Hex by yburyug

Memory: last toolchain build peaked at 457 MiB of 2 GiB

Latest version
0.1.0
Last run
25 days ago
Checks
10

This package compiles cleanly for all tested hardware using Nerves.

What does Nerves compatibility mean?

Nerves builds Elixir firmware for embedded devices such as the Raspberry Pi and BeagleBone. This site adds each Hex package to a fresh Nerves project and builds firmware for a set of common boards, the targets listed below.

A package that compiles for every target is very likely to work on a device. A failure usually comes from native code (C, Rust or Zig) that does not cross-compile, or from something the build expects on a desktop machine. It does not prove the package is unusable: a fix may be a configuration change away.

Target / check Status Firmware size Run
host
host
pass —
bumblebee_quantized-0.1.0-1793116953574
nerves_system_bbb
2.31.1
pass 25835448
bumblebee_quantized-0.1.0-1793116953574
nerves_system_mangopi_mq_pro
0.18.1
pass 29114538
bumblebee_quantized-0.1.0-1793116953574
nerves_system_qemu_aarch64
0.5.1
pass 31917568
bumblebee_quantized-0.1.0-1793116953574
nerves_system_rpi0
2.2.1
pass 35256217
bumblebee_quantized-0.1.0-1793116953574
nerves_system_rpi0_2
2.2.1
pass 40627269
bumblebee_quantized-0.1.0-1793116953574
nerves_system_rpi4
2.2.1
pass 44960469
bumblebee_quantized-0.1.0-1793116953574
nerves_system_rpi5
2.2.1
pass 58637434
bumblebee_quantized-0.1.0-1793116953574
nerves_system_trellis
0.6.1
pass 26366836
bumblebee_quantized-0.1.0-1793116953574
nerves_system_x86_64
1.35.1
pass 34259908
bumblebee_quantized-0.1.0-1793116953574

Add this badge to your README

It updates itself as bumblebee_quantized's compatibility is reassessed.

bumblebee_quantized Nerves compatibility badge
Markdown
HTML