Speech recognition and tool-calling models on embedded Linux boards, under 200 MB of RAM, no cloud round trip.
Mostly the memory arithmetic: what fits, what an ARMv7 core can hold in real time, and when the honest answer is that it does not.
| nlohmann/json | JSON for Modern C++ | |
| yhirose/cpp-httplib | A C++ header-only HTTP/HTTPS server and client library | |
| livekit/agents | A framework for building realtime voice AI agents | |
| cactus-compute/needle | 14MB foundation model for phones, wearables, smart home and robots | |
| growthbook/growthbook | Open source feature flags, experimentation and product analytics | |
| Serial-Studio/Serial-Studio | Telemetry dashboard for UART, BLE, MQTT, Modbus and CAN bus | |
| Openpanel-dev/openpanel | Open-source web and product analytics, an alternative to Mixpanel | |
| 0xShug0/audio.cpp | Pure C++ inference engine for audio models, powered by ggml | |
| dearlordylord/huly-mcp | MCP server and CLI for the Huly platform |

