The AI in a Box is a Rockchip-powered offline and open-source LLM device
Useful Sensors indicates that this device is built around the RockChip 3588S SoC with 8GB DRAM memory and NPU already seen in other SBCs such as the Indiedroid Nova, NanoPi R6C, etc.
They also mention that the AI in a Box is developed using open-source models like Whisper and Llama2. Moreover, all the code is made available under an open-source license, including their library for optimized transformer inference on the RockChip NPU.