ODROID-XU4 LLM Benchmarking

Why 4 Cores Outperform 8 Cores in llama.cpp

1. The Asymmetric (big.LITTLE) Architecture

The Samsung Exynos 5422 SoC inside the ODROID-XU4 features 8 total physical cores split into two distinct clusters:

Cluster Cores CPU Architecture Relative Speed
LITTLE Cores 0 – 3 Cortex-A7 Low Power (BogoMIPS ~48)
big Cores 4 – 7 Cortex-A15 High Performance (BogoMIPS ~108)

2. Core Bottlenecks in Parallel Inference

3. Optimal Execution Command

To maximize tokens-per-second, use taskset to bind the execution exclusively to the 4 high-performance cores (Cores 4–7):

taskset -c 4-7 ./build/bin/llama-bench -m qwen0.5b.gguf -t 4 -r 1 --no-warmup