Scope
The tasks a compact model can take on by itself
A research lab for training small open-source LLMs
We study models small enough to run on a single GPU: their limits, how they are trained, and how they should be tested.
Fine-tuning
Adapting models when compute is scarce
Evaluation
Scoring that stays out of the training loop
On-device
Running models where the data already lives