Theory Thursday: Steering the Sailboat: How 13 Parameters Shift a 7B Mode

Art by @basilonmypizza: https://lnkd.in/eF8FkWzN - https://basilhefti.ch/

Training an AI model is hard. It requires skill and persistence. And the methods evolve constantly in this fast-moving field.

The newest trick: add a small number of steering parameters to unlock sleeping functionality.

In Learning to Reason in 13 Parameters, J. Morris et al. take a pretrained Qwen 7B model and improve its performance on GSM8K, a benchmark of ~8,000 grade-school math word problems requiring multi-step reasoning.

They freeze all 7 billion parameters. Nothing in the base model is retrained.

Instead, they attach a tiny low-rank adapter. In the extreme case: just 13 trainable parameters. Inserted into carefully chosen attention projections. Optimized using reinforcement learning.

The implication is interesting. The tiny adapter moves the model toward more consistent reasoning paths, like a rudder gives a sailboat the stability to hold its course.

Practically, this means we can keep a 7B model and steer it, preserving the option to run it on-device.

Which use cases for small devices are you waiting to see?

• https://lnkd.in/ehn5KPHY, Learning to Reason in 13 Parameters, J. Morris et al., Feb ‘26

• Art: https://lnkd.in/eF8FkWzN https://basilhefti.ch/