praxagent / Technical record
Notes tagged Sparse-Autoencoders
Research notes collected under Sparse-Autoencoders, ordered by date.
A Linear Nudge, a Nonlinear Wake
We followed controlled hidden-state edits through the final 29 blocks of Llama 3.3 70B. The delivered edits scaled linearly with dose in all 24 test cells on the prespecified panel; the model's final hidden state did in …
Can a Jacobian Lens Detect SAE Steering?
A prospectively frozen Llama 3.3 70B experiment asks whether an auditor can tell, from a steered internal state alone, which public SAE feature was steered. Under a fixed Jacobian-lens readout the answer is no; the same …
How to Read an SAE Feature ID
A primer on sparse autoencoders: what a feature ID is, how labels get assigned, and why an activation map is not yet an explanation. A public deception/roleplay feature set is used as a worked example under Llama 3.3 70B …