Post
56
π§ New Space: MindReader-NLA β ask a frozen LM what it's thinking, in plain English.
A trained Activation Verbalizer (~5β13M params, frozen backbone) over Qwen-2.5-7B, Llama-3.2-3B, and Gemma-2-2B. Three demos in one Space:
Playground β sample K verbalizations of the layer-L hidden state and score how well each reproduces the original activation when fed back through the same frozen model (raw + anisotropy-centred cosine FVE).
Live Thought Trace β stream a verbalization per token as the model writes, side-by-side with the generation.
Steer-by-Editing β edit the verbalized thought, project it back into hidden-state space, and watch the continuation change.
Runs on ZeroGPU. Try it: RiverRider/srt-nla-demo
Paper + code: https://github.com/space-bacon/SRT
A trained Activation Verbalizer (~5β13M params, frozen backbone) over Qwen-2.5-7B, Llama-3.2-3B, and Gemma-2-2B. Three demos in one Space:
Playground β sample K verbalizations of the layer-L hidden state and score how well each reproduces the original activation when fed back through the same frozen model (raw + anisotropy-centred cosine FVE).
Live Thought Trace β stream a verbalization per token as the model writes, side-by-side with the generation.
Steer-by-Editing β edit the verbalized thought, project it back into hidden-state space, and watch the continuation change.
Runs on ZeroGPU. Try it: RiverRider/srt-nla-demo
Paper + code: https://github.com/space-bacon/SRT