the word 'simple' and 'Santa' in Santa Barbara
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 27 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron mostly lights up on the word 'Santa' in 'University of California, Santa Barbara' and on pieces of words meaning 'simple' or 'simplify'. When it was turned up, the model started repeating the word 'simple' again and again.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
cing into swirling marine vortexes called “gyres”. Here's a recording of the Hangout in case you missed it...⏎In 1997, Sea Captain Charles Moore discovered an area in the mid-Pacific Ocean the size of Texas that
-
informatics Group and the Computational Bioscience Research Center created the tool, along with artificial intelligence researcher and current KAUST Provost Lawrence Carin and clinical collaborators from Harbin Medical University in China.⏎The
-
and the ability to flex and stretch Led by materials science Associate Professor Michael Arnold ... - Read More⏎A team of chemistry and materials science experts from University of California Santa Barbara and The Dow
-
they were looking for—an unexplained bump emerging from the data.⏎“I was far from convinced,” says Incandela, a professor at the University of California, Santa Barbara and the former spokesperson of the CMS experiment at the Large Hadron Collider.⏎
-
whole of the Pepys’s Ballad collection has been digitised and is available on the ‘English Broadside Ballad Archive’ hosted by the University of California Santa Barbara.⏎Broadside Ballad: The North Country Lovers (‘John and
-
have not yet been directly compared with simpler antiretroviral drug regimens in terms of their safety, efficacy, feasibility
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: There are very very very very very very very very very very very very very very very very very very very very very very very very very very very very very very very very very very very very very very very very very very very very very very
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
be safe and effective, review suggests⏎By Robert Preidt⏎MONDAY, Oct. 15 (HealthDay News) -- A technique called the "mother's kiss" is a safe and effective way to remove foreign objects from the
-
Step 1 - Addition, but don't forget to simplify⏎Step 2 - Drag the correct answer⏎Step 3 - Addition, but don't forget to simplify⏎Step 4 - Multiple choice⏎Try to answer all the 1
-
math by knowing what to expect.⏎How to Find Common Factors⏎An Efficient Method to Find Common Factors⏎How to Simplify Expressions⏎A straight forward approach to simplifying expressions⏎Integer Practice Problems - Addition⏎Review and Practice Problems for adding
-
And then the numerators. 1 + 3 = 4. We then get the answer 345 Can we simplify? No, that's not possible.⏎The answer is 315 + 35 = 3
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L25:2318 strongly suppresses
- L26:2213 strongly suppresses
- L21:2540 strongly suppresses
- L21:1974 excites
- L22:2412 excites
- L26:1564 excites
- L22:2173 suppresses
- L22:2031 excites
- L20:2382 suppresses
- L24:2199 suppresses
- L8:14 excites
- L17:2401 suppresses
- L18:569 excites
- L8:7 excites
- L25:2105 excites
- L22:1497 excites
- L23:2444 excites
- L25:11 suppresses
- L23:872 suppresses
- L20:2264 suppresses
- L22:962 excites
- L8:16 suppresses
- L18:1571 suppresses
- L8:10 excites
Feeds later layers
None: this is the last layer.
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 简
- 简单
- simpl
- simple
- →Simple
- simplify
- simple
- simplified
- simplicity
- 简化
Suppresses
- �
- ernel
- LayoutPanel
- redentials
- S
- aravel
- 往外
- ież
- 琮
- mucho