space before a citation year
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 14 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires in academic citations like '(Scholze et al., 2005)', on the gap right before the year, after the author's name. Turning it up made the model produce repeated filler and lists, so the steering does not show a clear link to citations.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
with the biological, chemical, and physical sciences, about one-fourth work on problems involving human decision making (Scholze et al., 2005).⏎In 2006, the second YSN
-
creating dependency. Reminding people of their mortality tends to make them hold more closely to traditional culture (Pyszczynski, Solomon, & Greenberg, 2003); this has implications for mental health, and can also be
-
that if I hit my thumb with a hammer I blame myself, not the hammer, but people often blame equally mechanical programs for user initiated errors. (Miller, 2004, p. 31).⏎Computer programs are just as
-
While the case of Johnson v. California challenged the practice of segregating inmates by using race as a classification, the practice is still actively implemented (Robertson, 2006). Research indicates that many “…prison officials separate inmates into
-
, in a national study, the more ACEs a respondent reported the poorer health, mental health and educational outcomes later in life. (Felitti et al., 1998).⏎In addition, the stress of chronic childhood trauma known as
-
G investigators carried out landmark studies on the natural history of cervical cancer that firmly established HPV as the necessary cause of this malignancy (Schiffman et al., 1993, 2007). Their efforts laid the groundwork
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: what is the, or, can, can I, to continue, for, to use, to, keep, which, further, to, get, 1, 2, , 1, 2, 1
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
a<|endoftext|>- Enter a word for the dictionary definition.⏎From The Collaborative International Dictionary of English v.0.48:⏎Nectarine \Nec`tar*ine"\ (n
-
in upwards of 150″ per year. Temperature varies little, with the average temperature near 82, and the humidity is always high.⏎Figure 2. Yum! After a hard days
-
and for this reason its conversational style feels more like a series of fireside chats than a regular college textbook. Those radio broadcasts were highly acclaimed and won the 2007 Linguistics, Language,
-
—used to introduce an additional statement about something that has already been mentioned. —used after a preposition to refer again to something that has already been mentioned. See the full definition for<|endoftext|>I have recently been re-reading two books I purchased
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L11:744 strongly excites
- L12:1035 strongly suppresses
- L13:1640 suppresses
- L10:699 excites
- L12:1299 suppresses
- L13:2953 suppresses
- L8:699 excites
- L11:1395 suppresses
- L13:1641 suppresses
- L13:604 suppresses
- L13:1716 excites
- L12:81 excites
- L13:2358 suppresses
- L12:2009 excites
- L6:619 suppresses
- L12:1379 excites
- L13:1220 excites
- L13:152 excites
- L13:136 weakly excites
- L13:1133 weakly excites
- L13:2827 weakly excites
- L13:242 weakly excites
- L13:1414 weakly excites
- L9:1774 weakly suppresses
Feeds later layers
- L16:978 strongly excites
- L15:2258 excites
- L16:2944 excites
- L16:2482 excites
- L15:1780 excites
- L15:917 excites
- L15:1377 excites
- L15:2305 excites
- L16:735 excites
- L15:1309 excites
- L16:2917 excites
- L16:451 suppresses
- L16:3035 excites
- L16:2281 excites
- L16:888 weakly excites
- L15:359 weakly excites
- L16:2524 weakly suppresses
- L16:1055 weakly excites
- L17:926 weakly suppresses
- L15:2965 weakly suppresses
- L25:808 weakly suppresses
- L18:2322 weakly suppresses end-of-text token after a finished passage
- L21:1426 weakly suppresses
- L22:532 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- I
- ard
- oir
- Ix
- 冷水
- less
- â
- I
- IX
- IQ
Suppresses
- suscept
- ฒ
- Annunci
- budding
- 加剧
- 누구
- uka
- Zuckerberg
- etypes
- 窟