unclear: opposite pairs and citation digits
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 20 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron is hard to pin down. It fires in places like 'alive (on) or dead (off)', 'from Z to A', and 'in like a lion, out like a lamb', where a word sets up its opposite. It goes strongly negative on digits inside citation page numbers. Turning it up gave muddled text about the sun.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
*) memchr (str, 'p', strlen(str));⏎printf ("'p' found at position %d.\
-
way's Game of Life⏎Conway's Game of Life consists of a world of cells on a grid. These cells are either alive (on) or dead (off). The state of cell is determined by a set of rules, which all
-
will make your list alphabetical A to Z. (Descending will reverse the list from Z to A).⏎There is an option of telling the program that your list has a header
-
that the same character is differently pronounced in different languages or even within the same, for example in English the character “u” is pronounced in “but” buht, yet also as in “
-
6th-18th, 2017, Vicenza, Italy)<|endoftext|>- Welcome to Botswana⏎- Where To Go⏎- What To Do⏎- Where To Stay⏎- Flora and Fauna⏎- Visitor
-
animal form she pleases; she first appears in the story as a dark brown moth.⏎How to pronounce æ?⏎The 'ae' pair, or the single 'æ' symbol mixed together, is not pronounced as two separate vowels. It comes
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I would like to provide a more comprehensive and ________________ ________________________________ ________________________________ ________________________________ ________________________________ ________________________________ ________________________________ ________________________________ ________________________________ ________________________________ ________________________________ ________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
and Freedom”, Nature, Nov. 15, 1941, Vol. 148, pp. 580-584.⏎The reasons why the adoption
-
iofacial) area, and/or the genitals. "LEOPARD," an acronym for such characteristic abnormalities, stands for (L)entigines; (E)lectrocard
-
Increased with Fewer Antibiotics⏎Am Fam Physician. 2006 May 1;73(9):1619-1634.⏎Clinical Question: Does more cautious prescribing of antibiotics for sore throat increase the
-
ate the molecular basis of the genetic susceptibility to alcoholism.(JAMA. 1992;268:1877-1882)<|endoftext|>The Imaginative Treatment of Geometry in Waldorf Education⏎A
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L19:2663 strongly suppresses
- L16:2181 strongly suppresses
- L17:1622 strongly excites
- L18:1781 strongly suppresses
- L14:1810 excites
- L19:2022 suppresses
- L13:2047 excites
- L17:2573 excites
- L17:1423 suppresses
- L19:1781 suppresses
- L18:1373 excites
- L19:2045 excites abbreviation pieces in organisation names
- L19:1829 suppresses opening bracket before an acronym
- L11:1153 suppresses
- L14:2419 excites
- L17:1590 suppresses
- L19:771 excites
- L17:2755 suppresses
- L18:1996 excites
- L17:1404 suppresses
- L12:1089 excites
- L18:772 excites
- L19:2772 excites
- L19:619 excites
Feeds later layers
- L22:530 strongly excites
- L27:129 strongly excites
- L23:238 strongly suppresses
- L25:652 excites
- L27:134 excites
- L21:1934 excites
- L21:111 excites
- L22:2241 suppresses
- L23:957 excites
- L21:144 suppresses
- L24:2215 excites
- L24:2767 excites
- L22:623 excites
- L27:583 excites
- L23:505 excites
- L26:1539 excites
- L26:788 suppresses
- L21:2623 excites
- L23:672 excites
- L27:1615 suppresses
- L27:1487 suppresses
- L22:839 suppresses
- L26:386 excites
- L24:142 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 贷
- lock
- 岗
- 债
- 秤
- 瘤
- 관
- 税
- 梦
- مة
Suppresses
- 地理位置
- .googleapis
- 湖泊
- Nich
- 基金份额
- (directory
- 鸬
- 白银
- ParameterValue
- (filePath