unclear: word before a noun in lists
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 14 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
It fires on a scattered mix of words, often the word just before a noun in a list or a formal phrase, such as 'both' or 'two'. The pattern is loose and hard to pin down. Turning it up made the model drift into questions or repeat itself.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
ulopathy, and the acute coagulopathy of trauma-shock (ACoTS) [2,3,5,6].⏎The etiology, diagnosis and treatment of coagul
-
and underscored the critical need for effective cooperation on border biosecurity measures.⏎Biosecurity is critical to protecting public health, ecosystems and a country’s economy. As countries become increasingly interconnected through global trade, travel and movement of
-
and group practice. Instructors also administer quizzes and full-length practice sections of the SAT. This allows instructors to identify areas in which students need improvement and provides both instructors and students with . If students do not improve their scores it is because either did
-
illustration of how one subject is put for another is found in comparing the two seemingly contradictory biblical accounts of the death of King Saul. Remember that in the Old
-
production assistant. Each of these positions are defined along with their respective duties, rules, and resources that figure in obtaining these jobs. Each chapter offers exercises, links
-
required materials, discussion of course policies, an overview of class assignments, and grading standards. Updated:
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have a 2015, 2017, 2018, 2019, 2010, 2010, 2019, 20
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
label at least 85% of that wine must come from within that AVA boundary. The AVA designation on a wine label usually appears just above the grape varietal description. The AVA designation does not limit the types of grapes
-
and the goals; and evaluations of the process itself and of the implementation and results of the action plan, with an eye toward improving MAPP’s effectiveness in the community as it’s
-
two days after the hot weather. Night-time cooling can help reduce the negative effects of heat load on production, but it does not reduce the welfare impact on the cows during the day.⏎In the summer of 2021 the Waik
-
five hours of instruction per week. Secondary school students who qualify for homebound instruction are eligible to receive a maximum of ten hours of instruction per week depending on their academic load. If appropriate to the needs of the child, the number of instructional hours
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L13:2134 suppresses
- L13:367 excites
- L13:1432 excites
- L11:475 excites
- L11:1391 suppresses
- L11:1974 excites
- L13:1541 suppresses
- L12:2060 excites
- L13:1198 excites
- L8:594 excites
- L12:1275 excites
- L12:2201 suppresses
- L13:2755 weakly suppresses
- L11:598 weakly suppresses
- L13:2415 weakly suppresses
- L10:1885 weakly excites
- L13:2768 weakly suppresses
- L7:2428 weakly excites
- L12:2000 weakly suppresses
- L12:1685 weakly excites
- L12:204 weakly suppresses
- L12:1421 weakly excites
- L7:33 weakly excites
- L12:2607 weakly suppresses
Feeds later layers
- L15:974 excites
- L16:1307 suppresses
- L15:509 suppresses
- L15:412 excites
- L15:1592 excites
- L16:2183 excites
- L15:1661 suppresses
- L15:3051 excites
- L15:132 excites
- L17:1796 suppresses
- L15:2000 weakly suppresses
- L15:2593 weakly suppresses
- L17:2975 weakly suppresses
- L19:837 weakly excites
- L15:2190 weakly excites
- L15:2019 weakly suppresses
- L17:2529 weakly suppresses
- L16:1357 weakly excites
- L15:414 weakly suppresses
- L15:794 weakly suppresses
- L15:534 weakly excites
- L15:273 weakly excites
- L19:673 weakly excites
- L23:2001 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ques
- thalm
- _Base
- _macros
- vergence
- 耽误
- foundation
- imating
- _Task
- _FILL
Suppresses
- loom
- ":"'
- 并
- cop
- 并向
- ]+'
- emu
- eced
- 並
- clue