predicts the word 'state'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 25 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron looks like it helps the model get ready to write the word 'state', and it is also active on word beginnings like 'ren' in renounce. Turning it up made the model repeat 'state' again and again. It switches off on the word 'social'.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
land and started settling down there.⏎- By 1916, Palestine came under British control after the Sykes-Picot Agreement (a secret agreement between Great Britain and France). This led to the division of the old
-
.⏎Sponges live under water. Most sponges live in salt water. The 5,000 species of sponge belong to the Phylum Porifora. They are further classified into four groups based on what comprises their skeletons
-
783). Finally, in 1819, Spain ceded Florida to the United States in exchange for the American renunciation of any claims on Texas. On March 3, 184
-
‘world’s most intractable conflict’ – is rooted in a dispute over land claimed by Jews as their biblical birthright and by the Palestinians, who seek self-determination. Despite repeated attempts to end the conflict between the two countries, there
-
ons of England organized numerous uprisings. In the face of such strong and well-organized opposition, King John was forced to renounce certain rights and to grant a charter of liberties. This document stated that the
-
." In contrast, many psychologists have taken the self very seriously, and discussed at length a huge number of important phenomena including self-identity, self-esteem, self-regulation, and self-improvement. Is it possible to have a psychologically interesting
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I want to get good at making good value line design, I want to create good value line design, I want to create good value line design, I want to create good value line design, I want to create good value line design,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
psychology, which has found gossip to be an important means for people to monitor cooperative reputations and so maintain widespread indirect reciprocity. Indirect reciprocity is a social interaction in which one actor helps another and is then benefited by a third party.
-
under multi-objective multiple-participant environment is very promising. Coupled with multi-objective methods (e. g
-
diagram! Does this economy converge to a steady state from any initial capital stock k0?⏎d) Is the private market equilibrium socially efficient from the viewpoint of a social planner that seeks to maximize the representative consumers utility function ? Explain why or why not
-
- [“Computer Science”,”Economics”,”Political Science”,”Cognitive Psychology”]⏎- Carnegie-Mellon University⏎- Bounded Rationality, Satisficing⏎Herbert Simon spent the bulk of his career as a
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L21:873 suppresses
- L9:510 excites
- L20:871 weakly suppresses
- L22:121 weakly suppresses
- L20:1461 weakly suppresses
- L10:154 weakly excites
- L23:1676 weakly excites
- L9:2540 weakly excites
- L1:2754 weakly excites
- L8:589 weakly excites
- L6:2001 weakly excites
- L3:1455 weakly excites
- L22:740 weakly suppresses
- L20:559 weakly suppresses
- L12:948 weakly suppresses
- L22:1861 weakly suppresses
- L21:972 weakly suppresses
- L7:2945 weakly suppresses
- L7:2607 weakly suppresses
- L9:205 weakly suppresses
- L4:1358 weakly suppresses
- L18:1418 weakly excites
- L0:2218 weakly suppresses
- L17:1169 weakly excites
Feeds later layers
- L27:2824 weakly excites
- L26:1194 weakly suppresses
- L26:2265 weakly excites
- L27:1029 weakly excites
- L26:2913 weakly excites
- L26:1991 weakly excites
- L26:2645 weakly excites
- L26:2594 weakly suppresses
- L27:3003 weakly excites
- L26:2296 weakly suppresses
- L27:1906 weakly excites
- L27:942 weakly excites
- L26:2771 weakly excites
- L26:1225 weakly suppresses
- L27:2767 weakly suppresses
- L26:1800 weakly suppresses
- L27:2489 weakly excites
- L27:2161 weakly excites
- L27:1877 weakly suppresses
- L27:340 weakly excites parenthesis introducing an acronym
- L27:792 weakly suppresses
- L27:2635 weakly excites
- L27:1998 weakly suppresses
- L26:1687 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- state
- →state
- nesia
- <State
- -state
- [state
- chóng
- state
- /Users
- (state
Suppresses
- SYN
- ige
- auté
- rove
- ериал
- ofire
- rif
- 代
- 羡
- Tunisia