'two' after 'divided into' or 'there are'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 16 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron reacts to the word 'two' when it introduces a count of things, like 'there are two kinds' or 'divided into two categories'. Turning it up made the model write about counting and lists of items, though the match is loose.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
ventilation set to recirculate.⏎If you are very sensitive to smoke,<|endoftext|>What is our proof?⏎The science behind Structured Democratic Dialogues⏎There are two realms for the work of Structured Democratic Dialogues (SDD):⏎The supporting
-
ensure that water and air quality are adequately protected during surface and subsurface natural gas development activities.⏎The recent increases in domestic natural gas supplies have been made possible by two technologies—horizontal drilling and hydraulic fracturing—that allow energy companies to tap natural gas
-
the power factor, and Realize overcurrent, overvoltage, overload protection and other functions. The main circuit of the frequency converter can be roughly divided into two categories: one is the voltage type, which is a frequency converter that converts the
-
stronger footing in terms of offering competitive products to its customers and provide customer satisfaction.⏎(iii) Innovation Innovation is the introduction of new ideas or methods. There are two kinds of innovation in every business⏎(a) Product Innovation In product innovation a new
-
And this is where the Digital Identity story begins.⏎Airbnb’s “Verified ID” service uses offline and online methods to ensure the user’s identity. There are two main features relevant in this scenario.⏎Offline validation is performed on a driver’s license
-
ates are converted into glucose (also known as blood sugar) and used by the cells for energy purposes.⏎What are complex carbohydrates?⏎Carbohydrates are divided into two main categories: simple and complex carbohydrates. Simple carbohydrates (monosaccharides
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the two and the three, and the two and and and the three, and and and and and, and and and and and, and, and, and, and, and, and, and, and, and, and, and
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
⏎• 13-19 July, 2020 - Helsinki, Finland⏎• 20-26 July 2020 – Istanbul, Turkey⏎• 16-
-
20 years||100-170 beats per minute||200 beats per minute|⏎|30 years||95-162 beats per minute||190 beats per minute|⏎|35 years||
-
the book||$8.32 used (63% off) $17.25 new (22% off) $21.95 direct from Amazon Amazon page|⏎Setup an account with your affiliations in order
-
and outbreaks.⏎A snack food at a school fair held on April 26th transmitted Salmonella to 124 attendees – aged one to 56. Twenty-two of the victims needed hospitalization. As of May 2nd
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L4:87 suppresses
- L3:230 excites
- L3:986 excites
- L10:993 excites
- L3:1129 suppresses
- L10:773 suppresses
- L10:215 excites
- L9:1744 excites
- L4:326 suppresses
- L10:1141 suppresses zero digit inside a number
- L5:2823 suppresses
- L3:830 weakly excites
- L3:3031 weakly excites
- L8:41 weakly suppresses
- L4:1964 weakly excites
- L7:1703 weakly suppresses
- L3:856 weakly suppresses
- L8:553 weakly suppresses
- L14:575 weakly suppresses
- L2:1426 weakly excites
- L4:1905 weakly suppresses
- L4:450 weakly excites
- L10:661 weakly suppresses
- L10:1901 weakly suppresses
Feeds later layers
- L19:1752 excites
- L25:3008 excites
- L17:1628 excites
- L25:1278 excites
- L27:1321 excites
- L21:808 excites
- L19:2842 excites
- L22:801 excites the digit 1 in numbers
- L26:1201 excites
- L17:2388 excites
- L24:272 excites
- L23:465 excites
- L18:2855 excites
- L18:726 excites
- L20:2151 excites
- L23:843 excites
- L20:3049 excites
- L22:1472 excites
- L20:740 excites
- L22:2725 weakly excites
- L22:939 weakly excites
- L17:963 weakly excites
- L21:1069 weakly excites quantity words like 'two' and 'several'
- L18:2796 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- -sided
- -dimensional
- quire
- rellas
- -step
- urances
- lvl
- layers
- 个月
- idable
Suppresses
- dale
- tracts
- maté
- alguém
- tract
- tractor
- tracted
- 那些
- -breaking
- Both