'been' after 'has' or 'have'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 10 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on 'been' in phrases like 'has been developed' or 'have been prepared', where a past participle follows. It was most negative on 'have been' in some sentences. Turning it up produced text about things that have been or are happening over time, so the link is mild.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
California Institute of Technology in Pasadena, for NASA’s Science Mission Directorate, Washington D.C. UCLA is responsible for overall Dawn mission science. The Dawn framing cameras have been developed and built under the leadership of the Max Planck Institute for Solar System Research
-
that was published in November 2011 and the previous edition of the International Basic Safety Standards which was published in 1996. It has been extensively revised and updated to take account of the latest finding of the United Nations Scientific
-
Using this item⏎This item has been provided for private study purposes (such as school projects, family and local history research
-
Pakistan⏎||It has been suggested that this article be merged with Blasphemy law#Pakistan. (
-
he was able to travel as far as Trebizond in the East, and acquire a collection of valuable reliquaries, manuscripts, and icons. It has been suggested that the Mosaic Icon of Saint Demetrios was gifted to Perotti
-
this project because of our expertise in planning and conducting structural dynamic tests on very large structures," Carne says.⏎Sandia's solid mechanics/structural dynamics group has done numerous structural analysis projects on large structures including the I-40 Rio Grande bridge
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the "L" in the "L" of the "L" of the "L" in the "L" of the "L" of the "L" of the "L" of the "L" of the "L
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
admire but also interactive thanks to educational workshops.<|endoftext|>New human genome research aids understanding of disease⏎In the decade since the human genome was published, scientists have been frustrated by their inability to figure out exactly how variations in genes promote disease.⏎But
-
responds to training depends on his breed’s history, genetic makeup, individual personality and, of course, you.⏎Genetics and Dog Behavior⏎Humans have bred dogs for specific duties for thousands of years, to the point where certain behavioral and personality traits
-
Eckstorm concludes the best interpretation is “shaped like a great knee,” referring to the peninsula on which much of the city sites.⏎It has had its share of mishaps: destruction in 1676 during King Phillips War, burned
-
astonishment in the face of this captured<|endoftext|>The UN adopted the Universal Human Rights Declaration in 1948 and since that time countries and international bodies have been adding to the fundamental rights of people.⏎Human Rights Law is governed by a variety
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L5:660 strongly suppresses
- L6:669 excites
- L6:535 excites
- L8:2719 suppresses
- L5:536 suppresses
- L8:255 suppresses
- L7:153 suppresses
- L8:1626 suppresses
- L5:527 suppresses
- L9:670 suppresses
- L7:734 excites
- L4:457 excites
- L3:1260 weakly suppresses
- L6:2614 weakly excites
- L8:3049 weakly excites
- L4:324 weakly suppresses
- L2:159 weakly excites
- L8:800 weakly excites
- L9:983 weakly suppresses
- L9:2508 weakly excites
- L1:2950 weakly excites
- L9:2088 weakly excites
- L2:834 weakly excites
- L4:1404 weakly excites
Feeds later layers
- L18:1968 excites
- L12:2964 excites
- L20:2574 suppresses
- L15:2901 suppresses
- L11:2896 excites
- L12:2898 excites
- L18:863 suppresses
- L12:1639 excites
- L12:1431 excites
- L12:742 suppresses
- L23:535 suppresses
- L11:1669 suppresses
- L18:2640 excites
- L11:2573 suppresses
- L17:2060 suppresses
- L11:1360 weakly excites
- L14:2939 weakly suppresses
- L21:773 weakly suppresses
- L16:1532 weakly suppresses
- L11:1163 weakly excites
- L18:642 weakly excites
- L13:2036 weakly suppresses
- L18:620 weakly excites
- L17:1255 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- s
- enc
- Adv
- obs
- ?>⏎
- orts
- ?>
- 0
- 不断提高
- orse
Suppresses
- 一开始
- invaded
- ",⏎⏎
- 当时的
- Started
- SenderId
- ẏ
- invade
- 一夜
- 一瓶