"of" after "board" or "off"
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 1 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word "of" when it follows "Board" or "off", as in "Board of Education". Its strongest negative reaction is on "kind" in phrases like "one of a kind". The steering results do not show a clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
the Woman's Board of Missions for the Pacific Islands, located in Hawaii (WBMPI). The three mainland boards cooperated with the maleled American Board of Commissioners for Foreign Missions.(2) The women's boards chose their missionaries and
-
action programs.⏎A crucial turning point came in 1995, when the University of California’s Board of Regents made the calamitous decision to eliminate affirmative action for its then nine universities,
-
To make a series connection between batteries, use a jumper wire between the negative of the first battery and the positive of the second battery. Run your positive wire off of
-
's Millville Board of Education to 32 educators across the district's nine schools.⏎"Three hundred
-
red squirrels and porcupines.⏎Types of Flora⏎The animals of the park have plenty to forage and thrive off of with a strong botanical environment in Palo Verde National Park. Some of the plant species
-
Manitowoc Rapids. It is estimated that more than 5,000 people attended the event. Today, the marker is located off of Broadway Street.⏎In the days before settlement, our area was named Manitowoc
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately:. of credit, of of financial with2ere2 with 2 of2Ins of2 financial analysisahas... of2 financials consolidated and financialn. financialn$ and x2
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
for more sophisticated future missions.⏎SLIM: A Historic Lunar Mission⏎Taking lunar exploration to new scales, JAXA’s SLIM mission is one of a kind in the world of space pioneering. The mission is designed to control the lander
-
When your cells can’t get glucose (a kind of sugar) to burn for energy, they burn fat instead. This leaves behind
-
the steel underneath. However, hot-dip can be done on a much larger scale and provides extremely long-lasting protection and<|endoftext|>Placenta forceps are a kind of gynecological instruments. These forceps are used after the mother has given
-
the condition suitable for consumption, to make them as tasty as possible, and unleash their maximum potential.⏎The process takes place in a roaster, which is a kind of oven that transfers heat to the beans by convection, conduction, and
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L0:1301 strongly suppresses
- L0:1224 strongly suppresses
- L0:178 strongly suppresses
- L0:1564 weakly suppresses
- L0:191 weakly suppresses
- L0:1638 weakly excites
- L0:1 weakly suppresses
- L0:2003 weakly excites
- L0:2883 weakly excites
- L0:2610 weakly suppresses
- L0:2340 weakly suppresses
- L0:157 weakly suppresses
- L0:2701 weakly suppresses
- L0:2566 weakly suppresses
- L0:1075 weakly excites
- L0:1116 weakly excites
- L0:109 weakly excites
- L0:1131 weakly excites
- L0:2784 weakly excites
- L0:1951 weakly excites
- L0:391 weakly suppresses
- L0:455 weakly excites
- L0:2641 weakly suppresses
- L0:2492 weakly suppresses
Feeds later layers
- L2:1628 suppresses
- L3:59 suppresses
- L18:46 excites
- L12:1945 suppresses
- L16:213 excites
- L2:2730 suppresses
- L16:182 excites
- L3:516 weakly suppresses
- L3:102 weakly suppresses
- L5:3001 weakly suppresses
- L12:1767 weakly suppresses
- L12:1472 weakly suppresses
- L7:1 weakly excites
- L3:2911 weakly suppresses
- L5:46 weakly suppresses
- L18:57 weakly excites
- L3:115 weakly suppresses
- L23:1646 weakly suppresses
- L21:1766 weakly suppresses 'in' in 'bear in mind' phrases
- L2:3015 weakly suppresses
- L2:1050 weakly suppresses
- L3:2042 weakly suppresses
- L7:122 weakly suppresses
- L3:1180 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- .Free
- ../../../
- v
- 个工作
- たり
- urther
- preced
- erd
- <<
- 趯
Suppresses
- Builders
- despre
- elts
- pellets
- 槿
- Phelps
- urtles
- Phones
- $filter
- -Sah