the letter l starting a word fragment
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 27 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on a separate 'l' at the start of a word that is split into pieces, like the 'l' in 'lathes', 'lilies' or 'lye'. Turning it up made the model repeat words such as 'prompt' and 'measure', which doesn't tell us much about the trigger.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
for it. For example, pressure will be needed when creating deep indents.⏎Lathes are divided into three types: the engine lathe, special purpose lathes and turret lathes. Some variants are placed on benches and others
-
.⏎Remove dried stems only after foliage dies back.⏎Rainy Side Notes⏎Lilium 'White Stargazer' is the most popular of the white upright lilies and used by many for forcing. In fact, Peter Schenk bred it
-
entions for Racial and Ethnic Minorities<|endoftext|>Lily of the valley, or convallaria, is not a true lily like the Easter or Asiatic lily, but is still toxic to dogs, humans and other animals. If your
-
8 cm).⏎Star-shaped, white petals recurved at the tips.⏎Humus rich, slightly acidic, moist, well-drained soil.⏎In spring, when lilies are at the spear stage of growth (like asparagus), fertilize with
-
via contaminated pasture) but simple exclusion measures can be 100% effective in preventing badgers from accessing cattle water troughs, feed troughs and mineral licks, or entering farm buildings. Further information is available on the TB hub.⏎
-
.⏎Smaller catapult toys are easy to make, all you need are couple craft (or lolly) sticks and rubber bands.⏎An amazing STEM project for future scientists – sling
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro Bro
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
ition - Formal request by one government to another government for it's citizens in case of jurisdiction.⏎- Crucial - Involving an extremely important decision.⏎- Languished - Suffered in an unpleasant situation.⏎- Faction -
-
in Little Rock. From 1881 to 189<|endoftext|>The term mudita is usually translated as "sympathetic" or "altruistic" joy, the pleasure that comes from delighting in other people's
-
1562. At first Vital followed the Kabbalistic system of Moses Cordovero but when Luria arrived in Safed he studied the Lurianic system with Luria until the latter's death in 15
-
or holy to God-and we are to be marked with honor, dignity, integrity, loyalty, righteousness and holiness. A commentary in my Bible says that "Lemuel" means "belonging to God." In other words, the
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L23:1760 suppresses
- L24:2164 excites
- L22:1383 excites
- L17:134 suppresses
- L17:337 weakly suppresses
- L18:81 weakly excites
- L23:149 weakly excites
- L23:154 weakly excites
- L20:287 weakly excites
- L18:1587 weakly suppresses
- L19:417 weakly excites
- L19:1064 weakly excites
- L3:543 weakly suppresses
- L12:1894 weakly suppresses
- L11:1944 weakly excites
- L5:1263 weakly suppresses
- L19:1639 weakly excites
- L13:253 weakly suppresses
- L2:1518 weakly suppresses
- L2:2334 weakly suppresses
- L23:1427 weakly suppresses
- L13:1377 weakly excites
- L3:1768 weakly excites
- L20:1710 weakly suppresses
Feeds later layers
None: this is the last layer.
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- uilder
- мар
- chants
- abs
- urger
- eing
- marked
- opic
- icals
- vice
Suppresses
- ender
- enders
- ais
- ame
- buffers
- าง
- measure
- Bro
- ní
- lator