dash at start of list item
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 11 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on a dash that starts a new bullet or list item, usually after a line break. Turning it up produced rambling text with no clear link to lists.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
as a facebook live on 15th october download a worksheet here download the october to november schedule in colour download the october to november schedule in.⏎Vocabulary Worksheet Mix Set context pre teach vocabulary these stages go online for
-
exposure drifting in from the Port of Oakland.⏎- Parks & Recreation: For the PCA program update in Solano County, stakeholders worked
-
00 kg armor piercing bombs, in four sections. 40 B5Ns armed with Type 91 torpedoes, also in four sections).⏎- 2nd Group – targets: Ford Island and Wheeler Field, (55
-
, popular unrest combined with dynamic leadership.⏎- The Decree for Land: land would be held communally. Peasants
-
” water color paper cut in half.⏎- Extra fine black Sharpie permanent marker.⏎- Water colors and brushes.⏎- Black
-
maps in the volume drawn by Bonne's son. Engraved by Andre. Condition: A nice impression with minor offsetting and a few faint spots.⏎B. Plan du Port Palliser, dans la Terre de Kerguelen
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: The question that is being asked... (as it is... the person who is responsible for the analysis, so the conclusion is determined, so the agreement is in place, so it is a no-brainer, so it is a no br
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
irico⏎| ||Key to the genera|| |⏎|1||Terrestrial shrubs, parasitic upon the roots of other plants||Atkinsonia|⏎|Parasitic shrubs on the branches of trees or shrubs||2|⏎
-
Using a bar diagram⏎In the bar diagram, the relationship is clear. This is a simple, one-step problem.⏎650 – 39 = 611 candles sold.⏎Printer’s Ink — 1718⏎
-
the beach before he was attacked by a golden retriever.⏎Present Simple: This tense describes an event that is happening at the time of writing or speaking. E.g. I go to the shop to buy some chips.⏎Some other examples include:⏎
-
3 : 10101100.00010001.0yyyyyyy.yyyyyyyy => 172.17.0.0/17⏎- We need a network with
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L3:355 weakly excites
- L8:447 weakly suppresses
- L6:47 weakly suppresses
- L4:517 weakly suppresses
- L5:198 weakly suppresses unclear: weak "and" in lists
- L7:2102 weakly suppresses
- L7:82 weakly excites opening bracket before an acronym
- L9:1314 weakly suppresses
- L6:1578 weakly suppresses
- L10:524 weakly excites
- L4:191 weakly excites
- L7:968 weakly excites
- L4:1687 weakly suppresses
- L5:1858 weakly excites
- L1:257 weakly excites
- L1:87 weakly excites
- L9:424 weakly excites
- L8:510 weakly suppresses
- L3:1535 weakly excites
- L5:213 weakly excites
- L6:12 weakly suppresses
- L1:1 weakly excites
- L1:743 weakly suppresses
- L6:13 weakly suppresses
Feeds later layers
- L17:4 weakly excites
- L16:1675 weakly suppresses
- L22:44 weakly excites
- L12:2256 weakly excites
- L12:2520 weakly suppresses
- L13:2277 weakly excites
- L14:1806 weakly suppresses
- L16:3013 weakly suppresses
- L15:2662 weakly excites
- L13:1982 weakly suppresses
- L21:1101 weakly suppresses
- L15:1670 weakly excites
- L18:3052 weakly suppresses
- L13:2166 weakly suppresses
- L15:2313 weakly suppresses
- L14:558 weakly suppresses
- L17:912 weakly suppresses
- L15:1716 weakly suppresses
- L16:531 weakly excites
- L12:483 weakly excites
- L16:1762 weakly suppresses
- L16:1771 weakly excites
- L21:2396 weakly excites
- L21:1158 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ница
- javax
- ival
- nieu
- 在一个
- coni
- earrings
- 침
- ismatch
- 不同类型
Suppresses
- reds
- arrêt
- <i
- yer
- urma
- 口水
- ogie
- دد
- ;</
- reece