colon or equals sign before a definition
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 10 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
The neuron fires on the colon or equals sign that comes right before a definition, label or value, such as the = in a formula or the : after a heading word. It was mostly quiet on ordinary sentences. Turning it up made the model's text wander into unrelated first-person sentences, which doesn't clearly relate to the trigger.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
ACC = E/V × Re + D/V × Rd × (1 - Tc)⏎Re = cost of equity⏎Rd = cost of debt⏎E = market value of the firm's equity⏎D = market value of the firm's
-
1999; Grevemeyer et al. 2010). The rectangle shows the position of Fig. 1b.⏎b :Map of eruption centers and main fissures of the 1995 eruption
-
information about visited websites and started applications. It is also measuring time in front of the monitor.<|endoftext|>DRDO Placement Paper (EMT & Microprocessor)⏎Paper: DRDO Placement Paper (EMT & Microprocessor)⏎EMT and microprocessor
-
.5, 2, and 1.8° per step.⏎Step angle = 360°/No of steps per revolution⏎Where m = Number of Phase winding on the
-
console in front of the furnace), etc., The electrical part of the large medium frequency furnace also includes a crucible leak alarm system.⏎Furnace body part: medium and small medium frequency furnaces are equipped with two furnace bodies. One is
-
-fetching. Relevant Computer Science topics such as models of computation and formal grammars are addressed, and their practical value explained.⏎Share Low-Level Programming<|endoftext|>New Delhi: For possibly the first
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: and I'm going to think about it. and I'm going to think about it. and I'm going to think about it. and I'm going to think about it. and I'm going to think about it. and I'm
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
of life.⏎If anything, this emphasizes the importance of taking care of your physical and mental health through college and
-
is not simply whether road pricing is regressive, or even if it will burden the poor. The relevant question is whether road pricing will burden the
-
were gone."⏎Join to answer this question⏎Join a community of thousands of dedicated teachers and students.Join eNotes<|endoftext|>Is there something else you would like to know?⏎Use the alphabetical glossary listing to
-
the message, his answer is merely to turn up the volume and repeat the message as a tautology: US policy is democratic because America is free. One suspects that if there was more truth to the assertion it would not have to be repeated
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L9:396 excites colon after a metadata label
- L4:24 excites
- L9:319 excites equals signs in maths and equations
- L3:77 excites
- L4:193 excites
- L6:1609 suppresses
- L8:309 weakly excites
- L8:137 weakly suppresses
- L0:2259 weakly suppresses
- L3:76 weakly suppresses
- L5:1976 weakly excites
- L6:1752 weakly excites
- L7:3018 weakly suppresses
- L4:113 weakly suppresses
- L3:294 weakly excites
- L6:2843 weakly suppresses
- L2:357 weakly excites
- L6:2237 weakly excites
- L4:701 weakly suppresses
- L6:482 weakly suppresses
- L4:302 weakly excites blank slot before a number
- L0:877 weakly excites
- L4:2690 weakly excites
- L4:2769 weakly suppresses
Feeds later layers
- L13:1343 excites
- L16:2177 excites
- L12:1150 excites
- L15:1041 excites
- L16:1142 excites
- L17:1066 excites
- L16:466 excites 'is' after a long subject phrase
- L12:2562 excites
- L14:1769 excites
- L12:850 excites
- L12:2171 excites
- L13:2292 excites opening parenthesis for a gloss or abbreviation
- L12:1212 suppresses
- L13:652 excites
- L13:371 weakly excites
- L13:948 weakly excites
- L14:827 weakly excites open bracket after a value or citation
- L12:792 weakly suppresses
- L11:502 weakly excites
- L11:567 weakly suppresses
- L14:995 weakly excites
- L24:154 weakly suppresses
- L11:162 weakly excites
- L16:551 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- offsetof
- ieux
- immers
- istani
- oubles
- 不错
- 每人
- ional
- CTOR
- (HttpStatus
Suppresses
- Disposed
- 蜂
- 鹩
- @(
- 游戏当中
- ificant
- себя
- niece
- ORTH
- UW