unclear: mid-sentence commas, 'most' before a verb
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 16 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
The neuron is hard to pin down. Its mildest highs are commas in the middle of sentences and in reference lists, but its strongest reactions are negative, on the word 'most' in phrases like 'commonly affects' or 'is the most used'. Turning it up or down gave rambling text with no clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
rhinophores are not overly large. The whitish-blue patches are distributed much as in Marcus's drawing of E. canguzua.⏎• Marcus, Er. (1955) Opisthobranchia from
-
othermia, or hemodilution related to fluid or blood administration; however, an acute coagulopathy can also occur in severely injured patients independent of, or in addition to, these factors [2,3]. Several terms are used
-
— it turned out to be the coup de grace for the team.⏎Back in 2009, at the IBM Research lab in Zurich scientists imaged, for the first time, the chemical structure of an individual molecule with unprecedented resolution,
-
. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Neither BioOne nor the owners and publishers of the content make, and they explicitly disclaim, any express or implied representations or warranties of any kind
-
Cars, trucks and motorcycles produce three times the pollution of buses.⏎These comparisons assume the vehicles are not filled to capacity on average. Trains come out even better in comparison to planes when both are full. (Note that Amtrak offers discounts on
-
, 2009), it is likely that diarrhea rates will increase in this region although future research will be needed to quantify this relationship.⏎Marengo, J. A., Jones<|endoftext|>(Student produced study guide from Foss, Foss
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the problem of the problem of the problem of the problem of the problem... I feel like I feel like I feel like... maybe a possible response to that, I think I feels like I feels like... I feels like... I feels like
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
in the affected joint. This condition most commonly affects the joints in hips, knees, hands, and spine. Rarely
-
can cause severe turmoil in a person's physical, psychological, and social health. Eating disorders most commonly affect women and occur in adolescence and young adulthood, though they can occur in
-
the most widely used server-side scripting language⏎At time of this writing, PHP is the most used server-side language (78.6%) for the websites (Source:
-
6. There is a record of a David de Boivil witnessing a charter as early as 1164.<|endoftext|>For the questions below, use the most efficient Excel formula or procedure to find your answer. Calculations by hand (or
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L2:1563 strongly excites
- L10:311 strongly suppresses
- L0:73 strongly excites
- L7:291 strongly excites
- L4:393 strongly suppresses
- L1:35 suppresses
- L7:922 suppresses
- L0:844 excites
- L2:316 excites
- L7:2731 suppresses
- L11:1383 weakly excites
- L4:1039 weakly suppresses 'a' after 'play' or 'plays'
- L1:16 weakly excites
- L0:1127 weakly excites
- L10:273 weakly excites
- L4:1591 weakly suppresses
- L4:717 weakly suppresses
- L7:674 weakly suppresses
- L1:2709 weakly excites
- L7:287 weakly suppresses
- L12:1719 weakly suppresses
- L5:2149 weakly excites
- L14:246 weakly excites
- L14:1387 weakly suppresses
Feeds later layers
- L17:300 strongly excites
- L17:420 strongly excites
- L18:198 excites
- L19:183 excites
- L18:105 excites
- L18:365 excites
- L17:399 excites
- L20:234 suppresses
- L18:474 excites
- L18:103 excites
- L21:252 excites
- L18:137 excites 'the' after 'to' in fixed phrases
- L19:683 excites
- L20:200 excites
- L19:593 excites
- L17:594 excites
- L18:133 suppresses
- L22:473 excites
- L20:247 excites
- L18:553 suppresses
- L21:505 suppresses
- L23:2397 suppresses
- L17:378 excites
- L18:420 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ughter
- ��
- ycles
- ince
- crit
- empt
- mic
- angan
- ivate
- ren
Suppresses
- floors
- 天花
- TableRow
- /ubuntu
- probe
- STDMETHOD
- osas
- acher
- DataTask
- 数据库