comma after a subject phrase
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 19 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds to a comma that comes right after a subject noun phrase and before a parenthetical like 'therefore' or 'also called'. The effect is weak compared with the other neurons here. Turning it down made the text loop on 'is there'.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
not have to be drawn. Successful root canal treatment can preserve the tooth for many years or even decades.⏎Root canal treatment: when needed?⏎A root canal treatment, also called root canal treatment, is often the last resort to save a sick or
-
treatment of rheumatism and gout. Comfrey has been used in folk medicine as a poultice for treating burns and wounds. However, internal consumption, such as in the form of herbal tea, is discouraged, as it has been
-
Concrete poured and formed on the construction site by concrete contractors is obviously at the mercy of weather conditions at the time of curing. Precast concrete panel construction, therefore, results in a stronger, less porous, higher quality structural component, with
-
-invasive nature. This is particularly true for COVID-19 cases, where keeping patients comfortable and stable is critical.⏎- No Radiation⏎CT and X-ray, the two modalities most commonly used for lung diagnostics related to COVID-19
-
air. Its operation is based on the ventilation unit with a heat exchanger, which is responsible for supplying cool air in summer and warm in winter⏎This solution, therefore, requires the use of appropriate installation in each room, as well
-
hours a week for science, technology, history, geography and creative arts; and two to three hours a week for sport and other physical activities.⏎English and maths, which dominate the proposed mandatory outcomes, should make up 45 to 5
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: is there is a can can is is is is is is is is is is is is is is is is is is is there a is is is is is is is is there is is is is is is is there is is is is
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
as a comorbid disorder with ADHD, Inattentive Type results in slower processing speed than it does in kids with ADHD, Hyperactive or Combined Type who also have a diagnosis of Anxiety Disorder. These children may also be identified as
-
the knowledge of laws that appear to govern the life of the past, obtained through investigation and analysis of the past events.⏎The stuff with which the traditional history is concerned, i.e. the events and incidents of the past, provides the rudimentary
-
: "It is the custom of our Government officials to struggle to make reasons for not doing things they obviously ought to do. When the particular thing they ought to do involves the encouragement of art, their struggles to shelve the whole matter become quite
-
blue dye DAPI in the second column. PK-M2 is visualized using a red stain in the third column, with the merge of the images in each row in the forth column. The 2nd and
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L15:304 strongly excites
- L16:731 strongly excites
- L18:843 strongly excites
- L15:824 suppresses
- L17:1356 excites
- L18:162 suppresses
- L16:1442 suppresses
- L16:930 suppresses
- L10:422 excites
- L14:168 suppresses
- L15:2003 suppresses
- L15:318 suppresses
- L12:616 excites
- L17:626 excites
- L18:313 suppresses
- L18:1154 excites
- L13:706 excites
- L13:1995 suppresses
- L17:975 excites
- L10:586 suppresses 'important' and degree words after 'how'
- L14:1487 excites
- L16:1166 suppresses
- L15:916 suppresses
- L16:1223 excites
Feeds later layers
- L20:813 strongly suppresses
- L26:318 suppresses
- L24:240 suppresses
- L22:228 suppresses
- L21:1074 suppresses
- L23:220 suppresses
- L20:578 suppresses
- L21:262 excites
- L20:586 suppresses
- L22:479 suppresses
- L20:2046 suppresses
- L25:9 excites
- L21:594 suppresses
- L20:554 suppresses
- L20:1106 suppresses
- L20:1762 suppresses
- L21:359 suppresses
- L24:35 excites
- L23:127 excites
- L27:604 suppresses
- L23:257 excites
- L20:349 excites
- L20:810 suppresses
- L21:299 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 哪
- ENSE
- aton
- енно
- ensa
- 级别的
- LOT
- iteur
- 尤其是
- its
Suppresses
- could
- can
- becomes
- applies
- became
- があります
- comes
- になります
- exists
- 进行了