"however" as a mid-sentence aside
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 9 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word "however" when it sits inside a sentence, set off by commas after a subject or phrase, like "Ants, however, are attracted". It was quiet on other words, and changing it did not produce a clear shared theme in the generated text.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
risk of birth defects and intellectual impairments. Alcohol also contributes to death and disability through accidents and injuries, assault, violence, homicide and suicide. It is, however, one of the
-
workers to be able to operate tractors and other farm machinery would be increased from 20 hours to 90 hours. Children enrolled in the program, however, could
-
idacloprid when caring for the gardenia.⏎A heavy sooty mold infestation may infect the whitefly or its larvae. Ants, however, are attracted
-
the Kennedy-Johnson administrations thought about nuclear war and nuclear weapons use in European and intercontinental military operations. The theater and strategic war plans that they approved, however, remain classified. Yet, basic planning concepts and nuclear targeting options in U.S
-
actively in the circle of expatriate modernists that included luminaries such as Gertrude Stein, Ezra Pound, and Ernest Hemingway. Fitzgerald, however, did not participate in the experiments of style and form that characterized most of the
-
of California, Los Angeles, who was not involved in the research. “And it does provide some evidence for a potential mechanism of treatment.”⏎Some researchers caution, however, that the findings
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the following is a collection of posts on the following topics: the following are the following topics: the following are the following topics: the following are the following topics: the following are the following topics: the following are the following topics: the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
professional health advice. This content does not provide dosage information, format recommendations, toxicity levels, or possible interactions with prescription drugs. Accordingly, this information should be used only under the
-
of new digital content poses a real challenge for archivists. Hard disks are expensive and require a constant supply of electricity, while even the best 'no-power' archiving materials such as magnetic tape degrade within a decade. This is a growing
-
tight budget. In several places, the ceiling lets through water from the grey Rhode Island sky.⏎The youngest group of children at Federal Hill
-
, looking for ideas that, for whatever reason, resonate with you?⏎Will you resist distraction while you read this? Or are you likely to have your attention pulled away - to jump to another open tab, or simply switch your focus to what’s
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L8:140 excites
- L6:2630 suppresses
- L7:32 excites
- L8:2298 suppresses
- L5:2146 excites
- L7:2280 suppresses
- L8:2296 suppresses
- L8:2646 excites
- L5:2502 weakly excites
- L4:9 weakly excites
- L8:1395 weakly excites
- L7:612 weakly suppresses
- L7:2779 weakly suppresses
- L6:1461 weakly suppresses
- L8:3036 weakly excites
- L7:443 weakly suppresses 'not' or 'only' setting up a contrast
- L7:2653 weakly suppresses
- L6:2457 weakly excites
- L5:2775 weakly suppresses
- L7:1387 weakly excites
- L6:2288 weakly suppresses
- L8:2191 weakly suppresses
- L7:2169 weakly suppresses
- L5:6 weakly suppresses
Feeds later layers
- L11:1922 excites
- L12:3025 excites
- L11:2178 excites
- L12:2154 excites
- L12:20 suppresses
- L12:877 excites
- L11:106 suppresses
- L10:449 excites
- L11:1289 excites
- L13:1233 excites
- L10:2301 excites
- L11:2911 excites
- L12:861 excites
- L14:3007 excites
- L17:2798 excites
- L11:1933 weakly suppresses
- L11:1653 weakly excites
- L11:158 weakly suppresses
- L12:2339 weakly excites
- L15:1243 weakly excites
- L10:2215 weakly excites
- L15:1725 weakly excites
- L11:2730 weakly excites
- L10:673 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- opes
- answered
- ace
- don
- oid
- Don
- sur
- ollapse
- цу
- üm
Suppresses
- bourne
- .Append
- 书中
- _CAPTURE
- irectory
- 标的
- 一则
- receive
- 史诗
- atcher