'there' after a because or if clause
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 25 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word 'there' when it starts a clause after words like 'as', 'so' or 'even when', as in 'as there is no force'. Turning it up made the model repeat 'there' over and over, so the link to that word is clear.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
learning are predicting customer churn, personalized recommendations, fraud detection, etc.⏎Unsupervised machine learning⏎Unsupervised learning is a machine learning technique, in which there is no need to supervise the model. Instead, the model works on its own
-
and speed by operating (some of) the controls of the vehicle. A fully automated vehicle does not have a driver in the sense of the Conventions, as there is not a human that decides on the speed and direction (not to be mistaken
-
and fire then turns that fuel back into carbon dioxide, water and mineral ash. Rain prompts another turn of the great wheel. If there was no plant life, there would be no fire.⏎Viruses are also an expression of cellular life. Vir
-
On a lifeless, airless satellite there would never be any scavengers or souvenir hunters, no wind to bury or wear down the abandoned spacecraft and artifacts, and no air to corrode metal. Even the footprints would still be
-
missing is the familiar sensation of weight. Without air resistance, all objects fall at the same rate. Because you and your spacecraft are falling at the same rate, there is no force between you and it to provide a
-
they started. To reliably control the quantum information, an asymmetric light wave is needed.⏎“The optimum would be a completely directional, unipolar ‘wave’, so there would be only the central peak, no oscillations. That would be the dream
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: all the times I was away from the main house, I was able to look forward to some kind of ability to none of none, so he was able to look forward to ability, so he was able to look forward to ability. But
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
War on Terror’. Curiously, despite their proliferation, they have received relatively little academic attention. In A Theory of the Drone, French philosopher Grégoire Chamayou seeks to comprehend how drones have revolutionised warfare and to deconstruct the
-
Grégoire Chamayou seeks to comprehend how drones have revolutionised contemporary warfare and to deconstruct
-
a graphic designer. He designed posters, brochures, album covers, etc. He many times cooperated with other artists, for example György Rad
-
ik (1898), 32; Lee, The Microtomists Vade Mecum (London, 1900); Macallum, On the Detection and Localization of Phosphorus in Animal and Vegetable Cells
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L21:2091 strongly suppresses
- L19:2324 strongly excites
- L23:2535 strongly suppresses
- L23:434 strongly excites
- L21:2034 strongly excites
- L20:2275 strongly excites
- L21:1586 strongly excites
- L22:539 strongly suppresses
- L17:2383 strongly suppresses
- L18:3059 strongly suppresses
- L20:2080 strongly excites
- L24:334 excites
- L23:466 excites
- L20:1873 excites
- L19:2171 excites
- L22:661 suppresses
- L19:1927 suppresses
- L18:562 excites
- L21:2989 excites
- L18:583 excites
- L16:2783 suppresses
- L18:2931 suppresses
- L19:2907 suppresses comma right after 'and' in lists
- L18:3066 suppresses
Feeds later layers
- L27:2210 strongly suppresses
- L26:2350 suppresses
- L27:840 suppresses
- L26:406 suppresses
- L27:1095 weakly excites
- L26:2817 weakly excites
- L26:969 weakly suppresses
- L27:1753 weakly suppresses
- L27:897 weakly suppresses
- L26:2225 weakly suppresses
- L26:471 weakly suppresses
- L27:2381 weakly excites
- L27:1031 weakly suppresses
- L26:2423 weakly suppresses
- L27:794 weakly suppresses
- L26:781 weakly suppresses
- L27:2078 weakly excites
- L27:1755 weakly excites
- L26:2880 weakly excites
- L26:2134 weakly suppresses
- L27:2649 weakly suppresses
- L27:918 weakly suppresses
- L26:680 weakly suppresses
- L27:2282 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- there
- There
- There
- THERE
- there
- هناك
- stances
- 有更好的
- "There
- plers
Suppresses
- 无
- 無
- none
- none
- no
- no
- nothing
- None
- without
- .no