"as a result" before "a"
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 27 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word "a" in the phrase "as a result", right before the word "result" comes. When it is turned down, the model gets stuck repeating the word "result". When it is turned up, the model writes odd, off-topic text.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
this post you might be interested in reading my report one year later!⏎The buildings welcome you⏎Many of the patients never came out again alive and many died as a result of the reprehensible treatment. It was said that the treatment was carried out
-
drivers of these buses have a responsibility to safely deliver their passengers to and from school. Despite this important responsibility, however, dozens of innocents die each year as a result of school-bus accidents.⏎If your child has sustained an injury from a
-
with another and the widespread adoption of the internet additionally revolutionized human communication. One far-reaching and prevalent culture that has developed as a result of easier communication is the use of memes. A meme is a conception,
-
making us sick. Diabetes, heart disease, strokes, and obesity diminish our lives and threaten to bankrupt our health care system.⏎Other species, too, suffer as a result of the way we eat. Industrial food production pollutes rivers and streams,
-
the Study of Religion" by Dr. Clayton Crockett. In it<|endoftext|>Approximately 1.6 million people die worldwide every year as a result of pneumococcal infection, which causes grave illnesses, including pneumonia,
-
get their planners out, write in homework assignments<|endoftext|>Drymarchon couperi (eastern indigo snake) has experienced population declines across its range primarily as a result of extensive habitat loss, fragmentation, and degradation. Conservation efforts for D.
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: result result result result result result result result result result result result result result result result result result result result result result result result result result result result result result result result result result result result result result result result result result result result result result result result
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
the time.⏎Is mostly known for the “Protesta de Baraguá” (Baraguá Protest), when he did not accept the terms of the Zanjón Pact, that ended the Ten Years War, as he understood the targets
-
687|⏎|Julkaisu||JOURNAL OF LANGUAGE TEACHING AND RESEARCH|⏎|DOI - pysyväislinkit|⏎|Tila||Julkaistu - 1 syysk. 20
-
for Engineering Education⏎K-State's Architectural Engineering program is accredited under the General Criteria by the Engineering Accreditation Commission of ABET.<|endoftext|>1 edition of Church basic communities in Latin America.
-
the US from the Mexican region. The UN is currently using the Basel Convention to help the US stop illegal dumping coming into the US from Mexico's city of Cuernavaca.⏎A transboundary environmental
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L23:694 strongly excites
- L22:1955 strongly suppresses
- L21:2100 strongly excites
- L23:2202 strongly suppresses
- L19:1906 strongly excites
- L23:1041 strongly excites
- L25:489 strongly excites
- L26:2203 strongly suppresses
- L25:1605 strongly suppresses
- L19:2178 strongly suppresses
- L26:629 strongly excites
- L22:1968 strongly suppresses
- L21:1288 strongly excites
- L19:1518 strongly suppresses
- L20:2506 suppresses
- L25:2158 suppresses
- L20:2950 suppresses
- L23:3050 excites
- L21:2697 excites
- L17:2449 suppresses
- L19:2916 suppresses
- L21:953 excites
- L17:2151 suppresses
- L17:434 suppresses
Feeds later layers
None: this is the last layer.
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- atile
- ке
- ennessee
- dàng
- mü
- canf
- 馋
- \/\/
- ắt
- 整顿
Suppresses
- result
- 结果
- result
- Result
- (result
- Result
- 的结果
- =result
- .result
- _result