pieces of split scientific or place names
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 25 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the middle chunks of split names, especially Latin species names like 'Dios-py-ros' or 'Ps-amm-omys' and place names like 'To-hoku'. Turning it up made the model produce unrelated text, so the species link is only visible in the examples.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
2) (Learn how and when to remove this template message)|⏎Sendust is a magnetic metal powder that was invented by Hakaru Masumoto at Tohoku Imperial University in Sendai, Japan, about 1936 as
-
the fall. Japanese maple can be grown in Southern California, but trees must be in a protected location and watered regularly.⏎Japanese Persimmon (Diospyros kaki): This is a fruit-bearing tree that grows to 30
-
North American diving duck related to the goldeneye, with a large puffy head. The male has white plumage with a black back.⏎- ‘Neophytes at duck identification often confuse a bufflehead with a male hooded merg
-
x-ray images of small animal spines identifying the effects of disc degeneration. The age-related disc and spine degeneration that occurs in the sand rat (Psammomys obesus) has previously been documented radiologically; selected representative radiographs
-
const void * memchr ( const void * ptr, int value, size_t num );⏎void * memchr ( void * ptr, int value, size_t num );⏎Locate character in block of memory⏎Searches within the first num bytes
-
or if it were truly indicative of Homer’s personal psychosomatic beliefs, it’s difficult to argue that his approach to storytelling<|endoftext|>Oak spider mites (Oligonychus bicolor) may be hard to see with the naked eye but
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I am a self-provementist, a self-provementist is a person who makes significant effort to improve their home environment with a high cost in money, effort, and time, and I want to make a difference in the environment.
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
by the routine. The template can consist of:⏎- An introductory paragraph highlighting the problem and promising a solution;⏎- Body of text with several tips in a logical order;⏎- The final paragraph where the author encourages the reader to follow the advice.⏎
-
damage (hepatitis, cirrhosis, tumors);⏎- bowel diseases in violation of protein digestion and absorption of amino acids (inflammations, post-operative conditions, paras<|endoftext|>Alice’s Adventures in Wonderland⏎The classic tale in the realm of
-
is harmful to the eyes since it increases the risk of cataracts and ARMD;⏎- Wear sunglasses with UV protection - ultraviolet radiation is harmful to the eyes;⏎- Monitor eye health regularly<|endoftext|>Introduction to Machine Learning with R: Rigorous
-
first and second control signal generating means for generating a first error signal (e.g. e3) proportional to the algebraic difference between said first and second control signals for input into said power management control circuit;⏎means connected to the output of said
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L24:244 suppresses
- L22:591 suppresses
- L24:331 suppresses
- L22:377 excites
- L24:405 excites
- L22:379 excites
- L24:531 suppresses
- L21:881 suppresses comma after 'if' clause in prose, braces in code
- L23:171 weakly suppresses
- L21:1197 weakly excites
- L23:813 weakly excites
- L3:14 weakly excites
- L24:1922 weakly suppresses
- L19:1084 weakly suppresses "and" joining clauses after a condition
- L21:2258 weakly suppresses
- L12:1481 weakly excites
- L22:751 weakly suppresses
- L22:165 weakly suppresses
- L15:2776 weakly suppresses
- L7:1179 weakly suppresses
- L21:1537 weakly excites end of document boundary token
- L20:1264 weakly suppresses
- L22:489 weakly excites
- L19:2591 weakly suppresses
Feeds later layers
- L26:377 strongly excites 'sh' starting a word piece
- L27:1065 excites
- L26:238 suppresses
- L27:2710 excites
- L27:799 weakly suppresses
- L27:2585 weakly excites
- L26:2682 weakly suppresses
- L27:1053 weakly suppresses
- L27:207 weakly suppresses
- L27:1772 weakly excites
- L26:921 weakly excites
- L27:1794 weakly suppresses
- L26:2938 weakly excites
- L27:2663 weakly excites
- L26:1127 weakly suppresses
- L26:3062 weakly excites
- L26:516 weakly excites
- L27:2383 weakly excites
- L27:1744 weakly suppresses
- L26:1471 weakly excites
- L27:1846 weakly excites
- L27:1258 weakly suppresses
- L26:2959 weakly excites word-start 'm' pieces
- L27:2307 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ")));⏎⏎
- cribe
- .datab
- onis
- >:</
- arden
- (){ ⏎ ⏎
- arend
- """ ⏎ ⏎
- 命题
Suppresses
- western
- bung
- addCriterion
- GENER
- angen
- UNG
- ocene
- 增高
- 一脚
- 低廉