closing bracket after an acronym
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 14 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the closing bracket that ends a short name or abbreviation written in brackets, such as the "(IP)" in "ingress protection (IP)" or "(TNC)" in a company description. Turning it up made the text repetitive and dull.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
As it turns out, "cuteness" improves cognitive function, as evidenced by the pattern of popular cat pictures used as visual mnemonics ("mems") on the Memrise platform. If it can help people learn world capitals and the
-
and military units in the course of the history of Eastern Europe and adjacent territories. The main and most numerous group is the Russian Cossacks (казаки) of the Don, Kuban, Terek and Ural rivers and the Ukrainian
-
is, distributors are a higher link than dealers. In practice, the distributor can be either a large company, for example, a transnational corporation (TNC) or an IP.⏎Both the dealer and the distributor are engaged in sales, replen
-
it was acceptable to discharge Marcellus brines into rivers. Therefore, brines were discharged to some PA rivers through publicly operated treatment works (POTW) and industrial
-
water submersion. Although “waterproof” does not have a technical definition, most companies who use the term have evaluated the product’s ingress protection (IP) rating in a laboratory (“ingress” means “entrance” and is just
-
computing.⏎Structure: Modeling Real-World Scenarios with Graphs⏎A graph (or network) is a data structure. It is composed of vertices (dots) and edges (lines). Many real-world scenarios can be modeled as a graph.
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I will be a future (and other, and current) (and current) and future (and current) and future (current) and current (and) and current (current) and current and future ( and future) and current (
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
- 10 Why is Taoism the best religion?⏎- 11 What does Tao mean?⏎- 12 Is Daoism a religion?⏎- 13 What religions are banned in China?⏎- 14 What are two
-
daily requirement vitamin A⏎- Almost 40 percent of your daily requirement of vitamin C⏎- About 15 percent of your daily requirement of magnesium⏎- Around 18 percent of your daily requirement of potassium⏎- Roughly
-
that the celery is safe for cats to eat.⏎Cats can definitely eat celery and benefit from it. Cats can eat some veggies in moderate, well, actually, small amounts. Cats can eat celery
-
not trying.⏎13. Remember that failure is an event, not a person.⏎14. I expect him to get over the shock of his failure.⏎15. The best teacher is experience learned from failures.⏎16. A hatred
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L7:195 suppresses 'of' in set noun phrases
- L5:5 suppresses digit after a label like paper or type
- L6:0 excites
- L9:7 excites
- L10:33 suppresses
- L5:1299 excites
- L4:513 suppresses
- L13:1046 suppresses 'in' or 'on' ending a phrase
- L10:77 suppresses
- L4:68 excites
- L11:31 suppresses
- L9:61 excites
- L6:136 suppresses
- L3:7 weakly suppresses
- L11:18 weakly excites
- L4:154 weakly suppresses
- L0:1333 weakly excites
- L1:1300 weakly excites
- L1:2901 weakly excites
- L0:870 weakly excites
- L12:126 weakly suppresses
- L10:105 weakly suppresses
- L8:20 weakly excites
- L8:705 weakly excites
Feeds later layers
- L15:74 suppresses
- L15:2425 suppresses
- L15:1653 suppresses
- L15:2239 excites
- L15:2569 excites
- L15:547 excites
- L15:1110 excites
- L17:1775 excites
- L15:2065 excites
- L20:1447 excites
- L15:1855 suppresses
- L15:1222 suppresses
- L15:2771 suppresses
- L16:337 excites
- L15:891 suppresses
- L15:2847 suppresses
- L17:310 excites
- L15:1194 suppresses
- L15:501 suppresses
- L15:2227 suppresses
- L15:1500 excites
- L15:56 suppresses
- L15:1539 suppresses
- L20:494 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 浍
- setType
- yar
- 呻
- ме
- setId
- Msp
- _CY
- жиз
- ';";⏎
Suppresses
- ordinates
- inar
- ories
- —including
- stantiate
- atever
- constructed
- icator
- 族自治州
- –