unclear: fragments of rare nouns
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 2 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on pieces of uncommon words, like the middle of 'puffer' fish, 'tabbouleh' and 'tuberous'. The pattern is not very clear, and turning it up gave rambling text with no obvious theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Connecting⏎- 2 The Network⏎- 3 Printing Files⏎- 4 GuardBuddies⏎- 5 Radio⏎- 6 Troubleshooting⏎- 7 Tapping the Wire⏎- 8 Scripting⏎
-
like minerals and vitamins.⏎Examples of salads: Tabbouleh, fattoush, rocca salad, greek salad.⏎2.
-
Southeast Asia, and Africa. They are primarily found in the submerged plants along the riverside.⏎There are at least about 150 known species of puffer. Some common species are,⏎Red Eye Puffer⏎Dwarf Pea P
-
the large four teeth used for crushing the hard shells of their prey. They are slow-moving fish and show dorsal, anal, caudal fin motion.⏎Puffer fish are common in tropical and temperate climates. They mostly live in brack
-
would pass away before<|endoftext|>The Badrouzi Festival or “Kajin” was held in ancient Iran in honor of
-
corn oil and safflower oil may also self-heat. Fish oils are notorious for their self-heating properties. Mineral oils like white spirit, mineral turpentine or lubricating oil are not prone to self-heating and will not cause
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have been in the hospital for a week, and I have been told by the nurse. I have been told by the nurse, and I have been in the hospital for a week. I have been in the hospital for a week,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
PA. Glass bottles, however, also leach chemicals, including aluminum, explains a study by Clemens Reimann of the Norges Geologiske Undersøkelse in Norway and colleagues. Aluminum is sometimes added to soda-lime
-
or she is just a huge airhead (this is my view). She truly seems not to know that<|endoftext|>Three Meetings in June 2006 Underscore UN Efforts to Improve Early Warning and Mitigation of Natural Disasters⏎
-
, an independent think-tank and watchdog over the environmental consequences of Canadian government and corporate activities around the world. Her books include In the Name of Progress: The Underside of Foreign Aid, (Doubleday 19
-
has these capabilities in principle, we can go to the testing stage where we begin to collect data from real epilepsy patients.⏎“Provid<|endoftext|>Dashes vs. Underscores in URLs⏎The debate over whether to use dashes or underscores to represent spaces
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L1:1464 excites
- L1:22 weakly excites
- L0:53 weakly suppresses
- L0:1224 weakly suppresses
- L1:3066 weakly suppresses
- L1:2683 weakly excites
- L1:1757 weakly suppresses
- L0:1301 weakly suppresses
- L1:10 weakly excites
- L0:182 weakly excites
- L0:1342 weakly suppresses
- L1:1029 weakly excites
- L0:178 weakly suppresses
- L1:2801 weakly excites
- L1:162 weakly excites
- L1:2342 weakly excites
- L1:1583 weakly excites
- L1:1313 weakly excites
- L1:619 weakly suppresses
- L0:404 weakly excites
- L0:102 weakly suppresses
- L1:491 weakly excites
- L1:1250 weakly excites
- L0:1911 weakly suppresses
Feeds later layers
- L4:2383 suppresses
- L4:2820 suppresses
- L18:805 suppresses
- L19:1206 suppresses
- L16:1558 suppresses
- L20:2017 weakly suppresses
- L17:2510 weakly excites
- L3:232 weakly suppresses 'on' after a noun like 'impact on'
- L21:1246 weakly suppresses
- L17:1369 weakly suppresses "of" after is/are/be (of + quality)
- L8:1945 weakly excites
- L14:233 weakly suppresses
- L11:2865 weakly excites
- L5:977 weakly excites
- L17:1196 weakly suppresses
- L8:1960 weakly suppresses
- L4:925 weakly excites
- L12:1378 weakly suppresses
- L17:2438 weakly suppresses
- L15:936 weakly excites
- L17:2615 weakly suppresses
- L7:2133 weakly suppresses
- L9:246 weakly excites
- L22:2679 weakly suppresses cycles and periods, before the word 'cycle'
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- Departments
- offices
- retweeted
- 攘
- modules
- Laundry
- institutions
- gy
- tongues
- Replay
Suppresses
- pace
- åde
- chron
- =sub
- ówi
- intermittent
- }}⏎⏎
- �
- siege
- iseconds