end of a short definition or claim
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 13 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up at the full stop or line break that closes a short statement, especially a dictionary-style definition or a bulleted fact, just before a new item starts. Turning it up made the replies repeat or wander, so it does not tell us much more.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
powers.⏎- A public land surveying unit of 36 sections or 36 square miles.⏎- An ancient administrative division of a large parish in England.⏎- A racially segregated area in South Africa established by the government as a residence for
-
. All rights reserved.⏎- n. a region in northmost Europe inhabited by Lapps⏎Sorry, no etymologies found.⏎Subfossil samples of Scots pine Pin
-
?⏎Consider these alternate headlines:⏎- “Icy conditions take clueless drivers by surprise”;⏎- “Too many crashes caused by overdriving winter road conditions”; and⏎- “Drivers fail to slow down in slippery conditions; no wonder IC
-
million Americans had received their COVID-19 shots, there were 3,544 reported deaths following COVID vaccination, or about 30 per day⏎- In just four months, the COVID-19 vaccines have killed more people
-
rotechny, imparting an intense red color to flames.⏎- n. A metallic chemical element (symbol Sr) with an atomic number of 38.⏎GNU Webster's 1913⏎- n. (Chem.) A
-
is not common but is still a risk that needs to be managed Some businesses have had unsafe work practices for many years before they have a fire caused by spontaneous ignition.⏎The possibility of spontaneous ignition is greater if the surrounding air is warm and dry –
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the system is a perfect square I have no idea I have no idea This is a very simple question I am a very small thing I am a very small thing I am a very small thing I am a
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
211171, China⏎2 Nanjing Xiaozhuang University, Nanjing, Jiangsu 211171, China⏎*Authors to whom correspondence should be addressed.⏎Received: 2020
-
To access this title, visit your library in the app or on the desktop website.⏎Chronicles of the imagination Geographical⏎- Walta Evans "School Librarian
-
is a free software. We also strongly recommend that you sign up for an AdobeID at the Adobe website. For more details please see FAQ 1&2. To view this ebook
-
line.com/VECE20|⏎|Order Information:||Web: http://www.tandfonline.com/pricing/journal/VECE20|⏎When requesting a correction, please mention this item's handle: RePEc:
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L9:682 suppresses
- L12:771 excites
- L8:149 excites
- L9:458 excites
- L11:567 excites
- L11:219 suppresses
- L9:1802 excites
- L12:2677 weakly excites
- L11:1084 weakly suppresses
- L12:901 weakly excites
- L8:524 weakly excites
- L10:404 weakly excites
- L7:848 weakly excites
- L9:1402 weakly suppresses
- L9:1191 weakly excites sentence-ending full stops in web text
- L12:1170 weakly suppresses
- L9:84 weakly excites
- L9:121 weakly suppresses
- L9:2858 weakly suppresses
- L7:265 weakly excites
- L9:159 weakly suppresses
- L8:319 weakly excites
- L8:512 weakly excites
- L12:28 weakly suppresses
Feeds later layers
- L15:306 weakly excites
- L15:482 weakly suppresses
- L14:730 weakly excites
- L16:565 weakly excites
- L23:1478 weakly excites
- L22:2104 weakly excites
- L25:1867 weakly suppresses
- L27:1493 weakly suppresses
- L16:976 weakly excites
- L16:1207 weakly excites
- L14:1079 weakly suppresses
- L20:2798 weakly excites
- L20:1338 weakly suppresses
- L14:2974 weakly excites
- L14:2712 weakly suppresses
- L27:2498 weakly suppresses
- L16:543 weakly suppresses
- L19:1218 weakly suppresses
- L25:1460 weakly suppresses
- L14:931 weakly suppresses
- L20:2161 weakly suppresses
- L21:348 weakly excites mid-sentence line breaks
- L18:36 weakly suppresses
- L19:1003 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ivers
- ordered
- EZ
- ption
- iverse
- <const
- rompt
- const
- 之作
- const
Suppresses
- DataGridViewTextBoxColumn
- .foreach
- anela
- zelf
- .squareup
- –and
- urious
- 嬷
- 酥
- ämp