"for" in same-or-true comparisons
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 14 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word "for" when a sentence says something is the same, true, or matching for another group, as in "the same is true for businesses" or "the corresponding percentage for whites". Turning it up gave repetitive or off-topic text rather than anything clearly related.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Over the same period the percentage of black adults with a four year college degree jumped from 2.2% to 22.8%. The corresponding percentage for whites in 201
-
object, and draw a line through them. The best points to use are the corners of an object for which it is easier to match shadow and object. Repeat for as many clearly defined shadow and object points as possible. As you do this,
-
your code units per conceptual relation as opposed to functional relation. For example, instead of putting all your controllers in one folder, do something like:⏎And the same for deeper code units concepts:⏎Consumer/Event/SomeEvent/SomeEventInterface
-
in plant sciences. I have worked at a number of institutes and the number of male and female group leaders and department heads is about equal, this is also true for the more junior roles.⏎3.-How has the profile of your profession changed since
-
insurance, and retirement contributions. Whatever is left is your Net Income and it will be considerably less than $1,500.⏎The same idea holds true for businesses. The difference between gross income and net income can be enormous, and the
-
at the 2019 Dairy Cattle<|endoftext|>General best practices for performance⏎You must plan for every feature in your app, and the same is true for performance. Planning for performance consists of determining what your performance-critical scenarios will be
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I can't be in the same place, and I have been thinking about it more often and more and more in the ... perhaps, I was thinking about it as a result. I was thinking about it to the ... and it's the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
i.e., "I don't want to see it again").⏎In #2 "saw" is past tense and neutral about the present. (see The<|endoftext|>In the field of meta-ethics, scholars have identified key problems in the
-
before and after the main meals. As mouth wash they used another salt solution<|endoftext|>About Apollo Missions"That’s one small step for a man, one giant leap for mankind...” nnOn 20 July 1969, Neil
-
.⏎• In “The American Frugal Housewife,” (the Better Homes and Gardens of its day) the author recommends using ear wax as lip balm.<|endoftext|>Health care employment has been the bright spot in the otherwise lackluster recent jobs
-
see practical); the noun from the verb within the earlier spelling practise, on the sample of pairs akin to advise, recommendation.⏎Word Origin Middle English (in legal<|endoftext|>Keywords: Sargent Mountain⏎Historical Items Showing 1 of 1 View
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L6:2907 weakly suppresses
- L2:3069 weakly excites
- L13:1100 weakly suppresses
- L6:1352 weakly excites
- L4:1035 weakly suppresses 'for' after verbs like 'fall' or 'click'
- L13:2802 weakly excites
- L11:2015 weakly excites
- L11:1673 weakly excites
- L4:986 weakly excites
- L10:341 weakly excites "of" inside treaty names
- L12:2613 weakly excites
- L12:1646 weakly excites
- L12:1732 weakly excites
- L12:205 weakly suppresses 'of' after an abstract noun
- L12:1308 weakly excites
- L10:1542 weakly excites
- L3:545 weakly suppresses
- L13:2769 weakly excites
- L3:1980 weakly excites
- L8:2830 weakly suppresses
- L13:2534 weakly suppresses
- L5:391 weakly suppresses
- L12:147 weakly suppresses
- L13:132 weakly excites "of" after a noun
Feeds later layers
- L17:865 excites
- L15:2573 excites
- L16:1968 excites
- L16:1831 excites
- L16:805 excites
- L15:2498 suppresses
- L15:748 excites
- L17:752 excites
- L18:748 suppresses
- L15:1227 excites
- L17:2192 suppresses
- L18:1860 excites
- L19:1854 excites
- L19:1881 excites
- L16:2658 excites
- L16:2323 excites
- L15:958 excites
- L16:1999 weakly excites
- L16:680 weakly excites
- L19:423 weakly excites words that set up a following clause
- L16:1051 weakly excites
- L16:2556 weakly excites
- L17:1327 weakly excites
- L19:292 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- enville
- nore
- 其他国家
- noc
- culate
- prot
- versions
- ilestone
- verted
- unfinished
Suppresses
- каз
- Geological
- 巾
- ù
- 학
- kans
- Sql
- »
- 士
- типа