the word 'same' in 'the same'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 14 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
The neuron lights up on the word 'same' when it follows 'the' and points back to something already mentioned, as in 'the same sphere' or 'the same result'. It is quieter on prepositions such as 'for' or 'in' that come right after 'the same' in a phrase like 'the same way in'. Turning it up did not make the writing talk about sameness.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
acceleration of a sphere rotating along a circular path at speed s. The sphere is at distance R from the center. What is the centripetal acceleration of the same sphere if both distance R and speed s are doubled?⏎B) a /
-
impression, to appreciate what the visual stimulus meant.⏎An experienced art observer will have learned to look in a deeper, more thoughtful way, dermatologists can adopt the same approach.⏎Human Rather Than Artificial⏎Visual literacy is an essential part of a dermat
-
es,or alcoholic digestion) for treatment of disorders of the locomotor system and gastrointestinal tract. The leaves and stems have also been used for the treatment of the same disorders
-
become pure and sweet again, he dosed the youngster with it – and cured him.⏎He treated several other parishioners in the same way and with the same result, and the treatment was widely adopted by 18th-century medics
-
is House⏎There are three houses named the Harrison Gray Otis House in Boston, Massachusetts. All were built by noted American architect Charles Bulfinch for the same man, Harrison Gray Otis.-First Harrison Gray Otis House:...⏎in
-
, Lo and colleagues within the OHSU Department of Urology, and at Harvard Medical School, Boston University and the University of Colorado, are using a similar study model<|endoftext|>Celebrate Earth Day 2012Certification Map,
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have been thinking about the following two questions: I have been thinking about the following two questions: "I have thought about..." (I think I have thought about this... ... (I think I have thought about ... ... (I think
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
, and this vacuum extends well beyond voting equipment. 2 The Diebold story is just the tip of the iceberg.⏎We know that using the same encryption key for every transaction hasn't been an acceptable practice since the Caesar Cipher was popular in ancient
-
aerial disturbances; in effect the suffix -oo serves as a kind of attenuator.⏎Moreover, their results suggest that the calls are not used in the same way in the Tai Forest and on Tiwai Island. For instance, "krak
-
Since E = constant = h / c, the above statement assumes that the relation between Planck's constant h and the velocity of light c is essentially the same for light from the distant nebulae as in light from laboratory sources. The assumption
-
least one hour before a meal. However, it may be taken with food if it upsets your stomach.⏎- Monopril should be taken at the same time each day to maintain an even level of the medicine in your
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L12:2285 suppresses
- L4:2695 suppresses
- L8:899 suppresses
- L5:2903 suppresses
- L10:1752 suppresses
- L13:1655 excites
- L7:1508 excites
- L8:955 excites
- L11:1884 suppresses
- L11:515 suppresses 'hands' in hand-washing advice
- L10:411 suppresses
- L13:1507 suppresses
- L12:2417 excites
- L11:1979 excites
- L12:2346 weakly excites
- L12:838 weakly excites
- L11:1987 weakly suppresses
- L11:248 weakly excites
- L11:490 weakly excites
- L9:2396 weakly excites
- L12:1951 weakly excites
- L11:2271 weakly excites
- L9:2725 weakly excites
- L13:1768 weakly excites
Feeds later layers
- L16:1039 strongly suppresses
- L16:2950 strongly suppresses
- L21:1102 suppresses 'one or more' before a count noun
- L17:2309 suppresses
- L16:1818 suppresses "two" and the link between two things
- L16:581 suppresses
- L18:1732 suppresses
- L18:2649 suppresses
- L18:1461 suppresses
- L16:2111 suppresses
- L15:989 suppresses
- L20:1647 suppresses
- L19:2131 suppresses
- L18:2605 excites
- L15:2527 suppresses
- L18:2563 suppresses
- L17:1786 suppresses
- L19:2372 suppresses
- L18:1746 suppresses
- L16:1013 suppresses
- L19:2423 suppresses
- L20:1724 suppresses
- L17:2331 suppresses
- L17:1724 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- lef
- ographics
- me
- quartered
- sf
- queryInterface
- ografia
- plaintext
- Me
- 地理位置
Suppresses
- 两个
- multiple
- two
- 多个
- 兩個
- 两款
- два
- 多家
- 两家
- 两边