'this' pointing back to a topic
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 7 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'this' when it points back to something just mentioned, like 'talking about this' or 'approach this process'. Its strongest negative reactions are on words like 'into' and 'of' in similar phrases. Turning it up did not produce a clear, related change in the sample text.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
and practices for using allowed electronic devices, such as phones and games, at your meetings and other Scouting events.⏎A Cub Scout friend and I were talking about this,
-
When choosing a kit, make sure to read the directions carefully, as the directions can stain clothing and fabrics.⏎There are a few groups of people who should approach this process with caution. Women who are pregnant or breastfeeding should avoid starting a tooth whit
-
of participants and their common theoretic and practice tasks.⏎In the article the concept of the electronic document to the Russian<|endoftext|>Both sexual and asexual reproduction occur in this species; however, asexual reproduction is the dominant form. Arms voluntarily detach to
-
inseparable. Most of us recognize this from our own lives. We cannot become who we are without caring for the relations that care for us.⏎David Brooks called this the meaning of covenant, the bond between singular persons that protects not private interests (
-
can also occur in severely injured patients independent of, or in addition to, these factors [2,3]. Several terms are used in the literature to refer to this condition, including acute traumatic coagulopathy (ATC), early coag
-
be supplied from dedicated level tanks at the final stage of the intake system (seawater intake, filtering, energy, aerating).⏎“We have worked on this contract since the autumn of 2016, and it's very satisfying
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have a function $ f $, and I know that $ f $ is a function that maps the set $ \mathbb{R} $, and I know that $ f $ is a function that maps $ \mathbb{
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
, planetary researchers were receiving thousands of colour images from Mars revealing evidence of dry riverbeds hinting at the planet’s wetter, warmer history. These insights into the Martian past demonstrated the science potential of investing in imaging of the planets from orbit
-
study and compare them, and we have limited evidence beyond six months about its benefits. Many of the studies also involve a very small number of participants.”⏎Because of this, there's a lot we don't know yet about IF—but here’s what
-
the sinful brotherhood of mankind, so that his chest vibrate[s] in unison with theirs."⏎His eloquent and powerful sermons derive from this sense of empathy. The narrative of the Rever
-
hole that will suck in the Earth and end humanity. Should we take the trillion to one chance? I’d role those dice.⏎Such extreme and contrived cases aside, I can accept his general precautionary principle. If the risk is the destruction
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L5:372 suppresses
- L4:270 suppresses
- L6:110 suppresses
- L4:307 suppresses
- L3:426 suppresses
- L5:891 excites
- L6:1458 weakly suppresses
- L2:680 weakly excites 'a' before a noun phrase
- L2:291 weakly excites
- L6:1213 weakly excites
- L6:790 weakly suppresses
- L4:109 weakly suppresses
- L2:468 weakly excites
- L5:2427 weakly excites
- L4:468 weakly excites "that" after "than" or "like"
- L5:102 weakly excites
- L6:1571 weakly suppresses
- L4:1486 weakly suppresses
- L6:489 weakly excites
- L5:32 weakly excites
- L4:191 weakly excites
- L6:769 weakly excites
- L5:552 weakly suppresses the word 'below' pointing to content further down
- L4:73 weakly suppresses
Feeds later layers
- L8:890 suppresses
- L8:895 suppresses
- L8:1322 suppresses
- L10:1355 suppresses
- L11:2305 suppresses
- L14:1506 suppresses
- L8:157 excites
- L8:621 excites
- L8:231 suppresses
- L13:1040 suppresses
- L13:2760 suppresses
- L11:899 suppresses
- L8:942 excites
- L8:2461 suppresses
- L8:1551 suppresses
- L9:40 excites
- L9:597 suppresses
- L10:326 suppresses
- L12:59 excites
- L11:1782 suppresses
- L14:2053 suppresses
- L10:2061 suppresses
- L11:1907 suppresses
- L9:113 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 的灵魂
- hdl
- HAND
- auc
- hay
- Forever
- 的文章
- nipples
- landers
- h
Suppresses
- stellar
- itime
- outing
- этому
- ibel
- thus
- afone
- -outs
- INU
- ellipsis