'in' after a noun phrase
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 24 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds to the small word 'in' (and sometimes 'on') when it follows a noun or phrase and starts a qualifier, like 'discriminatory either of itself or in its effect' or 'selected in order to'. When it was turned up, the model repeated words like 'light view' and 'reason', though that link is loose.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
, creed, sex or marital status ⏎Further Article 23(1) states that “no law shall make any provision that is discriminatory either of itself or in its effect”.⏎The constitutional anti-discrimination clause is set out in Article
-
in price.⏎A measure of a variable's sensitivity to a change in another variable is elasticity. In economics, elasticity refers the degree to which individuals change their demand in response to price or income changes.⏎<|endoftext|>The liver is an essential organ of our
-
law could be the “Responsibility to Protect.” This principle, originally evolved against a background of genocide, tries to make it incumbent on states to take protective measures in events where human rights are imperilled.
-
This is even more true, under the current circumstances with Covid-19 and the current restrictions on people's movements and the heavy blow to SIDS’ economies in their continued reliance on tourism."⏎Vanessa Gray, Head of the Division for Least
-
, number, power, location, etc…), the installation may include additional substations designed "Secondary substations". The locations of these substations are carefully selected in order to optimize the budget dedicated to MV and LV power cables. They are supplied
-
about the application of the law of armed conflict to hostilities in the space domain. Efforts to achieve greater clarity must be undertaken before such hostilities occur, in part because such efforts will help to address some of the current challenges in space security
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: for in in in in in in in in in in in in in in in in in in in in in in in in in in in in in in in in in in in in in in in in in in in in in in in
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
course, combining these free tools to deliver learning over the web is not without its challenges. One significant challenge is that of the level
-
- Excellent cutting surface roughness can be produced even when machining at low speed.⏎- Suitable for soft materials or workpieces<|endoftext|>Fernanda vertelt haar verhaal in een gesprek met CSL Behring⏎Living With Alpha 1
-
you don’t do well, it’s not just your failure it’s the extended family as well.⏎Marrying an unstable husband and having four of her five in five years would stress anyone, but Flora still wanted her children to have the
-
a node is visited __before__ its children. In "post-order" traversal, a node is visited __after__ its children. The more rarely used "in-order" traversal is generally applicable only to binary trees, and is where you visit
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L20:2850 excites
- L17:706 excites
- L17:303 suppresses
- L19:704 excites
- L18:293 suppresses
- L20:283 excites
- L12:234 excites
- L5:763 suppresses
- L16:1059 weakly excites
- L16:1557 weakly excites 'in' meaning 'in this case' or 'in between'
- L4:289 weakly excites
- L14:1625 weakly excites the word 'in' after a noun
- L10:132 weakly excites
- L22:535 weakly excites
- L15:771 weakly suppresses
- L19:2866 weakly suppresses
- L17:1721 weakly excites 'by' introducing a method or means
- L19:1464 weakly suppresses
- L23:1366 weakly excites
- L23:1506 weakly excites
- L15:906 weakly suppresses
- L15:675 weakly excites
- L9:1358 weakly excites
- L3:232 weakly excites 'on' after a noun like 'impact on'
Feeds later layers
- L27:1684 excites
- L27:814 excites
- L27:1282 excites
- L27:1809 excites
- L27:478 weakly excites
- L27:2423 weakly excites
- L26:346 weakly excites
- L27:1355 weakly suppresses
- L27:2053 weakly suppresses
- L26:657 weakly suppresses the word 'people' coming next
- L26:110 weakly suppresses
- L26:1764 weakly suppresses
- L25:1085 weakly excites
- L27:1846 weakly excites
- L27:1199 weakly excites
- L25:1526 weakly excites
- L25:390 weakly excites
- L26:1530 weakly excites
- L27:208 weakly excites
- L27:1810 weakly suppresses
- L27:1424 weakly suppresses
- L27:3004 weakly excites
- L27:785 weakly excites
- L25:50 weakly suppresses 'di' syllable in diabetes and diet words
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- light
- view
- Light
- light
- (light
- relation
- connection
- virtue
- →light
- Light
Suppresses
- esimal
- stile
- ego
- olang
- ducible
- oodles
- TOCOL
- es
- 禀
- <Any