'in' after a noun, introducing a clause
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 7 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word 'in' when it follows a noun and starts a description, as in 'a condition in which' or 'a writer in the 1800s'. It goes quiet or negative on words like 'the most' or 'the biggest' in superlative phrases. Turning it up made the model's text drift into unrelated topics, with no clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
-oriented programming⏎- event-driven programming.⏎At least some portion of a study should be devoted to object-oriented programming.⏎Note About Coding⏎Computer programming is one step in the software-development process; it is the implementation of the solutions to problems. Within
-
at high risk for developing osteoporosis. Osteoporosis is a condition in which thinning bones become so fragile that they are prone to fracture easily. A
-
issued from Barrelon workshop. In fact, they are still there.⏎Georges Dufêtre who has been one of Barrelon employees (since lst February 1864) became officially his successor in
-
induced) or a chemical. It may require medication and even surgery to eliminate. ...Read moreSee 1 more doctor answer⏎Ischemia is a symptom in which a person does not have enough blood supply to a part of the body,
-
of the scarlet letter, Reverend Dimmesdale, and burrs to add onto the overall theme of guilt.⏎Nathaniel Hawthorne was a writer in the 1800s, an anti
-
4th Century, it is listed in the Table of Elements as a chemical element in the Transonic series. It had the symbol of "CO" - both letters
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the world of the universe. It is the most beautiful, most powerful, and most fascinating phenomenon in the universe. But how much of that power is it, in fact, influencing the world? And how much of it is it affecting the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
any others please let us know by adding a comment below.⏎Ultimate Titanic: This is by far the biggest collection of Educational Titanic resources and should be the starting point for any teacher and
-
). It is one of Indonesia's most active volcanoes and lies in one of the world's most densely populated areas.
-
first we’ll look at who Orion is in mythology, the stars⏎Orion is one of the easier to recognizable and noticeable constellations. It is perhaps the most splendid of all constellations, befitting for a venerated character
-
, man-made molecular switches or molecular muscles. The work on rotaxanes described won the 2016 Nobel prize in chemistry and represents some of the most exciting and cutting-edge research happening in organic chemistry at the moment. Organic chemistry:
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L6:2079 suppresses
- L6:2210 suppresses
- L4:2022 weakly excites
- L6:2082 weakly excites
- L4:284 weakly suppresses
- L6:113 weakly suppresses
- L0:1991 weakly excites
- L4:2411 weakly suppresses
- L6:2021 weakly excites
- L5:1494 weakly suppresses
- L3:478 weakly excites
- L3:2399 weakly suppresses
- L3:189 weakly excites
- L5:233 weakly excites
- L1:786 weakly excites
- L6:1808 weakly suppresses
- L6:2513 weakly excites
- L5:1619 weakly excites
- L4:1311 weakly excites
- L5:2204 weakly suppresses
- L6:1806 weakly excites
- L3:406 weakly excites line break in the middle of a sentence
- L2:2484 weakly suppresses
- L1:1889 weakly suppresses
Feeds later layers
- L12:637 suppresses
- L10:797 suppresses
- L11:2781 weakly suppresses
- L9:68 weakly excites
- L20:2566 weakly suppresses
- L8:981 weakly excites
- L26:2897 weakly excites
- L12:1825 weakly excites
- L15:2374 weakly suppresses
- L15:103 weakly excites
- L12:2935 weakly excites
- L14:3032 weakly suppresses
- L12:2090 weakly suppresses
- L13:2375 weakly suppresses
- L22:387 weakly suppresses
- L8:670 weakly excites
- L16:2850 weakly excites
- L8:207 weakly excites
- L19:367 weakly excites
- L26:2532 weakly excites
- L12:230 weakly suppresses
- L14:2480 weakly excites
- L11:1517 weakly suppresses
- L23:2944 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- oyer
- '\\
- 仅供参考
- oni
- Transcript
- ("/",
- otional
- Resistance
- ums
- useForm
Suppresses
- 中最
- 史上最
- 最具
- 对他们
- 最难
- 般的
- 最为
- 最
- 乃至
- 最受