the word 'can' after a subject
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 17 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'can' right after a noun or pronoun subject, as in 'Hives can occur' or 'It can be challenging'. Turning it up did not make the output obviously about ability or possibility.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
which is an examination of what motivates individuals. According to Maslow, people must achieve basic survival needs before reaching one’s full potential.⏎Maslow’s theory can easily be applied to workplace mentality that runs the gamut of employees just showing up
-
is experiencing a hypersensitivity reaction. Fluid escaping from blood vessels becomes trapped in parts of the skin and lining membranes of the body, causing localized swelling.⏎Hives can occur anywhere on the body where there is skin. Therefore, you can also get
-
degree the potential for addiction. In this article I want to explain what addiction is and how gambling fits in.⏎It can lead to the establishment of a powerful and difficult to break state<|endoftext|>Even before the
-
people consider “food allergy” may instead be a food intolerance or non-allergic issue. Yet, food allergy remains an important problem in children and adults, and can be life threatening. Methods of testing (including skin testing and blood testing) for
-
bond, namely the coupon payment throughout the life of the bond and the principal payment, or the balloon payment, at the end of the bond's life. You can see how it changes over time in the bond price chart in our calculator.⏎To
-
, V, X, L, C, D, M.⏎In conclusion, we simply find the significant difference between the Arabic and Roman numerals. This difference can certainly be overcome with the numeral converter.⏎Why Arabic to Roman Numeral Converter?⏎
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I am the 4th and 5th and 5th and 5th and 5th and 5th and 5th and 5th and 10th and 10th and 10
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
! Click on one of the images to start.<|endoftext|>Appendicitis is a serious medical condition that can be life-threatening if not treated promptly.While appendicitis is most common in people between the ages of 15 and 30,
-
, either permanently, as a hermit or monk; or partially, as every member of a religious institute; or temporarily,k as in a retreat. Physical solitude is not escapism or isolationism, but a means to an end, the end
-
PCs will make copies in the process, and the website host grants visitors an implied license or permission to make those copies.4⏎Downloading content from any web page is the equivalent to making a copy of the content, the same as making copies of
-
in the world. Physicians and researchers who specialize in the study, diagnosis, treatment, and prevention of cancer are called oncologists.⏎What causes cancer?⏎Cancer is ultimately the result of cells that uncontrollably grow and do not die. Normal
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L10:384 strongly excites
- L4:173 strongly suppresses
- L3:978 suppresses
- L15:886 excites
- L10:2166 excites
- L0:1372 suppresses
- L13:2339 excites
- L11:360 suppresses
- L6:170 excites
- L5:387 excites
- L9:352 suppresses
- L6:1363 suppresses
- L4:904 excites
- L3:2961 suppresses
- L6:7 weakly suppresses
- L16:2349 weakly excites
- L5:1692 weakly suppresses
- L5:2772 weakly excites
- L5:371 weakly excites
- L16:968 weakly suppresses
- L4:693 weakly excites
- L13:1542 weakly suppresses
- L8:4 weakly excites
- L8:614 weakly excites
Feeds later layers
- L24:2814 strongly excites the modal 'can' after 'there' or 'it'
- L18:2896 strongly excites
- L18:1491 strongly excites
- L19:2701 strongly excites
- L19:1473 strongly excites "can" after a noun in a clause
- L21:2007 excites
- L19:2433 excites
- L20:2487 excites
- L18:522 excites
- L22:1892 excites the digit 6 in years 19xx
- L19:1709 suppresses
- L26:1452 excites
- L19:1850 suppresses
- L20:636 excites
- L19:2185 excites
- L18:2634 suppresses
- L19:1294 excites
- L18:736 excites
- L21:853 excites 'can' after 'and' or a noun subject
- L24:298 excites 'would' in hypothetical or past statements
- L18:2044 excites
- L18:262 excites
- L24:864 excites 'to' before an infinitive
- L22:1422 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 't
- ’t
- |R
- easily
- ’T
- afford
- safely
- |
- 很好地
- adians
Suppresses
- 网讯
- apsed
- 了一批
- esModule
- иж
- 示范基地
- 骥
- bases
- дум
- lest