'between' after link or relationship nouns
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 14 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'between' when it follows words like 'link', 'connection', 'correspondence' or 'association'. Turning it up did not produce a clear change in what the model wrote.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
studies have delivered inconsistent results in attempting to determine whether early gluten consumption increases the likelihood of developing celiac disease. Previously conducted studies have found that there is no connection between early consumption of gluten, and even that late introduction of gluten may be a contributing
-
is Noether's theorem, which states that there is a one-to-one correspondence between each one of them and a differentiable symmetry of nature. For example, the
-
no one had answered in this way."⏎In their paper, published in the current issue of the Public Library of Science ONE, they say there's an established link between Type 1 diabetes and the body's ability to
-
of any kind, not just dark) were also less likely to report depressive symptoms than those who didn’t eat chocolate at all. However researchers found no significant link between any non‐dark chocolate consumption and clinically relevant depressive symptoms.⏎“This study provides some
-
experience upset stomach, headaches, and increased heart rate and blood pressure. The products that contain caffeine often cause other problems, too. Studies have found a significant connection between consumption of sugary drinks and weight gain in children. Stick to water and milk
-
<|endoftext|>Myth 1: There has been no reduction in poverty as a result of post-1991 reforms⏎This myth challenges not only the link between reforms and growth but the link between growth and poverty, by asserting that poverty did
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the thing that I have been thinking about, the thing that I have been thinking about, the thing that I have been thinking about, the thing that I have been thinking about, the thing that I have been thinking about, the thing that
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
52°30'58"N⏎Longitude: -3.0604 / 3°3'37"W⏎OS Eastings: 328136⏎OS Northings: 291
-
东方在线 发布人:young⏎14. Energy Resources⏎China is rich in various energy resources.
-
00) ⇒ #<marker at 100 in markers.texi>⏎;; Now insert one character at the beginning of the buffer: (goto-char (point-min)) ⇒ 1 (insert "Q") ⇒ nil⏎<|endoftext|>A
-
/var/www/html/drupal⏎# cp sites/default/default.settings.php sites/default/settings.php⏎Now make a “default” directory writable by installer.⏎# chmod -R a+w sites/default/⏎Step 4: Create the MySQL Database⏎I
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L12:1378 excites
- L10:2874 suppresses
- L12:2891 excites
- L13:3061 suppresses
- L10:712 suppresses
- L13:2514 suppresses
- L12:1589 suppresses
- L9:2827 suppresses
- L10:1836 weakly suppresses
- L12:277 weakly excites
- L13:2294 weakly excites
- L13:2723 weakly suppresses
- L12:1502 weakly excites
- L3:2871 weakly suppresses
- L11:1039 weakly suppresses
- L0:1739 weakly excites
- L5:1704 weakly excites
- L13:2521 weakly suppresses
- L6:402 weakly suppresses
- L1:2759 weakly excites
- L11:769 weakly suppresses
- L13:197 weakly excites
- L13:584 weakly excites unit conversions in parentheses
- L13:417 weakly excites
Feeds later layers
- L15:1172 excites
- L17:1779 excites
- L17:1488 excites
- L15:1159 suppresses ampersand in citation author lists
- L18:1401 excites
- L16:2378 excites
- L17:2040 excites
- L16:2329 excites
- L15:1679 weakly suppresses
- L15:3040 weakly suppresses
- L23:929 weakly suppresses
- L23:1020 weakly excites
- L19:2423 weakly suppresses
- L20:669 weakly suppresses
- L16:2950 weakly suppresses
- L18:1767 weakly excites
- L19:2683 weakly excites
- L16:1050 weakly excites
- L25:590 weakly suppresses
- L25:2825 weakly excites
- L24:2353 weakly excites
- L18:1955 weakly suppresses
- L26:2012 weakly excites
- L21:699 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- sembles
- Goodman
- 运气
- 罄
- Herrera
- setattr
- restrial
- cala
- vided
- ondo
Suppresses
- yl
- 夫
- иров
- ilst
- ér
- ��
- 是为了
- .are
- ume
- wend