the letter B in vitamin names
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 10 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the letter "B" when it names a vitamin, like "vitamin B12", and also on "Bi" and "Biological" in journal names. Turning it up did not change the model's writing in any obvious way.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
from the outer layer of the wheat grain. The cereal has a rich content of protein, fiber, vitamins, minerals and phytonutrients. Vitamins include B1, B2, B3, B6 and E. Mineral content includes
-
level⏎of 52 pmol/L, whose mother had a level of 300 pmol/L. Understanding the clinical⏎manifestations of vitamin B12 deficiency and how it is relevant to Australia’s refugee⏎population might assist
-
.⏎Oats are one of the healthiest cereals on the planet. They are rich in healthy fiber, magnesium, manganese, thiamine (vitamin B1) and other important nutrients.⏎Protein content: 15% of
-
, we could:⏎|Vitamin B12 Need||94%||Confirm|⏎|Lupus (S
-
ini, L. (2021). Contrasting response of native and non‐native plants to disturbance and herbivory in mountain environments. Journal of Biogeography, 48(7), 1594-1
-
diets and the low vitamin B12 levels in this population.3⏎Vitamin B12 is one of the most complex vitamins. The measurement of serum levels and
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the idea that a ‘absolute’ (i) is a non-unique (i) value. (i) is the same as the value of the (…) that can be filled in in the empty place where the value is the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
staffing gaps in order to provide students with instruction. The problem is not that schools do not wish to hire certified teachers but that a suitable pool of certified teachers qualified to teach in these fields and willing to
-
ways in which requirements influence designs and code (Figure 1).⏎From Requirements to Designs and Code⏎The boundary between requirements and design is not a sharp line, but keep your specifications free from implementation bias except when you have a compelling reason to intentionally
-
is somewhat common currency, but to claim tradition plays another role besides that of explaining how we came to have our moral beliefs, that it’s not only the medium through which these beliefs have been given to us, but also a guide for our present
-
recording of a human voice.⏎The recording played Thursday predates Thomas Edison's invention of the phonograph (previously thought to have recorded the first sound) by 17 years. It captured about 10 seconds of the French folks
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L0:825 strongly suppresses
- L2:1869 excites
- L2:1855 excites
- L1:4 excites
- L4:1319 excites the 'B' in vitamin B
- L6:1357 excites
- L0:1638 suppresses
- L6:328 suppresses
- L7:520 suppresses
- L7:2095 excites
- L2:1807 weakly excites
- L0:1746 weakly excites
- L3:1733 weakly suppresses
- L4:667 weakly suppresses
- L2:1695 weakly excites
- L2:776 weakly suppresses
- L2:3060 weakly excites
- L7:1851 weakly excites
- L5:138 weakly excites
- L2:43 weakly suppresses
- L2:411 weakly excites
- L3:1254 weakly suppresses
- L2:1438 weakly suppresses
- L1:1810 weakly suppresses
Feeds later layers
- L18:385 strongly suppresses
- L18:242 strongly suppresses
- L20:256 strongly suppresses
- L18:402 strongly suppresses
- L19:370 excites
- L17:517 suppresses "but" in "not only X, but" phrases
- L19:583 suppresses
- L21:706 suppresses
- L19:2330 suppresses
- L22:2245 suppresses
- L22:1412 suppresses
- L19:1021 suppresses
- L23:2304 suppresses
- L26:2842 suppresses
- L26:2701 weakly suppresses
- L17:1721 weakly suppresses 'by' introducing a method or means
- L16:570 weakly suppresses 'but' in 'not only X, but also' contrasts
- L22:1533 weakly suppresses
- L26:2888 weakly suppresses
- L26:1364 weakly excites
- L26:1633 weakly suppresses
- L27:2209 weakly suppresses
- L22:1600 weakly suppresses
- L27:2670 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- streams
- wright
- ylene
- hores
- kor
- form
- 阄
- level
- lle
- _AST
Suppresses
- illance
- akedown
- serie
- ɥ
- cellphone
- series
- 再造
- 博物
- phones
- Strategic