glosses, translations and unit conversions
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 16 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the small opening mark just before a translation, a meaning or a unit conversion, such as the quote before "hemp" or the bracket before "22,841 ft". It goes strongly negative on the digit 9 in years like 1933 or 1930. Turning it up did not produce a clear, related theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
to be used for canvas sails, ropes and rigging of these vessels. The word ‘canvas’ originated from the Arabic word for cannabis, a Latin word meaning ‘hemp‘. All of the British captains carried hemp seed in their stores to
-
would manage other plants.⏎Looking after non-bonsai plants involves re-potting them frequently to allow the root systems to expand, but bonsai cultivation is the opposite.⏎Since you will need to keep your bonsai tree small, you have
-
” is by strengthening whatever muscles (sh<|endoftext|>The baguette cut is named due to its long, rectangular shape after the French word baguette, for “long rod”, coming down from the Latin baculum, meaning “a stick”.
-
book credibly debunks the move to tax or cap carbon dioxide emissions both from technical and political perspectives.⏎The word “neurotoxic” literally translates as “nerve poison”. Broadly described, a
-
gyne is different with its marked compact, low and bushy stature (5-10 cm) and small green leaves (each stem is 3.4 cm wide). During planting in the aquarium, the longest upright shoots should
-
are the highest mountains of each of the seven continents.⏎Aconcagua, South America⏎With its cone-shaped peak rising at 6,962 m (22,841 ft), Cerro Aconcagua holds the title
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: her name was a little different. She was a little... her... her... her... her... her... her... her... her... her... her... her... her... her... her... her... her... her... her...
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
6 EO-1, Salyut 7 EP-5. More...⏎Makarov Makarov, Oleg Grigoryevich (1933-20
-
atta Facts⏎Mohammad Hatta (1902-1980), one of the foremost intellectuals in the Afro
-
final manned flight of the Skylab space station in 1973 and 1974.⏎He was born January 23, 1930, in Okemah, Oklahoma. He received a Bachelor of Science
-
the process that people go through when formulating solutions to problems.⏎Herbert Simon was born in Milwaukee, Wisconsin, on June 15th, 1916. He went to the Milwaukee public school system,
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L9:345 excites
- L14:1302 suppresses
- L12:2180 suppresses
- L10:2612 excites birth dates, the day before the year
- L13:2500 excites
- L12:2830 suppresses
- L11:1895 excites
- L14:2058 suppresses
- L15:711 suppresses
- L14:2267 excites
- L14:412 excites
- L12:1461 excites
- L12:2720 excites
- L11:3043 suppresses
- L15:2869 suppresses
- L12:1279 excites
- L15:1942 excites
- L14:867 excites
- L15:400 suppresses
- L11:3049 excites
- L10:728 suppresses
- L15:2069 suppresses
- L11:1663 excites
- L12:55 excites
Feeds later layers
- L17:2105 excites
- L18:2063 excites
- L17:164 suppresses
- L19:2176 suppresses
- L17:1888 suppresses
- L19:2895 suppresses
- L20:2256 excites
- L17:2749 suppresses
- L17:2356 excites
- L17:2051 excites
- L17:3058 excites
- L19:2715 excites
- L17:1704 excites
- L17:1625 excites
- L17:2921 weakly suppresses
- L19:2541 weakly excites
- L17:2733 weakly excites
- L20:2867 weakly suppresses
- L20:2389 weakly suppresses
- L17:2189 weakly excites
- L17:2922 weakly suppresses
- L21:1580 weakly suppresses
- L18:3003 weakly excites
- L18:2235 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- MotionEvent
- ussen
- aneous
- utely
- 月中
- ysql
- aneously
- onitor
- OLID
- ức
Suppresses
- 性格
- 个性
- 的性格
- pedigree
- unique
- karakter
- characteristics
- Profile
- 特质
- egal