'F' starting a word in a split
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 27 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on a capital 'F' that begins a word, especially in lists of translations or after a line break, such as 'Frecuencia' or 'FPGA'. Turning it up made the model repeat themes like 'picture' or 'growing', and turning it down made it repeat 'air' or 'chart'.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
. Fixtures are designed to hold the workpiece in a specific position and orientation, allowing for consistent and accurate processing.⏎Deutsch: Frequenz / Español: Frecuencia / Português: Frequéncia / Français: Frêquence
-
. The period is the duration of one cycle in a repeating event, so the period is the reciprocal of the frequency.⏎Deutsch: Fabrik / Español: Fábrica / Português: Fábrica / Français: Us
-
defensores for the frontier. In the principal northern towns four squadrons and one company were to be formed under the name of "Defensores de la Frontera." Each squadron was to be under the command of a "commandant
-
when the bow tends to rise. tunnel, water-See WATER TUNNEL. tunnel, wind-See WIND TUNNEL. turbulent flow-See F
-
controller, an FPGA is not designed to execute a specific set of instructions. Instead, developers program the FPGA to perform specific logic functions by configuring its hardware components. FPGAs consist of a matrix of configurable logic
-
enable developers to design digital circuits and systems at a higher level of abstraction, making FPGA design more efficient and less error-prone.⏎Differences Between Microcontrollers and FPGAs⏎Microcontrollers are programmable, which means that developers can write software
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: after recharting chart chart chart chart chart chart chart chart chart chart chart chart chart chart chart chart chart chart chart chart chart chart chart chart chart chart chart chart chart chart chart chart chart chart chart chart chart chart chart chart chart chart chart chart
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
these mysterious disappearances by locating their last names in the word search puzzle in our Missing Persons worksheet. If you uncover all eight names, the FBI (Floss Bureau of Investigation) will reward you with the title of Master
-
where they seem not to have learned one of the great lessons of 20th century art, illustrated by Marcel Duchamp’s 1917 “Fountain”: that the intent of the artist is what makes something art.⏎Origin of
-
ptomatically.⏎-Please note this is not a medical mask and should not be worn as personal protective equipment.⏎-The face covering does not guarantee safety or protection.⏎-Face coverings should not be used as a replacement for social distancing or self isolation
-
1,800 illustrated dictionary⏎entries. Most entries have links to additional information, activities,⏎and child-friendly, related websites. There are links to English-French,⏎English-German, English-Portuguese, or the English-S
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L23:2441 excites
- L22:369 excites
- L18:437 excites
- L20:211 excites
- L18:328 suppresses
- L2:1622 weakly excites
- L21:2605 weakly excites
- L24:2737 weakly excites
- L3:1098 weakly excites
- L1:9 weakly excites
- L21:237 weakly suppresses
- L21:381 weakly suppresses zeros inside long number codes
- L21:2432 weakly excites
- L4:1892 weakly excites
- L6:13 weakly excites
- L21:2484 weakly suppresses
- L26:1564 weakly excites
- L17:378 weakly excites
- L13:1539 weakly excites
- L3:412 weakly excites
- L23:2013 weakly suppresses
- L1:2099 weakly excites
- L22:151 weakly suppresses
- L4:2660 weakly excites
Feeds later layers
None: this is the last layer.
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- icut
- {}",
- -paper
- successor
- ania
- low
- 荼
- createCommand
- opleft
- lowest
Suppresses
- essian
- nhuận
- 弹性
- Clayton
- arding
- ventions
- throw
- repent
- ChildIndex
- nit