comma after a leading 'Yes'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 5 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the comma that follows the word 'Yes' at the start of an answer, as in 'Yes, goats can eat strawberries'. Turning it up did not make the output start with yes; the text drifted into unrelated material.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
interest of their constituents and of the nation. Now information technology has stripped away the insulation that physical distance provided back when information couldn’t travel faster than a horse.Yes, one wonders what the Framers might have thought of free speech.⏎February 3
-
turn, they will be kind to others. It is a amazing what a good message these gestures will send to them.⏎Teach The Value of Money⏎Yes, kids see you passing these green pieces of paper around, but do they really know
-
(at no extra cost to you). As an Amazon Associate I earn from qualifying purchases. Please read my disclaimer for additional details.⏎Can goats eat strawberries?⏎Yes, goats can eat strawberries, however, not all goats are fond of their sour and
-
welding techniques for a variety of purposes including hull repairs, welding anode brackets (see RNLI news story), repairing sheet pile walls and shuttering.<|endoftext|>Yes, there is blue light being emitted from your TV screen while you are watching TV.
-
them the right way, in the right time frame.⏎Is mixing baking powder and water a chemical change?⏎Is mixing water and baking soda a chemical change? Yes, mixing water and baking soda is a chemical change because it changes the composition of the
-
be responsible in school. Once you learn how to use the program, you can type or print lists and notices for yourself to be responsible in school.⏎- Yes, really a planner – A planner could actually help. The kind with a calendar and
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: The first step in this blog is to set the stage for the problem by ensuring that all the devices in my network are connected to a private and public IP address. The private IP address is the main device of the network. The public IP
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
Terraform is able to determine what changed and create incremental execution plans, which can be applied.⏎The infrastructure Terraform can manage includes low-level components such as compute instances, storage, and networking, as well as high-level components such as DNS entries
-
company could generate revenue from the new infrastructure investment. The first AWS service launched for public usage was Simple Queue Service in November 2004. Amazon EC2 was built by a team in Cape Town, South Africa, under Pinkham and
-
UGHTER THERAPY⏎Laughing your heart out can boost your immunity along with your mood. It raise the level of antibodies in the blood and wbc that kill viruses with increasing the number of antibodies in respiratory passages, the entry points
-
a form of inherited red blood cell disorder. The red blood cells consist of hemoglobin, a protein that carries oxygen to the tissues of the body. Healthy red blood cells are glossy, disk-shaped, and flexible.⏎Haemoglobin would be abnormal
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L4:2865 suppresses
- L4:1869 suppresses
- L3:1220 weakly suppresses
- L4:2733 weakly excites
- L4:2312 weakly suppresses
- L2:1592 weakly excites
- L4:2301 weakly suppresses
- L2:1174 weakly suppresses
- L0:1715 weakly excites
- L3:1048 weakly excites
- L1:2644 weakly suppresses
- L0:595 weakly excites
- L2:2550 weakly excites
- L0:155 weakly excites
- L2:129 weakly excites
- L3:2421 weakly excites
- L4:1556 weakly suppresses
- L4:1299 weakly suppresses
- L0:177 weakly suppresses
- L4:2709 weakly suppresses
- L4:2557 weakly suppresses
- L2:2581 weakly excites
- L2:382 weakly excites
- L2:2192 weakly suppresses
Feeds later layers
- L13:1054 weakly suppresses
- L10:1958 weakly suppresses
- L6:1859 weakly suppresses
- L9:1991 weakly excites
- L17:1791 weakly excites
- L11:1514 weakly suppresses
- L10:2706 weakly excites
- L22:2375 weakly excites
- L20:2828 weakly excites
- L21:771 weakly suppresses
- L23:2156 weakly excites
- L22:2664 weakly excites
- L21:1521 weakly excites
- L14:2518 weakly excites
- L7:1206 weakly suppresses
- L17:2986 weakly excites
- L19:2314 weakly excites
- L23:1738 weakly excites
- L22:2017 weakly suppresses
- L6:1779 weakly excites
- L7:2283 weakly suppresses
- L16:1945 weakly suppresses
- L7:2800 weakly suppresses
- L23:967 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 掖
- ocument
- posé
- 钵
- enberg
- 一个职业
- hypocrisy
- eded
- eway
- heets
Suppresses
- ⌋
- тир
- ://${
- Tiles
- letal
- �
- below
- 指纹
- 】,【
- special